Exploring audio-based stylistic variation in podcasts

Abstract

Podcast are a growing spoken medium that is listened to for various reasons in various situations (e.g., for entertainment or educational purposes, on the train or at home) consisting of various types of audio such as (unstructured) speech, music, and other sounds. Traditionally, search and recommendation of spoken content focuses on topical content, derived from text transcriptions, ignoring paralinguistic aspects in spoken language. Instead, we propose to model these paralinguistic aspects, such as speaking style, in podcasts to address both the heterogeneity of type of audio in podcasts and user needs to enable enriched access to this medium. In this paper, we take a first step towards this goal and explore audio-based stylistic variation in podcasts by 1) investigating what facets of stylistic variation are salient and of interest to listeners, and 2) gathering more insights into the kind of stylistic variation that is currently feasible to model with open-source audio tools and that is present in podcasts. We find that much of the stylistic variation mentioned by the users is related to speaking style and music, and we show, using open-source tools, how audio-based stylistic aspects vary across episodes, shows, and genres.

Related

November 2024 | EPJ Data Science

Consumption-based approaches in proactive detection for content moderation

Shahar Elisha, John N. Pougué-Biyong, Mariano Beguerisse-Díaz

November 2024 | SIAM Journal on Mathematics of Data Science

Topological Fingerprints for Audio Identification

Wojciech Reise, Ximena Fernández, Maria Dominguez, Heather A. Harrington, Mariano Beguerisse-Díaz

October 2024 | CIKM

PODTILE: Facilitating Podcast Episode Browsing with Auto-generated Chapters

A. Ghazimatin, E. Garmash, G. Penha, K. Sheets, M. Achenbach, O. Semerci, R. Galvez, M. Tannenberg, S. Mantravadi, D. Narayanan, O. Kalaydzhyan, D. Cole, B. Carterette, A. Clifton, P. N. Bennett, C. Hauff, M. Lalmas-Roelleke