Publications

Sep 11, 2025|RecSys
Evaluating Podcast Recommendations with Profile-Aware LLM-as-a-Judge
Francesco Fabbri, Gustavo Penha, Edoardo D'Amico, Alice Wang, Marco De Nadai, Jackie Doremus, Paul Gigioli, Andreas Damianou, Oskar Stål, Mounia Lalmas
Aug 5, 2025|KDD
ForTune: Running Offline Scenarios to Estimate Impact on Business Metrics
Georges Dupret, Konstantin Sozinov, Carmen Barcena Gonzalez, Ziggy Zacks, Amber Yuan, Ben Carterette, Manuel Mai, Andrey Gatash, Gwo Liang Lien, Shubham Bansal, Roberto Sanchis-Ojeda, Mounia Lalmas
Jul 8, 2025|FAccT
Policy-as-Pormpt: Rethinking Content Moderation in the Age of Large Language Models
Konstantina Palla, José Luis Redondo García, Claudia Hauff, Francesco Fabbri, Henrik Lindström, Daniel R. Taber, Andreas Damianou, Mounia Lalmas
Apr 29, 2024|The Web Conference
Long-term off-policy evaluation and learning
Yuta Saito, Himan Abdollahpouri, Jesse Anderton, Ben Carterette, Mounia Lalmas
Apr 26, 2022|The Web Conference (WWW)
Using Survival Models to Estimate Long-Term Engagement in Online Experiments
Praveen Chandar, Brian St. Thomas, Lucas Maystre, Vijay Pappu, Roberto Sanchis-Ojeda, Tiffany Wu, Ben Carterette, Mounia Lalmas, Tony Jebara
Dec 6, 2020|NeuRIPS
Model Selection for Production System via Automated Online Experiments
Zhenwen Dai, Praveen Chandar, Ghazal Fazelnia, Benjamin Carterette, Mounia Lalmas
Sep 22, 2020|RecSys
Inferring the Causal Impact of New Track Releases on Music Recommendation Platforms through Counterfactual Predictions
Rishabh Mehrotra, Prasanta Bhattacharya, Mounia Lalmas
Aug 22, 2020|KDD
Counterfactual Evaluation of Slate Recommendations with Sequential Reward Interactions
Praveen Chandar, James McInerney, Brian Brost, Rishabh Mehrotra, Benjamin Carterette
Jul 13, 2020|EC
The Engagement-Diversity Connection: Evidence from a Field Experiment on Spotify
David Holtz, Benjamin Carterette, Praveen Chandar, Zahra Nazari, Henriette Cramer, Sinan Aral
Nov 1, 2019|ISMIR
Generalized Metrics for Single-F0 Estimation Evaluation
Rachel M. Bittner, Juan J Bosch
Nov 1, 2019|ISMIR - International Society for Music Information Retrieval Conference
Generalized Metrics for Single-F0 Estimation Evaluation
Rachel M. Bittner, Juan J Bosch
Sep 18, 2019|ACM Transactions on Intelligent Systems and Technology
An Analysis of Approaches Taken in the ACM RecSys Challenge 2018 for Automatic Music Playlist Continuation
Hamed Zamani, Markus Schedl, Paul Lamere, Ching-Wei Chen
Jul 21, 2019|SIGIR
Developing Evaluation Metrics for Instant Search Using Mixed Methods
Praveen Chandar, Jean Garcia-Gathright, Christine Hosey, Brian St. Thomas, Jennifer Thom
Mar 11, 2019|The Web Conference
The Music Streaming Sessions Dataset
Brian Brost, Rishabh Mehrotra, Tristan Jehan
Oct 22, 2018|CIKM
Estimating clickthrough bias in the cascade model
Praveen Chandar, Ben Carterette
Oct 22, 2018|CIKM
Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems
Rishabh Mehrotra, James McInerney, Hugues Bouchard, Mounia Lalmas, Fernando Diaz
Sep 27, 2018|RecSys
Recsys Challenge 2018: Automatic Music Playlist Continuation
Ching-Wei Chen, Paul Lamere, Markus Schedl, Hamed Zamani
Sep 1, 2018|ISMIR
OpenMIC-2018: an Open Dataset for Multiple Instrument Recognition
Eric J. Humphrey, Simon Durand, Brian McFee
Aug 7, 2018|SIGIR
Offline comparative evaluation with incremental, minimally-invasive online feedback
Ben Carterette, Praveen Chandar
Aug 7, 2018|SIGIR
Understanding and Evaluating User Satisfaction with Music Discovery
Jean Garcia-Gathright, Brian St. Thomas, Christine Hosey, Zahra Nazari, Fernando Diaz

Explore our publications and scientific contributions

Evaluating Podcast Recommendations with Profile-Aware LLM-as-a-Judge

ForTune: Running Offline Scenarios to Estimate Impact on Business Metrics

Policy-as-Pormpt: Rethinking Content Moderation in the Age of Large Language Models

Long-term off-policy evaluation and learning

Using Survival Models to Estimate Long-Term Engagement in Online Experiments

Model Selection for Production System via Automated Online Experiments

Inferring the Causal Impact of New Track Releases on Music Recommendation Platforms through Counterfactual Predictions

Counterfactual Evaluation of Slate Recommendations with Sequential Reward Interactions

The Engagement-Diversity Connection: Evidence from a Field Experiment on Spotify

Generalized Metrics for Single-F0 Estimation Evaluation

Generalized Metrics for Single-F0 Estimation Evaluation

An Analysis of Approaches Taken in the ACM RecSys Challenge 2018 for Automatic Music Playlist Continuation

Developing Evaluation Metrics for Instant Search Using Mixed Methods

The Music Streaming Sessions Dataset

Estimating clickthrough bias in the cascade model

Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems

Recsys Challenge 2018: Automatic Music Playlist Continuation

OpenMIC-2018: an Open Dataset for Multiple Instrument Recognition

Offline comparative evaluation with incremental, minimally-invasive online feedback

Understanding and Evaluating User Satisfaction with Music Discovery