Evaluation

17 publications
April 2024 | The Web Conference

Long-term off-policy evaluation and learning

Yuta Saito, Himan Abdollahpouri, Jesse Anderton, Ben Carterette, Mounia Lalmas

April 2022 | The Web Conference (WWW)

Using Survival Models to Estimate Long-Term Engagement in Online Experiments

Praveen Chandar, Brian St. Thomas, Lucas Maystre, Vijay Pappu, Roberto Sanchis-Ojeda, Tiffany Wu, Ben Carterette, Mounia Lalmas, Tony Jebara

December 2020 | NeuRIPS

Model Selection for Production System via Automated Online Experiments

Zhenwen Dai, Praveen Chandar, Ghazal Fazelnia, Benjamin Carterette, Mounia Lalmas

September 2020 | RecSys

Inferring the Causal Impact of New Track Releases on Music Recommendation Platforms through Counterfactual Predictions

Rishabh Mehrotra, Prasanta Bhattacharya, Mounia Lalmas

August 2020 | KDD

Counterfactual Evaluation of Slate Recommendations with Sequential Reward Interactions

Praveen Chandar, James McInerney, Brian Brost, Rishabh Mehrotra, Benjamin Carterette

July 2020 | EC

The Engagement-Diversity Connection: Evidence from a Field Experiment on Spotify

David Holtz, Benjamin Carterette, Praveen Chandar, Zahra Nazari, Henriette Cramer, Sinan Aral

November 2019 | ISMIR

Generalized Metrics for Single-F0 Estimation Evaluation

Rachel M. Bittner, Juan J Bosch

November 2019 | ISMIR - International Society for Music Information Retrieval Conference

Generalized Metrics for Single-F0 Estimation Evaluation

Rachel M. Bittner, Juan J Bosch

September 2019 | ACM Transactions on Intelligent Systems and Technology

An Analysis of Approaches Taken in the ACM RecSys Challenge 2018 for Automatic Music Playlist Continuation

Hamed Zamani, Markus Schedl, Paul Lamere, Ching-Wei Chen

July 2019 | SIGIR

Developing Evaluation Metrics for Instant Search Using Mixed Methods

Praveen Chandar, Jean Garcia-Gathright, Christine Hosey, Brian St. Thomas, Jennifer Thom

March 2019 | The Web Conference

The Music Streaming Sessions Dataset

Brian Brost, Rishabh Mehrotra, Tristan Jehan

October 2018 | CIKM

Estimating clickthrough bias in the cascade model

Praveen Chandar, Ben Carterette

October 2018 | CIKM

Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems

Rishabh Mehrotra, James McInerney, Hugues Bouchard, Mounia Lalmas, Fernando Diaz

September 2018 | RecSys

Recsys Challenge 2018: Automatic Music Playlist Continuation

Ching-Wei Chen, Paul Lamere, Markus Schedl, Hamed Zamani

September 2018 | ISMIR

OpenMIC-2018: an Open Dataset for Multiple Instrument Recognition

Eric J. Humphrey, Simon Durand, Brian McFee

August 2018 | SIGIR

Understanding and Evaluating User Satisfaction with Music Discovery

Jean Garcia-Gathright, Brian St. Thomas, Christine Hosey, Zahra Nazari, Fernando Diaz