Model Selection for Production System via Automated Online Experiments
Zhenwen Dai, Praveen Chandar, Ghazal Fazelnia, Benjamin Carterette, Mounia Lalmas
Evaluation
14 publications
December 2020 | NeuRIPS
September 2020 | RecSys
Inferring the Causal Impact of New Track Releases on Music Recommendation Platforms through Counterfactual Predictions
Rishabh Mehrotra, Prasanta Bhattacharya, Mounia Lalmas
August 2020 | KDD
Counterfactual Evaluation of Slate Recommendations with Sequential Reward Interactions
Praveen Chandar, James McInerney, Brian Brost, Rishabh Mehrotra, Benjamin Carterette
July 2020 | EC
The Engagement-Diversity Connection: Evidence from a Field Experiment on Spotify
David Holtz, Benjamin Carterette, Praveen Chandar, Zahra Nazari, Henriette Cramer, Sinan Aral
November 2019 | ISMIR
Generalized Metrics for Single-F0 Estimation Evaluation
Rachel M. Bittner, Juan J Bosch
September 2019 | ACM Transactions on Intelligent Systems and Technology
An Analysis of Approaches Taken in the ACM RecSys Challenge 2018 for Automatic Music Playlist Continuation
Hamed Zamani, Markus Schedl, Paul Lamere, Ching-Wei Chen
July 2019 | SIGIR
Developing Evaluation Metrics for Instant Search Using Mixed Methods
Praveen Chandar, Jean Garcia-Gathright, Christine Hosey, Brian St. Thomas, Jennifer Thom
March 2019 | The Web Conference
The Music Streaming Sessions Dataset
Brian Brost, Rishabh Mehrotra, Tristan Jehan
October 2018 | CIKM
Estimating clickthrough bias in the cascade model
Praveen Chandar, Ben Carterette
October 2018 | CIKM
Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems
Rishabh Mehrotra, James McInerney, Hugues Bouchard, Mounia Lalmas, Fernando Diaz
September 2018 | RecSys
Recsys Challenge 2018: Automatic Music Playlist Continuation
Ching-Wei Chen, Paul Lamere, Markus Schedl, Hamed Zamani
September 2018 | ISMIR
OpenMIC-2018: an Open Dataset for Multiple Instrument Recognition
Eric J. Humphrey, Simon Durand, Brian McFee
August 2018 | SIGIR
Offline comparative evaluation with incremental, minimally-invasive online feedback
Ben Carterette, Praveen Chandar
August 2018 | SIGIR
Understanding and Evaluating User Satisfaction with Music Discovery
Jean Garcia-Gathright, Brian St. Thomas, Christine Hosey, Zahra Nazari, Fernando Diaz