Who predicts better? Results from an online study comparing humans and an online recommender system.

TitleWho predicts better? Results from an online study comparing humans and an online recommender system.
Publication TypeConference Paper
Year of Publication2008
AuthorsKrishnan, V., Narayanashetty P. K., Nathan M., Davies R. T., and Konstan J. A.
Conference NameACM Conference on Recommender Systems
Conference LocationLausanne, Switzerland
Conference Start Date10/23/2008
PublisherACM
ISBN Number978-1-60558-093-7
Abstract

Algorithmic recommender systems attempt to predict which items a target user will like based on information about the user's prior preferences and the preferences of a larger community. After more than a decade of widespread use, researchers and system users still debate whether such "impersonal" recommender systems actually perform as well as human recommenders. We compare the performance of MovieLens algorithmic predictions with the recommendations made, based on the same user profiles, by active MovieLens users. We found that algorithmic collaborative filtering outperformed humans on average, though some individuals outperformed the system substantially and humans on average outperformed the system on certain prediction tasks.

DOIhttp://doi.acm.org/10.1145/1454008.1454042
AttachmentSize
p211-krishnan.pdf411.9 KB