Acquiring Reliable Ratings from the Crowd

2015-11-12

Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 3

Volume

Vol. 3 (2015): Third AAAI Conference on Human Computation and Crowdsourcing

Works in Progress

We address the problem of acquiring reliable ratings of items such as restaurants or movies from the crowd. We propose a crowdsourcing platform that takes into consideration the workers’ skills with respect to the items being rated and assigns workers the best items to rate. Our platform focuses on acquiring ratings from skilled workers and for items that only have a few ratings. We evaluate the effectiveness of our system using a real-world dataset about restaurants.

10.1609/hcomp.v3i1.13261