AAAI

Association for the Advancement of Artificial Intelligence

Home > Proceedings / Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 6

Skill-and-Stress-Aware Assignment of Crowd-Worker Groups to Task Streams

Authors

Katsumi Kumai,Masaki Matsubara,Yuhki Shiraishi,Daisuke Wakatsuki,Jianwei Zhang,Takeaki Shionome,Hiroyuki Kitagawa,Atsuyuki Morishima

University of Tsukuba,University of Tsukuba,Tsukuba University of Technology,Tsukuba University of Technology,Iwate University,Teikyo University,University of Tsukuba,University of Tsukuba


Published:

2018-07-09

Proceedings:

Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 6

Volume

Issue:

Vol. 6 (2018): Sixth AAAI Conference on Human Computation and Crowdsourcing

Track:

Technical Papers

Downloads:

Download PDF

Abstract:

Worker-task assignments represent one of the critical issues in crowdsourcing, as they affect the quality of task results. This study addresses the problem of forming worker groups assigned to the same task in a task stream that requires more than one worker. We introduce a worker-group queue model that covers practical and common scenarios for task-stream crowdsourcing, and compare three strategies in terms of the skill balance among worker groups, the quality of the final outputs, the number of worker re-assignments of workers, and psychological stress felt by workers. We found that one of the compared strategies that employs multiple worker queues yields good results based on these measures.

DOI:

10.1609/hcomp.v6i1.13328


HCOMP

Vol. 6 (2018): Sixth AAAI Conference on Human Computation and Crowdsourcing


ISBN 978-1-57735-799-5