Task Sequence Design: Evidence on Price and Difficulty

2013-11-10

Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 1

Volume

Vol. 1 (2013): First AAAI Conference on Human Computation and Crowdsourcing

Works in Progress

We experimentally study the effects of two variables in task sequence design, price and difficulty of tasks, on the quality of work produced in a task sequence. We find that in a three-task sequence, the work quality of a task is influenced by prices of all previous tasks, potentially at various degrees. For the effects of task difficulty, however, we observe similar work quality of a task regardless whether the task follows an easier or more difficult task. This observation is inconsistent with the prediction of either the task switching effect or the sequential difficulty effect in the literature. Interestingly, according to a post-task survey, workers seem to adjust their perception of appropriate payment for a task according to the change of difficulty levels over tasks in a sequence, suggesting a potential "anchoring" effect on task difficulty. The insensitivity of work quality to the change of task difficulty levels is possibly a result of a mixture of different effects.

10.1609/hcomp.v1i1.13116