AAAI

Association for the Advancement of Artificial Intelligence

Home > Proceedings / Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 3

A Crowdsourcing Method for Obtaining Rephrased Questions

Authors

Nobuyuki Shimizu,Atsuyuki Morishima,Ryota Hayashi

Yahoo Japan Corporation,University of Tsukuba,University of Tsukuba


Published:

2015-11-12

Proceedings:

Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 3

Volume

Issue:

Vol. 3 (2015): Third AAAI Conference on Human Computation and Crowdsourcing

Track:

Works in Progress

Downloads:

Download PDF

Abstract:

We propose a method for obtaining and ranking paraphrased questions from crowds to be used as a part of instructions in microtask-based crowdsourcing. With our method, we are able to obtain questions that differ in expression yet have the same semantics with respect to the crowdsourcing task. This is done by generating tasks that give hints and elicit instructions from workers. We conducted experiments with data used for a real set of gold standard questions submitted to a commercial crowdsourcing platform and compared the results with those from a direct-rewrite method.

DOI:

10.1609/hcomp.v3i1.13251


HCOMP

Vol. 3 (2015): Third AAAI Conference on Human Computation and Crowdsourcing


ISBN 978-1-57735-740-7