Tropel: Crowdsourcing Detectors with Minimal Training

2015-11-12

Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 3

Volume

Vol. 3 (2015): Third AAAI Conference on Human Computation and Crowdsourcing

Full Papers

This paper introduces the Tropel system which enables non-technical users to create arbitrary visual detectors without first annotating a training set. Our primary contribution is a crowd active learning pipeline that is seeded with only a single positive example and an unlabeled set of training images. We examine the crowd's ability to train visual detectors given severely limited training themselves. This paper presents a series of experiments that reveal the relationship between worker training, worker consensus and the average precision of detectors trained by crowd-in-the-loop active learning. In order to verify the efficacy of our system, we train detectors for bird species that work nearly as well as those trained on the exhaustively labeled CUB 200 dataset at significantly lower cost and with little effort from the end user. To further illustrate the usefulness of our pipeline, we demonstrate qualitative results on unlabeled datasets containing fashion images and street-level photographs of Paris.

10.1609/hcomp.v3i1.13224