• Skip to main content
  • Skip to primary sidebar
AAAI

AAAI

Association for the Advancement of Artificial Intelligence

    • AAAI

      AAAI

      Association for the Advancement of Artificial Intelligence

  • About AAAIAbout AAAI
    • AAAI Officers and Committees
    • AAAI Staff
    • Bylaws of AAAI
    • AAAI Awards
      • Fellows Program
      • Classic Paper Award
      • Dissertation Award
      • Distinguished Service Award
      • Allen Newell Award
      • Outstanding Paper Award
      • Award for Artificial Intelligence for the Benefit of Humanity
      • Feigenbaum Prize
      • Patrick Henry Winston Outstanding Educator Award
      • Engelmore Award
      • AAAI ISEF Awards
      • Senior Member Status
      • Conference Awards
    • AAAI Resources
    • AAAI Mailing Lists
    • Past AAAI Presidential Addresses
    • Presidential Panel on Long-Term AI Futures
    • Past AAAI Policy Reports
      • A Report to ARPA on Twenty-First Century Intelligent Systems
      • The Role of Intelligent Systems in the National Information Infrastructure
    • AAAI Logos
    • News
  • aaai-icon_ethics-diversity-line-yellowEthics & Diversity
  • Conference talk bubbleConferences & Symposia
    • AAAI Conference
    • AIES AAAI/ACM
    • AIIDE
    • IAAI
    • ICWSM
    • HCOMP
    • Spring Symposia
    • Summer Symposia
    • Fall Symposia
    • Code of Conduct for Conferences and Events
  • PublicationsPublications
    • AAAI Press
    • AI Magazine
    • Conference Proceedings
    • AAAI Publication Policies & Guidelines
    • Request to Reproduce Copyrighted Materials
  • aaai-icon_ai-magazine-line-yellowAI Magazine
    • Issues and Articles
    • Author Guidelines
    • Editorial Focus
  • MembershipMembership
    • Member Login
    • Developing Country List
    • AAAI Chapter Program

  • Career CenterCareer Center
  • aaai-icon_ai-topics-line-yellowAITopics
  • aaai-icon_contact-line-yellowContact

Home / Proceedings / Proceedings of the AAAI Conference on Human Computation and Crowdsourcing /

Vol. 1 (2013): First AAAI Conference on Human Computation and Crowdsourcing

Full Papers

  • DataSift: An Expressive and Accurate Crowd-Powered Search Toolkit

    Aditya Parameswaran,Ming Han Teh,Hector Garcia-Molina,Jennifer Widom

    112-120

    PDF
  • CrowdBand: An Automated Crowdsourcing Sound Composition System

    Mary Pietrowicz,Danish Chopra,Amin Sadeghi,Puneet Chandra,Brian Bailey,Karrie Karahalios

    121-129

    PDF
  • What Will Others Choose? How a Majority Vote Reward Scheme Can Improve Human Computation in a Spatial Location Identification Task

    Huaming Rao,Shih-Wen Huang,Wai-Tat Fu

    130-137

    PDF
  • nEmesis: Which Restaurants Should You Avoid Today?

    Adam Sadilek,Sean Brennan,Henry Kautz,Vincent Silenzio

    138-146

    PDF
  • Ability Grouping of Crowd Workers via Reward Discrimination

    Yuko Sakurai,Tenda Okimoto,Masaaki Oka,Masato Shinoda,Makoto Yokoo

    147-155

    PDF
  • SQUARE: A Benchmark for Research on Computing Crowd Consensus

    Aashish Sheshadri,Matthew Lease

    156-164

    PDF
  • Incentives for Privacy Tradeoff in Community Sensing

    Adish Singla,Andreas Krause

    165-173

    PDF
  • Leveraging Collaboration: A Methodology for the Design of Social Problem-Solving Systems

    Lucas Tabajara,Marcelo Prates,Diego Noble,Luis Lamb

    174-181

    PDF
  • Crowdsourcing Spatial Phenomena Using Trust-Based Heteroskedastic Gaussian Processes

    Matteo Venanzi,Alex Rogers,Nicholas Jennings

    182-189

    PDF
  • Dwelling on the Negative: Incentivizing Effort in Peer Prediction

    Jens Witkowski,Yoram Bachrach,Peter Key,David Parkes

    190-197

    PDF
  • Improving Your Chances: Boosting Citizen Science Discovery

    Yexiang Xue,Bistra Dilkina,Theodoros Damoulas,Daniel Fink,Carla Gomes,Steve Kelling

    198-206

    PDF
  • Inferring Users’ Preferences from Crowdsourced Pairwise Comparisons: A Matrix Completion Approach

    Jinfeng Yi,Rong Jin,Shaili Jain,Anil Jain

    207-215

    PDF
  • Volunteering Versus Work for Pay: Incentives and Tradeoffs in Crowdsourcing

    Andrew Mao,Ece Kamar,Yiling Chen,Eric Horvitz,Megan Schwamb,Chris Lintott,Arfon Smith

    94-102

    PDF
  • Why Stop Now? Predicting Worker Engagement in Online Crowdsourcing

    Andrew Mao,Ece Kamar,Eric Horvitz

    103-111

    PDF
  • Interpretation of Crowdsourced Activities Using Provenance Network Analysis

    Trung Dong Huynh,Mark Ebden,Matteo Venanzi,Sarvapali Ramchurn,Stephen Roberts,Luc Moreau

    78-85

    PDF
  • Crowdsourcing a HIT: Measuring Workers’ Pre-Task Interactions on Microtask Markets

    Jason Jacques,Per Ola Kristensson

    86-93

    PDF
  • CASTLE: Crowd-Assisted System for Text Labeling and Extraction

    Sean Goldberg,Daisy Wang,Tim Kraska

    51-59

    PDF
  • Depth-Workload Tradeoffs for Workforce Organization

    Hoda Heidari,Michael Kearns

    60-68

    PDF
  • The Crowd-Median Algorithm

    Hannes Heikinheimo,Antti Ukkonen

    69-77

    PDF
  • 99designs: An Analysis of Creative Competition in Crowdsourced Design

    Ricardo Araujo

    17-24

    PDF
  • Crowdsourcing Multi-Label Classification for Taxonomy Creation

    Jonathan Bragg,- Mausam,Daniel Weld

    25-33

    PDF
  • Winner-Take-All Crowdsourcing Contests with Stochastic Production

    Ruggiero Cavallo,Shaili Jain

    34-41

    PDF
  • Scalable Preference Aggregation in Social Networks

    Swapnil Dhamal,Y. Narahari

    42-50

    PDF
  • On the Verification Complexity of Group Decision-Making Tasks

    Ofra Amir,Yuval Shahar,Ya'akov Gal,Litan Ilani

    44965

    PDF
  • Community Clustering: Leveraging an Academic Crowd to Form Coherent Conference Sessions

    Paul André,Haoqi Zhang,Juho Kim,Lydia Chilton,Steven Dow,Robert Miller

    45185

    PDF

Disco: Human and Machine Learning in Games Workshop

  • ARTigo: Building an Artwork Search Engine With Games and Higher-Order Latent Semantic Analysis

    Christoph Wieser,François Bry,Alexandre Bérard,Richard Lagrange

    15-20

    PDF
  • Disco: Workshop on Human and Machine Learning in Games

    Markus Krause,François Bry,Mihai Georgescu

    2

    PDF
  • Gameful Markets for Collaboration and Learning

    Stephan Leutenmayr,Fabian Kneissl,Sven Ziemer,François Bry

    44993

    PDF
  • Discovery of Player Strategies in a Serious Game

    Hua Li,Hector Munoz-Avila,Lei Ke,Carl Symborski,Rafael Alonso

    45183

    PDF

Scaling Speech, Language Understanding and Dialogue through Crowdsourcing Workshop

  • Conversations in the Crowd: Collecting Data for Task-Oriented Dialog Learning

    Walter Lasecki,Ece Kamar,Dan Bohus

    44962

    PDF
  • Does History Help? An Experiment on How Context Affects Crowdsourcing Dialogue Annotation

    Elnaz Nouri

    45085

    PDF
  • Crowdsourcing Transcription Beyond Mechanical Turk

    Haofeng Zhou,Denys Baskov,Matthew Lease

    45185

    PDF

Works in Progress

  • Understanding Potential MicrotaskWorkers for Paid Crowdsourcing

    Ming-Hung Wang,Kuan-Ta Chen,Shuo-Yang Wang,Chin-Laung Lei

    76-77

    PDF
  • Boosting OCR Accuracy Using Crowdsourcing

    Shuo-Yang Wang,Ming-Hung Wang,Kuan-Ta Chen

    78-79

    PDF
  • TrailView: Combining Gamification and Social Network Voting Mechanisms for Useful Data Collection

    Michael Weingert,Kate Larson

    80-81

    PDF
  • Task Sequence Design: Evidence on Price and Difficulty

    Ming Yin,Yiling Chen,Yu-An Sun

    82-83

    PDF
  • Using Visibility to Control Collective Attention in Crowdsourcing

    Kristina Lerman,Tad Hogg

    42-43

    PDF
  • Manipulating Social Roles in a Tagging Environment

    Mieke Leyssen,Jacco van Ossenbruggen,Arjen de Vries,Lynda Hardman

    44-45

    PDF
  • Towards a Language for Non-Expert Specification of POMDPs for Crowdsourcing

    Christopher Lin,- Mausam,Daniel Weld

    46-47

    PDF
  • Two Methods for Measuring Question Difficulty and Discrimination in Incomplete Crowdsourced Data

    Sarah Luger,Jeff Bowles

    48-49

    PDF
  • Crowd, the Teaching Assistant: Educational Assessment Crowdsourcing

    Pallavi Manohar,Shourya Roy

    50-51

    PDF
  • Crowdsourcing Quality Control for Item Ordering Tasks

    Toshiko Matsui,Yukino Baba,Toshihiro Kamishima,Hisashi Kashima

    52-53

    PDF
  • Ontology Quality Assurance with the Crowd

    Jonathan Mortensen,Mark Musen,Natalya Noy

    54-55

    PDF
  • Personalized Human Computation

    Peter Organisciak,Jaime Teevan,Susan Dumais,Robert Miller,Adam Kalai

    56-57

    PDF
  • EM-Based Inference of True Labels Using Confidence Judgments

    Satoshi Oyama,Yukino Baba,Yuko Sakurai,Hisashi Kashima

    58-59

    PDF
  • Task Redundancy Strategy Based on Volunteers’ Credibility for Volunteer Thinking Projects

    Lesandro Ponciano,Francisco Brasileiro,Guilherme Gadelha

    60-61

    PDF
  • Inserting Micro-Breaks into Crowdsourcing Workflows

    Jeffrey Rzeszotarski,Ed Chi,Praveen Paritosh,Peng Dai

    62-63

    PDF
  • Effect of Task Presentation on the Performance of Crowd Workers — A Cognitive Study

    Harini Sampath,Rajeev Rajeshuni,Bipin Indurkhya,Saraschandra Karanam,Koustuv Dasgupta

    64-65

    PDF
  • HiveMind: Tuning Crowd Response with a Single Value

    Preetjot Singh,Walter Lasecki,Paulo Barelli,Jeffrey Bigham

    66-67

    PDF
  • Aggregating Human-Expert Opinions for Multi-Label Classification

    Evgueni Smirnov,Hua Zhang,Ralf Peeters,Nikolay Nikolaev,Maike Imkamp

    68-69

    PDF
  • Herding the Crowd: Automated Planning for Crowdsourced Planning

    Kartik Talamadupula,Subbarao Kambhampati,Yuheng Hu,Tuan Nguyen,Hankz Zhuo

    70-71

    PDF
  • Designing a Crowdsourcing Tool to Analyze Relationships Among Jazz Musicians: The Case of Linked Jazz 52nd Street

    Hilary Thorsen,M. Pattuelli

    72-73

    PDF
  • A Framework for Adaptive Crowd Query Processing

    Beth Trushkowsky,Tim Kraska,Michael Franklin

    74-75

    PDF
  • Lottery-Based Payment Mechanism for Microtasks

    L. Celis,Shourya Roy,Vivek Mishra

    45273

    PDF
  • OnDroad Planner: Building Tourist Plans Using Traveling Social Network Information

    Isabel Cenamor,Tomás de la Rosa,Daniel Borrajo

    14-15

    PDF
  • Using Human and Machine Processing in Recommendation Systems

    Eric Colson

    16-17

    PDF
  • LabelBoost: An Ensemble Model for Ground Truth Inference Using Boosted Trees

    Siamak Faridani,Georg Buscher

    18-19

    PDF
  • A Ground Truth Inference Model for Ordinal Crowd-Sourced Labels Using Hard Assignment Expectation Maximization

    Siamak Faridani,Georg Buscher,Ya Xu

    20-21

    PDF
  • Frequency and Duration of Self-Initiated Task-Switching in an Online Investigation of Interrupted Performance

    Sandy Gould,Anna Cox,Duncan Brumby

    22-23

    PDF
  • Assessing the Viability of Online Interruption Studies

    Sandy Gould,Anna Cox,Duncan Brumby,Sarah Wiseman

    24-25

    PDF
  • Human Stigmergy in Augmented Environments

    Kshanti Greene,Thomas Young

    26-27

    PDF
  • Reducing Error in Context-Sensitive Crowdsourced Tasks

    Daniel Haas,Matthew Greenstein,Kainar Kamalov,Adam Marcus,Marek Olszewski,Marc Piette

    28-29

    PDF
  • Transcribing and Annotating Speech Corpora for Speech Recognition: A Three-Step Crowdsourcing Approach with Quality Control

    Annika Hämäläinen,Fernando Pinto Moreira,Jairo Avelar,Daniela Braga,Miguel Sales Dias

    30-31

    PDF
  • An Initial Study of Automatic Curb Ramp Detection with Crowdsourced Verification Using Google Street View Images

    Kotaro Hara,Jin Sun,Jonah Chazan,David Jacobs,Jon Froehlich

    32-33

    PDF
  • English to Hindi Translation Protocols for an Enterprise Crowd

    Srinivasan Iyengar,Shirish Karande,Sachin Lodha

    34-35

    PDF
  • Joint Crowdsourcing of Multiple Tasks

    Andrey Kolobov,- Mausam,Daniel Weld

    36-37

    PDF
  • GameLab: A Tool Suit to Support Designers of Systems with Homo Ludens in the Loop

    Markus Krause

    38-39

    PDF
  • Automated Support for Collective Memory of Conversational Interactions

    Walter Lasecki,Jeffrey Bigham

    40-41

    PDF
  • A Human-Centered Framework for Ensuring Reliability on Crowdsourced Labeling Tasks

    Omar Alonso,Catherine Marshall,Marc Najork

    44960

    PDF
  • Making Crowdwork Work: Issues in Crowdsourcing for Organizations

    Obinna Anya,Melissa Cefkin,Steve Dill,Robert Moore,Susan Stucky,Osarieme Omokaro

    45021

    PDF
  • Using Crowdsourcing to Generate an Evaluation Dataset for Name Matching Technologies

    Alya Asarina,Olga Simek

    45084

    PDF
  • Statistical Quality Estimation for General Crowdsourcing Tasks

    Yukino Baba,Hisashi Kashima

    45147

    PDF
  • Crowdsourcing Translation by Leveraging Tournament Selection and Lattice-Based String Alignment

    Julien Bourdaillet,Shourya Roy,Gueyoung Jung,Yu-An Sun

    45210

    PDF

Demonstrations

  • Crowdsourcing Objective Answers to Subjective Questions Online

    Ravi Iyer

    93-94

    PDF
  • Automating Crowdsourcing Tasks in an Industrial Environment

    Vasilis Kandylas,Omar Alonso,Shiroy Choksey,Kedar Rudre,Prashant Jaiswal

    95-96

    PDF
  • Cobi: Community-Informed Conference Scheduling

    Juho Kim,Haoqi Zhang,Paul André,Lydia Chilton,Anant Bhardwaj,David Karger,Steven Dow,Robert Miller

    97-98

    PDF
  • Curio: A Platform for Supporting Mixed-Expertise Crowdsourcing

    Edith Law,Conner Dalton,Nick Merrill,Albert Young,Krzysztof Gajos

    99-100

    PDF
  • Real-Time Drawing Assistance through Crowdsourcing

    Alex Limpaecher,Nicolas Feltman,Adrien Treuille,Michael Cohen

    101-102

    PDF
  • An Introduction to the Zooniverse

    Arfon Smith,Stuart Lynn,Chris Lintott

    103

    PDF
  • Wanted: More Nails for the Hammer — An Investigation Into the Application of Human Computation

    Elizabeth Brem,Tyler Bick,Andrew Schriner,Daniel Oerther

    85-86

    PDF
  • Frenzy: A Platform for Friendsourcing

    Lydia Chilton,Felicia Cordeiro,Daniel Weld,James Landay

    87-88

    PDF
  • The Work Exchange: Peer-to-Peer Enterprise Crowdsourcing

    Stephen Dill,Robert Kern,Erika Flint,Melissa Cefkin

    89-90

    PDF
  • In-HIT Example-Guided Annotation Aid for Crowdsourcing UI Components

    Yi-Ching Huang,Chun-I Wang,Shih-Yuan Yu,Yung-jen Hsu

    91-92

    PDF

Frontmatter

  • HCOMP-13 Organization

    Björn Hartmann,Eric Horvitz

    vii-viii

    PDF
  • Sponsors

    Björn Hartmann,Eric Horvitz

    ix

    PDF
  • Preface

    Björn Hartman,Eric Horvitz

    xi-x

    PDF

Primary Sidebar