AAAI Publications, Second AAAI Conference on Human Computation and Crowdsourcing

Font Size: 
Attendee-Sourcing: Exploring The Design Space of Community-Informed Conference Scheduling
Anant Bhardwaj, Juho Kim, Steven Dow, David Karger, Sam Madden, Rob Miller, Haoqi Zhang

Last modified: 2014-09-05


Constructing a good conference schedule for a large multi-track conference needs to take into account the preferences and constraints of organizers, authors, and attendees. Creating a schedule which has fewer conflicts for authors and attendees, and thematically coherent sessions is a challenging task. Cobi introduced an alternative approach to conference scheduling by engaging the community to play an active role in the planning process. The current Cobi pipeline consists of committee-sourcing and author-sourcing to plan a conference schedule. We further explore the design space of community-sourcing by introducing attendee-sourcing -- a process that collects input from conference attendees and encodes them as preferences and constraints for creating sessions and schedule. For CHI 2014, a large multi-track conference in human-computer interaction with more than 3,000 attendees and 1,000 authors, we collected attendees’ preferences by making available all the accepted papers at the conference on a paper recommendation tool we built called Confer, for a period of 45 days before announcing the conference program (sessions and schedule). We compare the preferences marked on Confer with the preferences collected from Cobi’s author-sourcing approach. We show that attendee-sourcing can provide insights beyond what can be discovered by author-sourcing. For CHI 2014, the results show value in the method and attendees’ participation. It produces data that provides more alternatives in scheduling and complements data collected from other methods for creating coherent sessions and reducing conflicts.


Confer; conference scheduling; mixed-initiative; crowdsourcing; community; community-sourcing, attendee-sourcing


Allen, J. (2000). Event Planning: The Ultimate Guide To Successful Meetings, Corporate Events, Fundraising Galas, Conferences, Conventions, Incentives, And Other Special Events. John Wiley & Sons Canada, Toronto.

Andre ́, P., Zhang, H., Kim, J., Chilton, L. B., Dow, S. P., and Miller, R. C. (2013). Community clustering: Leveraging an academic crowd to form coherent conference sessions. In First AAAI Conference on Human Computation and Crowd- sourcing. AAAI.

Chilton, L. B., Kim, J., Andre ́, P., Cordeiro, F., Landay, J. A., Weld, D. S., Dow, S. P., Miller, R. C., and Zhang, H. (2014). Frenzy: Collaborative data organization for creating confer- ence sessions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’14, New York, NY, USA. ACM.

Confer (2014). Confer.

Confex (2014). Confex.

DiSalvo, C., Lodato, T., Fries, L., Schechter, B., and Barn- well, T. (2011). The collective articulation of issues as de- sign practice. CoDesign, 7(3-4):185–197.

Ekstrand, M. D., Riedl, J. T., and Konstan, J. A. (2011). Collaborative filtering recommender systems. Foundations and Trendstextregistered in Human-Computer Interaction, 4:175–243.

Heimerl, K., Gawalt, B., Chen, K., Parikh, T., and Hartmann, B. (2012). Communitysourcing: Engaging local crowds to perform expert work via physical kiosks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’12, pages 1539–1548, New York, NY, USA. ACM.

Kandasamy, D. M., Curtis, K., Fox, A., and Patterson, D. (2012). Diversity within the crowd. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work Companion, CSCW ’12, pages 115–118, New York, NY, USA. ACM.

Kim, J., Zhang, H., Andre ́, P., Chilton, L. B., Mackay, W., Beaudouin-Lafon, M., Miller, R. C., and Dow, S. P. (2013). Cobi: A community-informed conference scheduling tool. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST ’13, New York, NY, USA. ACM.

Kokkalis, N., Ko ̈hn, T., Pfeiffer, C., Chornyi, D., Bernstein, M. S., and Klemmer, S. R. (2013). Emailvalet: Managing email overload through private, accountable crowdsourcing. In Proceedings of the 2013 Conference on Computer Sup- ported Cooperative Work, CSCW ’13, pages 1291–1300, New York, NY, USA. ACM.

Kulkarni, A. P., Can, M., and Hartmann, B. (2011). Turko- matic: Automatic recursive task and workflow design for mechanical turk. In CHI ’11 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’11, pages 2053– 2058, New York, NY, USA. ACM.

Law, E. and Zhang, H. (2011). Towards large-scale collab- orative planning: Answering high-level search queries using human computation. In In AAAI.

Macek, B.-E., Scholz, C., Atzmueller, M., and Stumme, G. (2012). Anatomy of a conference. In Proceedings of the 23rd ACM Conference on Hypertext and Social Media, HT ’12, pages 245–254, New York, NY, USA. ACM.

McNee, S. M., Albert, I., Cosley, D., Gopalkrishnan, P., Lam, S. K., Rashid, A. M., Konstan, J. A., and Riedl, J. (2002). On the recommending of citations for research pa- pers. In Proceedings of the 2002 ACM Conference on Com- puter Supported Cooperative Work, CSCW ’02, pages 116– 125, New York, NY, USA. ACM.

Sampson, S. E. (2004). Practical implications of preference- based conference scheduling. Production and Operations Management, 13(3):205–215.

Wongchokprasitti, C., Brusilovsky, P., and Parra-Santander, D. (2010). Conference navigator 2.0: community-based rec- ommendation for academic conferences.

Zhang, H., Law, E., Miller, R., Gajos, K., Parkes, D., and Horvitz, E. (2012). Human computation tasks with global constraints. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’12, pages 217– 226, New York, NY, USA. ACM.

Full Text: PDF