Overview

I create systems that use both human and machine intelligence to solve problems quickly and reliably. I have helped introduce the ideas of continuous, real-time, and instantaneous crowdsourcing. These approaches leverage the "crowd agent" model that I previously introduced, which uses computer-mediated groups of people submitting input simultaneously to create a collective intelligence capable of completing tasks better than any individual.

Research: Crowdsourcing, Human Computation, Human-AI Interaction, Human-Computer Interaction, Collective Intelligence, AI/ML, Accessibility


For a full publications list and citations information, see my Google Scholar page


Papers

    2020

  1. Y. Chen, A. Monroy-Hernandez, I. Wehrman, S. Oney, W.S. Lasecki, R. Vaish. Sifter: A Hybrid Workflow for Theme-based Video Curation at Scale. In Proceedings of the ACM Conference on Interactive Media Experiences (IMX 2020). Barcelona, Spain.
  2. D. Ramesh, A.Z. Liu, J.Y. Song, A. Echeverria, N. Waytowich, W.S. Lasecki. Yesterday's Reward is Today's Punishment: Contrast Effects in Human Feedback to Reinforcement Learning Agents. In Proceedings of the International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 2020). Auckland, New Zealand.
    Best Paper Nomination
  3. A.Z. Liu, S. Guerra, I. Fung, G. Matute, E. Kamar, W.S. Lasecki. Towards Hybrid Human-AI Workflows for Unknown Unknown Detection. In Proceedings of the Web Conference (WebConf [WWW] 2020). Taipei, Taiwan.
  4. Y. Chen, M. Pandey, J.Y. Song, W.S. Lasecki, S. Oney. Improving Crowd-Supported GUI Testing with Structural Guidance. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2020). Honolulu, HI.
  5. J.S. Huffaker, J.K. Kummerfeld, W.S. Lasecki, M.S. Ackerman. Crowdsourced Detection of Emotionally Manipulative Language. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2020). Honolulu, HI.
  6. F. Jahanbakhsh, J. Cranshaw, S. Counts, W.S. Lasecki, K. Inkpen. An Experimental Study of Bias in Platform Worker Ratings: The Role of Performance Quality and Gender. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2020). Honolulu, HI.
  7. H. Kaur, C. Lampe, W.S. Lasecki. Using Affordances to Improve AI Support of Social Media Posting Decisions. In Proceedings of the ACM Conference on Intelligent User Interfaces (IUI 2020). Cagliari, Italy.
    Best Paper Honorable Mention

    8. 2019

  8. J.J.Y. Chung, J.Y. Song, S. Kutty, S. Hong, J. Kim, W.S. Lasecki. Efficient Elicitation Approaches to Estimate Collective Crowd Answers. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2019). Austin, TX.
    Best Paper Honorable Mention
    Blog post
  9. T. Yu, R. Zhang, H. Er, S. Li, E. Xue, B. Pang, X.V. Lin, Y.C. Tan, T. Shi, Z. Li, Y. Jiang, M. Yasunaga, S. Shim, T. Chen, A. Fabbri, Z. Li, L. Chen, Y. Zhang, S. Dixit, V. Zhang, C. Xiong, R. Socher, W.S. Lasecki, D. Radev. CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databases. In Proceedings of the Annual Conference on Empirical Methods in Natural Language Processing and International Joint Conference on Natural Language Processing (EMNLP 2019). Hong Kong.
  10. G. Bansal, B. Nushi, E. Kamar, W.S. Lasecki, D. Weld and E. Horvitz. Beyond Accuracy: On the Role of Mental Models in Human-AI Teams. In Proceedings of the AAAI Conference on Human Computation (HCOMP 2019). Skamania Lodge, WA.
  11. J.K. Kummerfeld, S.R. Gouravajhala, J.J. Peper, V. Athreya, C. Gunasekara, J. Ganhotra, S.S. Patel, L.C. Polymenakos, W.S. Lasecki. A Large-Scale Corpus for Conversation Disentanglement. In Proceedings of the Association for Computational Linguistics (ACL 2019). Florence, Italy.
  12. S.W. Lee, A. Willette, D. Koutra, W.S. Lasecki. The Effect of Social Interaction on Facilitating Audience Participation in a Live Music Performance. In Proceedings of the ACM Conferences on Creativity and Cognition (C&C 2019). San Diego, CA.
  13. J.Y. Song, S.J. Lemmer, M.X. Liu, S. Yan, J. Kim, J.J. Corso, W.S. Lasecki. Popup: Reconstructing 3D Video Using Particle Filtering to Aggregate Crowd Responses. In Proceedings of the ACM International Conference on Intelligent User Interfaces (IUI 2019). Los Angeles, CA.
  14. G. Bansal, B. Nushi, E. Kamar, D. Weld, W.S. Lasecki, E. Horvitz. Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2019). Honolulu, HI.
  15. J.Y. Song, R. Fok, J. Kim, W.S. Lasecki. FourEyes: Leveraging Tool Diversity as a Means to Improve Aggregate Accuracy in Crowdsourcing. In ACM Transactions on Interactive Intelligent Systems (TiiS). 2019.

    16. 2018

  16. S.W. Lee, R. Krosnick, S.Y. Park, B. Keelean, S. Vaidya, S.D. O'Keefe, W.S. Lasecki. Exploring Real-time Collaboration in Crowd-Powered Systems Through a UI Design Tool. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2018). New York, NY.
  17. H. Kaur, A.C. Williams, A.L. Thompson, W.S. Lasecki, S. Iqbal, J. Teevan. Creating Better Action Plans for Writing Tasks via Vocabulary-Based Planning. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2018). New York, NY.
  18. S. Oney, A. Lundgard, R. Krosnick, M. Nebeling, W.S. Lasecki. Arboretum and Arbility: Improving Web Accessibility Through a Shared Browsing Architecture. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2018). Berlin, Germany.
  19. R. Krosnick, S.W. Lee, W.S. Lasecki, S. Oney. Expresso: Building Responsive Interfaces with Keyframes. In Proceedings of the IEEE Symposium on Visual Languages and Human-Centered Computing (VL/HCC 2018). Lisbon, Portugal.
  20. R. Fok, H. Kaur, S. Palani, M.E. Mott, W.S. Lasecki. Towards More Robust Speech Interactions for Deaf and Hard of Hearing Users. In Proceedings of the International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2018). Galway, Ireland.
  21. S.R. Gouravajhala, J. Yim, K. Desingh, Y. Huang, O.C. Jenkins, W.S. Lasecki. EURECA: Enhanced Understanding of Real Environments via Crowd Assistance. In Proceedings of the AAAI Conference on Human Computation (HCOMP 2018). Zurich, Switzerland.
  22. A. Rao, H. Kaur, W.S. Lasecki. Plexiglass: Multiplexing Passive and Active Tasks for More Efficient Crowdsourcing. In Proceedings of the AAAI Conference on Human Computation (HCOMP 2018). Zurich, Switzerland.
  23. Y. Jiang, C. Finegan-Dollak, J.K. Kummerfeld, W.S. Lasecki. Effective Crowdsourcing for a New Summarization Task. In Proceedings of the North American Chapter of the Association forComputational Linguistics Conference (NAACL 2018). New Orleans, LA.
  24. A. Lundgard, Y. Yang, M.L. Foster, W.S. Lasecki. Bolt: Instantaneous Crowdsourcing via Just-in-Time Training. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2018). Montreal, Canada.
  25. J.J. Williams, A. Rafferty, D. Tingley, A. Ang, W.S. Lasecki, J. Kim. Enhancing Online Problems Through Instructor-Centered Tools for Randomized Experiments. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2018). Montreal, Canada.
    Video
  26. J.Y. Song, R. Fok, A. Lundgard, F. Yang, J. Kim, W.S. Lasecki. Two Tools are Better Than One: Tool Diversity as a Means of Improving Aggregate Crowd Performance. In Proceedings of the ACM International Conference on Intelligent User Interfaces (IUI 2018). Tokyo, Japan.
    Best Student Paper Honorable Mention
    Blog post

    27. 2017

  27. S.W. Lee, Y. Zhang, I. Wong, Y. Yang, S.D. O'Keefe, W.S. Lasecki. SketchExpress: Remixing Animations For More Effective Crowd-Powered Prototyping Of Interactive Interfaces. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2017). Quebec City, Canada.
  28. S. Swaminathan, R. Fok, F. Chen, T.K. Huang, I. Lin, R. Jadvani, W.S. Lasecki, J.P. Bigham. WearMail: On-the-Go Access to Information in Your Email with a Privacy-Preserving Human Computation Workflow. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2017). Quebec City, Canada.
  29. H. Kaur, M. Gordon, Y. Yang, J.P. Bigham, J. Teevan, E. Kamar, W.S. Lasecki. CrowdMask: Using Crowds to Preserve Privacy in Crowd-Powered Systems via Progressive Filtering. In Proceedings of the AAAI Conference on Human Computation (HCOMP 2017). Quebec City, Canada.
  30. Y. Jiang, J.K. Kummerfeld, W.S. Lasecki. Understanding Task Design Trade-offs in Crowdsourced Paraphrase Collection. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017). Vancouver, Canada.
  31. W.S. Lasecki, C.D. Miller, I. Naim, R. Kushalnagar, A. Sadilek, D. Gildea, J.P. Bigham. Scribe: Deep Integration of Human and Machine Intelligence to Caption Speech in Real-Time. In Communications of the Association for Computing Machinery (CACM). 2017.
  32. Y. Chen, S.W. Lee, Y. Xie, Y. Yang, W.S. Lasecki, S. Oney. Codeon: On-Demand Software Development Assistance. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2017). Denver, CO.
  33. D. Merritt, J. Jones, M.S. Ackerman, W.S. Lasecki. Kurator: Using The Crowd to Help Families With Personal Curation Tasks . In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2017). Portland, OR.

    34. 2016

  34. T. Huang, W.S. Lasecki, A. Azaria, J.P. Bigham. "Is there anything else I can help you with?": Challenges in Deploying an On-Demand Crowd-Powered Conversational Agent. In Proceedings of the AAAI Conference on Human Computation (HCOMP 2016). Austin, TX.
  35. Y. Gaur, W.S. Lasecki, F. Metze, J.P. Bigham. The Effects of Automatic Speech Recognition Quality on Human Transcription Latency. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A 2016). Montreal, Canada.
    Best Paper
  36. J.J. Williams, J. Kim, E.L. Glassman, A. Rafferty, W.S. Lasecki. Making Static Lessons Adaptive through Crowdsourcing & Machine Learning. Chapter in Design Recommendations for Intelligent Tutoring Systems: Domain Modeling (Volume 4). 2016.
  37. Y. Chen, S. Oney and W.S. Lasecki. Towards Providing On-Demand Expert Support for Software Developers. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2016). San Jose, CA.
  38. J.J. Williams, J. Kim, A. Rafferty, S. Maldonado, K. Gajos, W.S. Lasecki, N. Heffernan. AXIS: Generating Explanations at Scale with Learnersourcing and Machine Learning. In Proceedings of the ACM Conference on Learning at Scale (L@S 2016). Edinburgh, UK.
    Best Paper Honorable Mention

    39. 2015

  39. J.P. Bigham, W.S. Lasecki, J.O. Wobbrock. Target Acquisition and the Crowd Actor. In Human Computation Journal (HCJournal). 2(2). 2015.
  40. T. Huang, W.S. Lasecki, J.P. Bigham. Guardian: A Crowd-Powered Spoken Dialogue System for Web APIs. In Proceedings of the AAAI Conference on Human Computation (HCOMP 2015). San Diego, CA.
  41. W.S. Lasecki, L. Rello, J.P. Bigham. Measuring Text Simplification with the Crowd. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A 2015). Florence, Italy.
  42. W.S. Lasecki, J. Kim, N. Rafter, O. Sen, J.P. Bigham, M.S. Bernstein. Apparition: Crowdsourced User Interfaces That Come To Life As You Sketch Them. In Proceedings of the International ACM Conference on Human Factors in Computing Systems (CHI 2015). Seoul, Korea. p1925-1934.
    Best Paper Honorable Mention
    Video
  43. W.S. Lasecki, M. Gordon, W. Leung, E. Lim, J.P. Bigham, S.P. Dow. Exploring Privacy and Accuracy Trade-Offs in Crowdsourced Behavioral Video Coding. In Proceedings of the International ACM Conference on Human Factors in Computing Systems (CHI 2015). Seoul, Korea. p1945-1954.
  44. W.S. Lasecki, J. Rzeszotarski, A. Marcus, J.P. Bigham. The Effects of Sequence and Delay on Crowd Work. In Proceedings of the International ACM Conference on Human Factors in Computing Systems (CHI 2015). Seoul, Korea.
  45. G. Laput, W.S. Lasecki, J. Wiese, R. Xiao, J.P. Bigham, C. Harrison. Zensors: Adaptive, Rapidly Deployable, Human-Intelligent Sensor Feeds. In Proceedings of the International ACM Conference on Human Factors in Computing Systems (CHI 2015). Seoul, Korea. p1935-1944.
    Video
  46. Y. Zhong, W.S. Lasecki, E. Brady, J.P. Bigham. RegionSpeak: Quick Comprehensive Spatial Descriptions of Complex Images for Blind Users. In Proceedings of the International ACM Conference on Human Factors in Computing Systems (CHI 2015). Seoul, Korea. p2353-2362.

    47. 2014

  47. W.S. Lasecki, M. Gordon, D. Koutra, M.F. Jung, S.P. Dow, J.P. Bigham. Glance: Rapidly Coding Behavioral Video with the Crowd. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2014). Honolulu, HI. p551-562.
    Video
  48. D. Retelny, S. Robaszkiewicz, A. To, W.S. Lasecki, J. Patel, N. Rahmati, T. Doshi, M. Valentine, M.S. Bernstein. Expert Crowdsourcing with Flash Teams. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2014). Honolulu, HI.
    Best Paper
  49. W.S. Lasecki, C.M. Homan, J.P. Bigham. Architecting Real-Time Crowd-Powered Systems. In Human Computation Journal (HCJournal October, 2014).
  50. W.S. Lasecki, R. Kushalnagar, J.P. Bigham. Helping Students Keep Up with Real-Time Captions by Pausing and Highlighting. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A 2014). Seoul, Korea.
    Best Technical Paper
  51. W.S. Lasecki, J.P. Bigham. Interactive Crowds: Real-Time Crowdsourcing and Crowd Agents. Chapter in Handbook of Human Computation. 2014. Amazon link: amzn.to/18KLKCK.
  52. Loparev, A., W.S. Lasecki, Murray, K.I., J.P. Bigham. Introducing Shared Character Control to Existing Video Games. In Proceedings of Foundations of Digital Interactive Games (FDG 2014). Ft. Lauderdale, FL.
  53. W.S. Lasecki, J.P. Bigham. Real-Time Captioning with the Crowd. In ACM Interactions Magazine. May, 2014.
  54. W.S. Lasecki, L. Weingard, G. Ferguson, J.P. Bigham. Finding Dependencies Between Actions Using the Crowd. In Proceedings of the International ACM Conference on Human Factors in Computing Systems (CHI 2014). Toronto, Canada.
  55. J.P. Bigham, W.S. Lasecki. Crowd Storage: Storing Information on Existing Memories. In Proceedings of the International ACM Conference on Human Factors in Computing Systems (CHI 2014). Toronto, Canada.
  56. W.S. Lasecki, J. Teevan, E. Kamar. Information Extraction and Manipulation Threats in Crowd-Powered Systems. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2014). Baltimore, MD.
  57. R. Kushalnagar, W.S. Lasecki, J.P. Bigham. Accessibility Evaluation of Classroom Captions. In ACM Transactions on Accessibility (TACCESS January, 2014).

    58. 2013

  58. W.S. Lasecki, P. Thiha, Y. Zhong, E. Brady, J.P. Bigham. Answering Visual Questions with Conversational Crowd Assistants. In Proceedings of the International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2013). Seattle, WA. Article #18.
  59. W.S. Lasecki, R. Wesley, J. Nichols, A. Kulkarni, J.F. Allen, J.P. Bigham. Chorus: A Crowd-Powered Conversational Assistant. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2013). St Andrews, UK. p151-162.
  60. R. Kushalnagar, W.S. Lasecki, J.P. Bigham. Captions Versus Transcripts for Online Video Content. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A 2013). p71-78.
  61. I. Naim, W.S. Lasecki, J.P. Bigham, D. Gildea. Text Alignment for Real-Time Crowd Captioning. In Proceedings of the North American Chapter of the Association for Computational Linguistics (NAACL 2013). Atlanta, GA. p201-210.
  62. W.S. Lasecki, C.D. Miller, J.P. Bigham. Warping Time for More Effective Real-Time Crowdsourcing. In Proceedings of the International ACM Conference on Human Factors in Computing Systems (CHI 2013). Paris, France. p2033-2036.
    Best Paper Honorable Mention
  63. W.S. Lasecki, Y. Song, H. Kautz, J.P. Bigham. Real-Time Crowd Labeling for Deployable Activity Recognition. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2013). San Antonio, TX. p1203-1212.

    64. 2012

  64. W.S. Lasecki, J.P. Bigham. Online Quality Control for Real-time Crowd Captioning. In Proceedings of the International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2012). Boulder, CO. p143-150.
  65. R. Kushalnagar, W.S. Lasecki, J.P. Bigham. A Readability Evaluation of Real-Time Crowd Captions in the Classroom. In Proceedings of the International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2012). Boulder, CO. p71-78.
  66. W.S. Lasecki, C.D. Miller, A. Sadilek, A. Abumoussa, D. Borrello, R. Kushalnagar, J.P. Bigham. Real-time Captioning by Groups of Non-Experts. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2012). Boston, MA. p23-34.
    Best Paper Award Nominee
  67. W.S. Lasecki, S. White, K.I. Murray, J.P. Bigham. Crowd Memory: Learning in the Collective. In Proceedings of Collective Intelligence (CI 2012). Boston, MA.

    68. 2011

  68. W.S. Lasecki, K.I. Murray, S. White, R.C. Miller, J.P. Bigham. Real-time Crowd Control of Existing Interfaces. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2011). Santa Barbara, CA. p23-32.

Workshops and Consortia

  1. J.S. Huffaker, J.K. Kummerfeld, W.S. Lasecki and M.S. Ackerman. Training Data Voids: Novel Attacks Against NLP Content Moderation. In CSCW Workshop on "Volunteer Work: Mapping the Future of Moderation Research" (CSCW 2019). Austin, TX. 2019.
  2. P. Ramaraj, S. Sahay, S.H. Kumar, W.S. Lasecki and J.E. Laird. Towards using transparency mechanisms to build better mental models. In Advances in Cognitive Systems 7th Goal Reasoning Workshop (ACS 2019). Boston, MA. 2019.
  3. W.S. Lasecki. On Facilitating Human-Computer Interaction via Hybrid Intelligence Systems. In Collective Intelligence. Pittsburgh, PA. 2019.
  4. H. Kaur, A.C. Williams, W.S. Lasecki. Building Shared Mental Models Between Humans and AI for Effective Collaboration. In CHI Workshop on Where is the Human? Bridging the Gap Between AI and HCI. Glasgow, UK. 2019.
  5. J. Chung, N. Banovic, W.S. Lasecki. Accident Prevention with Predictive Instantaneous Crowdsourcing. In CHI Workshop on Looking into the Future: Weaving the Threads of Vehicle Automation. Glasgow, UK. 2019.
  6. J.S. Huffaker, W.S. Lasecki, M.S. Ackerman. Mitigating Conspiracy Thinking with Non-Expert Crowds. In CHI Workshop on HCI for Accurate, Impartial and Transparent Journalism: Challenges and Solutions. Glasgow, UK. 2019.
  7. Y. Yang, E. Kandogan, Y. Li, P. Sen, W.S. Lasecki. A Study on Interaction in Human-In-The-Loop Machine Learning for Text Analytics. In IUI Workshop on Explainable Smart Systems (ExSS 2019). Los Angeles, CA. 2019.
  8. S.R. Gouravajhala, Y. Jiang, P. Kaur, J. Chaar, W.S. Lasecki. Finding Mnemo: Hybrid Intelligence Memory in a Crowd-Powered Dialog System. In Collective Intelligence Conference (CI 2018). Zurich, Switzerland. 2018.
  9. C. Toxtli, J. Chan, W.S. Lasecki, S. Savage. Enabling Expert Critique with Chatbots and Micro Guidance. In Collective Intelligence Conference (CI 2018). Zurich, Switzerland. 2018.
  10. J. Herskovitz, J. Chinnam, I. Wong, M. Liu, J. Mo, S.W. Lee, W.S. Lasecki. Crowdsourcing for Effortless Creation of Collaborative AR Spaces. In CHI Workshop on Novel Interaction Techniques for Collaboration in VR. Montreal, Canada. 2018.
  11. J.Y. Song, R. Fok, F. Yang, K. Wang, A. Lundgard, W.S. Lasecki. Tool Diversity as a Means of Improving Aggregate Crowd Performance on Image Segmentation Tasks. In HCOMP Workshop on Human Computation for Image and Video Analysis (GroupSight 2017). Quebec City, Canada. 2017.
  12. S.R. Gouravajhala, J.Y. Song, J. Yim, R. Fok, Y. Huang, F. Yang, K. Wang, Y. An, W.S. Lasecki. Towards Hybrid Intelligence for Robotics. In Collective Intelligence Conference (CI 2017). New York, NY. 2017.
  13. J.P. Bigham, W.S. Lasecki, C. Kulkarni. Crowdsourcing and Crowd Work. ACM Conference on Human Factors in Computing Systems Courses (CHI Courses 2017). Denver, CO. 2017.
  14. Y. Chen, S. Oney, W.S. Lasecki. Expert Crowd Support Systems for Software Developers. Oral presentation. In Collective Intelligence Conference (CI 2016). New York, NY.
  15. S.R. Gouravajhala, D. Koutra, W.S. Lasecki. Towards Crowd-Assisted Data Mining. In CHI Workshop on Human Centred Machine Learning (HCML 2016). San Jose, CA. 2016.
  16. Y. Chen, S. Oney, W.S. Lasecki. Towards software development microtasks. In CHI Workshop on Productivity Decomposed: Getting Big Things Done with Little Microtasks. San Jose, CA. 2016.
  17. W.S. Lasecki, J. Teevan, E. Kamar. The Cost of Asking Crowd Workers to Behave Maliciously. In AAMAS 2015 Workshop on Human-Agent Interaction Design and Models (HAIDM 2015). Istanbul, Turkey. 2015.
  18. W.S. Lasecki, M. Gordon, J. Teevan, E. Kamar, J.P. Bigham. Preserving Privacy in Crowd-Powered Systems. In AAMAS 2015 Workshop on Human-Agent Interaction Design and Models (HAIDM 2015). Istanbul, Turkey. 2015.
  19. G.V. de la Cruz, B. Peng, W.S. Lasecki, M.E. Taylor. Generating Real-Time Crowd Advice to Improve Reinforcement Learning Agents. In Proceedings of the Association for the Advancement of Artificial Intelligence Workshop on Learning for General Competency in Video Games (AAAI 2015). Austin, TX. 2015.
  20. W.S. Lasecki. Crowd-Powered Intelligent Systems. In AAAI Conference on Human Computation Doctoral Consortium (HCOMP 2013). Pittsburgh, PA. 2014.
  21. W.S. Lasecki. Powering Interactive Intelligent Systems with the Crowd. In Proceedings of the ACM Symposium on User Interface Science and Technology Doctoral Symposium (UIST 2013). Honolulu, HI. 2014.
  22. W.S. Lasecki, A. Ritter, J.P. Bigham. Powering Spoken Language Interactions with the Crowd (full version). In ACM Conference on Human Factors in Computing Systems Workshop on Designing Speech and Language Interactions (DSLI 2014). Toronto, Canada. 2014. [Submitted Version].
  23. A. Sadilek, C.M. Homan, W.S. Lasecki, V. Silenzio, H. Kautz. Modeling Fine-Grained Dynamics of Mood at Scale. ACM Conference on Web Search and Data Mining Workshop on Diffusion Networks and Cascade Analytics. Selected for Oral Presentation. New York, NY. 2014.
  24. W.S. Lasecki, D. Bohus, E. Kamar. Conversations in the Crowd: Collecting Data for Task-Oriented Dialog Learning. Proceedings of the Human Computation Workshop on Scaling Speech, Language Understanding and Dialogue through Crowdsourcing. Palm Springs, CA. 2013.
  25. W.S. Lasecki. Crowdsourcing for Deployable Intelligent Systems. In Proceedings of the Association for the Advancement of Artificial Intelligence Doctoral Consortium (AAAI 2013). Bellevue, WA. 2013.
  26. W.S. Lasecki, J.P. Bigham. Spoken Control of Existing Mobile Interfaces With the Crowd. In Proceedings of the ACM Conference on Human Factors in Computing Systems Student Research Competition Workshop on Mobile Accessibility (MOBACC 2013). Paris, France. 2013.

Demos

  1. Y. Yang, E. Kandogan, Y. Li, W.S. Lasecki, P. Sen. HEIDL: Learning Linguistic Expressions with Deep Learning and Human-in-the-Loop. In ACL Demos (ACL 2019). Florence, Italy. 2019.
    Best Poster, Michigan AI Symposium (re-presentation)
  2. S.W. Lee, Y. Yang, S. Yan, Y. Zhang, I. Wong, Z. Tan, M. McGruder, C.M. Homan, W.S. Lasecki. Creating Interactive Behaviors in Early Sketch by Recording and Remixing Crowd Demonstrations. In AAAI Conference on Human Computation Demos (HCOMP 2016). Austin, TX. 2016.
  3. J. Yim, W. Leung, J. Jasani, E. Lim, A.M. Henderson, M. Gordon, D. Koutra, J.P. Bigham, S.P. Dow, W.S. Lasecki. Coding Varied Behavior Types Using the Crowd. In ACM Conference on Computer Supported Cooperative Work and Social Computing Demos (CSCW 2016). San Fransisco, CA. 2016.
  4. W.S. Lasecki, R. Kushalnagar, J.P. Bigham. Legion Scribe: Real-Time Captioning by Non-Experts. In ACM SIGACCESS Conference on Computers and Accessibility -- Captioning Challenge (ASSETS 2014). Rochester, NY.
  5. W.S. Lasecki, M. Gordon, S.P. Dow, J.P. Bigham. Glance: Enabling Rapid Interactions with Data Using the Crowd (full version). In ACM Conference on Human Factors in Computing Systems -- Interactivity (CHI 2014). Toronto, Canada. [Submitted version].
  6. W.S. Lasecki, C.D. Miller, R. Kushalnagar, J.P. Bigham. Legion:Scribe. In ACM SIGACCESS Conference on Computers and Accessibility -- Captioning Challenge (ASSETS 2013). Bellevue, WA.
  7. W.S. Lasecki, R. Wesley, J. Nichols, A. Kulkarni, J.F. Allen, J.P. Bigham. Chorus: A Crowd-Powered Conversational Assistant. In Proceedings of the ACM Symposium on User Interface Science and Technology -- Demos (UIST 2013). St. Andrews, UK.
  8. W.S. Lasecki, C.D. Miller, R. Kushalnagar, J.P. Bigham. Legion:Scribe. In International Cross-Disciplinary Conference on Web Accessibility -- The Paciello Group Web Accessibility Challenge (W4A 2013). Rio de Janeiro.
    Judges Award
  9. W.S. Lasecki, R. Wesley, A. Kulkarni, J.P. Bigham. Speaking With the Crowd. In Proceedings of the ACM Symposium on User Interface Software and Technology -- Demos (UIST 2012). Boston, MA.
  10. W.S. Lasecki, K.I. Murray, S. White, R.C. Miller, J.P. Bigham. Real-Time Crowd Control of Existing Interfaces. In Proceedings of the ACM Symposium on User Interface Software and Technology -- Demos (UIST 2011). Santa Barbara, CA.

Posters and Abstracts

  1. J.J.Y. Chung, F. Xiao, N. Banovic, W.S. Lasecki. Towards Instantaneous Recovery from Autonomous System Failures via Predictive Crowdsourcing. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2019). New Orleans, LA.
  2. A. Vernier, J.Y. Song, E. Sun, A. Kench, W.S. Lasecki. Towards Universal Evaluation of Image Annotation Interfaces. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2019). New Orleans, LA.
  3. J. Herskovitz, E. Ofek, W.S. Lasecki, A. Fourney. Opportunities for In-Home Augmented Reality Guidance. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2019). Scotland, UK. [poster]
  4. H. Kaur, I. Johnson, H.J. Miller, L.G. Terveen, C. Lampe, B. Hecht, W.S. Lasecki. Oh The Places You'll Share: An Affordances-Based Model of Social Media Posting Behaviors. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2018). Denver, CO. [poster]
  5. H. Kaur, A.C. Williams, A.L. Thompson, W.S. Lasecki, S. Iqbal, J. Teevan. Using Vocabularies to Collaboratively Create Better Plans for Writing Tasks. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2018). Denver, CO. [poster]
  6. J.Y. Song, R. Fok, F. Yang, K. Wang, A. Lundgard, W.S. Lasecki: Two Tools Are Better Than One: Tool Diversity as a Means of Improving Aggregate Crowd Performance on an Object Segmentation Task. In Proceedings of the Human Computation Works-in-Progress (HCOMP 2017). Quebec City, Canada.
  7. S.W. Lee, Y. Chen, W.S. Lasecki: The Need for Real-Time Crowd Generation of Task Lists from Speech. In Proceedings of the Human Computation Works-in-Progress (HCOMP 2017). Quebec City, Canada.
  8. J.J. Williams, A. Rafferty, A. Ang, D. Tingley, J. Kim, W.S. Lasecki. Connecting Instructors, Learning Scientists, and Reinforcement Learning Researchers via Collaborative Dynamic Personalized Experimentation. In Proceedings of the 3rd Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM 2017). Ann Arbor, MI.
  9. S.W. Lee, Y. Chen, N. Klugman, S.R. Gouravajhala, A. Chen, W.S. Lasecki. Exploring Coordination Models for Ad Hoc Programming Teams. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2017). Denver, CO.
  10. J.J. Williams, A.N. Rafferty, A. Ang, D. Tingley, W.S. Lasecki, J. Kim. Connecting Instructors and Learning Scientists via Collaborative Dynamic Experimentation. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2017). Denver, CO.
  11. J.J. Williams, J. Kim, A. Rafferty, S. Maldonado, K. Gajos, W.S. Lasecki, N. Heffernan. AXIS - An Adaptive Tool for Generating Explanations Using MOOClets for Crowdsourcing and Machine Learning. In Proceedings of the Learning with MOOCs Conference (LWMOOCs 2016). New York, NY.
  12. M. Gordon, J.P. Bigham, W.S. Lasecki. LegionTools: A Toolkit + UI for Recruiting and Routing Crowds to Synchronous Real-Time Tasks. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2015). Charlotte, NC.
  13. G.V. de la Cruz, B. Peng, W.S. Lasecki, M.E. Taylor. Towards Integrating Real-Time Crowd Advice with Reinforcement Learning. In Proceedings of Intelligent User Interfaces (IUI 2015). Atlanta, GA.
  14. W.S. Lasecki, C.M. Homan, J.P. Bigham: Tuning the Diversity of Open-Ended Responses From the Crowd. In Proceedings of the Human Computation Works-in-Progress (HCOMP 2014). Pittsburgh, PA.
  15. M. Gordon, W.S. Lasecki, W. Leung, E. Lim, S.P. Dow, J.P. Bigham: Glance Privacy: Obfuscating Personal Identity While Coding Behavioral Video. In Proceedings of the Human Computation Works-in-Progress (HCOMP 2014). Pittsburgh, PA.
  16. T. Huang, W.S. Lasecki, A. Ritter, J.P. Bigham: Combining Non-Expert and Expert Crowd Work to Convert Web APIs to Dialog Systems. In Proceedings of the Human Computation Works-in-Progress (HCOMP 2014). Pittsburgh, PA.
  17. W.S. Lasecki*, Y. Zhong*, J.P. Bigham: Increasing the Bandwidth of Crowdsourced Visual Question Answering to Better Support Blind Users. In Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility Poster Track (ASSETS 2013). Rochester, NY.
  18. D. Scarafoni, M. Gordon, W.S. Lasecki, J.P. Bigham: Comparing Human and Automated Agents in a Coordinated Navigation Domain. University of Rochester Undergraduate Research Exposition. Rochester, NY.
    Professor's Choice Award
  19. J. Teevan, D. Liebling, W.S. Lasecki. Selfsourcing Personal Tasks. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2014). Toronto, Canada.
  20. W.S. Lasecki, J. Teevan, E. Kamar. Raising an Army: Attacking Crowd Systems. In CrowdConf 2013
  21. W.S. Lasecki, J.P. Bigham: Automated Support for Collective Memory of Conversational Interactions. In Proceedings of the Human Computation Works-in-Progress (HCOMP 2013). Palm Springs, CA.
  22. P. Singh, W.S. Lasecki, P. Barelli, J.P. Bigham: HiveMind: Tuning Crowd Response with a Single Value. In Proceedings of the Human Computation Works-in-Progress (HCOMP 2013). Palm Springs, CA.
  23. W.S. Lasecki, C.D. Miller, R. Kushalnagar, J.P. Bigham. Legion:Scribe. In Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility Captioning Competition (ASSETS 2013). Bellevue, WA.
  24. W.S. Lasecki, J. Teevan, E. Kamar. Information Extraction and Manipulation Threats in Crowd-Powered Systems. In Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI 2013). Bellevue, WA.
  25. W.S. Lasecki, L. Weingard, J.P. Bigham, G. Ferguson. Crowd Formalization of Action Conditions. In Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI 2013). Bellevue, WA.
  26. W.S. Lasecki, L. Weingard, G. Ferguson, J.P. Bigham. Finding Action Dependencies Using the Crowd. In Proceedings of the ACM Conference on Knowledge Capture (KCAP 2013). Banff, Canada.
  27. W.S. Lasecki. Real-Time Conversational Crowd Assistants. In Proceedings of the ACM Conference on Human Factors in Computing Systems Student Research Competition (CHI 2013). Paris, France.
  28. M. Murphy, C.D. Miller, W.S. Lasecki, J.P. Bigham. Adaptive Time Windows for Real-Time Crowd Captioning. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2013). Paris, France.
  29. W.S. Lasecki, T. Lau, Grant He, J.P. Bigham Crowd-Based Recognition of Web Interaction Patterns. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2012). Boston, MA.
  30. Y. Song, W.S. Lasecki, J.P. Bigham, H. Kautz. Online Training of Activity Recognition Systems. In Proceedings of Ubiquitous Computing (UBICOMP 2012). Pittsburgh, PA.
  31. W.S. Lasecki, J.P. Bigham, J.F. Allen, G. Ferguson. Real-time Collaborative Planning with the Crowd. In Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI 2012). Toronto, Canada.
  32. W.S. Lasecki, C.D. Miller, D. Borrello, J.P. Bigham. Online Sequence Alignment for Real-time Audio Transcription by Non-experts. In Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI 2012). Toronto, Canada.
  33. W.S. Lasecki, J.P. Bigham. Self Correcting Crowds. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2012). Austin, TX.
  34. Y. Zhong, P. Thiha, G. He, W.S. Lasecki, J.P. Bigham. Using Real-time Feedback to Improve Visual Question Answering. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2012). Austin, TX.

Technical Reports and Thesis

  1. W.S. Lasecki. Crowd Agents: Interactive Intelligent Systems Powered by the Crowd. University of Rochester Ph.D. Thesis. 2015. 
    Outstanding Dissertation Award Commendation
  2. W.S. Lasecki, C.M. Homan, J.P. Bigham. Tuning the Diversity of Open-Ended Responses from the Crowd. arXiv Report 1408.6621. 2014.
  3. W.S. Lasecki, A. Marcus, J. Rzeszotarski, J.P. Bigham. Using Microtask Continuity to Improve Crowdsourcing. Carnegie Mellon University Technical Report CMU-HCII-14-100. 2014.
  4. D. Scarafoni, M. Gordon, W.S. Lasecki, J.P. Bigham. Comparing Human and Automated Agents in a Coordinated Navigation Domain. University of Rochester Technical Report #989. 2014.
  5. A. Sadilek, C. Homan, W.S. Lasecki, V. Silenzio, H. Kautz. Modeling Fine-Grained Dynamics of Mood at Scale. University of Rochester Technical Report #988. 2014.
  6. A. Loparev, W.S. Lasecki, K.I. Murray, J.P. Bigham. Introducing Shared Character Control to Existing Video Games. University of Rochester Technical Report #986. 2013.
  7. M. Lease, J. Hullman, J.P. Bigham, M.S. Bernstein, J. Kim, W.S. Lasecki, S. Bakhshi, T. Mitra, R.C. Miller. Mechanical Turk is Not Anonymous. Social Science Research Network (SSRN). 2013.Top Ten Most Downloaded Articles (Month)
  8. W.S. Lasecki, A. Kulkarni, R. Wesley, J. Nichols, C. Hu, J.F. Allen, J.P. Bigham. Chorus: Letting the Crowd Speak with One Voice. University of Rochester Technical Report #983. 2012.
  9. P. Singh, W.S. Lasecki, P. Barelli, J.P. Bigham. HiveMind: A Framework for Optimizing Open-Ended Responses From the Crowd. University of Rochester Technical Report #978. 2012.
  10. W.S. Lasecki. Crowd Agents. University of Rochester Masters Thesis. 2012. 
  11. W.S. Lasecki, H. Kautz. Planning With Tests, Branches, and Non-Deterministic Actions as Satisfiability. University of Rochester Technical Report #979. 2012.

Dissertations Advised

  1. J.Y. Song. Eliciting and Leveraging Input Diversity in Crowd-Powered Intelligent Systems. University of Michigan Ph.D. Thesis. 2019.
  2. S.W. Lee. Improving User Involvement through Live Collaborative Creation. University of Michigan Ph.D. Thesis. 2018.