Print Email Facebook Twitter Improving Worker Engagement Through Conversational Microtask Crowdsourcing Title Improving Worker Engagement Through Conversational Microtask Crowdsourcing Author Qiu, S. (TU Delft Web Information Systems) Gadiraju, Ujwal (Leibniz Universität) Bozzon, A. (TU Delft Human-Centred Artificial Intelligence; TU Delft Web Information Systems) Date 2020 Abstract The rise in popularity of conversational agents has enabled humans to interact with machines more naturally. Recent work has shown that crowd workers in microtask marketplaces can complete a variety of human intelligence tasks (HITs) using conversational interfaces with similar output quality compared to the traditional Web interfaces. In this paper, we investigate the effectiveness of using conversational interfaces to improve worker engagement in microtask crowdsourcing. We designed a text-based conversational agent that assists workers in task execution, and tested the performance of workers when interacting with agents having different conversational styles. We conducted a rigorous experimental study on Amazon Mechanical Turk with 800 unique workers, to explore whether the output quality, worker engagement and the perceived cognitive load of workers can be affected by the conversational agent and its conversational styles. Our results show that conversational interfaces can be effective in engaging workers, and a suitable conversational style has potential to improve worker engagement. Subject cognitive task loadconversational interfaceconversational stylemicrotask crowdsourcinguser engagement To reference this document use: http://resolver.tudelft.nl/uuid:e2770c3a-5b73-48f9-9bf1-4ee953a609a5 DOI https://doi.org/10.1145/3313831.3376403 Publisher Association for Computing Machinery (ACM), New York, NY, USA ISBN 978-1-4503-6708-0/20/04 Source CHI 2020 - Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Event CHI 2020: The ACM CHI Conference on Human Factors in Computing Systems, 2020-04-25 → 2020-04-30, Honolulu, United States Series Conference on Human Factors in Computing Systems - Proceedings Bibliographical note Accepted author manuscript Part of collection Institutional Repository Document type conference paper Rights © 2020 S. Qiu, Ujwal Gadiraju, A. Bozzon Files PDF chi20workerengagement.pdf 852.14 KB Close viewer /islandora/object/uuid:e2770c3a-5b73-48f9-9bf1-4ee953a609a5/datastream/OBJ/view