Print Email Facebook Twitter Exploring the Effect of Automation Failure on the Human’s Trustworthiness in Human-Agent Teamwork Title Exploring the Effect of Automation Failure on the Human’s Trustworthiness in Human-Agent Teamwork Author Bouman, Nikki (TU Delft Electrical Engineering, Mathematics and Computer Science) Contributor Tielman, M.L. (mentor) Centeio Jorge, C. (mentor) Jonker, C.M. (graduation committee) Yang, J. (graduation committee) Degree granting institution Delft University of Technology Programme Computer Science and Engineering Date 2022-11-07 Abstract Collaboration in teams composed of both humans and automations has an interdependent nature, which demands calibrated trust among all the teammembers. For building suitable autonomous teammates, we need to study how trust and trustworthiness function in such teams. In particular, automations occasionally fail to do their job, which leads to a decrease in human’s trust. However, research has given contradictory statements about the effects of such a reduction of trust on the human’s trustworthiness, i.e. human’s characteristics that make them more or less reliable to the automation. As such, this study investigates how automation failure in a human-automation teamwork scenario affects the human’s trust in the automation and human’s trustworthiness towards the automation. We present a between-subjects controlled experiment in which the participants perform a simulated task in a 2D grid-world, collaborating with an automation in a “moving-out” scenario. During the experiment, we measure the participants’ trust and trustworthiness regarding the automation both subjectively and objectively. Our results show that automation failure negatively affects the human’s trustworthiness, as well as their trust in and liking of the automation. Learning the effects of automation failure in trust and trustworthiness can contribute to a better understanding of the nature and dynamics of trust in these teams, foreseeing undesirable consequences and improving human-automation teamwork. Subject Artificial intelligencehuman factorsTrust developmentTrustworthinesstrustworthy AItrust in technologyhuman trustworthiness To reference this document use: http://resolver.tudelft.nl/uuid:012a2cdb-4aa7-4667-b95d-02ae0baa6cde Part of collection Student theses Document type master thesis Rights © 2022 Nikki Bouman Files PDF Exploring_the_Effect_of_A ... Bouman.pdf 1.47 MB Close viewer /islandora/object/uuid:012a2cdb-4aa7-4667-b95d-02ae0baa6cde/datastream/OBJ/view