The accuracy of an audio interface designed for value elicitation

The accuracy of an audio interface designed for value elicitation: Eliciting personal values from the users to build responsible AI

Voorneveld, Elvira (TU Delft Electrical Engineering, Mathematics and Computer Science)

Jonker, C.M. (mentor)
Chen, P.Y. (mentor)
Wehner, S.D.C. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2023-06-23

Behavior support applications aim to provide personalized and flexible support to users in various domains. To achieve this, understanding users' preferences, values, and context is crucial. Creating user models that incorporate users' norms and values has been proposed as a solution to capture the relationship between desired behaviors and values. However, updating and modifying user models at run-time remains a challenge, as users' norms and values may change over time. This study investigates the accuracy of an audio interface designed to elicit values-related information using isolated questions. This involves designing an audio interface and evaluating its effectiveness through participant interactions, where they are presented with four scenarios. It was found that the audio interface performs above average in terms of usability, as indicated by the System Usability Scale score. The accuracy of the user models is evaluated through the Hamming distance and value differences between the base model and the participant-improved model. Most models required a small number of changes, and when changes were made, they were generally minimal. Additionally, feedback collected through open-ended interview questions lays down a basis for further development. The study contributes to the field by demonstrating the efficacy of the audio interface and its potential for updating user models in real-time. Overall, the research findings support the development of more effective and personalized behavior support applications that can adapt to its users.

Audio
Interface
User Modelling
Accuracy
Artifical Intelligence
User Study
Usability

http://resolver.tudelft.nl/uuid:f8762fca-867e-4a55-8f3e-6841a4b3b3d7

Student theses

bachelor thesis

© 2023 Elvira Voorneveld