Evaluating the Accuracy of User Values Elicited through a Textual Interface

Evaluating the Accuracy of User Values Elicited through a Textual Interface: Conducting a user study with a textual interface using questions in isolation to capture user values

Kastelein, Pien (TU Delft Electrical Engineering, Mathematics and Computer Science)

Chen, P.Y. (mentor)
Jonker, C.M. (mentor)
Wehner, S.D.C. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2023-06-23

This research paper focuses on the accuracy and limitations of user values elicited through a textual interface with questions asked in isolation. The primary objective was to conduct a user study using a textual interface that uses questions in isolation to assess the effectiveness and accuracy of this interface type and questioning style. The study involved exploring various scenarios and associated user values, as well as comparing the textual interface with graphical and audio interfaces tested in four related studies. The user study consisted of 15 participants who interacted with the textual interface. Afterwards, they were tasked with judging and adapting their behaviour models while also evaluating the interface's usability. The findings indicate that while the textual interface demonstrates decent usability, participants did not perceive a strong need for the current system and that compared to other interface types, the textual interface does not yield the most accurate results. This research provides insights into the usability and limitations of a textual interface for eliciting user values. It emphasizes the need for further exploration and development of alternative interface types to enhance accuracy and user engagement.

Value elicitation
Behaviour trees
Questions in isolation
Behaviour modelling

http://resolver.tudelft.nl/uuid:00fb8965-f62d-4f59-9206-77381e87c042

Student theses

bachelor thesis

© 2023 Pien Kastelein