Estimating Intention To Speak Using Non-Verbal Vocal Behavior

Estimating Intention To Speak Using Non-Verbal Vocal Behavior

van Marken, Julie (TU Delft Electrical Engineering, Mathematics and Computer Science)

Hung, H.S. (mentor)
Elnouty, A.W.F.A.M. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2023-06-28

This research aims to answer the question whether non-verbal vocal behavior can be used to estimate intention to speak. To answer this question data from a dutch social networking event is used to gather intentions to speak. The intentions to speak are split up in two categories: successful and unsuccessful intentions. The unsuccessful intentions are further split up into two categories: unsuccessful intentions to start speaking and unsuccessful intentions to continue speaking. The perceived unsuccessful intentions to speak are gathered by manually annotating a 10-minute segment of the networking event and successful intentions to speak are automatically extracted using Voice Activity Detection. From the audio, non-verbal vocal features are extracted to train a machine learning model to predict if there is an intention to speak. The model is trained on successful intentions to speak and evaluated on both successful and unsuccessful intentions to speak. From the experiment results it was concluded that the model predicted intention to speak better than random guessing.

Machine Learning
Non-Verbal Communication
Intention Estimation

http://resolver.tudelft.nl/uuid:7580ec2f-165f-4901-92a6-b1a5e61f4b0e

Student theses

bachelor thesis

© 2023 Julie van Marken