Personalised models for speech detection from body movements using transductive parameter transfer

Personalised models for speech detection from body movements using transductive parameter transfer

Gedik, E. (TU Delft Pattern Recognition and Bioinformatics)
Hung, H.S. (TU Delft Pattern Recognition and Bioinformatics)

2017-08-01

We investigate the task of detecting speakers in crowded environments using a single body worn triaxial accelerometer. Detection of such behaviour is very challenging to model as people’s body movements during speech vary greatly. Similar to previous studies, by assuming that body movements are indicative of speech, we show experimentally, on a real-world dataset of 3 h including 18 people, that transductive parameter transfer learning (Zen et al. in Proceedings of the 16th international conference on multimodal interaction. ACM, 2014) can better model individual differences in speaking behaviour, significantly improving on the state-of-the-art performance. We also discuss the challenges introduced by the in-the-wild nature of our dataset and experimentally show how they affect detection performance. We strengthen the need for an adaptive approach by comparing the speech detection problem to a more traditional activity (i.e. walking). We provide an analysis of the transfer by considering different source sets which provides a deeper investigation of the nature of both speech and body movements, in the context of transfer learning.

Human behaviour
Social actions
Social signal processing
Transfer learning
Wearable sensors

http://resolver.tudelft.nl/uuid:4fe22cfc-44da-4f18-ab5b-75a07e14103a

https://doi.org/10.1007/s00779-017-1006-4

1617-4909

Personal and Ubiquitous Computing, 21 (4), 723-737

Institutional Repository

journal article

© 2017 E. Gedik, H.S. Hung