A Generative Neural Network Model for Speech Enhancement

A Generative Neural Network Model for Speech Enhancement

Kapadia, Husain (TU Delft Electrical Engineering, Mathematics and Computer Science; TU Delft Circuits and Systems; GN Hearing)

Kleijn, Bastiaan (mentor)
Hendriks, Richard (graduation committee)
de Vries, Bert (graduation committee)
Hendrikse, Anne (graduation committee)

Delft University of Technology

2019-09-20

Listening in noise is a challenging problem that affects the hearing capability of not only normal hearing but especially hearing impaired people. Since the last four decades, enhancing the quality and intelligibility of noise corrupted speech by reducing the effect of noise has been addressed using statistical signal processing techniques as well as neural networks. However, the fundamental idea behind implementing these methods is the same, i.e., to achieve the best possible estimate of a single target speech waveform. This thesis explores a different route using generative modeling with deep neural networks where speech is artificially generated by conditioning the model on previously predicted samples and features extracted from noisy speech. The proposed system consists of the U-Net model for enhancing the noisy features and the WaveRNN synthesizer (originally proposed for text-to-speech synthesis) re-designed for synthesizing clean sounding speech from noisy features. Subjective results indicate that speech generated by the proposed system is preferred over listening to noisy speech however, the improvement in intelligibility is not significant.

Generative Model
Machine Learning
Speech Enhancement
Neural Networks
Speech Synthesis
Deep Learning

http://resolver.tudelft.nl/uuid:b76d4c1f-108b-4110-bced-ea6b320eda56

2020-09-01

Student theses

master thesis

© 2019 Husain Kapadia