Active Learning To Reduce Human Labeling For Automatic Psychological Text Classification

Active Learning To Reduce Human Labeling For Automatic Psychological Text Classification

O'Dwyer Wha Binda, Jahson (TU Delft Electrical Engineering, Mathematics and Computer Science; TU Delft Intelligent Systems)

Brinkman, W.P. (mentor)
Bruijnes, M. (graduation committee)
Hung, H.S. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2021-07-01

In recent years there has been an increase in the number of patients for issues relating to mental illness. To this effect to help with this increase, schema mode assessment through a conversation agent is being used to conduct schema therapy, a form of psychological treatment. To train such an agent, training data labeled by humans is necessary but can be very expensive to conduct. The question being researched is through the use of Active Machine learning is it possible to reduce the amount of required labeled data to do such classification. Three experiments on the use of active learning with currently available classifiers were performed where the active learner attempted to train the classifiers to an accuracy within +/- 3% of the same classifier trained with traditional machine learning on the full data set. The experimental results found that in all cases the use of active learning drastically decreased the number of necessary labeled data the classifier needed to achieve a similar accuracy. Consistently reducing the number by 98% and above answering the initial question. Though possible limitations of the data set and classifiers for such texts may be positively influencing the magnitude of the reduction.

Active Machine Learning
Text Classification
Natural Language Processing
Support Vector Machine
machine learning

http://resolver.tudelft.nl/uuid:b4f30a7a-7a2a-4cf6-8d95-450d0126afca

https://github.com/Jahb/ActiveMachineLearningResearch Github repo hosting experimental code.

Student theses

bachelor thesis

© 2021 Jahson O'Dwyer Wha Binda