A systematic comparison of commonsense knowledge usages between natural language processing (NLP) and computer vision (CV)

A systematic comparison of commonsense knowledge usages between natural language processing (NLP) and computer vision (CV)

Kuiper, Adrian (TU Delft Electrical Engineering, Mathematics and Computer Science)

He, G. (mentor)
Yang, J. (mentor)
Gadiraju, Ujwal (mentor)
Houben, G.J.P.M. (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2022-06-24

Commonsense knowledge is the key of human intelligence in generalizing their knowledge to deal with complex tasks. Over the past years, a lot of research has been done in both natural language processing (NLP) and computer vision (CV) on leveraging commonsense knowledge to improve AI models. However, no systematic comparisons of existing work have been made between the two domains. Therefore this survey aims to provide an overview of how commonsense knowledge is used within NLP and CV and how research varies between these two domains and what future challenges it may hold. An observation made from this survey is that leveraging commonsense is more difficult in CV than NLP, as commonsense is mostly incorporated textually and datasets need to be filtered to make them more relevant for visual commonsense. We hope to promote further research and create a better understanding of commonsense knowledge and its applications with this survey.

Commonsense Knowledge
Survey
NLP
CV

http://resolver.tudelft.nl/uuid:01a8584a-49e2-40f2-8591-75e15f9f96a7

Student theses

bachelor thesis

© 2022 Adrian Kuiper