A Comparison of Instance Attribution Methods

A Comparison of Instance Attribution Methods: Comparing Instance Attribution Methods to Baseline k-Nearest Neighbors Method

de Kruif, Evan (TU Delft Electrical Engineering, Mathematics and Computer Science)

Anand, Avishek (mentor)
Corti, L. (graduation committee)
Lyu, Lijun (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2023-02-03

In this research, a comparison between different Instance Attribution (IA) methods and k-Nearest Neighbors (kNN) via cosine similarity is conducted on a Natural Language Processing (NLP) machine learning model. The format in which the comparison is made is by way of a human survey and automated similarity comparisons of representative vectors. The goal of this is to judge and compare the effectiveness of each method’s results in the context of a human’s language understanding and ability to determine if a fact is true or not. Through this research, it was found that for results obtained on the same input, IA methods were preferred 32.5% more often than kNN. It is also shown that this preference is not linked to the similarity between the IA results and the kNN results. Through these findings, it can be seen that when understood through the lens of human comprehension, IA methods are much more effective at generating a set of influential training points from the model’s training dataset.

Instance Attribution
Explainable AI
Natural Language Processing
Fact Checking

http://resolver.tudelft.nl/uuid:4864c74b-3e6c-41a8-bfce-f07e8deaa5fc

Student theses

bachelor thesis

© 2023 Evan de Kruif