An empirical study of the effects of unconfoundedness on the performance of Propensity Score Matching

An empirical study of the effects of unconfoundedness on the performance of Propensity Score Matching

Erdelský, Andrej (TU Delft Electrical Engineering, Mathematics and Computer Science)

Krijthe, J.H. (mentor)
Bongers, S.R. (mentor)
Bidarra, Rafael (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2022-06-23

The purpose of this research is to analyze the performance of Propensity Score Matching, a causal inference method for causal effect estimation. More specifically, investigate how Propensity Score Matching reacts to breaking the unconfoundedness assumption, one of its core conceptual pillars. This has been achieved by running PSM on synthetic data that upholds the unconfoundedness condition, and then comparing these results with measurements obtained from running the algorithm on data with confounding features with varying contribution to other variable values and hiding these features individually or in progressively higher numbers. These results are also then compared to Linear Regression, a generic machine learning algorithm, for the sake of comparison of performance. The results obtained point to the observation that when hiding variables that only contribute to the main effect, treatment effect or treatment propensity calculation respectively, PSM performs with the same error no matter which of the three effects the hidden feature affects, making them equivalent in their error contribution. Additionally, it has also become apparent that in all experimental scenarios used in this work, PSM performed very similarly to Linear Regression and did not seem to offer any advantages over the latter in these specific situations.

Propensity
Causal Inference
Causality
Machine Learning

http://resolver.tudelft.nl/uuid:a765961f-2bca-4e7c-a65f-dcade576025c

Student theses

bachelor thesis

© 2022 Andrej Erdelský