Honesty in Causal Forests, is it worth it ?

Honesty in Causal Forests, is it worth it ?

Havelka, Matej (TU Delft Electrical Engineering, Mathematics and Computer Science)

Bongers, S.R. (mentor)
Krijthe, J.H. (mentor)
Bidarra, Rafael (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2022-06-23

Causal machine learning is a relatively new field which tries to find a causal relation between the treatment and the outcome, rather than a correlation between the features and the outcome. To achieve this, many different models were proposed, one of which is the causal forest. Causal forest is made up of a random forest, with a different estimation function in the leaf node, which means it suffers from the same problems, like being easy to overfit. The reason why honesty was introduced was to ensure mathematically that forests do not overfit as easily. This research however, only provided preliminary results and no real testing was done in terms of causal inference. In this paper three scenarios are tested where a comparison is made between a causal forest with and without honesty. Based on the results it seems that honesty does indeed help for trees to not overfit. However in a general setting it hurts the model as it only trains with half of the available data. This makes honest causal forest less accurate in general settings where there is not a lot of training data. In a setting where a large amount of data is provided it seems that honesty does not change the performance, meaning it creates a theoretical guarantee against overfitting with no repercussions for the performance.

Causal Inference
Causal Forest
Honesty
Causality

http://resolver.tudelft.nl/uuid:811cbca8-1c31-4fc3-9786-30cc9ba5670f

https://github.com/MatejHav/causal-methods-evaluation Repository used as the codebase for the obtained results.

Student theses

bachelor thesis

© 2022 Matej Havelka