Causal inference analysis is the estimation of the effects of actions on
outcomes. In the context of healthcare data this means estimating the outcome
of counter-factual treatments (i.e. including treatments that were not
observed) on a patient's outcome. Compared to classic machine learning methods,
evaluation and validation of causal inference analysis is more challenging
because ground truth data of counter-factual outcome can never be obtained in
any real-world scenario. Here, we present a comprehensive framework for
benchmarking algorithms that estimate causal effect. The framework includes
unlabeled data for prediction, labeled data for validation, and code for
automatic evaluation of algorithm predictions using both established and novel
metrics. The data is based on real-world covariates, and the treatment
assignments and outcomes are based on simulations, which provides the basis for
validation. In this framework we address two questions: one of scaling, and the
other of data-censoring. The framework is available as open source code at
this https URL

本文介绍了一个综合框架，用于对评估算法进行基准测试，它包括用于预测的未标记数据、用于验证的标记数据以及使用已建立和新颖指标进行算法预测的自动评估的代码，并解决了缩放和数据屏蔽问题。