Zhang, Yi, Eli Ben-Michael, and Kosuke Imai. (2024). ``Safe Policy Learning under Regression Discontinuity Designs.''

Abstract

The regression discontinuity (RD) design is widely used for program evaluation with observational data. The RD design enables the identification of the local average treatment effect (LATE) at the treatment cutoff by exploiting known deterministic treatment assignment mechanisms. The primary focus of the existing literature has been the development of rigorous estimation methods for the LATE. In contrast, we consider policy learning under the RD design. We develop a robust optimization approach to finding an optimal treatment cutoff that improves upon the existing one. Under the RD design, policy learning requires extrapolation. We address this problem by partially identifying the conditional expectation function of counterfactual outcome under a smoothness assumption commonly used for the estimation of LATE. We then minimize the worst case regret relative to the status quo policy. The resulting new treatment cutoffs have a safety guarantee, enabling policy makers to limit the probability that they yield a worse outcome than the existing cutoff. Going beyond the standard single-cutoff case, we generalize the proposed methodology to the multi-cutoff RD design by developing a doubly robust estimator. We establish the asymptotic regret bounds for the learned policy using semi-parametric efficiency theory. Finally, we apply the proposed methodology to empirical and simulated data sets. (Last updated in August 2022)

Replication Archive

Related Papers

Zhou, Lingxiao, Kosuke Imai, Jason Lyall, and Georgia Papadogeorgou (2026). ``Dynamic Policy Evaluation and Learning with Spatio-temporal Data.''
Jia, Zeyang, Eli Ben-Michael, and Kosuke Imai (2026). ``Bayesian Safe Policy Learning with Chance Constrained Optimization: Application to Military Security Assessment during the Vietnam War.'' Journal of the Royal Statistical Society, Series A (Statistics in Society), Vol. 189, No. 3, pp. 1448-1472.
Imai, Kosuke, Sooahn Shin, D. James Greiner, and Ryan Halen (2026). ``Triage Score: A Counterfactual Risk Assessment Instrument.''
Koch, Benedikt, Kosuke Imai, and Tomasz Strzalecki (2026). ``An Axiomatic Foundation for Decisions with Counterfactual Utility.''
Koch, Benedikt and Kosuke Imai (2025). ``Statistical Decision Theory with Counterfactual Loss.''
Ben-Michael, Eli, D. James Greiner, Kosuke Imai, and Zhichao Jiang (2025). ``Safe Policy Learning through Extrapolation: Application to Pre-trial Risk Assessment.'' Journal of the American Statistical Association, Vol. 120, No. 551, pp. 1386-1399.
Ben-Michael, Eli, D. James Greiner, Melody Huang, Kosuke Imai, Zhichao Jiang, Sooahn Shin (2025). ``Does AI help humans make better decisions? A statistical evaluation framework for experimental and observational studies.'' Proceedings of the National Academy of Sciences, Vol. 122, No. 38, e2505106122.
Imai, Kosuke and Michael Lingzhi Li (2025). ``Statistical Inference for Heterogeneous Treatment Effects Discovered by Generic Machine Learning in Randomized Experiments.'' Journal of Business & Economic Statistics, Vol. 43, No. 1, pp. 256-268.
Jia, Zeyang, Kosuke Imai, and Michael Lingzhi Li (2025). ``Cramming Contextual Bandits for On-policy Statistical Evaluation.''
Ben-Michael, Eli, Kosuke Imai, and Zhichao Jiang (2024). ``Policy Learning with Asymmetric Counterfactual Utilities.'' Journal of the American Statistical Association, Vol. 119, No. 548, pp. 3045-3058.
Li, Michael Lingzhi and Kosuke Imai (2024). ``Neyman Meets Causal Machine Learning: Experimental Evaluation of Individualized Treatment Rules.'' Journal of Causal Inference, Vol 12, No. 1, pp. 1-20. Special Issue on Neyman (1923) and its influences on causal inference
Imai, Kosuke and Zhichao Jiang (2023). ``Principal Fairness for Human and Algorithmic Decision-Making.'' Statistical Science, Vol. 38, No. 2 (July), pp317-328.
Imai, Kosuke and Michael Lingzhi Li (2023). ``Experimental Evaluation of Individualized Treatment Rules.'' Journal of the American Statistical Association, Vol. 118, No. 541, pp. 242-256.
Imai, Kosuke, Zhichao Jiang, D. James Greiner, Ryan Halen, and Sooahn Shin (2023). ``Experimental Evaluation of Algorithm-Assisted Human Decision-Making: Application to Pretrial Public Safety Assessment.'' (with discussion) Journal of the Royal Statistical Society, Series A (Statistics in Society), Vol. 186, No. 2 (April), pp. 167-189. Read before the Royal Statistical Society.
Imai, Kosuke, and Aaron Strauss (2011). ``Estimation of Heterogeneous Treatment Effects from Randomized Experiments, with Application to the Optimal Planning of the Get-out-the-vote Campaign.'' Political Analysis, Vol. 19, No. 1 (Winter), pp. 1-19. Winner of Political Analysis Editors' Choice Award.
© Kosuke Imai