Abstract

This paper introduces the largest and most comprehensive dataset of US presidential campaign television advertisements, available in digital format. The dataset also includes machine-searchable transcripts and high-quality summaries designed to facilitate a variety of academic research. To date, there has been great interest in collecting and analyzing US presidential campaign advertisements, but the need for manual procurement and annotation led many to rely on smaller subsets. We design a large-scale parallelized, AI-based analysis pipeline that automates the laborious process of preparing, transcribing, and summarizing videos. We then apply this methodology to the 9,707 presidential ads from the Julian P. Kanter Political Commercial Archive. We conduct extensive human evaluations to show that these transcripts and summaries match the quality of manually generated alternatives. We illustrate the value of this data by including an application that tracks the genesis and evolution of current focal issue areas over seven decades of presidential elections. Our analysis pipeline and codebase also show how to use LLM-based tools to obtain high-quality summaries for other video datasets.

Replication Archive

https://doi.org/10.7910/DVN/Q0AR94

Related Papers

Imai, Kosuke and Kentaro Nakamura ``Causal Inference with Generative Artificial Intelligence: Application to Texts as Treatments.'' Journal of the American Statistical Association, Forthcoming.

Imai, Kosuke and Kentaro Nakamura (2026). ``Leveraging generative AI for causal inference with unstructured data.'' Proceedings of the National Academy of Sciences, Vol. 123, No. 36, e2530532123.

Nakamura, Kentaro, Adam Breuer, Michael H. Crespin, Bryce J. Dietrich, and Kosuke Imai (2026). ``Causal Inference with Video Features as Treatments.''

Nakamura, Kentaro and Kosuke Imai (2026). ``GenAI Powered Dynamic Causal Inference with Unstructured Data.''

Dasanaike, Noah and Kosuke Imai (2026). ``Using Embedding Models to Improve Probabilistic Race Prediction.''

Shi, Wenqi, Kosuke Imai, and Yi Zhang (2026). ``Privacy-preserving Meta-analysis through Low-Rank Basis Hunting.''

Li, Michael Lingzhi and Kosuke Imai (2025). ``Statistical Performance Guarantee for Subgroup Identification with Generic Machine Learning.''

Goplerud, Max, Kosuke Imai, Nicole E. Pashley (2025). ``Estimating Heterogeneous Causal Effects of High-Dimensional Treatments: Application to Conjoint Analysis.'' Annals of Applied Statistics, Vol. 19, No. 2 (June), pp. 866-888.

Imai, Kosuke and Michael Lingzhi Li (2025). ``Statistical Inference for Heterogeneous Treatment Effects Discovered by Generic Machine Learning in Randomized Experiments.'' Journal of Business & Economic Statistics, Vol. 43, No. 1, pp. 256-268.

Jia, Zeyang, Kosuke Imai, and Michael Lingzhi Li (2025). ``Cramming Contextual Bandits for On-policy Statistical Evaluation.''

Zhang, Yi and Kosuke Imai (2025). ``Individualized Policy Evaluation and Learning under Clustered Network Interference.''

Zhang, Yi, Melody Huang, and Kosuke Imai (2024). ``Minimax Regret Estimation for Generalizing Heterogeneous Treatment Effects with Multisite Data.''

Ham, Dae Woong, Kosuke Imai, and Lucas Janson (2024). ``Using Machine Learning to Test Causal Hypotheses in Conjoint Analysis.'' Political Analysis, Vol. 32, No. 3 (July), pp. 329-344.

Li, Michael Lingzhi and Kosuke Imai (2024). ``Neyman Meets Causal Machine Learning: Experimental Evaluation of Individualized Treatment Rules.'' Journal of Causal Inference, Vol 12, No. 1, pp. 1-20. Special Issue on Neyman (1923) and its influences on causal inference

Eshima, Shusei, Kosuke Imai, and Tomoya Sasaki (2024). ``Keyword-Assisted Topic Models.'' American Journal of Political Science, Vol. 68, No. 2 (April), pp. 730-750.

Tarr, Alexander, June Hwang, and Kosuke Imai (2023). ``Automated Coding of Political Campaign Advertisement Videos: An Empirical Validation Study.'' Political Analysis, Vol. 31, No. 4 (October), pp. 554-574.

Imai, Kosuke and Michael Lingzhi Li (2023). ``Experimental Evaluation of Individualized Treatment Rules.'' Journal of the American Statistical Association, Vol. 118, No. 541, pp. 242-256.

Ning, Yang, Sida Peng, and Kosuke Imai (2020). ``Robust Estimation of Causal Effects via High-Dimensional Covariate Balancing Propensity Score.'' Biometrika, Vol. 107, No. 3 (September), pp. 533-554.

Kim, In Song, Steven Liao, and Kosuke Imai (2020). ``Measuring Trade Profile with Granular Product-level Trade Data.'' American Journal of Political Science, Vol. 64, No. 1 (January), pp. 102-117.

Egami, Naoki, and Kosuke Imai (2019). ``Causal Interaction in Factorial Experiments: Application to Conjoint Analysis.'' Journal of the American Statistical Association, Vol. 114, No. 526 (June), pp. 529-540.

Svyatkovskiy, Alexey, Kosuke Imai, Mary Kroeger, and Yuki Shiraito (2016). ``Large-scale text processing pipeline with Apache Spark.'' IEEE International Conference on Big Data, Washington, DC, pp. 3928-3935.

Imai, Kosuke and Marc Ratkovic (2013). ``Estimating Treatment Effect Heterogeneity in Randomized Program Evaluation.'' Annals of Applied Statistics, Vol. 7, No. 1 (March), pp. 443-470. Winner of the Tom Ten Have Memorial Award. Reprinted in Advances in Political Methodology, R. Franzese, Jr. ed., Edward Elger, 2017.

Imai, Kosuke, and Aaron Strauss (2011). ``Estimation of Heterogeneous Treatment Effects from Randomized Experiments, with Application to the Optimal Planning of the Get-out-the-vote Campaign.'' Political Analysis, Vol. 19, No. 1 (Winter), pp. 1-19. Winner of Political Analysis Editors' Choice Award.