Generalizing Experimental Results

Abstract

Experiments have come to be a widely accepted and highly regarded method for political science research. Randomization allows for well identified causal effects that are “internally valid” to the experimental setting. However, political scientists are driven by asking big questions with broad impacts, and we are rarely able to conduct the ideal experiment on a representative sample of the target population of interest. This leaves open the question–under what conditions can we make inferences about the effectiveness of treatment for a different population, one upon which we did not conduct our experiment. This problem of “external validity” has seen increased attention in statistics and the broader social sciences as researchers and policy makers wish to know the impact of interventions beyond the experimental sample. This chapter examines the assumptions researchers must make in order to generalize their experimental findings and the implications for how researchers should design experiments if they wish to maximize the generalizability of their findings.

Publication
Forthcoming. Advances in Experimental Political Science
Erin Hartman
Erin Hartman
Assistant Professor of
Political Science and Statistics

Related