Bernard Black from Northwestern, Pritzer School of Law and Kellog School of Management
"The Road to False Positives: Evidence for Specification Search in Studies of Reg SHO” (with Hemang Desai, Kate Litvak, Woongsun Yoo, and Jeff Jiewei Yu)
Abstract: We provide evidence of specification search by reexamining results from 10 studies of an SEC randomized experiment (Reg SHO) that report evidence for a wide variety of indirect effects of the experiment, despite no evidence for a causal channel for these effects. Using either a simple, pre-specified research design or best-match specifications (which follow the sample and specification choices reported in the respective papers) we obtain null results, while reported results are mostly significant. This suggests that these papers made unreported specification choices, which produced significance. Evidence from Binomial and Kolmogorov-Smirnov tests is consistent with reported results reflecting specification search.
26
November 2026