A growing literature on inference in difference-in-differences (DiD) designs has been pessimistic about obtaining hypothesis tests of the correct size, particularly with few groups. We provide Monte Carlo evidence for four points: (i) it is possible to obtain tests of the correct size even with few groups, and in many settings very straightforward methods will achieve this; (ii) the main problem in DiD designs with grouped errors is instead low power to detect real effects; (iii) feasible GLS estimation combined with robust inference can increase power considerably whilst maintaining correct test size – again, even with few groups, and (iv) using OLS with robust inference can lead to a perverse relationship between power and panel length.
Authors


Research Fellow University of Michigan
Tom is a Research Fellow at IFS, a Research Professor for the Institute for Social Research at the University of Michigan.

Journal article details
- DOI
- 10.1515/jem-2017-0005
- Publisher
- De Gruyter
- JEL
- C12; C13; C21
- Issue
- October 2017
Suggested citation
Brewer, M., Crossley, T., and Joyce, R. (2017), 'Inference with difference-in-differences revisited' https://doi.org/10.1515/jem-2017-0005
More from IFS
Understand this issue

Gender norms, violence and adolescent girls’ trajectories: Evidence from India
24 October 2022

Paul Johnson’s final episode: big challenges ahead for the UK economy
In Paul's final episode, he speaks with incoming IFS Director Helen Miller about the big economic pressures facing the UK.
9 July 2025

How could government help people manage their pension pots?
We explore options for how government could help people manage their pension pots in retirement.
5 July 2025
Policy analysis

Which places have the highest standard of living?
Measuring living standards using average household spending gives a starkly different picture of regional inequalities than using average income.
11 April 2025

IFS Deputy Director Carl Emmerson appointed to the UK Statistics Authority Methodological Assurance Review Panel
14 April 2023

The role of changing health in rising health-related benefit claims
Is the working-age population less healthy since the pandemic? What role is changing health playing in rising health-related benefit claims?
12 March 2025
Academic research

Using tax records to correct for under-representation of top income sources in surveys
We show that the survey correction method of Blanchet, Flores and Morgan (2022) can fail to correct its structure by components.
6 May 2025

Estimating intra-household sharing from time-use data
Estimating intra-household sharing is crucial to understanding overall inequality. However, expenditure data is almost always at the household level.
2 May 2025

Focal pricing constraints and pass-through of input cost changes
I show that the adoption and extent of focal pricing practices in an industry in general do not lower average pass-through of input cost changes.
2 May 2025