Downloads

cwp351515.pdf
PDF | 354.4 KB
Models with high-dimensional covariates arise frequently in economics and other fields. Often, only a few covariates have important effects on the dependent variable. When this happens, the model is said to be sparse. In applications, however, it is not known which covariates are important and which are not. This paper reviews methods for discriminating between important and unimportant covariates with particular attention given to methods that discriminate correctly with probability approaching 1 as the sample size increases. Methods are available for a wide variety of linear, nonlinear, semiparametric, and nonparametric models. The performance of some of these methods in finite samples is illustrated through Monte Carlo simulations and an empirical example.
Authors

Northwestern University
Working Paper details
- DOI
- 10.1920/wp.cem.2015.3515
- Publisher
- Institute for Fiscal Studies
Suggested citation
Horowitz, J. (2015). Variable selection and estimation in high-dimensional models. London: Institute for Fiscal Studies. Available at: https://ifs.org.uk/publications/variable-selection-and-estimation-high-dimensional-models (accessed: 23 May 2025).
More from IFS
Understand this issue

Where next for the state pension?
13 December 2023

Social mobility and wealth
IFS researchers shared findings from ESRC-funded research on social mobility and its drivers.
12 December 2023

Autumn Statement 2023: IFS analysis
23 November 2023
Policy analysis

The short- and medium-term effects of Sure Start on children’s outcomes
An evaluation of Sure Start’s impacts on education, health, absences, special educational needs, crime and social care, plus a cost–benefit analysis.
22 May 2025

The relationship between NHS waiting lists and health-related benefit claims
Have increases in NHS waiting lists and waiting times contributed to the growing number of people claiming working-age health-related benefits?
2 May 2025

Can the government achieve its 18-week elective waiting time target?
Simulation modelling of NHS elective waiting times in England shows that the government’s 18-week target is unlikely to be met in this parliament.
20 March 2025
Academic research

Female genital cutting and the slave trade
We investigate the historical origins of female genital cutting (FGC) and how FGC is associated with the Red Sea route of the African slave trade.
10 May 2025

The health effects of universal early childhood interventions: evidence from Sure Start
We estimate the health impacts of Sure Start, a universal integrated ECI in England, from infancy to adolescence.
9 May 2025

Measuring cost of living inequality during an inflation surge
We provide new evidence that inflation inequality surged during the 2021–2023 cost-of living crisis.
9 May 2025