Downloads

cwp351515.pdf
PDF | 354.4 KB
Models with high-dimensional covariates arise frequently in economics and other fields. Often, only a few covariates have important effects on the dependent variable. When this happens, the model is said to be sparse. In applications, however, it is not known which covariates are important and which are not. This paper reviews methods for discriminating between important and unimportant covariates with particular attention given to methods that discriminate correctly with probability approaching 1 as the sample size increases. Methods are available for a wide variety of linear, nonlinear, semiparametric, and nonparametric models. The performance of some of these methods in finite samples is illustrated through Monte Carlo simulations and an empirical example.
Authors

Northwestern University
Working Paper details
- DOI
- 10.1920/wp.cem.2015.3515
- Publisher
- Institute for Fiscal Studies
Suggested citation
Horowitz, J. (2015). Variable selection and estimation in high-dimensional models. London: Institute for Fiscal Studies. Available at: https://ifs.org.uk/publications/variable-selection-and-estimation-high-dimensional-models (accessed: 8 February 2025).
More from IFS
Understand this issue

Where next for the state pension?
13 December 2023

Social mobility and wealth
IFS researchers shared findings from ESRC-funded research on social mobility and its drivers.
12 December 2023

Autumn Statement 2023: IFS analysis
23 November 2023
Policy analysis

Ethnic differences in private pension participation after automatic enrolment
What are the drivers of ethnic gaps in private pension participation rates and what consequences will these gaps have for future retirement incomes?
23 January 2025

Exposure to air pollution in England, 2003–23
We set out how air pollution (PM2.5) has changed across England and explore inequalities by ethnicity, income deprivation, region and age.
6 December 2024

The effect of Sure Start on youth misbehaviour, crime and contacts with children’s social care
This report studies the impact of Sure Start, which supported families of under-5s, on children’s behaviour, youth offending and social care contacts.
23 October 2024
Academic research

The determinants of local housing supply in England
We estimate local housing supply elasticities for 325 local authorities and 6,788 census tract areas in England.
4 February 2025

The welfare effects of price shocks and household relief packages: Evidence from the European Energy Crisis
How should governments respond to rapid increases in the cost of living driven by shocks to the prices of staple goods?
31 January 2025

A neyman-orthogonalization approach to the incidental parameter problem
31 January 2025