Downloads
![Image representing the file: cwp351515.pdf](/sites/default/files/output_url_files/cwp351515.pdf_0.jpg)
cwp351515.pdf
PDF | 354.4 KB
Models with high-dimensional covariates arise frequently in economics and other fields. Often, only a few covariates have important effects on the dependent variable. When this happens, the model is said to be sparse. In applications, however, it is not known which covariates are important and which are not. This paper reviews methods for discriminating between important and unimportant covariates with particular attention given to methods that discriminate correctly with probability approaching 1 as the sample size increases. Methods are available for a wide variety of linear, nonlinear, semiparametric, and nonparametric models. The performance of some of these methods in finite samples is illustrated through Monte Carlo simulations and an empirical example.
Authors
![Person graphic](/sites/default/files/styles/square_desktop/public/2022-06/IFS-person-graphic.png?itok=hWCtTSrz)
Northwestern University
Working Paper details
- DOI
- 10.1920/wp.cem.2015.3515
- Publisher
- Institute for Fiscal Studies
Suggested citation
Horowitz, J. (2015). Variable selection and estimation in high-dimensional models. London: Institute for Fiscal Studies. Available at: https://ifs.org.uk/publications/variable-selection-and-estimation-high-dimensional-models (accessed: 30 June 2024).
More from IFS
Understand this issue
![State Pension claim form](/sites/default/files/styles/square_desktop/public/2023-12/state-pension-claim-form.jpg?itok=OCixJu9J)
Where next for the state pension?
13 December 2023
![Nice houses with city in the background](/sites/default/files/styles/square_desktop/public/2023-12/nice-houses-with-city-in-background_0.jpg?itok=TDx-TwSe)
Social mobility and wealth
12 December 2023
![Chancellor Jeremy Hunt with red box](/sites/default/files/styles/square_desktop/public/2023-12/chancellor-jeremy-hunt-with-red-box.jpg?itok=Dah5hdYC)
Autumn Statement 2023: IFS analysis
23 November 2023
Policy analysis
![Welsh town with mountains behind](/sites/default/files/styles/square_desktop/public/2024-06/Welsh-town-feature.jpg?itok=5axb5wZn)
How would the parties’ tax and spending plans affect Scotland and Wales?
28 June 2024
![Man putting vote into ballot box](/sites/default/files/styles/square_desktop/public/2022-07/Man-putting-vote-into-ballot-box.jpg?itok=Pa6g41dr)
General Election 2024: Manifesto Analysis Presentations
24 June 2024
![Shopping street](/sites/default/files/styles/square_desktop/public/2024-06/Street-scene-.jpg?itok=R39cR6Xp)
How do the last five years measure up on levelling up?
19 June 2024
Academic research
![Working paper cover](/sites/default/files/styles/portrait/public/2024-06/WP202428-The-impact-of%20labour-demand-shocks-when-occupational-labour-supplies-are-heterogeneous.jpg?itok=Erq9-V9O)
The impact of labour demand shocks when occupational labour supplies are heterogeneous
28 June 2024
![Working Paper Cover](/sites/default/files/styles/portrait/public/2024-06/WP202427-The-impact-of-flexibility-at-work-on-fertility_Page_01.jpg?itok=pHaEvbkK)
The impact of flexibility at work on fertility
11 June 2024
![Working Paper Cover](/sites/default/files/styles/portrait/public/2024-06/WP202426-Intergenerational-mobility-in-socio-emotional-skills_Page_01.jpg?itok=wH1znQhh)
Intergenerational mobility in socio-emotional skills
5 June 2024