Variable selection in linear models

Variable selection in linear models is essential for improved inference and interpretation, an activity which has become even more critical for high dimensional data. In this article, we provide a selective review of some classical methods including Akaike information criterion, Bayesian information criterion, Mallow's Cpand risk inflation criterion, as well as regularization methods including Lasso, bridge regression, smoothly clipped absolute deviation, minimax concave penalty, adaptive Lasso, elastic‐net, and group Lasso. We discuss how to select the penalty parameters. We also provide a review for some screening procedures for ultra high dimensions.WIREs Comput Stat2014, 6:1–9. doi: 10.1002/wics.1284 This article is categorized under: Statistical Models > Linear Models Statistical Learning and Exploratory Methods of the Data Sciences > Modeling Methods Statistical Models > Model Selection