PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 1, 1980Journal of the American Statistical Association217 citations

A Critique of Some Ridge Regression Methods

View Full Paper
GSGary SmithSpringer Nature (Germany)FCFrank W. CampbellWest Texas A&M University

Key Points

  • This critique aims to examine the limitations and assumptions inherent in ridge regression methods.
  • Analyzed ridge regression techniques in the context of multicollinearity and least squares estimates.
  • Evaluated the implications of shrinking estimates toward zero and their impact on coefficient accuracy.
  • Assessed the effects of improper labeling of data and reliance on ad hoc pseudoinformation.
  • Ridge regression retains inadequacies similar to those it aims to correct, particularly regarding coefficient estimation.
  • Linear transformations often incorrectly influence the model's implicit estimates.
  • Mislabeling data as weak reflects a misunderstanding of nonorthogonal data properties.

Abstract

Abstract Ridge estimates seem motivated by a belief that least squares estimates tend to be too large, particularly when there is multicollinearity. The ridge solution is to supplement the data by stochastically shrinking the estimates toward zero. Although flexibility is provided by the abstention from exact exclusion restrictions, ridge regression retains many weaknesses of similarly motivated procedures : a neglect of the basic fact that linear transformations should not change the implicit estimates of a model's coefficients, an incorrect labeling of nonorthogonal data as weak, and a loose representation of a priori beliefs and reliance at times on ad hoc pseudoinformation.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Smith et al. (1980) studied this question.

synapsesocial.com/papers/6a10043890ecb39bf65fbf9dhttps://doi.org/10.1080/01621459.1980.10477428
Ask AI
Helpful
Bookmark
Share
View Full Paper

Also Consider

Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context:

  1. 1Shrinkage Approaches for Ridge-Type Estimators Under Multicollinearity2025 · 1 citations
  2. 2Improved ridge estimation approach to address overfitting: Simulation and financial data analysis2026
  3. 3Improved Data-Driven Shrinkage Estimators for Regression Models Under Severe Multicollinearity2026
  4. 4An Improved Beta Ridge-Type Estimator For Regression Problem2024
  5. 5Generalized Ridge Regression: Biased Estimation for Multiple Linear Regression Models2024