Simulated Annealing Algorithm Based Ridge Estimator

Multicollinearity is a significant problem in multiple linear regression. Different researchers have suggested biased estimators as a possible solution to address the issue of multicollinearity, and an example of a biased estimator is the ridge regression estimator. Estimating the bias parameter is an essential problem for the ridge regression estimator. This paper presents a new solution method that utilizes simulated annealing optimization to determine the optimal bias parameter as an alternative to the ridge regression bias value proposed by Hoerl and Kennard. We obtained the bias parameter estimation values using the proposed solution method, considering various dependency structures, sample sizes, variance, and number of variables.