Path-Tracking Control for Intelligent Vehicles Based on SAC

In response to the deterioration of path-tracking accuracy and driving stability encountered by intelligent vehicles under dynamically varying operating conditions, a multi-objective optimization strategy integrating soft actor-critic (SAC) reinforcement learning with variable-parameter Model Predictive Control (MPC) is proposed in this paper to achieve online adaptive adjustment of path-tracking controller parameters. Based on a three-degree-of-freedom vehicle dynamics model, a linear time-varying (LTV) MPC controller is constructed to jointly optimize the front wheel steering angle. An SAC agent is developed utilizing the actor-critic framework, with a comprehensive reward function designed around tracking accuracy and control smoothness to enable online tuning of the MPC weighting matrices (lateral error weight, heading error weight, and steering control weight) as well as the prediction horizon parameter, thereby realizing adaptive balance between tracking accuracy and stability under different operating conditions. Based on the simulation results, it can be concluded that under normal operating conditions, the proposed integrated SAC-MPC control scheme demonstrates superior tracking performance, with the maximum absolute lateral error and mean lateral error reduced by 44.9% and 67.2%, respectively, and the maximum absolute heading error reduced by 23.5%. When the system operates under nonlinear conditions during the transitional phase, the proposed control scheme not only enhances tracking accuracy—evidenced by reductions of 43.4% and 23.8% in the maximum absolute lateral error and maximum absolute heading error, respectively—but also significantly improves system stability, as indicated by a 20.7% reduction in the sideslip angle at the center of gravity. Experimental validation further confirms these findings. The experimental results reveal that, compared with the fixed-parameter MPC, the maximum absolute value and mean value of the lateral error are reduced by approximately 36.2% and 78.1%, respectively; the maximum absolute heading angle error is decreased by 24.3%; the maximum absolute yaw rate is diminished by 19.6%; and the maximum absolute sideslip angle at the center of gravity is reduced by 30.8%.