FMCW LiDAR Nonlinearity Compensation Based on Deep Reinforcement Learning with Hybrid Prioritized Experience Replay

Frequency-modulated continuous-wave (FMCW) LiDAR systems are extensively utilized in industrial metrology, autonomous navigation, and geospatial sensing due to their high precision and resilience to interference. However, the intrinsic nonlinear dynamics of laser systems introduce significant distortion, adversely affecting measurement accuracy. Although conventional iterative pre-distortion correction methods can effectively mitigate nonlinearities, their long-term reliability is compromised by factors such as temperature-induced drift and component aging, necessitating periodic recalibration. In light of recent advances in artificial intelligence, deep reinforcement learning (DRL) has emerged as a promising approach to adaptive nonlinear compensation. By continuously interacting with the environment, DRL agents can dynamically modify correction strategies to accommodate evolving system behaviors. Nonetheless, existing DRL-based methods often exhibit limited adaptability in rapidly changing nonlinear contexts and are constrained by inefficient uniform experience replay mechanisms that fail to emphasize critical learning samples. To address these limitations, this study proposes an enhanced Soft Actor-Critic (SAC) algorithm incorporating a hybrid prioritized experience replay framework. The prioritization mechanism integrates modulation frequency (MF) error and temporal difference (TD) error, enabling the algorithm to dynamically reconcile short-term nonlinear perturbations with long-term optimization goals. Furthermore, a time-varying delayed experience (TDE) injection strategy is introduced, which adaptively modulates data storage intervals based on the rate of change in modulation frequency error, thereby improving data relevance, enhancing sample diversity, and increasing training efficiency. Experimental validation demonstrates that the proposed method achieves superior convergence speed and stability in nonlinear correction tasks for FMCW LiDAR systems. The residual nonlinearity of the upward and downward frequency sweeps was reduced to 1.869×10−5 and 1.9411×10−5, respectively, with a spatial resolution of 0.0203m. These results underscore the effectiveness of the proposed approach in advancing intelligent calibration methodologies for LiDAR systems and highlight its potential for broad application in high-precision measurement domains.