Answers are grounded in this paper and cite their sources.
This study investigates the integration of reinforcement learning (RL) with Model Reference Adaptive Control (MRAC) to improve pitch-axis tracking of an aerial platform operating under nonlinear dynamics and external disturbances. A hybrid RL-MRAC framework is developed by augmenting a conventional linear MRAC controller with a bounded, online reinforcement-learning component based on SARSA-inspired temporal-difference learning. The proposed approach learns corrective control actions without requiring prior offline training or explicit knowledge of the plant’s nonlinear dynamics. A Lyapunov-based stability analysis is presented to characterize the tracking behavior under bounded uncertainties and specified adaptive-parameter assumptions. The proposed controller is evaluated through MATLAB simulations and compared with conventional Linear-MRAC, Nonlinear-MRAC, and radial basis function neural-network MRAC. The evaluation considers multiple reference trajectories, external disturbances, nonlinear parameter variations, measurement noise, and actuator constraints. Simulation results demonstrate that RL-MRAC can improve tracking performance under selected operating conditions. In the representative sinusoidal-disturbance case, the proposed controller achieves reductions of 3.64% in integral absolute error and 6.05% in integral time-weighted absolute error compared with Linear-MRAC. However, repeated simulations reveal that the improvements are dependent on the operating conditions and are accompanied by increased control-input variation. These findings demonstrate the potential of bounded residual reinforcement learning as an adaptive compensation strategy while highlighting the importance of learning design, robustness, and actuator limitations in practical applications.
No takes yet. Share an insight, caveat, or question.
Elembaby et al. (2026) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: