Answers are grounded in this paper and cite their sources.
Reinforcement learning (RL) holds promise for the automated control of satellite orbits and the avoidance of spatial obstacles due to its ability to learn and adapt to dynamic environments through interaction, enabling autonomous, real-time decision-making for orbit adjustments. Satellite orbit control tasks manifest strong nonlinear characteristics, for which algorithms grounded on neural networks are more adept at handling. However, RL methods based on neural networks, which are highly nonconvex and nonsmooth functions, sometimes yield extreme action values that are not conducive to the orbit-constrained task at hand. In addition, in practical satellite task environments, limited observability is often faced. This limited observability not only increases the complexity of the algorithm but also affects the efficiency of identifying appropriate actions. To address this issue, we introduce a hierarchical parameterization mechanism to accelerate the search for appropriate actions. Hence, we introduce the integration of self-attention mechanisms with the Kalman filter into RL frameworks to accommodate scenarios with limited observability. Experimental results demonstrate a marked increase in the success rate of automated evasion maneuvers in environments with limited observability and orbital constraints, when facing pursuing satellites. Then, we performed a comparative analysis, applying Lambert guidance and RL-based guidance as control strategies for powerful confinement environment to validate our algorithm’s robustness.
No takes yet. Share an insight, caveat, or question.
A 2026 study studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: