What question did this study set out to answer?

The research aims to develop an optimal control method for multi-modular robot manipulators using nonzero-sum game theory.

March 19, 2026

Optimal Cooperative Control of Multi‐Modular Robot Manipulator Based on Adaptive Dynamic Programming With Experience Replay in Nonzero‐Sum Games

Key Points

The research aims to develop an optimal control method for multi-modular robot manipulators using nonzero-sum game theory.
Established system dynamics using the Newton-Euler iterative algorithm.
Allocated driving forces to modules through load distribution.
Formulated the control problem as a nonzero-sum game with each joint as a player.
Developed a radial basis function neural network for state observation.
Proposed a new weight-adjustment rule for neural networks utilizing experience replay.
Demonstrated the effectiveness of the proposed method through experiments.
Achieved ultimate uniform boundedness of closed-loop system errors as proved by Lyapunov theory.

Abstract

ABSTRACT This paper proposes an adaptive dynamic programming (ADP) method based on nonzero‐sum (NZS) game theory for the optimal cooperative control of a multi‐modular robot manipulator (MMRM). First, the system dynamics are established via the Newton‐Euler iterative algorithm, and load distribution is adopted to allocate driving forces to each module while maintaining force balance. The optimal cooperative control problem is then formulated as an NZS game, with each joint of the modular manipulators treated as a player. A radial basis function neural network (RBFNN)‐based state observer is constructed to estimate model unknowns. Moreover, a novel critic neural network weight‐adjustment rule that incorporates experience replay is proposed to relax the persistent excitation (PE) condition. Finally, Lyapunov theory proves the ultimate uniform boundedness (UUB) of the closed‐loop system errors, and experiments verify the method's effectiveness.

KI fragen

Bookmark