A Human–Robot Skill Transfer Strategy with Task-Constrained Optimization and Real-Time Whole-Body Adaptation

This is the authors' abstract. We don't add key points for this paper.

Human–robot skill transfer enables robots to learn skills from humans and adapt to new task-constrained scenarios. During task execution, robots are expected to react in real-time to unforeseen dynamic obstacles. This paper proposes an integrated human–robot skill transfer strategy with offline task-constrained optimization and real-time whole-body adaptation. Specifically, we develop the via-point trajectory generalization method to learn from only one human demonstration. To incrementally incorporate multiple human skill variations, we encode initial distributions for each skill with Joint Probabilistic Movement Primitives (ProMPs) by generalizing the template trajectory with discrete via-points and deriving corresponding inverse kinematics (IK) solutions. Given initial Joint ProMPs, we develop an effective constrained optimization method to incorporate task constraints in Joint and Cartesian space analytically to a unified probabilistic framework. A double-loop gradient descent-ascent algorithm is performed with the optimized ProMPs directly utilized for task execution. During task execution, we propose an improved real-time adaptive control method for robot whole-body movement adaptation. We develop the Dynamical System Modulation (DSM) method to modulate the robot end-effector through iterations in real-time and improve the real-time null space velocity control method to ensure collision-free joint configurations for the robot non-end-effector. We validate the proposed strategy with a 7-DoF Xarm robot on a series of offline and real-time movement adaptation experiments.