Abstract:The increasing number of defunct and fragmented spacecraft poses a growing hazard to existing onorbit assets. The redundant continuum manipulator with high flexibility provides dual-arm robotic systems with apparent advantages in active debris removal missions in space. Existing autonomously-coordinated control approaches for dual-arm continuum manipulators require a real-time inverse kinematic solution and a security assurance mechanism for possible collisions, which are difficult to upscale for space debris capture systems with high-speed maneuverability. In this paper, we consider collision avoidance and input saturation control in proposing a multiagent reinforcement learning approach, named the multiagent twin delayed deep deterministic policy gradient (MATD3), to generate a real-time inverse kinematic solution for coordinated manipulators. During the training process, the MATD3 algorithm performs lower overestimation than the multiagent deep deterministic policy gradient (MADDPG) algorithm. Then, a feedback dynamics controller is designed for the continuum manipulators. Under the guidance of the policy networks, each agent can schedule the joint trajectory design online according to the collaborator and target debris information. During the capture operation, a competitive mechanism for the anticollision function is developed through reasonable reward functions to maintain dual arms at a safe distance. Simulation results show that the average accuracy of the proposed approach is 42% higher than that of MADDPG in inverse kinematic trajectory planning. The designed integrated tracking controller can effectively perform capture missions in the simulation environment. Multiagent reinforcement learning shows promise for future onorbit servicing missions.

Reinforcement Learning Control for Coordinated Manipulation of Multi-Robots.

Learning Robust Skills for Tightly Coordinated Arms in Contact-Rich Tasks

Local Multi-Robot Coordination and Experiments

Liberating Humanity from Heavy Labor: Dual-Arm Coordination and Teleoperation Control for an Assistive Robot

Decentralized Ability-Aware Adaptive Control for Multi-robot Collaborative Manipulation

Brief paper: Adaptive robust coordinated control of multiple mobile manipulators interacting with rigid environments

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Optimized leader‐follower consensus control using combination of reinforcement learning and sliding mode mechanism for multiple robot manipulator system

Collaborative motion planning for multi-manipulator systems through Reinforcement Learning and Dynamic Movement Primitives

Trajectory coordination for a cooperative multi-manipulator system and dynamic simulation error analysis

Multi-target Approaching Control of Hyper-redundant Manipulators Using Reinforcement Learning

Coordinated Control Based on Reinforcement Learning for Dual-Arm Continuum Manipulators in Space Capture Missions

Abstractions and Algorithms for Cooperative Multiple Robot Planar Manipulation.

Coordinated Resolved Motion Control of Dual-Arm Manipulators with Closed Chain

Improved Reinforcement Learning Coordinated Control of a Mobile Manipulator using Joint Clamping

Cooperative Distributed Model Predictive Control for Robot In-Hand Manipulation

Reinforcement Learning for Human-Robot Shared Control

Adaptive Optimal Control For Coordination In Physical Human-Robot Interaction

Proactive Robot Control for Collaborative Manipulation Using Human Intent

Distributed Coordination of Networked Manipulators: A Two-Layer Control Scheme

Hierarchical Adaptive Control for Collaborative Manipulation of a Rigid Object by Quadrupedal Robots