Abstract:The increasing number of defunct and fragmented spacecraft poses a growing hazard to existing onorbit assets. The redundant continuum manipulator with high flexibility provides dual-arm robotic systems with apparent advantages in active debris removal missions in space. Existing autonomously-coordinated control approaches for dual-arm continuum manipulators require a real-time inverse kinematic solution and a security assurance mechanism for possible collisions, which are difficult to upscale for space debris capture systems with high-speed maneuverability. In this paper, we consider collision avoidance and input saturation control in proposing a multiagent reinforcement learning approach, named the multiagent twin delayed deep deterministic policy gradient (MATD3), to generate a real-time inverse kinematic solution for coordinated manipulators. During the training process, the MATD3 algorithm performs lower overestimation than the multiagent deep deterministic policy gradient (MADDPG) algorithm. Then, a feedback dynamics controller is designed for the continuum manipulators. Under the guidance of the policy networks, each agent can schedule the joint trajectory design online according to the collaborator and target debris information. During the capture operation, a competitive mechanism for the anticollision function is developed through reasonable reward functions to maintain dual arms at a safe distance. Simulation results show that the average accuracy of the proposed approach is 42% higher than that of MADDPG in inverse kinematic trajectory planning. The designed integrated tracking controller can effectively perform capture missions in the simulation environment. Multiagent reinforcement learning shows promise for future onorbit servicing missions.

Reinforcement Learning Compensated Coordination Control of Multiple Mobile Manipulators for Tight Cooperation

Dynamical Obstacle Avoidance of Task- Constrained Mobile Manipulation Using Model Predictive Control

Learning Robust Skills for Tightly Coordinated Arms in Contact-Rich Tasks

Reinforcement Learning Control for Coordinated Manipulation of Multi-Robots.

Improved Reinforcement Learning Coordinated Control of a Mobile Manipulator using Joint Clamping

Brief paper: Adaptive robust coordinated control of multiple mobile manipulators interacting with rigid environments

Adaptive Compliant Force-Motion Control of Coordinated Non-Holonomic Mobile Manipulators Interacting with Unknown Non-Rigid Environments

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Adaptive neural-fuzzy control of uncertain constrained multiple coordinated nonholonomic mobile manipulators

The Cooperation Control of Multiple Robotic Manipulators with Disturbance Observers

Liberating Humanity from Heavy Labor: Dual-Arm Coordination and Teleoperation Control for an Assistive Robot

Multi-target Approaching Control of Hyper-redundant Manipulators Using Reinforcement Learning

Distributed Cooperative Control of Redundant Mobile Manipulators With Safety Constraints

Design of a coordinated control strategy for multi-mobile-manipulator cooperative teleoperation system

Cooperative Transportation Control of Multiple Mobile Manipulators Through Distributed Optimization

Coordinated Control Based on Reinforcement Learning for Dual-Arm Continuum Manipulators in Space Capture Missions

Hybrid Adaptive Impedance-Leader-follower Control for Multi-Arm Coordination Manipulators

Coordinated Motion Control of Mobile Self-Reconfigurable Robots in Virtual Rigid Framework

Continuous Multi-Target Approaching Control of Hyper-Redundant Manipulators Based on Reinforcement Learning

Adaptive Tracking Control of Coordinated Nonholonomic Mobile Manipulators

Optimized leader‐follower consensus control using combination of reinforcement learning and sliding mode mechanism for multiple robot manipulator system