Abstract:The increasing number of defunct and fragmented spacecraft poses a growing hazard to existing onorbit assets. The redundant continuum manipulator with high flexibility provides dual-arm robotic systems with apparent advantages in active debris removal missions in space. Existing autonomously-coordinated control approaches for dual-arm continuum manipulators require a real-time inverse kinematic solution and a security assurance mechanism for possible collisions, which are difficult to upscale for space debris capture systems with high-speed maneuverability. In this paper, we consider collision avoidance and input saturation control in proposing a multiagent reinforcement learning approach, named the multiagent twin delayed deep deterministic policy gradient (MATD3), to generate a real-time inverse kinematic solution for coordinated manipulators. During the training process, the MATD3 algorithm performs lower overestimation than the multiagent deep deterministic policy gradient (MADDPG) algorithm. Then, a feedback dynamics controller is designed for the continuum manipulators. Under the guidance of the policy networks, each agent can schedule the joint trajectory design online according to the collaborator and target debris information. During the capture operation, a competitive mechanism for the anticollision function is developed through reasonable reward functions to maintain dual arms at a safe distance. Simulation results show that the average accuracy of the proposed approach is 42% higher than that of MADDPG in inverse kinematic trajectory planning. The designed integrated tracking controller can effectively perform capture missions in the simulation environment. Multiagent reinforcement learning shows promise for future onorbit servicing missions.

Collaborative Load Transportation in Microgravity Environments: Centralized and Decentralized Predictive Controllers

Cooperative Distributed Predictive Control for Collision-Free Vehicle Platoons

Distributed Model Predictive Control for Vehicle Platoon With Mixed Disturbances and Model Uncertainties

Dynamical Obstacle Avoidance of Task- Constrained Mobile Manipulation Using Model Predictive Control

Decentralized Adaptive Aerospace Transportation of Unknown Loads Using A Team of Robots

Decentralized Ability-Aware Adaptive Control for Multi-robot Collaborative Manipulation

Distributed Collaborative Control of Multi-Vehicle Autonomous Cooperative Transportation Systems: A Hierarchical Constraint-Following Approach

Communication-Free Decentralized Controller Design for Flexible Object Transport

Distributed Optimal Control Framework for High-Speed Convoys: Theory and Hardware Results

Coordinated Control Based on Reinforcement Learning for Dual-Arm Continuum Manipulators in Space Capture Missions

Hierarchical Adaptive Motion Planning with Nonlinear Model Predictive Control for Safety-Critical Collaborative Loco-Manipulation

Adaptive Controller Based on Spatial Disturbance Observer in a Microgravity Environment.

Learning Decentralized Multi-Biped Control for Payload Transport

Efficient Optimization-based Cable Force Allocation for Geometric Control of a Multirotor Team Transporting a Payload

Aerial Transportation Control of Suspended Payloads with Multiple Agents

Online Weight-adaptive Nonlinear Model Predictive Control

Automated Layout Design and Control of Robust Cooperative Grasped-Load Aerial Transportation Systems

Safety-critical Motion Planning for Collaborative Legged Loco-Manipulation over Discrete Terrain

Coordinated Transport by Dual Humanoid Robots Using Distributed Model Predictive Control