Abstract:This paper presents a study on path planning for 6-DOF free-floating space robotic manipulators using Deep Deterministic Policy Gradient-based Reinforcement Learning. The focus is the development of a novel reward function tailored to address critical requirements for efficient and effective manipulation in space. These requirements include accurate pose alignment between the end-effector and the target, collision avoidance with both the target and other links of the manipulator, smoothing of joint velocities, adaptability to strong dynamic coupling between the manipulator and its base spacecraft due to high manipulator-spacecraft mass ratio, and resilience to noise in the state observations. Uniquely, the proposed reward function employs quaternions for orientation control to reduce pose misalignments and dynamic singularities, as opposed to traditional Euler angles. Our findings demonstrate that the Reinforcement Learning algorithm, when guided by this new reward function that integrates these enhancements and constraints, not only achieves the desired path planning objectives more efficiently but also exhibits faster convergence. Furthermore, the Reinforcement Learning successfully manages significant dynamic coupling effects caused by a high mass ratio between the robotic manipulator and the base spacecraft. Even under the challenge of noisy state observations, the trained agent successfully completes the path planning task, proving the Reinforcement Learning's applicability to real-space mission designs where the noise in observation is inevitable. The study highlights the critical role of reward function design in the Reinforcement Learning training process and its consequential impact on the solution quality, providing a solid foundation for future advancements in free-floating space robotic missions.

Adaptive Reactionless Control Strategy Via the PSO-ELM Algorithm for Free-Floating Space Robots During Manipulation of Unknown Objects

ESO-based Robust Predictive Control of Lunar Module with Fuel Sloshing Dynamics

Model-Based Robot Learning Control with Uncertainty Directed Exploration

Reinforcement learning strategy for spacecraft attitude hyperagile tracking control with uncertainties

Adaptive Zero Reaction Motion Control for Free-Floating Space Manipulators

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

The Cartesian Path Planning of Free-Floating Space Robot Using Particle Swarm Optimization

Collision-Free Optimal Trajectory for a Controlled Floating Space Robot

A Multi-Target Trajectory Planning of a 6-Dof Free-Floating Space Robot Via Reinforcement Learning

Trajectory Optimization and Tracking Control of Free-flying Space Robots for Capturing Non-cooperative Tumbling Objects

A Learning System for Motion Planning of Free-Float Dual-Arm Space Manipulator towards Non-Cooperative Object

Study on Non-holonomic Cartesian Path Planning of a Free-Floating Space Robotic System.

Reinforcement learning for path planning of free-floating space robotic manipulator with collision avoidance and observation noise

Optimal Predefined-time Trajectory Planning for a Free-floating Space Robot

An improve nonlinear robust control approach for robotic manipulators with PSO-based global optimization strategy

Path Planning of 6-DOF Free-Floating Space Robotic Manipulators Using Reinforcement Learning

Deep Koopman-Operator-Based Model Predictive Control for Free-Floating Space Robots with Disturbance Observer

Adaptive Reaction Null-Space Control of Dual-Arm Space Robot for Post-Capture of Non-Cooperative Target

Region of Attraction Estimation for Free-Floating Systems under Time-Varying LQR Control

Reinforcement learning in dual-arm trajectory planning for a free-floating space robot

[Cortical necrosis of the kidney].