Abstract:This paper presents a study on path planning for 6-DOF free-floating space robotic manipulators using Deep Deterministic Policy Gradient-based Reinforcement Learning. The focus is the development of a novel reward function tailored to address critical requirements for efficient and effective manipulation in space. These requirements include accurate pose alignment between the end-effector and the target, collision avoidance with both the target and other links of the manipulator, smoothing of joint velocities, adaptability to strong dynamic coupling between the manipulator and its base spacecraft due to high manipulator-spacecraft mass ratio, and resilience to noise in the state observations. Uniquely, the proposed reward function employs quaternions for orientation control to reduce pose misalignments and dynamic singularities, as opposed to traditional Euler angles. Our findings demonstrate that the Reinforcement Learning algorithm, when guided by this new reward function that integrates these enhancements and constraints, not only achieves the desired path planning objectives more efficiently but also exhibits faster convergence. Furthermore, the Reinforcement Learning successfully manages significant dynamic coupling effects caused by a high mass ratio between the robotic manipulator and the base spacecraft. Even under the challenge of noisy state observations, the trained agent successfully completes the path planning task, proving the Reinforcement Learning's applicability to real-space mission designs where the noise in observation is inevitable. The study highlights the critical role of reward function design in the Reinforcement Learning training process and its consequential impact on the solution quality, providing a solid foundation for future advancements in free-floating space robotic missions.

Deep Learning with Fractional Order Operaters Lagrangian Method for Space Robot based on Sliding Mode-based Fixed-time Control

Dynamics-based deep learning and fractional-order fixed-time sliding mode control for space robot impedance system

Adaptive Control of Mini Space Robot Based on Linear Separation of Inertial Parameters

Variable Force Tracking Control Via Online Learning

Open-Loop Motion Control of a Hydraulic Soft Robotic Arm Using Deep Reinforcement Learning

Dynamic Modeling of Robotic Manipulator Via an Augmented Deep Lagrangian Network

Deep Koopman-Operator-Based Model Predictive Control for Free-Floating Space Robots with Disturbance Observer

Impedance Control of Space Manipulator Based on Deep Reinforcement Learning

Trajectory Planning for Teleoperated Space Manipulators Using Deep Reinforcement Learning

Data-Driven Optimal Control of Tethered Space Robot Deployment with Learning Based Koopman Operator

Deep reinforcement learning with reward shaping for tracking control and vibration suppression of flexible link manipulator

Fuzzy Approximate Learning-Based Sliding Mode Control for Deploying Tethered Space Robot

Design and Simulation Analysis of Trajectory Planning Algorithm for 6-DoF Manipulator Based on Deep Learning

Adaptive sliding mode control of robotic manipulator based on reinforcement learning

Time-Delay Sliding Mode Control for Trajectory Tracking of Robot Manipulators

Deep Learning Aided Dynamic Parameter Identification of 6-DOF Robot Manipulators

Controller Design for a Delta Robot Using Lagrangian Multipliers

Path Planning of 6-DOF Free-Floating Space Robotic Manipulators Using Reinforcement Learning

Trajectory Tracking of Delta Parallel Robot via Adaptive Backstepping Fractional-Order Non-Singular Sliding Mode Control

Distributed Variable Structure Control With Sliding Mode For Free-Flying Space Robot

Adaptive Fuzzy Integral Sliding Mode Cooperative Control Based on Time-Delay Estimation for Free-Floating Close-Chain Manipulators