Abstract:Abstract Rigid joint manipulators are limited in their movement and degrees of freedom (DOF), while continuum robots possess a continuous backbone that allows for free movement and multiple DOF. Continuum robots move by bending over a section, taking inspiration from biological manipulators such as tentacles and trunks. This paper presents an implementation of a forward kinematics and velocity kinematics model to describe the planar continuum robot, along with the application of reinforcement learning (RL) as a control algorithm. In this paper, we have adopted the planar constant curvature representation for the forward kinematic modeling. This choice was made due to its straightforward implementation and its potential to fill the literature gap in the field RL-based control for planar continuum robots. The intended control mechanism is achieved through the use of Deep Deterministic Policy Gradient (DDPG), a RL algorithm that is suited for learning controls in continuous action spaces. After simulating the algorithm, it was observed that the planar continuum robot can autonomously move from any initial point to any desired goal point within the task space of the robot. By analyzing the results, we wanted to recommend a future direction for research in the field of continuum robot control, specifically in the application of RL algorithms. One potential area of focus could be the integration of sensory feedback, such as vision or force sensing, to improve the robot’s ability to navigate complex environments. Additionally, exploring the use of different RL algorithms, such as Proximal Policy Optimization (PPO) or Trust Region Policy Optimization (TRPO), could lead to further advancements in the field. Overall, this paper demonstrates the potential for RL-based control of continuum robots and highlights the importance of continued research in this area.

N-space (NS)-Framework: a generalized solution for soft continuum robots via reinforcement learning

Axis-space framework for cable-driven soft continuum robot control via reinforcement learning

An Integrated Tracking Control Approach Based on Reinforcement Learning for a Continuum Robot in Space Capture Missions

Open-Loop Motion Control of a Hydraulic Soft Robotic Arm Using Deep Reinforcement Learning

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

Active Exploration Deep Reinforcement Learning for Continuous Action Space with Forward Prediction

Control of Space Flexible Manipulator Using Soft Actor-Critic and Random Network Distillation

Path Planning of 6-DOF Free-Floating Space Robotic Manipulators Using Reinforcement Learning

Subspace-wise Hybrid RL for Articulated Object Manipulation

Trajectory Planning for Teleoperated Space Manipulators Using Deep Reinforcement Learning

Dynamics-Adaptive Continual Reinforcement Learning Via Progressive Contextualization.

Parametrized deep q-networks learning: Reinforcement learning with discrete-continuous hybrid action space

Model-free control framework for multi-limb soft robots

Training in Task Space to Speed Up and Guide Reinforcement Learning

Action Decoupled SAC Reinforcement Learning with Discrete-Continuous Hybrid Action Spaces.

Local Motion Simulation Using Deep Reinforcement Learning

Sim-to-Real Transfer with Action Mapping and State Prediction for Robot Motion Control

Just Round: Quantized Observation Spaces Enable Memory Efficient Learning of Dynamic Locomotion

A Reinforcement Learning Approach for Continuum Robot Control

Learning to Control a Free-floating Space Robot Using Deep Reinforcement Learning

Deep Multi-Agent Reinforcement Learning with Discrete-Continuous Hybrid Action Spaces