Abstract:Abstract Rigid joint manipulators are limited in their movement and degrees of freedom (DOF), while continuum robots possess a continuous backbone that allows for free movement and multiple DOF. Continuum robots move by bending over a section, taking inspiration from biological manipulators such as tentacles and trunks. This paper presents an implementation of a forward kinematics and velocity kinematics model to describe the planar continuum robot, along with the application of reinforcement learning (RL) as a control algorithm. In this paper, we have adopted the planar constant curvature representation for the forward kinematic modeling. This choice was made due to its straightforward implementation and its potential to fill the literature gap in the field RL-based control for planar continuum robots. The intended control mechanism is achieved through the use of Deep Deterministic Policy Gradient (DDPG), a RL algorithm that is suited for learning controls in continuous action spaces. After simulating the algorithm, it was observed that the planar continuum robot can autonomously move from any initial point to any desired goal point within the task space of the robot. By analyzing the results, we wanted to recommend a future direction for research in the field of continuum robot control, specifically in the application of RL algorithms. One potential area of focus could be the integration of sensory feedback, such as vision or force sensing, to improve the robot’s ability to navigate complex environments. Additionally, exploring the use of different RL algorithms, such as Proximal Policy Optimization (PPO) or Trust Region Policy Optimization (TRPO), could lead to further advancements in the field. Overall, this paper demonstrates the potential for RL-based control of continuum robots and highlights the importance of continued research in this area.

Model-Based Reinforcement Learning for Position Control of Continuum Manipulators Actuated by Pneumatic Artificial Muscles

Adaptive robust posture control of a parallel manipulator driven by pneumatic muscles

ADAPTIVE ROBUST POSTURE CONTROL OF A PNEUMATIC MUSCLES DRIVEN PARALLEL MANIPULATOR 1

Model-Based Robot Learning Control with Uncertainty Directed Exploration

Adaptive Position Control of Pneumatic Continuum Manipulator Based on MAML Meta-Reinforcement Learning

Control of Robotic Joint Actuated by Antagonistic Pneumatic Artificial Muscles Based on Model-free Reinforcement Learning

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

A Model-free Adaptive Controller for Biomimetic Pneumatically Actuated Continuum Manipulators.

Model-Based Reinforcement Learning for Closed-Loop Dynamic Control of Soft Robotic Manipulators

Sim-to-Real Transfer Reinforcement Learning for Position Control of Pneumatic Continuum Manipulator

Motion Control of a Hydraulic Manipulator with Adaptive Nonlinear Model Compensation and Comparative Experiments

A Hybrid Controller for a Soft Pneumatic Manipulator Based on Model Predictive Control and Iterative Learning Control

A Model-Based Sliding-Mode Tracking Controller For Pneumatic Muscle Actuated Continuum Arms

Modeling And Control For Pneumatic Manipulator Based On Dynamic Neural Network

Vibration and Position Control of a Two-Link Flexible Manipulator Using Reinforcement Learning

Active Model-Based Control for Pneumatic Artificial Muscle

A Reinforcement Learning Approach for Continuum Robot Control

Vibration Control Based on Reinforcement Learning for a Single-link Flexible Robotic Manipulator

Control Of Flexible Manipulator Based On Reinforcement Learning

Learning-based Control for Tendon-Driven Continuum Robotic Arms

Model-based Linear Control of Nonlinear Pneumatic Soft Bending Actuators