Abstract:In recent years, industries have increasingly emphasized the need for high-speed, energy-efficient, and cost-effective solutions. As a result, there has been growing interest in developing flexible link manipulator robots to meet these requirements. However, reducing the weight of the manipulator leads to increased flexibility which, in turn, causes vibrations. This research paper introduces a novel approach for controlling the vibration and motion of a two-link flexible manipulator using reinforcement learning. The proposed system utilizes trust region policy optimization to train the manipulator's end effector to reach a desired target position, while minimizing vibration and strain at the root of the link. To achieve the research objectives, a 3D model of the flexible-link manipulator is designed, and an optimal reward function is identified to guide the learning process. The results demonstrate that the proposed approach successfully suppresses vibration and strain when moving the end effector to the target position. Furthermore, the trained model is applied to a physical flexible manipulator for real-world control verification. However, it is observed that the performance of the trained model does not meet expectations, due to simulation-to-real challenges. These challenges may include unanticipated differences in dynamics, calibration issues, actuator limitations, or other factors that affect the performance and behavior of the system in the real world. Therefore, further investigations and improvements are recommended to bridge this gap and enhance the applicability of the proposed approach.

Reinforcement Learning Control for a Flexible Joint Manipulator and Its Verification

Control Of Flexible Manipulator Based On Reinforcement Learning

Neural-Learning-Based Control for a Constrained Robotic Manipulator with Flexible Joints

Vibration and Position Control of a Two-Link Flexible Manipulator Using Reinforcement Learning

Value Iteration-Based Adaptive Fuzzy Backstepping Optimal Control of Modular Robot Manipulators via Integral Reinforcement Learning

Reinforcement learning-based adaptive tracking control for flexible-joint robotic manipulators

Design of Robust Terminal Sliding Mode Control for Underactuated Flexible Joint Robot

Self-adaptive Composite Control for Flexible Joint Robot Based on RBF Neural Network

A Modified Active Disturbance Rejection Control Method for the Compliance Control of the Flexible Joint Robots.

A Hybrid Model and Model-Free Position Control for a Reconfigurable Manipulator

Model-Free Control of Flexible Manipulator Based on Intrinsic Design

Optimized leader‐follower consensus control using combination of reinforcement learning and sliding mode mechanism for multiple robot manipulator system

A new control method of flexible-joint manipulator with harmonic drive

Model-Based Reinforcement Learning for Position Control of Continuum Manipulators Actuated by Pneumatic Artificial Muscles

Learning Control of Flexible Manipulator with Unknown Dynamics

Vision-based reinforcement learning control of soft robot manipulators

Continuous output feedback sliding mode control for underactuated flexible-joint robot

Fusing Dynamics and Reinforcement Learning for Control Strategy: Achieving Precise Gait and High Robustness in Humanoid Robot Locomotion*

Pattern-based autonomous smooth switching control for constrained flexible joint manipulator

Design and Control of a Muscle-skeleton Robot Elbow based on Reinforcement Learning

Adaptive composite learning control of a flexible two‐link manipulator with unknown spatiotemporally varying disturbance