Abstract:Aiming at the application of robots in service, medical treatment, rehabilitation, and other fields, a humanoid cable-driven hybrid robot by imitating the structure of human arm is designed in this article. The robot is composed of a cable–spool–pulley system, series mechanism, and coaxial spherical parallel mechanism, which can achieve six degrees of freedom movement in space. A challenge with cable driving is that the movement of the rear end joints (such as pitch and roll) can alter the length or tension of the cable driven by the frontend joints, resulting in joint coupling. This interference can lead to a decrease in the motion accuracy of the robotic arm. In addition, it also affects the durability of cables or mechanical components such as bearings and pulleys. Considering the joint motion coupling phenomenon caused by the cable-driven, the decoupling method is proposed, and the kinematic model of the robot is established. To solve the nonlinear coupling characteristics and the uncertainty of the dynamics parameters, a controller is proposed for the humanoid cable-driven hybrid robot, combining proportional-integral-derivative (PID) control based on decoupling method (DC-PID) and the double delay deep deterministic policy gradient (TD3) deep reinforcement learning algorithm. The trajectory tracking of the end-effector position and orientation are controlled by using DC-PID and TD3. And the simulation results show that the proposed control method has good trajectory tracking and convergence performance according to trajectory tracking error and training reward. Finally, the humanoid cable-driven hybrid robot prototype is developed. The experimental results of coupling compensation show that the average maximum error of the joint is reduced by 77.58% after considering the coupling compensation of the joint. The results of the controller validation experiments show that the DC-PID controller reduces the maximum error in each axis by 11.54%, 35.29%, and 40.16%, respectively, compared to the open-loop experiments.

Control of a Cable-Driven Parallel Robot Via Deep Reinforcement Learning

Dynamic Control of a Cable-Driven Parallel Robot Allowing Wrapping Phenomenon through Sim-to-Real Deep Reinforcement Learning

Deep Reinforcement Learning Control of Fully-Constrained Cable-Driven Parallel Robots

Comparison of End-to-end and Hybrid Deep Reinforcement Learning Strategies for Controlling Cable-Driven Parallel Robots

Utilizing Reinforcement Learning to Drive Redundant Constrained Cable-Driven Robots with Unknown Parameters

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

Robust Motion Control for UAV in Dynamic Uncertain Environments Using Deep Reinforcement Learning.

Position Control of Cable-Driven Robotic Soft Arm Based on Deep Reinforcement Learning

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Deep Reinforcement Learning Based Cable Tension Distribution Optimization for Cable-driven Rehabilitation Robot

Robot Control in Human Environment Using Deep Reinforcement Learning and Convolutional Neural Network.

A Cable‐Actuated Soft Manipulator for Dexterous Grasping Based on Deep Reinforcement Learning

Dynamic Obstacle Avoidance for Cable-Driven Parallel Robots With Mobile Bases via Sim-to-Real Reinforcement Learning

Disturbance observer‐based control for cable‐driven parallel robots with external disturbance using deep reinforcement learning

Vision-Based Deep Reinforcement Learning For UR5 Robot Motion Control

Deep Reinforcement Learning for Motion Control Algorithms in Robotics

Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning

A Modified Convergence DDPG Algorithm for Robotic Manipulation

An Integrated Tracking Control Approach Based on Reinforcement Learning for a Continuum Robot in Space Capture Missions

Deep reinforcement learning and decoupling proportional-integral-derivative control of a humanoid cable-driven hybrid robot

Dexterous robotic manipulation using deep reinforcement learning and knowledge transfer for complex sparse reward‐based tasks