Abstract:The advent of Industry 4.0 has significantly promoted the field of intelligent manufacturing, which is facilitated by the development of new technologies are emerging. Robot technology and robot intelligence methods have rapidly developed and been widely applied. Manipulators are widely used in industry, and their control is a crucial research topic. The inverse kinematics solution of manipulators is an important part of manipulator control, which calculates the joint angles required for the end effector to reach a desired position and posture. Traditional inverse kinematics solution algorithms often face the problem of insufficient generalization, and iterative methods have challenges such as large computation and long solution time. This paper proposes a reinforcement learning-based inverse kinematics solution algorithm, called the MAPPO-IK algorithm. The algorithm trains the manipulator agent using the MAPPO algorithm and calculates the difference between the end effector state of the manipulator and the target posture in real-time by designing a reward mechanism, while considering Gaussian distance and cosine distance. Through experimental comparative analysis, the feasibility, computational efficiency, and superiority of this reinforcement learning algorithm are verified. Compared with traditional inverse kinematics solution algorithms, this method has good generalization and supports real-time computation, and the obtained result is a unique solution. Reinforcement learning algorithms have better adaptability to complex environments and can handle different sudden situations in different environments. This algorithm also has the advantages of path planning, intelligent obstacle avoidance, and other advantages in dynamically processing complex environmental scenes.

ON SELF-LEARNING CONTROL STRATEGY FOR ROBOT MANIPULATORS

Learning control strategy based on human-machine on-line cooperation

Deterministic Learning and Robot Manipulator Control

Adaptive Motion Tracking Control of Robot Manipulators Non-Regressor Based Approach

Robot Manipulator Control Based on the Inner-Learning Mechanism

Skill Learning Strategy Based on Dynamic Motion Primitives for Human–Robot Cooperative Manipulation

Learning From Human Demonstrations for Wheel Mobile Manipulator: An Unscented Model Predictive Control Approach

An Intelligent Social Learning-based Optimization Strategy for Black-box Robotic Control with Reinforcement Learning

A Deep Reinforcement Learning Solution for the Low Level Motion Control of a Robot Manipulator System

Inner-Learning Mechanism Based Control Scheme for Manipulator with Multitasking and Changing Load

Adaptive Neural Learning Control of Rigid-Link Electrically-Driven Robot Manipulators

Reinforcement Learning Based Control for Uncertain Robotic Manipulator Trajectory Tracking

Decentralized Robust Adaptive Iterative Learning Control of Robot Manipulators

Optimized leader‐follower consensus control using combination of reinforcement learning and sliding mode mechanism for multiple robot manipulator system

Learning strategies for underwater robot autonomous manipulation control

Adaptive sliding mode control of robotic manipulator based on reinforcement learning

Reinforcement Learning Control for Coordinated Manipulation of Multi-Robots.

Inverse kinematics solution and control method of 6-degree-of-freedom manipulator based on deep reinforcement learning

Fusing Dynamics and Reinforcement Learning for Control Strategy: Achieving Precise Gait and High Robustness in Humanoid Robot Locomotion*

Alignment condition-based adaptive iterative learning control for robot manipulators

Higher-Order Adaptive Iterative Control For Uncertain Robot Manipulators