Abstract:Purpose The purpose of this paper is using a model-free reinforcement learning (RL) algorithm to optimize manipulability which can overcome difficulties of dilemmas of matrix inversion, complicated formula transformation and expensive calculation time. Design/methodology/approach Manipulability optimization is an effective way to solve the singularity problem arising in manipulator control. Some control schemes are proposed to optimize the manipulability during trajectory tracking, but they involve the dilemmas of matrix inversion, complicated formula transformation and expensive calculation time. Findings The redundant manipulator trained by RL can adjust its configuration in real-time to optimize the manipulability in an inverse-free manner while tracking the desired trajectory. Computer simulations and physics experiments demonstrate that compared with the existing methods, the average manipulability is increased by 58.9%, and the calculation time is reduced to 17.9%. Therefore, the proposed method effectively optimizes the manipulability, and the calculation time is significantly shortened. Originality/value To the best of the authors’ knowledge, this is the first method to optimize manipulability using RL during trajectory tracking. The authors compare their approach to existing singularity avoidance and manipulability maximization techniques, and prove that their method has better optimization effects and less computing time.

Manipulability Optimization of Redundant Manipulators Using Dynamic Neural Networks.

A Unified Weighted Least Norm Method For Redundant Manipulator Control

Manipulability Optimization of Redundant Manipulators Using Reinforcement Learning

Global Redundancy Optimization of Manipulability for 7-Dofs Anthropomorphic Manipulator Using Joint Monotonicity

Kinematic and Dynamic Models of Hyper-Redundant Manipulator Based on Link Eigenvectors

Metaheuristic-Based RNN for Manipulability Optimization of Redundant Manipulators

A Dynamic Neural Network Approach for Efficient Control of Manipulators

Perturbed Manipulability Optimization in a Distributed Network of Redundant Robots

A Dual Neural Network for Constrained Joint Torque Optimization of Kinematically Redundant Manipulators

Research on parallel optimization scheme between singularity avoidance and minimum Torque for a Redundant Manipulator

Manipulability Optimization for Coordinated Motion Control of Multi-arm Space Robots

Kinematic Optimization of Redundant Manipulators to Improve the Fault-Tolerant Control

Kinematic and Dynamic Manipulability Optimizations of Redundant Manipulators Based on RNN Model

Kinematic and dynamic optimizations of the redundant manipulator via local degrees of freedom

Singularity Avoidance Based on Avoiding Joint Velocity Limits for Redundant Manipulators

RNN for Perturbed Manipulability Optimization of Manipulators Based on a Distributed Scheme: A Game-Theoretic Perspective

A Computationally Effective Singularity Avoidance Method for Redundant Manipulators with Non-Spherical Wrists

Torque Minimization Of Kinematically Redundant Manipulators Using A Dual Neural Network

Dynamic Manipulability and Optimization of a Redundant Three DOF Planar Parallel Manipulator

Manipulability and Robustness Optimization of the Cable-Driven Redundant Soft Manipulator

A Data-Driven Cyclic-Motion Generation Scheme for Kinematic Control of Redundant Manipulators