Abstract:Collaborative robotic arms in smart factories should ensure the safety and interactivity during their operation such as reaching and grasping objects. Especially, the advanced motion planner including the path planning and the motion control functions is essential for human-machine co-working. Since the traditional physics-based motion planning approaches require extreme computational resources to obtain near-optimal solutions, deep reinforcement learning algorithms have been actively adopted and have effectively solved the limitation. They, however, have the easy task preference problem, primarily taking the simpler ways for the more rewards, due to randomly training the agents how to reach the target points in the large-scale search spaces. Therefore, we propose a novel curriculum-based deep reinforcement learning framework that makes the agents learn the motion planning tasks in unbiased ways from the ones with the low complexities to the others with the high complexities. It uses the unsupervised learning algorithms to cluster the target points with the similar task complexities for generating the effective curriculum. In addition, the review and buffer flushing mechanisms are integrated into the framework to mitigate the catastrophic forgetting problem where the agent abruptly lose the previous learned knowledge upon learning new one in the curriculum. The evaluation results of the proposed framework show that the curriculum significantly enhances the success rate on the task with the highest complexity from 12% to 56% and the mechanisms improve the success rate on the tasks with the easier complexities from an average of 66% to 76.5%, despite requiring less training time.

A General Framework of Motion Planning for Redundant Robot Manipulator Based on Deep Reinforcement Learning

A Heuristic Solution-Based Motion Planning Framework for Redundant Manipulators

An Obstacle-Avoidance Motion Planning Method for Redundant Space Robot via Reinforcement Learning

Brain-Inspired Strategy for the Motion Planning of Hyper-Redundant Manipulators

An RRT-Based Motion Planning Method for Hyper-Redundant Manipulators in Confined Spaces

Reinforcement Learning-Based Reactive Obstacle Avoidance Method for Redundant Manipulators

Motion Planning Algorithms of Redundant Manipulators Based on Self-Motion Manifolds

A Data-Driven Sparse Motion Planning Scheme for Redundant Manipulators.

Guided deep reinforcement learning framework using automated curriculum scheme for accurate motion planning

An Efficiently Convergent Deep Reinforcement Learning-Based Trajectory Planning Method for Manipulators in Dynamic Environments

Energy-Efficient Motion Planning and Control for Robotic Arms Via Deep Reinforcement Learning

Collective Neural Dynamics for Sparse Motion Planning of Redundant Manipulators Without Hessian Matrix Inversion

Constrained motion planning of free-float dual-arm space manipulator via deep reinforcement learning

Using Implicit Behavior Cloning and Dynamic Movement Primitive to Facilitate Reinforcement Learning for Robot Motion Planning

Motion Planning Of Hyper Redundant Manipulators Based On A New Geometrical Method

Motion Planning Method of Redundant Dual-Chain Manipulator with Multiple Constraints

Path Planning Method for Manipulators Based on Improved Twin Delayed Deep Deterministic Policy Gradient and RRT*

On Generalized RMP Scheme for Redundant Robot Manipulators Aided with Dynamic Neural Networks and Nonconvex Bound Constraints

Collaborative motion planning for multi-manipulator systems through Reinforcement Learning and Dynamic Movement Primitives

Global Motion Planning and Redundancy Resolution for Large Objects Manipulation by Dual Redundant Robots with Closed Kinematics

Deep Reinforcement Learning for Multi-contact Motion Planning of Hexapod Robots