Abstract:Introduction: Reinforcement learning has been widely used in robot motion planning. However, for multi-step complex tasks of dual-arm robots, the trajectory planning method based on reinforcement learning still has some problems, such as ample exploration space, long training time, and uncontrollable training process. Based on the dual-agent depth deterministic strategy gradient (DADDPG) algorithm, this study proposes a motion planning framework constrained by the human joint angle, simultaneously realizing the humanization of learning content and learning style. It quickly plans the coordinated trajectory of dual-arm for complex multi-step tasks. Methods: The proposed framework mainly includes two parts: one is the modeling of human joint angle constraints. The joint angle is calculated from the human arm motion data measured by the inertial measurement unit (IMU) by establishing a human-robot dual-arm kinematic mapping model. Then, the joint angle range constraints are extracted from multiple groups of demonstration data and expressed as inequalities. Second, the segmented reward function is designed. The human joint angle constraint guides the exploratory learning process of the reinforcement learning method in the form of step reward. Therefore, the exploration space is reduced, the training speed is accelerated, and the learning process is controllable to a certain extent. Results and discussion: The effectiveness of the framework was verified in the gym simulation environment of the Baxter robot's reach-grasp-align task. The results show that in this framework, human experience knowledge has a significant impact on the guidance of learning, and this method can more quickly plan the coordinated trajectory of dual-arm for multi-step tasks.

Trajectory Planning to Open Valves for Dual-Arm Robots

Discrete trajectory planning for robotic arms

Visualized Trajectory Planning of Flexible Redundant Robotic Arm Using A Novel Hybrid Algorithm

Trajectory Planning of Multi-Robot Coordination Platform for Locating Large Subassembly.

An Efficient Trajectory Planner for Car-like Robots on Uneven Terrain

Discrete States-Based Trajectory Planning for Nonholonomic Robots

Research on Collaboration Motion Planning Method for a Dual-Arm Robot Based on Closed-Chain Kinematics

An algorithm for trajectory optimization of dual-arm coordination based on arm angle constraints

An Integrated Trajectory Planning and Motion Control Strategy of a Variable Rotational Speed Pump-Controlled Electro-Hydraulic Actuator

Research on trajectory planning method of dual-arm robot based on ROS

Motion Planning for Industrial Robots Based on Task Process Decomposition

Joint-space Trajectory Planning for Robots under Multiple Constraints

Research on the Safety Design and Trajectory Planning for a New Dual Upper Limb Rehabilitation Robot

Online Dual Robot–human Collaboration Trajectory Generation by Convex Optimization

Multi-Objective Trajectory Planning with Dual-Encoder

Trajectory Planning and Optimization for Robotic Machining Based On Measured Point Cloud

Unknown Geometrical Constraints Estimation and Trajectory Planning for Robotic Door-Opening Task with Visual Teleoperation Assists

Hybrid Task Constrained Planner for Robot Manipulator in Confined Environment

Contact-Rich Trajectory Generation in Confined Environments Using Iterative Convex Optimization

Motion Planning and Cooperative Manipulation for Mobile Robots with Dual Arms

Motion planning framework based on dual-agent DDPG method for dual-arm robots guided by human joint angle constraints