Abstract:In this article, the trajectory planning of the two manipulators of the dual-arm robot is studied to approach the patient in a complex environment with deep reinforcement learning algorithms. The shape of the human body and bed is complex which may lead to the collision between the human and the robot. Because the sparse reward the robot obtains from the environment may not support the robot to accomplish the task, a neural network is trained to control the manipulators of the robot to prepare to hold the patient up by using a proximal policy optimization algorithm with a continuous reward function. Firstly, considering the realistic scene, the 3D simulation environment is built to conduct the research. Secondly, inspired by the idea of the artificial potential field, a new reward and punishment function was proposed to help the robot obtain enough rewards to explore the environment. The function is consisting of four parts which include the reward guidance function, collision detection, obstacle avoidance function, and time function. Where the reward guidance function is used to guide the robot to approach the targets to hold the patient, the collision detection and obstacle avoidance function are complementary to each other and are used to avoid obstacles, and the time function is used to reduce the number of training episode. Finally, after the robot is trained to reach the targets, the training results are analyzed. Compared with the DDPG algorithm, the PPO algorithm reduces about 4 million steps for training to converge. Moreover, compared with the other reward and punishment functions, the function used in this paper will obtain many more rewards at the same training time. Apart from that, it will take much less time to converge, and the episode length will be shorter; so, the advantage of the algorithm used in this paper is verified.

Optimization Of End Trajectory Of Medical Robot Arm Based On Human Biomimetics

Human Demonstration Trajectory Refinement for Redundant Manipulators.

Whole-Body Inverse Kinematics and Operation-Oriented Motion Planning for Robot Mobile Manipulation

Trajectory Planning and Simulation Study of Redundant Robotic Arm for Upper Limb Rehabilitation Based on Back Propagation Neural Network and Genetic Algorithm

Optimal Design for Kinematics Parameter of Medical Robot

Enhancing the Performance of a Biomimetic Robotic Elbow-and-Forearm System Through Bionics-Inspired Optimization

Trajectory Optimization of Robot-Assisted Endovascular Catheterization with Reinforcement Learning

Placement And Motion Optimization Of Redundant Maxillofacial Surgical Robot With New Dexterity Measure

Patient-Specific Exercises with the Development of an End-Effector Type Upper Limb Rehabilitation Robot

Optimizing Base Placement of Surgical Robot: Kinematics Data-Driven Approach by Analyzing Working Pattern

Modeling and design optimization of master manipulator for robot-assisted minimally invasive surgery

Experimental Validation Of Manipulability Optimization Control Of A 7-Dof Serial Manipulator For Robot-Assisted Surgery

Kinematic-driven human-robot interaction system with deep learning for flexible acupuncture needling manipulations

Optimizing Robot Arm Reaching Ability with Different Joints Functionality

An Improved Path Planning Algorithm Based on Artificial Potential Field and Primal-Dual Neural Network for Surgical Robot

Biomechanics-Aware Trajectory Optimization for Navigation during Robotic Physiotherapy

Hierarchical optimization Control of Redundant Manipulator for Robot-assisted Minimally Invasive Surgery.

Safety-Enhanced Motion Planning for Flexible Surgical Manipulator Using Neural Dynamics

Flexible control and trajectory planning of medical two-arm surgical robot

Dual-Arm Robot Trajectory Planning Based on Deep Reinforcement Learning under Complex Environment