Abstract:Learning manipulation skills from open surgery provides more flexible access to the organ targets in the abdomen cavity and this could make the surgical robot working in a highly intelligent and friendly manner. Teaching by demonstration (TbD) is capable of transferring the manipulation skills from human to humanoid robots by employing active learning of multiple demonstrated tasks. This work aims to transfer motion skills from multiple human demonstrations in open surgery to robot manipulators in robot-assisted minimally invasive surgery (RA-MIS) by using TbD. However, the kinematic constraint should be respected during the performing of the learned skills by using a robot for minimally invasive surgery. In this article, we propose a novel methodology by integrating the cognitive learning techniques and the developed control techniques, allowing the robot to be highly intelligent to learn senior surgeons' skills and to perform the learned surgical operations in semiautonomous surgery in the future. Finally, experiments are performed to verify the efficiency of the proposed strategy, and the results demonstrate the ability of the system to transfer human manipulation skills to a robot in RA-MIS and also shows that the remote center of motion (RCM) constraint can be guaranteed simultaneously. Note to Practitioners-This article is inspired by limited access to the manipulation of laparoscopic surgery under a kinematic constraint at the point of incision. Current commercial surgical robots are mostly operated by teleoperation, which is representing less autonomy on surgery. Assisting and enhancing the surgeon's performance by increasing the autonomy of surgical robots has fundamental importance. The technique of teaching by demonstration (TbD) is capable of transferring the manipulation skills from human to humanoid robots by employing active learning of multiple demonstrated tasks. With the improved ability to interact with humans, such as flexibility and compliance, the new generation of serial robots becomes more and more popular in nonclinical research. Thus, advanced control strategies are required by integrating cognitive functions and learning techniques into the processes of surgical operation between robots, surgeon, and minimally invasive surgery (MIS). In this article, we propose a novel methodology to model the manipulation skill from multiple demonstrations and execute the learned operations in robot-assisted minimally invasive surgery (RA-MIS) by using a decoupled controller to respect the remote center of motion (RCM) constraint exploiting the redundancy of the robot. The developed control scheme has the following functionalities: 1) it enables the 3-D manipulation skill modeling after multiple demonstrations of the surgical tasks in open surgery by integrating dynamic time warping (DTW) and Gaussian mixture model (GMM)-based dynamic movement primitive (DMP) and 2) it maintains the RCM constraint in a smaller safe area while performing the learned operation in RA-MIS. The developed control strategy can also be potentially used in other industrial applications with a similar scenario.

Towards Transferring Skills to Flexible Surgical Robots with Programming by Demonstration and Reinforcement Learning

Reinforcement Learning Based Manipulation Skill Transferring for Robot-assisted Minimally Invasive Surgery.

Human Demonstration Trajectory Refinement for Redundant Manipulators.

Transferring Optimal Contact Skills to Flexible Manipulators by Reinforcement Learning

Automate Surgical Tasks for a Flexible Serpentine Manipulator Via Learning Actuation Space Trajectory from Demonstration

Toward Teaching by Demonstration for Robot-Assisted Minimally Invasive Surgery

Learning surgical skills under the RCM constraint from demonstrations in robot-assisted minimally invasive surgery

Towards Human-Robot Collaborative Surgery: Trajectory and Strategy Learning in Bimanual Peg Transfer

A Cooperative Control Framework for Haptic Guidance of Bimanual Surgical Tasks Based on Learning from Demonstration.

Autonomous Tissue Manipulation via Surgical Robot Using Learning Based Model Predictive Control

A Physical Human-Robot Interaction Algorithm Based on Fuzzy Reinforcement Learning for Minimally Invasive Surgery Manipulator

A Combined Learning and Optimization Framework to Transfer Human Whole-body Loco-manipulation Skills to Mobile Manipulators

Learning Target-Directed Skill and Variable Impedance Control from Interactive Demonstrations for Robot-Assisted Soft Tissue Puncture Tasks

Constrained-Space Optimization and Reinforcement Learning for Complex Tasks

Effective Learning and Online Modulation for Robotic Variable Impedance Skills.

Autonomous Soft Tissue Retraction Using Demonstration-Guided Reinforcement Learning

Reinforcement Learning-based Learning from Demonstrations for Collaborative Robots

Motion Planning based on Learning from Demonstration for Multiple-Segment Flexible Robots Actuated by Electroactive Polymers

Learning-based Endovascular Navigation Through the Use of Non-Rigid Registration for Collaborative Robotic Catheterization

Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learning

Integrating Reinforcement Learning and Learning From Demonstrations to Learn Nonprehensile Manipulation