Abstract:Learning manipulation skills from open surgery provides more flexible access to the organ targets in the abdomen cavity and this could make the surgical robot working in a highly intelligent and friendly manner. Teaching by demonstration (TbD) is capable of transferring the manipulation skills from human to humanoid robots by employing active learning of multiple demonstrated tasks. This work aims to transfer motion skills from multiple human demonstrations in open surgery to robot manipulators in robot-assisted minimally invasive surgery (RA-MIS) by using TbD. However, the kinematic constraint should be respected during the performing of the learned skills by using a robot for minimally invasive surgery. In this article, we propose a novel methodology by integrating the cognitive learning techniques and the developed control techniques, allowing the robot to be highly intelligent to learn senior surgeons' skills and to perform the learned surgical operations in semiautonomous surgery in the future. Finally, experiments are performed to verify the efficiency of the proposed strategy, and the results demonstrate the ability of the system to transfer human manipulation skills to a robot in RA-MIS and also shows that the remote center of motion (RCM) constraint can be guaranteed simultaneously. Note to Practitioners-This article is inspired by limited access to the manipulation of laparoscopic surgery under a kinematic constraint at the point of incision. Current commercial surgical robots are mostly operated by teleoperation, which is representing less autonomy on surgery. Assisting and enhancing the surgeon's performance by increasing the autonomy of surgical robots has fundamental importance. The technique of teaching by demonstration (TbD) is capable of transferring the manipulation skills from human to humanoid robots by employing active learning of multiple demonstrated tasks. With the improved ability to interact with humans, such as flexibility and compliance, the new generation of serial robots becomes more and more popular in nonclinical research. Thus, advanced control strategies are required by integrating cognitive functions and learning techniques into the processes of surgical operation between robots, surgeon, and minimally invasive surgery (MIS). In this article, we propose a novel methodology to model the manipulation skill from multiple demonstrations and execute the learned operations in robot-assisted minimally invasive surgery (RA-MIS) by using a decoupled controller to respect the remote center of motion (RCM) constraint exploiting the redundancy of the robot. The developed control scheme has the following functionalities: 1) it enables the 3-D manipulation skill modeling after multiple demonstrations of the surgical tasks in open surgery by integrating dynamic time warping (DTW) and Gaussian mixture model (GMM)-based dynamic movement primitive (DMP) and 2) it maintains the RCM constraint in a smaller safe area while performing the learned operation in RA-MIS. The developed control strategy can also be potentially used in other industrial applications with a similar scenario.

Hierarchical Task Impedance Control of a Serial Manipulator for Minimally Invasive Surgery

Safety-enhanced Human-Robot Interaction Control of Redundant Robot for Teleoperated Minimally Invasive Surgery

Asymmetric Bimanual Control of Dual-arm Serial Manipulator for Robot-assisted Minimally Invasive Surgeries

Operational space robust impedance control of the redundant surgical robot for minimally invasive surgery

Improved Human-Robot Collaborative Control Of Redundant Robot For Teleoperated Minimally Invasive Surgery

Manipulability Optimization Control of a Serial Redundant Robot for Robot-assisted Minimally Invasive Surgery

Internet of Things (Iot)-Based Collaborative Control of a Redundant Manipulator for Teleoperated Minimally Invasive Surgeries

Optimization-Based Variable Impedance Control of Robotic Manipulator for Medical Contact Tasks

Fuzzy Approximation-based Task-Space Control of Robot Manipulators with Remote Center of Motion Constraint

Teleoperation in Robot-assisted MIS with Adaptive RCM via Admittance Control

Achieving Dexterous Bidirectional Interaction in Uncertain Conditions for Medical Robotics

Hierarchical optimization Control of Redundant Manipulator for Robot-assisted Minimally Invasive Surgery.

Collaborative Framework for Robot-Assisted Minimally Invasive Surgery Using a 7-Dof Anthropomorphic Robot

A Human Activity-Aware Shared Control Solution for Medical Human–robot Interaction

Development of a New Medical Robot System for Minimally Invasive Surgery.

Human-robot interaction control of a haptic master manipulator used in laparoscopic minimally invasive surgical robot system

A passive convex optimal control algorithm for teleoperating a redundant robotic arm in minimally invasive surgery

A Controller to Impose a RCM for Hands-on Robotic-Assisted Minimally Invasive Surgery

Development of a Control Algorithm for a Hybrid Structure Surgical Manipulator

Toward Teaching by Demonstration for Robot-Assisted Minimally Invasive Surgery

Master–slave Real-Time Control Strategy in Cartesian Space for a Novel Surgical Robot for Minimally Invasive Surgery