Abstract:Learning manipulation skills from open surgery provides more flexible access to the organ targets in the abdomen cavity and this could make the surgical robot working in a highly intelligent and friendly manner. Teaching by demonstration (TbD) is capable of transferring the manipulation skills from human to humanoid robots by employing active learning of multiple demonstrated tasks. This work aims to transfer motion skills from multiple human demonstrations in open surgery to robot manipulators in robot-assisted minimally invasive surgery (RA-MIS) by using TbD. However, the kinematic constraint should be respected during the performing of the learned skills by using a robot for minimally invasive surgery. In this article, we propose a novel methodology by integrating the cognitive learning techniques and the developed control techniques, allowing the robot to be highly intelligent to learn senior surgeons' skills and to perform the learned surgical operations in semiautonomous surgery in the future. Finally, experiments are performed to verify the efficiency of the proposed strategy, and the results demonstrate the ability of the system to transfer human manipulation skills to a robot in RA-MIS and also shows that the remote center of motion (RCM) constraint can be guaranteed simultaneously. Note to Practitioners-This article is inspired by limited access to the manipulation of laparoscopic surgery under a kinematic constraint at the point of incision. Current commercial surgical robots are mostly operated by teleoperation, which is representing less autonomy on surgery. Assisting and enhancing the surgeon's performance by increasing the autonomy of surgical robots has fundamental importance. The technique of teaching by demonstration (TbD) is capable of transferring the manipulation skills from human to humanoid robots by employing active learning of multiple demonstrated tasks. With the improved ability to interact with humans, such as flexibility and compliance, the new generation of serial robots becomes more and more popular in nonclinical research. Thus, advanced control strategies are required by integrating cognitive functions and learning techniques into the processes of surgical operation between robots, surgeon, and minimally invasive surgery (MIS). In this article, we propose a novel methodology to model the manipulation skill from multiple demonstrations and execute the learned operations in robot-assisted minimally invasive surgery (RA-MIS) by using a decoupled controller to respect the remote center of motion (RCM) constraint exploiting the redundancy of the robot. The developed control scheme has the following functionalities: 1) it enables the 3-D manipulation skill modeling after multiple demonstrations of the surgical tasks in open surgery by integrating dynamic time warping (DTW) and Gaussian mixture model (GMM)-based dynamic movement primitive (DMP) and 2) it maintains the RCM constraint in a smaller safe area while performing the learned operation in RA-MIS. The developed control strategy can also be potentially used in other industrial applications with a similar scenario.

Internet of Things (Iot)-Based Collaborative Control of a Redundant Manipulator for Teleoperated Minimally Invasive Surgeries

Improved Human-Robot Collaborative Control Of Redundant Robot For Teleoperated Minimally Invasive Surgery

Safety-enhanced Human-Robot Interaction Control of Redundant Robot for Teleoperated Minimally Invasive Surgery

Collaborative Framework for Robot-Assisted Minimally Invasive Surgery Using a 7-Dof Anthropomorphic Robot

Manipulability Optimization Control of a Serial Redundant Robot for Robot-assisted Minimally Invasive Surgery

Hierarchical Task Impedance Control of a Serial Manipulator for Minimally Invasive Surgery

Intelligent Control for Human-Robot Cooperation in Orthopedics Surgery.

Fuzzy Approximation-based Task-Space Control of Robot Manipulators with Remote Center of Motion Constraint

A Human Activity-Aware Shared Control Solution for Medical Human–robot Interaction

Telemanipulation of Snake-Like Robots for Minimally Invasive Surgery of the Upper Airway

Asymmetric Bimanual Control of Dual-arm Serial Manipulator for Robot-assisted Minimally Invasive Surgeries

Inverse Kinematics Control Methods for Redundant Snakelike Robot Teleoperation During Minimally Invasive Surgery.

Collaborative Bimanual Manipulation Using Optimal Motion Adaptation and Interaction Control

Teleoperation in Robot-assisted MIS with Adaptive RCM via Admittance Control

A Controller to Impose a RCM for Hands-on Robotic-Assisted Minimally Invasive Surgery

Mixed-Reality-Guided Teleoperation of a Collaborative Robot for Surgical Procedures

Operational space robust impedance control of the redundant surgical robot for minimally invasive surgery

Human-Robot Shared Control for Surgical Robot Based on Context-Aware Sim-to-Real Adaptation

Anthropomorphic Dual-Arm Coordinated Control for a Single-Port Surgical Robot Based on Dual-Step Optimization

Integrated Planning and Control of Robotic Surgical Instruments for Tasks Autonomy

Toward Teaching by Demonstration for Robot-Assisted Minimally Invasive Surgery