Abstract:Purpose: Recent developments in robotics and artificial intelligence (AI) have led to significant advances in healthcare technologies enhancing robot-assisted minimally invasive surgery (RAMIS) in some surgical specialties. However, current human-robot interfaces lack intuitive teleoperation and cannot mimic surgeon's hand/finger sensing and fine motion. These limitations make tele-operated robotic surgery not suitable for micro-surgery and difficult to learn for established surgeons. We report a pilot study showing an intuitive way of recording and mapping surgeon's gross hand motion and the fine synergic motion during cardiac micro-surgery as a way to enhance future intuitive teleoperation. Methods: We set to develop a prototype system able to train a Deep Neural Net-work (DNN) by mapping wrist, hand and surgical tool real-time data acquisition(RTDA) inputs during mock-up heart micro-surgery procedures. The trained network was used to estimate the tools poses from refined hand joint angles. Results: Based on surgeon's feedback during mock micro-surgery, the developed wearable system with light-weight sensors for motion tracking did not interfere with the surgery and instrument handling. The wearable motion tracking system used 15 finger-thumb-wrist joint angle sensors to generate meaningful data-sets representing inputs of the DNN network with new hand joint angles added as necessary based on comparing the estimated tool poses against measured tool pose. The DNN architecture was optimized for the highest estimation accuracy and the ability to determine the tool pose with the least mean squared error. This novel approach showed that the surgical instrument's pose, an essential requirement for teleoperation, can be accurately estimated from recorded surgeon's hand/finger movements with a mean squared error (MSE) less than 0.3%

System Identification of Beating Heart Medical Surgery Assisted Robot

Beating Heart Modeling and Simulation

Learning-Based Force Control of a Surgical Robot for Tool-Soft Tissue Interaction

Vision-Based Real-Time Tracking of Surgical Instruments in Robot-Assisted Laparoscopic Surgery

Robotic Motion Compensation for Beating Heart Intracardiac Surgery

Towards Finger Motion Tracking and Analyses for Cardiac Surgery

[Kinematics Parameter Identification and Accuracy Evaluation Method for Neurosurgical Robot].

A "eye-in-body" integrated surgery robot system for stereotactic surgery

Development of a Robotic Cochlear Implantation System

Design and evaluation of a wearable vascular interventional surgical robot system

Innovative Effector Design for Simulation Training in Robotic Surgery

Mapping Surgeon's Hand/Finger Motion During Conventional Microsurgery to Enhance Intuitive Surgical Robot Teleoperation

A Robotic System with Force Feedback for Micro-Surgery

Human Activity Recognition Enhanced Robot-Assisted Minimally Invasive Surgery

Transfer of male or female primordial germ cells of quail into chick embryonic gonads.

Mechanism design and simulation analysis of robot system for vascular interventional surgery

Preliminary Design of a Robotic System for Kinaesthetic Training of Surgical Tasks

Automated Heart and Lung Auscultation in Robotic Physical Examinations

Brain Activity Analysis for the Configurational Determination of Surgical Manipulation and Endoscope

Modeling, Analysis and Evaluation of a Novel Compact 6-DoF 3-RRRS Needle Biopsy Robot

Real-to-Sim Registration of Deformable Soft Tissue with Position-Based Dynamics for Surgical Robot Autonomy