Abstract:Small-scale continuum robot-assisted minimally invasive surgery has received crucial attention due to its smaller incisions and high dexterity. In medical scenarios such as radiofrequency ablation and nasal/throat swab sampling, monitoring and controlling the forces applied to human tissue can help improve the safety and comfort level of the procedure. However, the tip-sensor-based force detection method can barely be deployed due to the miniature size of the continuum robot; meanwhile, the mechanical modeling-based high-precision force estimation cannot be realized on account of the continuum robots’ complex structure with high nonlinear properties. To address the high-precision force estimation challenge for further compliant control during minimally invasive interventions, a learning-based high-precision force estimation method via long short-term memory (LSTM) is proposed in this paper. On this basis, compliance control and high-precision force tracking can be further realized for small-scale continuum robot. The compliance control ensures a smooth and stable transition during the interaction between the robot and the environment, and force tracking can be utilized for maintaining or precisely controlling the force applied to the human tissue. Finally, the contact force sensing and control experiments are carried out on a small-scale continuum robot system prototype, and a demonstration using a human nasal cavity model is conducted. The results validate that the proposed LSTM neural network fits the mechanical model of the continuum robot well with the root mean square error of 3.44mN, and the control method can significantly compensate for the instantaneous impact during contact with an attenuation of 59.3 $\%$ and rapidly respond to keep the force accurately at the expected value with the mean absolute error of 2.41mN Note to Practitioners —This research is motivated by the increasing number of applications for small-scale continuum robot-assisted minimally invasive interventional surgery, such as radiofrequency ablation, biopsy, and endoscopic submucosal dissection. These surgeries require high-precision contact force sensing and control. However, due to the small size and complex structure of the continuum robot, traditional methods such as installing force sensors and mechanical modeling are not effective. Therefore, this paper utilizes a neural network to infer contact force through more accessible information about the robot, such as the tension of the actuators. This method allows for compliant force control during the dynamic contact between the small-scale continuum robot and human tissue. Experiments conducted on a human nasal cavity model demonstrate that the proposed method can improve the safety and reliability of small-scale continuum robot-assisted minimally invasive surgery.

An RNN-LSTM Enhanced Compact and Affordable Micro Force Sensing System for Interventional Continuum Robots with Interchangeable End-Effector Instruments

Learning-Based High-Precision Force Estimation and Compliant Control for Small-Scale Continuum Robot

Design and Stiffness Control of a Variable-Length Continuum Robot for Endoscopic Surgery

End-effector Contact Force Estimation for the Industrial Robot in Automated Fiber Placement Processes with Dynamic End-Load Variations

Variable Force Tracking Control Via Online Learning

Deep-Learning-Based Force Sensing Method for a Flexible Endovascular Surgery Robot

A Deep Learning Approach to Intrinsic Force Sensing on the da Vinci Surgical Robot

A Laminated Continuum Robot With Gripping Force-Sensing Forceps for Robot-Assisted Minimally Invasive Surgeries

A Recurrent Convolutional Neural Network Approach for Sensorless Force Estimation in Robotic Surgery

Laser-Profiled Continuum Robot with Integrated Tension Sensing for Simultaneous Shape and Tip Force Estimation

An Integrated 3D MEMS Force Sensing and Feedback System for Robot-Assisted Minimally Invasive Surgery

A Modular 3-Degree-of-Freedom Force Sensor for Robot-assisted Minimally Invasive Surgery Research

Fine Robotic Manipulation without Force/Torque Sensor

Neural Network Enhanced Robot Tool Identification and Calibration for Bilateral Teleoperation

Vision-Based Force Estimation for Minimally Invasive Telesurgery Through Contact Detection and Local Stiffness Models

Interaction Force Measurement of Parallel Robots Based on Structure-Integrated Force Sensors Using Interpretable Linear Neural Networks

Compensatory force measurement and multimodal force feedback for remote-controlled vascular interventional robot

Toward Force Estimation in Robot-Assisted Surgery using Deep Learning with Vision and Robot State

A Modular Miniature 6-D Force Sensor Designed for Minimally Invasive Surgery

Two-Dimensional Shape and Distal Force Estimation for the Continuum Robot Based on Learning from the Proximal Sensors

Towards Model-Free Tool Dynamic Identification And Calibration Using Multi-Layer Neural Network