Abstract:Small-scale continuum robot-assisted minimally invasive surgery has received crucial attention due to its smaller incisions and high dexterity. In medical scenarios such as radiofrequency ablation and nasal/throat swab sampling, monitoring and controlling the forces applied to human tissue can help improve the safety and comfort level of the procedure. However, the tip-sensor-based force detection method can barely be deployed due to the miniature size of the continuum robot; meanwhile, the mechanical modeling-based high-precision force estimation cannot be realized on account of the continuum robots’ complex structure with high nonlinear properties. To address the high-precision force estimation challenge for further compliant control during minimally invasive interventions, a learning-based high-precision force estimation method via long short-term memory (LSTM) is proposed in this paper. On this basis, compliance control and high-precision force tracking can be further realized for small-scale continuum robot. The compliance control ensures a smooth and stable transition during the interaction between the robot and the environment, and force tracking can be utilized for maintaining or precisely controlling the force applied to the human tissue. Finally, the contact force sensing and control experiments are carried out on a small-scale continuum robot system prototype, and a demonstration using a human nasal cavity model is conducted. The results validate that the proposed LSTM neural network fits the mechanical model of the continuum robot well with the root mean square error of 3.44mN, and the control method can significantly compensate for the instantaneous impact during contact with an attenuation of 59.3 $\%$ and rapidly respond to keep the force accurately at the expected value with the mean absolute error of 2.41mN Note to Practitioners —This research is motivated by the increasing number of applications for small-scale continuum robot-assisted minimally invasive interventional surgery, such as radiofrequency ablation, biopsy, and endoscopic submucosal dissection. These surgeries require high-precision contact force sensing and control. However, due to the small size and complex structure of the continuum robot, traditional methods such as installing force sensors and mechanical modeling are not effective. Therefore, this paper utilizes a neural network to infer contact force through more accessible information about the robot, such as the tension of the actuators. This method allows for compliant force control during the dynamic contact between the small-scale continuum robot and human tissue. Experiments conducted on a human nasal cavity model demonstrate that the proposed method can improve the safety and reliability of small-scale continuum robot-assisted minimally invasive surgery.

Robotic needle steering in deformable tissues with extreme learning machines

Needle-tissue interactive mechanism and steering control in image-guided robot-assisted minimally invasive surgery: a review

Magnetic needle steering control using Lyapunov redesign

Autonomous Medical Needle Steering In Vivo

Needle Steering for Robot-Assisted Insertion into Soft Tissue: A Survey

Modeling of path planning and needle steering with path tracking in anatomical soft tissues for minimally invasive surgery

Learning-Based High-Precision Force Estimation and Compliant Control for Small-Scale Continuum Robot

An Adaptive Control Method and Learning Strategy for Ultrasound-Guided Puncture Robot

Learning Target-Directed Skill and Variable Impedance Control from Interactive Demonstrations for Robot-Assisted Soft Tissue Puncture Tasks

An Eye-Gaze-Controlled Needle Deployment Robot: Design, Modeling, and Experimental Evaluation

Autonomous Tissue Manipulation via Surgical Robot Using Learning Based Model Predictive Control

Learning automatic navigation control skills for miniature helical robots from human demonstrations

Adaptive Kinematic Control of a Robotic Venipuncture Device Based on Stereo Vision, Ultrasound, and Force Guidance

A Novel Robotic Guidance System With Eye-Gaze Tracking Control for Needle-Based Interventions

Vessel Pose Estimation for Obstacle Avoidance in Needle Steering Surgery Using Multiple Forward Looking Sensors

Bevel-Tip Needle Deflection Modeling, Simulation, and Validation in Multi-Layer Tissues

Kinematics modelling and dynamics analysis of an SMA-actuated active flexible needle for feedback-controlled manipulation in phantom

Synthesizing Strategies for Needle Steering in Gelatin Phantoms

Collaborative Robotic Biopsy with Trajectory Guidance and Needle Tip Force Feedback

Deep-Learning-Based Force Sensing Method for a Flexible Endovascular Surgery Robot

Simulation-based Flexible Needle Control with Single-core FBG Feedback for Spinal Injections