Abstract:Deep needle insertion to a target often poses a huge challenge, requiring a combination of specialized skills, assistive technology, and extensive training. One of the frequently encountered medical scenarios demanding such expertise includes the needle insertion into a femoral vessel in the groin. Conventionally, deep needle insertion is guided by ultrasound (US) imaging. However, utilizing US for needle tracking demands specialized training and skill to manipulate the probe effectively and interpret the imaging accurately. To address this challenge, this article presents an innovative technology for needle tip real-time tracking. This advancement will be instrumental in facilitating robotic-guided needle insertion toward the identified target. Specifically, our approach revolves around the creation of scattering imaging using an optical fiber-equipped needle and uses convolutional neural network (CNN)-based algorithms to enable real-time estimation of the needle tip's position and orientation during insertion procedures. The efficacy of the proposed technology was rigorously evaluated through three experiments. The first two experiments involved rubber and bacon phantoms to simulate groin anatomy. The positional errors averaging and mm, and the orientation errors averaging and rad. Furthermore, the system's capabilities were validated through experiments conducted on fresh porcine phantom mimicking more complex anatomical structures, yielding the positional accuracy results of mm and an orientational accuracy of rad. Given the average femoral arterial radius of 4–5 mm, the proposed system is demonstrated with a great potential for precise needle guidance in femoral artery insertion procedures. In addition, the findings highlight the broader potential applications of the system in the medical field.

Preliminary study of needle tracking in a microsurgical robotic system for automated operations

Development and Control of A Robotic Arm for Percutaneous Surgery

Toward Autonomous Robotic Micro-Suturing using Optical Coherence Tomography Calibration and Path Planning

A Novel Robotic Guidance System With Eye-Gaze Tracking Control for Needle-Based Interventions

Needle Detection and Localisation for Robot‐assisted Subretinal Injection Using Deep Learning

Needle Tip Tracking Based on Optical Imaging and AI

Visually Servoed Suturing for Robotic Microsurgical Keratoplasty

Preliminary Study of a Modular MR-Compatible Robot for Image-Guided Insertion of Multiple Needles

Autonomous Medical Needle Steering In Vivo

A dual-instrument Kalman-based tracker to enhance robustness of microsurgical tools tracking

Real-Time Constrained 6D Object-Pose Tracking of An In-Hand Suture Needle for Minimally Invasive Robotic Surgery

Autonomous Needle Navigation in Retinal Microsurgery: Evaluation in ex vivo Porcine Eyes

Localization and Control of Magnetic Suture Needles in Cluttered Surgical Site with Blood and Tissue

An Optical Tracker Based Registration Method Using Feedback for Robot-Assisted Insertion Surgeries.

Modeling of path planning and needle steering with path tracking in anatomical soft tissues for minimally invasive surgery

Markerless Suture Needle 6D Pose Tracking with Robust Uncertainty Estimation for Autonomous Minimally Invasive Robotic Surgery

Beveled Needle Position and Pose Estimation Based on Optical Coherence Tomography in Ophthalmic Microsurgery

Autonomous Needle Navigation in Subretinal Injections via iOCT

An Eye-Gaze-Controlled Needle Deployment Robot: Design, Modeling, and Experimental Evaluation

Robotic System for Microsurgical Keratoplasty

Research Of Automatic Needle Locating Based On Stereo Visual Servoing