Abstract:Deep needle insertion to a target often poses a huge challenge, requiring a combination of specialized skills, assistive technology, and extensive training. One of the frequently encountered medical scenarios demanding such expertise includes the needle insertion into a femoral vessel in the groin. After the access to the femoral vessel, various medical procedures, such as cardiac catheterization and extracorporeal membrane oxygenation (ECMO) can be performed. However, even with the aid of Ultrasound imaging, achieving successful insertion can necessitate multiple attempts due to the complexities of anatomy and tissue deformation. To address this challenge, this paper presents an innovative technology for needle tip real-time tracking, aiming for enhanced needle insertion guidance. Specifically, our approach revolves around the creation of scattering imaging using an optical fiber-equipped needle, and uses Convolutional Neural Network (CNN) based algorithms to enable real-time estimation of the needle tip's position and orientation during insertion procedures. The efficacy of the proposed technology was rigorously evaluated through three experiments. The first two experiments involved rubber and bacon phantoms to simulate groin anatomy. The positional errors averaging 2.3+1.5mm and 2.0+1.2mm, and the orientation errors averaging 0.2+0.11rad and 0.16+0.1rad. Furthermore, the system's capabilities were validated through experiments conducted on fresh porcine phantom mimicking more complex anatomical structures, yielding positional accuracy results of 3.2+3.1mm and orientational accuracy of 0.19+0.1rad. Given the average femoral arterial radius of 4 to 5mm, the proposed system is demonstrated with a great potential for precise needle guidance in femoral artery insertion procedures. In addition, the findings highlight the broader potential applications of the system in the medical field.

Needle Tip Force Estimation using an OCT Fiber and a Fused convGRU-CNN Architecture

Spatio-Temporal Deep Learning Models for Tip Force Estimation During Needle Insertion

Needle tip force estimation by deep learning from raw spectral OCT data

Medical needle tip tracking based on Optical Imaging and AI

Needle Tip Tracking Based on Optical Imaging and AI

Optical Fiber-Based Needle Shape Sensing in Real Tissue: Single Core vs. Multicore Approaches

Force Estimation from OCT Volumes using 3D CNNs

Needle Tip Pose Estimation for Ultrasound-Guided Steerable Flexible Needle With a Complicated Trajectory in Soft Tissue

Needle Detection and Localisation for Robot‐assisted Subretinal Injection Using Deep Learning

Toward FBG-Sensorized Needle Shape Detection in Real Tissue Insertions

Identification of tissue types and boundaries with a fiber optic force sensor

Exploring the Needle Tip Interaction Force with Retinal Tissue Deformation in Vitreoretinal Surgery

Toward FBG-Sensorized Needle Shape Prediction in Tissue Insertions

Data-Driven 3-D Tactile Cues With Intermediate Soft Interfaces Toward Training Needle Insertions

Tissue Classification During Needle Insertion Using Self-Supervised Contrastive Learning and Optical Coherence Tomography

A method for predicting needle insertion deflection in soft tissue based on cutting force identification

Computer‐aided Veress needle guidance using endoscopic optical coherence tomography and convolutional neural networks

Tip Estimation Method In Phantoms For Curved Needle Using 2d Transverse Ultrasound Images

Towards Human‐controlled, Real‐time Shape Sensing Based Flexible Needle Steering for MRI‐guided Percutaneous Therapies

Collaborative Robotic Biopsy with Trajectory Guidance and Needle Tip Force Feedback

Tactile needle probe for minimally invasive tissue identification during epidural space insertion