Abstract:Deep needle insertion to a target often poses a huge challenge, requiring a combination of specialized skills, assistive technology, and extensive training. One of the frequently encountered medical scenarios demanding such expertise includes the needle insertion into a femoral vessel in the groin. After the access to the femoral vessel, various medical procedures, such as cardiac catheterization and extracorporeal membrane oxygenation (ECMO) can be performed. However, even with the aid of Ultrasound imaging, achieving successful insertion can necessitate multiple attempts due to the complexities of anatomy and tissue deformation. To address this challenge, this paper presents an innovative technology for needle tip real-time tracking, aiming for enhanced needle insertion guidance. Specifically, our approach revolves around the creation of scattering imaging using an optical fiber-equipped needle, and uses Convolutional Neural Network (CNN) based algorithms to enable real-time estimation of the needle tip's position and orientation during insertion procedures. The efficacy of the proposed technology was rigorously evaluated through three experiments. The first two experiments involved rubber and bacon phantoms to simulate groin anatomy. The positional errors averaging 2.3+1.5mm and 2.0+1.2mm, and the orientation errors averaging 0.2+0.11rad and 0.16+0.1rad. Furthermore, the system's capabilities were validated through experiments conducted on fresh porcine phantom mimicking more complex anatomical structures, yielding positional accuracy results of 3.2+3.1mm and orientational accuracy of 0.19+0.1rad. Given the average femoral arterial radius of 4 to 5mm, the proposed system is demonstrated with a great potential for precise needle guidance in femoral artery insertion procedures. In addition, the findings highlight the broader potential applications of the system in the medical field.

Needle Tip Pose Estimation for Ultrasound-Guided Steerable Flexible Needle With a Complicated Trajectory in Soft Tissue

Ultrasound Robotic System to Multi-Approach Puncture for Endoscopic Spinal Surgery

Needle path planning and steering in a three-dimensional non-static environment using two-dimensional ultrasound images

Needle Tip Tracking Based on Optical Imaging and AI

Needle Segmentation in US Images Based on Real-time Gray-scale Hough Transformation

Medical needle tip tracking based on Optical Imaging and AI

Dynamic Path Planning for Bevel-Tip Flexible Needle Insertion into Soft Tissue Based on a Real-Time Finite Element Model

Optical Flow-Based Tracking of Needles and Needle-Tip Localization Using Circular Hough Transform in Ultrasound Images

Improving Needle Tip Tracking and Detection in Ultrasound-based Navigation System Using Deep Learning-enabled Approach

TipDet: A multi-keyframe motion-aware framework for tip detection during ultrasound-guided interventions

Modeling of path planning and needle steering with path tracking in anatomical soft tissues for minimally invasive surgery

Needle tracking in low-resolution ultrasound volumes using deep learning

STEERABLE NEEDLE TRAJECTORY FOLLOWING IN THE LUNG: TORSIONAL DEADBAND COMPENSATION AND FULL POSE ESTIMATION WITH 5DOF FEEDBACK FOR NEEDLES PASSING THROUGH FLEXIBLE ENDOSCOPES

Needle Tip Force Estimation using an OCT Fiber and a Fused convGRU-CNN Architecture

Vessel Pose Estimation for Obstacle Avoidance in Needle Steering Surgery Using Multiple Forward Looking Sensors

A Novel Method for Enhanced Needle Localization Using Ultrasound-Guidance

Real-Time Curvature Detection of a Flexible Needle with a Bevel Tip

An Algorithm for Accurate Needle Orientation

Needle Segmentation Using GAN: Restoring Thin Instrument Visibility in Robotic Ultrasound

Automatic and accurate needle detection in 2D ultrasound during robot-assisted needle insertion process

Hybrid Deep Learning and Model-Based Needle Shape Prediction