Abstract:Deep needle insertion to a target often poses a huge challenge, requiring a combination of specialized skills, assistive technology, and extensive training. One of the frequently encountered medical scenarios demanding such expertise includes the needle insertion into a femoral vessel in the groin. After the access to the femoral vessel, various medical procedures, such as cardiac catheterization and extracorporeal membrane oxygenation (ECMO) can be performed. However, even with the aid of Ultrasound imaging, achieving successful insertion can necessitate multiple attempts due to the complexities of anatomy and tissue deformation. To address this challenge, this paper presents an innovative technology for needle tip real-time tracking, aiming for enhanced needle insertion guidance. Specifically, our approach revolves around the creation of scattering imaging using an optical fiber-equipped needle, and uses Convolutional Neural Network (CNN) based algorithms to enable real-time estimation of the needle tip's position and orientation during insertion procedures. The efficacy of the proposed technology was rigorously evaluated through three experiments. The first two experiments involved rubber and bacon phantoms to simulate groin anatomy. The positional errors averaging 2.3+1.5mm and 2.0+1.2mm, and the orientation errors averaging 0.2+0.11rad and 0.16+0.1rad. Furthermore, the system's capabilities were validated through experiments conducted on fresh porcine phantom mimicking more complex anatomical structures, yielding positional accuracy results of 3.2+3.1mm and orientational accuracy of 0.19+0.1rad. Given the average femoral arterial radius of 4 to 5mm, the proposed system is demonstrated with a great potential for precise needle guidance in femoral artery insertion procedures. In addition, the findings highlight the broader potential applications of the system in the medical field.

Needle Detection and Localisation for Robot‐assisted Subretinal Injection Using Deep Learning

The Neural Networks Based Needle Detection for Medical Retinal Surgery

Autonomous Needle Navigation in Subretinal Injections via iOCT

Deep Learning Guided Autonomous Surgery: Guiding Small Needles into Sub-Millimeter Scale Blood Vessels

Automatic and accurate needle detection in 2D ultrasound during robot-assisted needle insertion process

Needle Tip Tracking Based on Optical Imaging and AI

Needle Segmentation in Volumetric Optical Coherence Tomography Images for Ophthalmic Microsurgery

Robust Needle Localization and Enhancement Algorithm for Ultrasound by Deep Learning and Beam Steering Methods

Medical needle tip tracking based on Optical Imaging and AI

Towards Robotic-Assisted Subretinal Injection: A Hybrid Parallel–Serial Robot System Design and Preliminary Evaluation

Robotic Navigation Autonomy for Subretinal Injection via Intelligent Real-Time Virtual iOCT Volume Slicing

Needle Segmentation Using GAN: Restoring Thin Instrument Visibility in Robotic Ultrasound

Towards Autonomous Retinal Microsurgery Using RGB-D Images

Semi-supervised Vein Segmentation of Ultrasound Images for Autonomous Venipuncture.

Real-time Deformation-aware Control for Autonomous Robotic Subretinal Injection under iOCT Guidance

Beveled Needle Position and Pose Estimation Based on Optical Coherence Tomography in Ophthalmic Microsurgery

An automatic drug injection device with spatial micro-force perception guided by an microscopic image for robot-assisted ophthalmic surgery

Lightweight Learning-based Automatic Segmentation of Subretinal Blebs on Microscope-Integrated Optical Coherence Tomography Images.

Improving needle visibility in LED-based photoacoustic imaging using deep learning with semi-synthetic datasets

Towards Deep Learning Guided Autonomous Eye Surgery Using Microscope and iOCT Images

Real-time deep learning-based image recognition for applications in automated positioning and injection of biological cells