Abstract:Background: Automated catheter localization for ultrasound guided high-dose-rate prostate brachytherapy faces challenges relating to imaging noise and artifacts. To date, catheter reconstruction during the clinical procedure is performed manually. Deep learning has been successfully applied to a wide variety of complex tasks and has the potential to tackle the unique challenges associated with multiple catheter localization on ultrasound. Such a task is well suited for automation, with the potential to improve productivity and reliability. Purpose: We developed a deep learning model for automated catheter reconstruction and investigated potential factors influencing model performance. The model was designed to integrate into a clinical workflow, with a proposed reconstruction confidence metric to aid in planner verification. Methods: Datasets from 242 patients treated from 2016 to 2020 were collected retrospectively. The anonymized dataset comprises 31,000 transverse images reconstructed from 3D sagittal ultrasound acquisitions and 3500 implanted catheters manually localized by the planner. Each catheter was retrospectively ranked based on the severity of imaging artifacts affecting reconstruction difficulty. The U-NET deep learning architecture was trained to localize implanted catheters on transverse images. A fivefold cross-validation method was used, allowing for evaluation over the entire dataset. The postprocessing software combined the predictions with patient-specific implant information to reconstructed catheters in 3D space, uniquely matched to the implanted grid positions. A reconstruction confidence metric was calculated based on the number and probability of localized predictions per catheter. For each patient, deep learning prediction and postprocessing reconstruction were completed in under 2 min on a nonperformance PC. Results: Overall, 80% of catheter reconstructions were accurate, within 2 mm along 90% of the length. The catheter tip was often not detected and required extrapolation during reconstruction. The reconstruction accuracy was 89% for the easiest catheter ranking and decreased to 13% for the highest difficulty ranking, when the aid of live ultrasound would have been recommended. Even when limited to the easiest ranked catheters, the reconstruction accuracy decreased at distal grid positions, down to 50%. Individual implantation style was found to influence the frequency of severe artifacts, slightly impacting the model accuracy. A reconstruction confidence metric identified the difficult catheters, removed the observed individual variation, and increased the overall accuracy to 91% while excluding 27% of the reconstructions. Conclusions: The deep learning model localized implanted catheters over a large clinical dataset, with overall promising results. The model faced challenges due to ultrasound artifacts and image degradation distal to the probe, underlining the continued importance of maintaining image quality and minimizing artifacts. A potential workflow for integration into the clinical procedure was demonstrated, including the use of a confidence metric to predict low accuracy reconstructions. Comparison between models evaluated on different datasets should also consider underlying differences, such as the frequency and severity of imaging artifacts.

700.03 Deep Learning Model for Real-Time Catheter Tracking From Fluoroscopy

Dynamic Coronary Roadmapping via Catheter Tip Tracking in X-ray Fluoroscopy with Deep Learning Based Bayesian Filtering

A Fast Catheter Segmentation and Tracking from Echocardiographic Sequences Based on Corresponding X-ray Fluoroscopic Image Segmentation and Hierarchical GRAPH Modelling

Fast Catheter Tracking in Echocardiographic Sequences for Cardiac Catheterization Interventions

Auxiliary Input in Training: Incorporating Catheter Features into Deep Learning Models for ECG-Free Dynamic Coronary Roadmapping

Automatic Tool Segmentation and Tracking During Robotic Intravascular Catheterization for Cardiac Interventions.

The challenges facing deep learning-based catheter localization for ultrasound guided high-dose-rate prostate brachytherapy

End-to-End Real-time Catheter Segmentation with Optical Flow-Guided Warping During Endovascular Intervention.

Catheter Tracking in 3D Echocardiographic Sequences Based on Tracking in 2D X-ray Sequences for Cardiac Catheterization Interventions.

Real-time guidewire tracking and segmentation in intraoperative x-ray

Online tracking of interventional devices for endovascular aortic repair

Self-Supervised Learning for Interventional Image Analytics: Towards Robust Device Trackers

CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers

A Multiple Catheter Tips Tracking Method in X‐ray Fluoroscopy Images by a New Lightweight Segmentation Network and Bayesian Filtering

Real-time Pose Tracking for a Continuum Guidewire Robot under Fluoroscopic Imaging

Topology observing 3D device reconstruction from continuous‐sweep limited angle fluoroscopy

Catheter Kinematics for Intracardiac Navigation

Robust Landmark-based Stent Tracking in X-ray Fluoroscopy

Fast Catheter Segmentation from Echocardiographic Sequences Based on Segmentation from Corresponding X-ray Fluoroscopy for Cardiac Catheterization Interventions.

Motion-adapted Catheter Navigation with Real-Time Instantiation and Improved Visualisation.

Frameless neuronavigation with computer vision and real-time tracking for bedside external ventricular drain placement: a cadaveric study