Abstract:Background: Automated catheter localization for ultrasound guided high-dose-rate prostate brachytherapy faces challenges relating to imaging noise and artifacts. To date, catheter reconstruction during the clinical procedure is performed manually. Deep learning has been successfully applied to a wide variety of complex tasks and has the potential to tackle the unique challenges associated with multiple catheter localization on ultrasound. Such a task is well suited for automation, with the potential to improve productivity and reliability. Purpose: We developed a deep learning model for automated catheter reconstruction and investigated potential factors influencing model performance. The model was designed to integrate into a clinical workflow, with a proposed reconstruction confidence metric to aid in planner verification. Methods: Datasets from 242 patients treated from 2016 to 2020 were collected retrospectively. The anonymized dataset comprises 31,000 transverse images reconstructed from 3D sagittal ultrasound acquisitions and 3500 implanted catheters manually localized by the planner. Each catheter was retrospectively ranked based on the severity of imaging artifacts affecting reconstruction difficulty. The U-NET deep learning architecture was trained to localize implanted catheters on transverse images. A fivefold cross-validation method was used, allowing for evaluation over the entire dataset. The postprocessing software combined the predictions with patient-specific implant information to reconstructed catheters in 3D space, uniquely matched to the implanted grid positions. A reconstruction confidence metric was calculated based on the number and probability of localized predictions per catheter. For each patient, deep learning prediction and postprocessing reconstruction were completed in under 2 min on a nonperformance PC. Results: Overall, 80% of catheter reconstructions were accurate, within 2 mm along 90% of the length. The catheter tip was often not detected and required extrapolation during reconstruction. The reconstruction accuracy was 89% for the easiest catheter ranking and decreased to 13% for the highest difficulty ranking, when the aid of live ultrasound would have been recommended. Even when limited to the easiest ranked catheters, the reconstruction accuracy decreased at distal grid positions, down to 50%. Individual implantation style was found to influence the frequency of severe artifacts, slightly impacting the model accuracy. A reconstruction confidence metric identified the difficult catheters, removed the observed individual variation, and increased the overall accuracy to 91% while excluding 27% of the reconstructions. Conclusions: The deep learning model localized implanted catheters over a large clinical dataset, with overall promising results. The model faced challenges due to ultrasound artifacts and image degradation distal to the probe, underlining the continued importance of maintaining image quality and minimizing artifacts. A potential workflow for integration into the clinical procedure was demonstrated, including the use of a confidence metric to predict low accuracy reconstructions. Comparison between models evaluated on different datasets should also consider underlying differences, such as the frequency and severity of imaging artifacts.

Catheter localization in 3D ultrasound using voxel-of-interest-based ConvNets for cardiac intervention

Automated Catheter Localization in Volumetric Ultrasound Using 3D Patch-Wise U-Net with Focal Loss

Improving Catheter Segmentation & Localization in 3D Cardiac Ultrasound Using Direction-Fused FCN

CATHETER DETECTION IN 3D ULTRASOUND USING TRIPLANAR-BASED CONVOLUTIONAL NEURAL NETWORKS

Catheter Detection in 3D Ultrasound by CNN

Efficient Catheter Segmentation in 3D Cardiac Ultrasound using Slice-Based FCN With Deep Supervision and F-Score Loss

Catheter Segmentation in Three-Dimensional Ultrasound Images by Feature Fusion and Model Fitting

Feature Study on Catheter Detection in Three-Dimensional Ultrasound

Feasibility Study of Catheter Segmentation in 3D Frustum Ultrasounds by DCNN

Transferring from ex-vivo to in-vivo: instrument localization in 3D cardiac ultrasound using Pyramid-UNet with hybrid loss

Efficient Medical Instrument Detection in 3D Volumetric Ultrasound Data

Efficient and Robust Instrument Segmentation in 3D Ultrasound Using Patch-of-Interest-FuseNet with Hybrid Loss

Weakly-supervised Learning for Catheter Segmentation in 3D Frustum Ultrasound

Deep Q-Network-Driven Catheter Segmentation in 3D US by Hybrid Constrained Semi-Supervised Learning and Dual-UNet

Real-Time Catheter Extraction from 2d X-Ray Fluoroscopic and 3d Echocardiographic Images for Cardiac Interventions

3D Pyramidal Densely Connected Network with Cross-Frame Uncertainty Guidance for Intravascular Ultrasound Sequence Segmentation.

The challenges facing deep learning-based catheter localization for ultrasound guided high-dose-rate prostate brachytherapy

Deep learning in vivo catheter tip locations for photoacoustic-guided cardiac interventions

ConvNet-Based Localization of Anatomical Structures in 3D Medical Images

CathFlow: Self-Supervised Segmentation of Catheters in Interventional Ultrasound Using Optical Flow and Transformers

3D/2D Registration of Mapping Catheter Images for Arrhythmia Interventional Assistance