Abstract:Background Magnetic resonance imaging (MRI) is the gold standard for delineating cancerous lesions in soft tissue. Catheter‐based interventions require the accurate placement of multiple long, flexible catheters at the target site. The manual segmentation of catheters in MR images is a challenging and time‐consuming task. There is a need for automated catheter segmentation to improve the efficiency of MR‐guided procedures. Purpose To develop and assess a machine learning algorithm for the detection of multiple catheters in magnetic resonance images used during catheter‐based interventions. Methods In this work, a 3D U‐Net was trained to retrospectively segment catheters in scans acquired during clinical MR‐guided high dose rate (HDR) prostate brachytherapy cases. To assess confidence in segmentation, multiple AI models were trained. On clinical test cases, average segmentation results were used to plan the brachytherapy delivery. Dosimetric parameters were compared to the original clinical plan. Data was obtained from 35 patients who underwent HDR prostate brachytherapy for focal disease with a total of 214 image volumes. 185 image volumes from 30 patients were used for training using a five‐fold cross validation split to divide the data for training and validation. To generate confidence measures of segmentation accuracy, five trained models were generated. The remaining five patients (29 volumes) were used to test the performance of the trained model by comparison to manual segmentations of three independent observers and assessment of dosimetric impact on the final clinical brachytherapy plans. Results The network successfully identified 95% of catheters in the test set at a rate of 0.89 s per volume. The multi‐model method identified the small number of cases where AI segmentation of individual catheters was poor, flagging the need for user input. AI‐based segmentation performed as well as segmentations by independent observers. Plan dosimetry using AI‐segmented catheters was comparable to the original plan. Conclusion The vast majority of catheters were accurately identified by AI segmentation, with minimal impact on plan outcomes. The use of multiple AI models provided confidence in the segmentation accuracy and identified catheter segmentations that required further manual assessment. Real‐time AI catheter segmentation can be used during MR‐guided insertions to assess deflections and for rapid planning of prostate brachytherapy.

Autonomous Image-Guided Robot-Assisted Active Catheter Insertion

Robot-assisted Active Catheter Insertion: Algorithms and Experiments

Design and Experimental Validation of an Active Catheter for Endovascular Navigation

Towards Automatic Manipulation of Intra-cardiac Echocardiography Catheter

A Novel Robot-Assisted Endovascular Catheterization System With Haptic Force Feedback

MRI Robots for Needle-Based Interventions: Systems and Technology

Toward MRI-guided coronary catheterization: visualization of guiding catheters, guidewires, and anatomy in real time.

Design and Performance Evaluation of Real-time Endovascular Interventional Surgical Robotic System with High Accuracy

MRI-guided coronary catheterization and PTCA: A feasibility study on a dog model.

Automating Catheterization Labs with Real-Time Perception

Automatic planning of needle placement for robot-assisted percutaneous procedures

AI-based Agents for Automated Robotic Endovascular Guidewire Manipulation

Integrated Magnetic Location Sensing and Actuation of Steerable Robotic Catheters for Peripheral Arterial Disease Treatment

Rapid multi‐catheter segmentation for magnetic resonance image‐guided catheter‐based interventions

Design and Hierarchical Control of a Homocentric Variable-Stiffness Magnetic Catheter for Multiarm Robotic Ultrasound-Assisted Coronary Intervention

Experience of robotic catheter ablation in humans using a novel remotely steerable catheter sheath

Design and Validation of a CT- and MRI-Guided Robot for Percutaneous Needle Procedures

Preliminary Evaluation of an Ultrasound-Guided Robotic System for Autonomous Percutaneous Intervention

Design and Performance Evaluation of a Remote Catheter Navigation System

Soft robotic steerable microcatheter for the endovascular treatment of cerebral disorders