Abstract:Identification of prostate gold fiducial markers in magnetic resonance imaging (MRI) images is challenging when CT images are not available, due to misclassifications from intra-prostatic calcifications. It is also a time consuming task and automated identification methods have been suggested as an improvement for both objectives. Multi-echo gradient echo (MEGRE) images have been utilized for manual fiducial identification with 100% detection accuracy. The aim is therefore to develop an automatic deep learning based method for fiducial identification in MRI images intended for MRI-only prostate radiotherapy. MEGRE images from 326 prostate cancer patients with fiducials were acquired on a 3T MRI, post-processed with N4 bias correction, and the fiducial center of mass (CoM) was identified. A 9 mm radius sphere was created around the CoM as ground truth. A deep learning HighRes3DNet model for semantic segmentation was trained using image augmentation. The model was applied to 39 MRI-only patients and 3D probability maps for fiducial location and segmentation were produced and spatially smoothed. In each of the three largest probability peaks, a 9 mm radius sphere was defined. Detection sensitivity and geometric accuracy was assessed. To raise awareness of potential false findings a 'BeAware' score was developed, calculated from the total number and quality of the probability peaks. All datasets, annotations and source code used were made publicly available. The detection sensitivity for all fiducials were 97.4%. Thirty-six out of thirty-nine patients had all fiducial markers correctly identified. All three failed patients generated a user notification using the BeAware score. The mean absolute difference between the detected fiducial and ground truth CoM was 0.7 ± 0.9 [0 3.1] mm. A deep learning method for automatic fiducial identification in MRI images was developed and evaluated with state-of-the-art results. The BeAware score has the potential to notify the user regarding patients where the proposed method is uncertain.

Automatic Localization of the Center of Fiducial Markers in 3d Ct/Mri Images for Image-Guided Neurosurgery

Automatic Detection of Fiducial Marker Center Based on Shape Index and Curvedness

An Image Registration Approach Based on 3D Geometric Projection Similarity of the Human Head

Automated Global Optimization Surface-Matching Registration Method for Image-to-Patient Spatial Registration in an Image-Guided Neurosurgery System

An Automatic Spatial Registration Method for Image-Guided Neurosurgery System

A New Robust Markerless Method for Automatic Image-to-patient Registration in Image-Guided Neurosurgery System.

Automated Fiducial Marker Detection and Fiducial Point Localization in CT Images for Lung Biopsy Image-Guided Surgery Systems.

Guidelines for the Placement of Fiducial Points in Image-Guided Neurosurgery

Accuracy Of Fiducial Marker Based Multimodal Image Registration In Image Guided Surgery

Robust and efficient 3D registration via depth map-based feature point matching in image-guided neurosurgery

Registration of 3D FMT and CT Images of Mouse Via Affine Transformation with Bayesian Iterative Closest Points

Automatic detection and localization of markers in stereotactic neurosurgery

Real-time Automatic Registration in Optical Surgical Navigation

Enhancing Precision in Medical Imaging: A 3D CNN Approach for Fiducial Point Detection in MRI Data

Automatic Localization and Marking for Features of Skull by Ct Image

A Robust Automated Markerless Registration Framework for Neurosurgery Navigation.

Anatomical Landmarks for Point-Matching Registration in Image-Guided Neurosurgery

Biological Fiducial Point Based Registration for Multiple Brain Tissues Reconstructed from Different Imaging Modalities

Visual Marker Localization in Robot-Assisted Stereotactic Neurosurgery.

A model-based, semi-global segmentation approach for automatic 3-D point landmark localization in neuroimages

Development and evaluation of a deep learning based artificial intelligence for automatic identification of gold fiducial markers in an MRI-only prostate radiotherapy workflow