Abstract:Background Deformable registration is required to generate a time‐integrated activity (TIA) map which is essential for voxel‐based dosimetry. The conventional iterative registration algorithm using anatomical images (e.g., computed tomography (CT)) could result in registration errors in functional images (e.g., single photon emission computed tomography (SPECT) or positron emission tomography (PET)). Various deep learning‐based registration tools have been proposed, but studies specifically focused on the registration of serial hybrid images were not found. Purpose In this study, we introduce CoRX‐NET, a novel unsupervised deep learning network designed for deformable registration of hybrid medical images. The CoRX‐NET structure is based on the Swin‐transformer (ST), allowing for the representation of complex spatial connections in images. Its self‐attention mechanism aids in the effective exchange and integration of information across diverse image regions. To augment the amalgamation of SPECT and CT features, cross‐stitch layers have been integrated into the network. Methods Two different 177 Lu DOTATATE SPECT/CT datasets were acquired at different medical centers. 22 sets from Seoul National University and 14 sets from Sunway Medical Centre are used for training/internal validation and external validation respectively. The CoRX‐NET architecture builds upon the ST, enabling the modeling of intricate spatial relationships within images. To further enhance the fusion of SPECT and CT features, cross‐stitch layers have been incorporated within the network. The network takes a pair of SPECT/CT images (e.g., fixed and moving images) and generates a deformed SPECT/CT image. The performance of the network was compared with Elastix and TransMorph using L1 loss and structural similarity index measure (SSIM) of CT, SSIM of normalized SPECT, and local normalized cross correlation (LNCC) of SPECT as metrics. The voxel‐wise root mean square errors (RMSE) of TIA were compared among the different methods. Results The ablation study revealed that cross‐stitch layers improved SPECT/CT registration performance. The cross‐stitch layers notably enhance SSIM (internal validation: 0.9614 vs. 0.9653, external validation: 0.9159 vs. 0.9189) and LNCC of normalized SPECT images (internal validation: 0.7512 vs. 0.7670, external validation: 0.8027 vs. 0.8027). CoRX‐NET with the cross‐stitch layer achieved superior performance metrics compared to Elastix and TransMorph, except for CT SSIM in the external dataset. When qualitatively analyzed for both internal and external validation cases, CoRX‐NET consistently demonstrated superior SPECT registration results. In addition, CoRX‐NET accomplished SPECT/CT image registration in less than 6 s, whereas Elastix required approximately 50 s using the same PC's CPU. When employing CoRX‐NET, it was observed that the voxel‐wise RMSE values for TIA were approximately 27% lower for the kidney and 33% lower for the tumor, compared to when Elastix was used. Conclusion This study represents a major advancement in achieving precise SPECT/CT registration using an unsupervised deep learning network. It outperforms conventional methods like Elastix and TransMorph, reducing uncertainties in TIA maps for more accurate dose assessments.

Clinical Pilot of a Deep Learning Elastic Registration Algorithm to Improve Misregistration Artifact and Image Quality on Routine Oncologic PET/CT

Deep learning based registration for head motion correction in positron emission tomography as a strategy for improved image quantification

Automated 3-dimensional registration of stand-alone (18)F-FDG whole-body PET with CT

Deep learning–based attenuation correction for whole-body PET — a multi-tracer study with 18F-FDG, 68 Ga-DOTATATE, and 18F-Fluciclovine

Deep-learning-based Attenuation Correction for 68Ga-DOTATATE Whole-body PET Imaging: A Dual-center Clinical Study

Image Registration of 18F-FDG PET/CT Using the MotionFree Algorithm and CT Protocols through Phantom Study and Clinical Evaluation

NIMG-84. COMPARISON OF TRADITIONAL AND ADVANCED DEEP-LEARNING PATIENT SPECIFIC REGISTRATION METHODS IN PRESERVING TUMOR HABITAT IN GLIOBLASTOMA TUMORS: A PRELIMINARY STUDY

Attenuation correction and truncation completion for breast PET/MR imaging using deep learning

Quantitative evaluation of a deep learning-based framework to generate whole-body attenuation maps using LSO background radiation in long axial FOV PET scanners

CT MRI Pelvic Deformable Registration via Deep Learning

Deep Learning-Based Longitudinal CT Registration for Anatomy Variation Assessment During Radiotherapy.

Deep learning for improving PET/CT attenuation correction by elastic registration of anatomical data

Correcting CT misregistration in data‐driven gated (DDG) PET with PET self‐gating and deformable image registration

Deformable Image Registration using Unsupervised Deep Learning for CBCT-guided Abdominal Radiotherapy

Deep Learning-Aided Respiratory Motion Compensation in PET/CT: Addressing Motion Induced Resolution Loss, Attenuation Correction Artifacts and PET-CT Misalignment.

An Optimized Registration Method Based on Distribution Similarity and DVF Smoothness for 3D PET and CT Images

Deep learning applications for quantitative and qualitative PET in PET/MR: technical and clinical unmet needs

Enhancing voxel‐based dosimetry accuracy with an unsupervised deep learning approach for hybrid medical image registration

Recovery of the spatially-variant deformations in dual-panel PET reconstructions using deep-learning

Development of a deep learning method for CT-free correction for an ultra-long axial field of view PET scanner

Evaluation of the prostate cancer and its metastases in the [68Ga]Ga-PSMA PET/CT images: deep learning method vs. conventional PET/CT processing