Abstract:Purpose: To develop and evaluate a transformer-based deep learning model for the synthesis of nephrographic phase images in CT urography (CTU) examinations from the unenhanced and urographic phases. Materials and Methods: This retrospective study was approved by the local Institutional Review Board. A dataset of 119 patients (mean $\pm$ SD age, 65 $\pm$ 12 years; 75/44 males/females) with three-phase CT urography studies was curated for deep learning model development. The three phases for each patient were aligned with an affine registration algorithm. A custom model, coined Residual transformer model for Nephrographic phase CT image synthesis (ResNCT), was developed and implemented with paired inputs of non-contrast and urographic sets of images trained to produce the nephrographic phase images, that were compared with the corresponding ground truth nephrographic phase images. The synthesized images were evaluated with multiple performance metrics, including peak signal to noise ratio (PSNR), structural similarity index (SSIM), normalized cross correlation coefficient (NCC), mean absolute error (MAE), and root mean squared error (RMSE). Results: The ResNCT model successfully generated synthetic nephrographic images from non-contrast and urographic image inputs. With respect to ground truth nephrographic phase images, the images synthesized by the model achieved high PSNR (27.8 $\pm$ 2.7 dB), SSIM (0.88 $\pm$ 0.05), and NCC (0.98 $\pm$ 0.02), and low MAE (0.02 $\pm$ 0.005) and RMSE (0.042 $\pm$ 0.016). Conclusion: The ResNCT model synthesized nephrographic phase CT images with high similarity to ground truth images. The ResNCT model provides a means of eliminating the acquisition of the nephrographic phase with a resultant 33% reduction in radiation dose for CTU examinations.

Res-U2Net: Untrained Deep Learning for Phase Retrieval and Image Reconstruction

Single-frame Noisy Interferogram Phase Retrieval Using an End-to-end Deep Learning Network with Physical Information Constraints

Res2-UNet++: A Deep Learning Image Post-Processing Method for Electrical Resistance Tomography

3D-2D Neural Nets for Phase Retrieval in Noisy Interferometric Imaging

Unsupervised Deep Learning for Phase Retrieval Via Teacher-Student Distillation.

End-to-end Res-Unet based reconstruction algorithm for photoacoustic imaging

Learning Phase Retrieval Without Using Real Data

Phase Retrieval: From Computational Imaging to Machine Learning

UHRNet: A Deep Learning-Based Method for Accurate 3D Reconstruction from a Single Fringe-Pattern

Irsnet: An Inception-Resnet Feature Reconstruction Model For Building Segmentation

Res-NeuS: Deep Residuals and Neural Implicit Surface Learning for Multi-View Reconstruction

ResNCT: A Deep Learning Model for the Synthesis of Nephrographic Phase Images in CT Urography

Physics-based Iterative Projection Complex Neural Network for Phase Retrieval in Lensless Microscopy Imaging

Unsupervised Phase Retrieval Using Deep Approximate MMSE Estimation

Dual-constrained Physics-Enhanced Untrained Neural Network for Lensless Imaging

Long-Range Imaging through Scattering Media Using Deep Learning

Re-UNet: a novel multi-scale reverse U-shape network architecture for low-dose CT image reconstruction

Transformer based Deep learning Hybrid Architecture for Phase Unwrapping

Untrained neural network embedded Fourier phase retrieval from few measurements

3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction