ResNCT: A Deep Learning Model for the Synthesis of Nephrographic Phase Images in CT Urography

Syed Jamal Safdar Gardezi,Lucas Aronson,Peter Wawrzyn,Hongkun Yu,E. Jason Abel,Daniel D. Shapiro,Meghan G. Lubner,Joshua Warner,Giuseppe Toia,Lu Mao,Pallavi Tiwari,Andrew L. Wentland
2024-05-29
Abstract:Purpose: To develop and evaluate a transformer-based deep learning model for the synthesis of nephrographic phase images in CT urography (CTU) examinations from the unenhanced and urographic phases. Materials and Methods: This retrospective study was approved by the local Institutional Review Board. A dataset of 119 patients (mean $\pm$ SD age, 65 $\pm$ 12 years; 75/44 males/females) with three-phase CT urography studies was curated for deep learning model development. The three phases for each patient were aligned with an affine registration algorithm. A custom model, coined Residual transformer model for Nephrographic phase CT image synthesis (ResNCT), was developed and implemented with paired inputs of non-contrast and urographic sets of images trained to produce the nephrographic phase images, that were compared with the corresponding ground truth nephrographic phase images. The synthesized images were evaluated with multiple performance metrics, including peak signal to noise ratio (PSNR), structural similarity index (SSIM), normalized cross correlation coefficient (NCC), mean absolute error (MAE), and root mean squared error (RMSE). Results: The ResNCT model successfully generated synthetic nephrographic images from non-contrast and urographic image inputs. With respect to ground truth nephrographic phase images, the images synthesized by the model achieved high PSNR (27.8 $\pm$ 2.7 dB), SSIM (0.88 $\pm$ 0.05), and NCC (0.98 $\pm$ 0.02), and low MAE (0.02 $\pm$ 0.005) and RMSE (0.042 $\pm$ 0.016). Conclusion: The ResNCT model synthesized nephrographic phase CT images with high similarity to ground truth images. The ResNCT model provides a means of eliminating the acquisition of the nephrographic phase with a resultant 33% reduction in radiation dose for CTU examinations.
Image and Video Processing,Artificial Intelligence,Medical Physics
What problem does this paper attempt to address?
### Problems the Paper Aims to Solve The main objective of this paper is to develop a deep learning model based on the Transformer architecture to synthesize nephrographic phase images from non-contrast and urographic phase images. Specifically: 1. **Simplify the CT Urography (CTU) Process**: - Traditional three-phase CTU includes non-contrast, nephrographic, and urographic phases. Each phase requires separate acquisition, leading to higher radiation doses. - By developing a deep learning model (ResNCT), nephrographic phase images can be synthesized using only non-contrast and urographic phase images, thus simplifying the three-phase CTU to a two-phase CTU. 2. **Reduce Radiation Dose**: - The radiation dose of traditional three-phase CTU is approximately three times that of standard portal venous phase CT. By eliminating the nephrographic phase acquisition, about 33% of the radiation dose can be reduced. 3. **Improve Image Quality**: - The ResNCT model can generate synthetic images that are highly similar to real nephrographic phase images. Experimental results show that the synthetic images perform well in terms of Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index (SSIM), and other performance metrics. - The synthetic images retain the attenuation values of renal tissues and can distinguish between different structures, such as non-enhanced and enhanced structures. 4. **Standardize Nephrographic Phase Images**: - Traditional nephrographic phase images exhibit some variability due to differences in patients' renal function and acquisition times. The images synthesized by the deep learning model eliminate this variability, making the images more consistent. In summary, this study aims to simplify the CT urography process, reduce radiation dose, and improve the consistency and accuracy of image quality by developing the ResNCT model.