Abstract:Background Deep‐learning‐based image reconstruction and noise reduction methods (DLIR) have been increasingly deployed in clinical CT. Accurate image quality assessment of these methods is challenging as the performance measured using physical phantoms may not represent the true performance of DLIR in patients since DLIR is trained mostly on patient images. Purpose In this work, we aim to develop a patient‐data‐based virtual imaging trial framework and, as a first application, use it to measure the spatial resolution properties of a DLIR method. Methods The patient‐data‐based virtual imaging trial framework consists of five steps: (1) insertion of lesions into projection domain data using the acquisition geometry of the patient exam to simulate different lesion characteristics; (2) insertion of noise into projection domain data using a realistic photon statistical model of the CT system to simulate different dose levels; (3) creation of DLIR‐processed images from projection or image data; (4) creation of ensembles of DLIR‐processed patient images from a large number of noise and lesion realizations; and (5) evaluation of image quality using ensemble DLIR images. This framework was applied to measure the spatial resolution of a ResNet based deep convolutional neural network (DCNN) trained on patient images. Lesions in a cylindrical shape and different contrast levels (−500, −100, −50, −20, −10 HU) were inserted to the lower right lobe of the liver in a patient case. Multiple dose levels were simulated (50%, 25%, 12.5%). Each lesion and dose condition had 600 noise realizations. Multiple reconstruction and denoising methods were used on all the noise realizations, including the original filtered‐backprojection (FBP), iterative reconstruction (IR), and the DCNN method with three different strength setting (DCNN‐weak, DCNN‐medium, and DCNN‐strong). Mean lesion signal was calculated by performing ensemble averaging of all the noise realizations for each lesion and dose condition and then subtracting the lesion‐present images from the lesion absent images. Modulation transfer functions (MTFs) both in‐plane and along the z‐axis were calculated based on the mean lesion signals. The standard deviations of MTFs at each condition were estimated with bootstrapping: randomly sampling (with replacement) all the DLIR/FBP/IR images from the ensemble data (600 samples) at each condition. The impact of varying lesion contrast, dose levels, and denoising strengths were evaluated. Statistical analysis with paired t‐test was used to compare the z‐axis and in‐plane spatial resolution of five algorithms for five different contrasts and three dose levels. Results The in‐plane and z‐axis spatial resolution degradation of DCNN becomes more severe as the contrast or radiation dose decreased, or DCNN denoising strength increased. In comparison with FBP, a 59.5% and 4.1% reduction of in‐plane and z‐axis MTF (in terms of spatial frequencies at 50% MTF), respectively, was observed at low contrast (−10 HU) for DCNN with the highest denoising strength at 25% routine dose level. When the dose level reduces from 50% to 12.5% of routine dose, the in‐plane and z‐axis MTFs reduces from 92.1% to 76.3%, and from 98.9% to 95.5%, respectively, at contrast of −100 HU, using FBP as the reference. For most conditions of contrasts and dose levels, significant differences were found among the five algorithms, with the following relationship in both in‐plane and cross‐plane spatial resolution: FBP > DCNN‐Weak > IR > DCNN‐Medium > DCNN‐Strong. The spatial resolution difference among algorithms decreases at higher contrast or dose levels. Conclusions A patient‐data‐based virtual imaging trial framework was developed and applied to measuring the spatial resolution properties of a DCNN noise reduction method at different contrast and dose levels using real patient data. As with other non‐linear image reconstruction and post‐processing techniques, the evaluated DCNN method degraded the in‐plane and z‐axis spatial resolution at lower contrast levels, lower radiation dose, and higher denoising strength.

Value of vendor-agnostic deep learning image denoising in brain computed tomography: A multi-scanner study

Assessment of image quality and impact of deep learning-based software in non-contrast head CT scans

Deep Learning-Based Denoising Enables High-Quality, Fully Diagnostic Neuroradiological Trauma CT at 25% Radiation Dose

Deep-learning denoising minimizes radiation exposure in neck CT beyond the limits of conventional reconstruction

Multi-reader multiparametric DECT study evaluating different strengths of iterative and deep learning-based image reconstruction techniques

Deep Learning Algorithm for Simultaneous Noise Reduction and Edge Sharpening in Low-Dose CT Images: A Pilot Study Using Lumbar Spine CT

Evaluation of a Vendor-Agnostic Deep Learning Model for Noise Reduction and Image Quality Improvement in Dental CBCT

Fully automated image quality evaluation on patient CT: Multi-vendor and multi-reconstruction study

Image quality evaluation in deep‐learning‐based CT noise reduction using virtual imaging trial methods: Contrast‐dependent spatial resolution

Competitive performance of a modularized deep neural network compared to commercial algorithms for low-dose CT image reconstruction

Can Deep Learning Outperform Modern Commercial CT Image Reconstruction Methods?

A two-stage deep-learning framework for CT denoising based on a clinically structure-unaligned paired data set

Deep Learning Enables 60% Accelerated Volumetric Brain MRI While Preserving Quantitative Performance: A Prospective, Multicenter, Multireader Trial

Dose reduction and image enhancement in micro-CT using deep learning

Impact of deep Learning-enhanced contrast on diagnostic accuracy in stroke CT angiography

Image Quality Assessment of a Deep Learning-Based Automatic Bone Removal Algorithm for Cervical CTA

Impact of AI-Based Post-Processing on Image Quality of Non-Contrast Computed Tomography of the Chest and Abdomen

Assessing the performance of CT image denoisers using Laguerre-Gauss Channelized Hotelling Observer for lesion detection

Iterative reconstruction and deep learning algorithms for enabling low-dose computed tomography in midfacial trauma

Improvement of depiction of the intracranial arteries on brain CT angiography using deep learning reconstruction

Deep Learning-Based Low Dose Ct Imaging