Abstract:Background Deep‐learning‐based image reconstruction and noise reduction methods (DLIR) have been increasingly deployed in clinical CT. Accurate image quality assessment of these methods is challenging as the performance measured using physical phantoms may not represent the true performance of DLIR in patients since DLIR is trained mostly on patient images. Purpose In this work, we aim to develop a patient‐data‐based virtual imaging trial framework and, as a first application, use it to measure the spatial resolution properties of a DLIR method. Methods The patient‐data‐based virtual imaging trial framework consists of five steps: (1) insertion of lesions into projection domain data using the acquisition geometry of the patient exam to simulate different lesion characteristics; (2) insertion of noise into projection domain data using a realistic photon statistical model of the CT system to simulate different dose levels; (3) creation of DLIR‐processed images from projection or image data; (4) creation of ensembles of DLIR‐processed patient images from a large number of noise and lesion realizations; and (5) evaluation of image quality using ensemble DLIR images. This framework was applied to measure the spatial resolution of a ResNet based deep convolutional neural network (DCNN) trained on patient images. Lesions in a cylindrical shape and different contrast levels (−500, −100, −50, −20, −10 HU) were inserted to the lower right lobe of the liver in a patient case. Multiple dose levels were simulated (50%, 25%, 12.5%). Each lesion and dose condition had 600 noise realizations. Multiple reconstruction and denoising methods were used on all the noise realizations, including the original filtered‐backprojection (FBP), iterative reconstruction (IR), and the DCNN method with three different strength setting (DCNN‐weak, DCNN‐medium, and DCNN‐strong). Mean lesion signal was calculated by performing ensemble averaging of all the noise realizations for each lesion and dose condition and then subtracting the lesion‐present images from the lesion absent images. Modulation transfer functions (MTFs) both in‐plane and along the z‐axis were calculated based on the mean lesion signals. The standard deviations of MTFs at each condition were estimated with bootstrapping: randomly sampling (with replacement) all the DLIR/FBP/IR images from the ensemble data (600 samples) at each condition. The impact of varying lesion contrast, dose levels, and denoising strengths were evaluated. Statistical analysis with paired t‐test was used to compare the z‐axis and in‐plane spatial resolution of five algorithms for five different contrasts and three dose levels. Results The in‐plane and z‐axis spatial resolution degradation of DCNN becomes more severe as the contrast or radiation dose decreased, or DCNN denoising strength increased. In comparison with FBP, a 59.5% and 4.1% reduction of in‐plane and z‐axis MTF (in terms of spatial frequencies at 50% MTF), respectively, was observed at low contrast (−10 HU) for DCNN with the highest denoising strength at 25% routine dose level. When the dose level reduces from 50% to 12.5% of routine dose, the in‐plane and z‐axis MTFs reduces from 92.1% to 76.3%, and from 98.9% to 95.5%, respectively, at contrast of −100 HU, using FBP as the reference. For most conditions of contrasts and dose levels, significant differences were found among the five algorithms, with the following relationship in both in‐plane and cross‐plane spatial resolution: FBP > DCNN‐Weak > IR > DCNN‐Medium > DCNN‐Strong. The spatial resolution difference among algorithms decreases at higher contrast or dose levels. Conclusions A patient‐data‐based virtual imaging trial framework was developed and applied to measuring the spatial resolution properties of a DCNN noise reduction method at different contrast and dose levels using real patient data. As with other non‐linear image reconstruction and post‐processing techniques, the evaluated DCNN method degraded the in‐plane and z‐axis spatial resolution at lower contrast levels, lower radiation dose, and higher denoising strength.

CT image quality evaluation in the age of deep learning: trade-off between functionality and fidelity

Fully automated image quality evaluation on patient CT: Multi-vendor and multi-reconstruction study

Performance evaluation of deep learning image reconstruction algorithm for dual-energy spectral CT imaging: A phantom study

Image quality and dose reduction opportunity of deep learning image reconstruction algorithm for CT: a phantom study

The Value of Deep Learning Image Reconstruction in Improving the Quality of Low-Dose Chest CT Images

Comparison of image quality based on deep-learning image reconstruction and iterative reconstruction algorithm for dual-energy CT: a phantom and animal-model study

The image quality of deep-learning image reconstruction of chest CT images on a mediastinal window setting

Deep learning image reconstruction algorithm for abdominal multidetector CT at different tube voltages: assessment of image quality and radiation dose in a phantom study

Image quality evaluation in deep‐learning‐based CT noise reduction using virtual imaging trial methods: Contrast‐dependent spatial resolution

Application of deep-learning reconstruction algorithm for enhanced CT scan of upper abdomen under different radiation doses: focus on noise, contrast-to-noise ratio and image quality

A Deep Learning Image Reconstruction Algorithm for Improving Image Quality and Hepatic Lesion Detectability in Abdominal Dual-Energy Computed Tomography: Preliminary Results

Impact of an artificial intelligence deep‐learning reconstruction algorithm for CT on image quality and potential dose reduction: A phantom study

Deep Learning Image Reconstruction Algorithm Reduces Image Noise While Alters Radiomics Features in Dual-Energy CT in Comparison with Conventional Iterative Reconstruction Algorithms: a Phantom Study

Image Quality of Coronary CT Angiography at Ultra Low Tube Voltage Reconstructed with a Deep-Learning Image Reconstruction Algorithm in Patients of Different Weight

Improved image quality and dose reduction in abdominal CT with deep-learning reconstruction algorithm: a phantom study

Improving Image Quality with Deep Learning Image Reconstruction in Double-Low-dose Head CT Angiography Compared with Standard Dose and Adaptive Statistical Iterative Reconstruction

Deep learning image reconstruction for improving image quality of contrast-enhanced dual-energy CT in abdomen

Multi-reader multiparametric DECT study evaluating different strengths of iterative and deep learning-based image reconstruction techniques

Application of deep learning image reconstruction algorithm in low-dose abdominal CT

Application of deep learning image reconstruction in low-dose chest CT scan

Comparison of image quality and lesion diagnosis in abdominopelvic unenhanced CT between reduced-dose CT using deep learning post-processing and standard-dose CT using iterative reconstruction: A prospective study