Abstract:Background Deep‐learning‐based image reconstruction and noise reduction methods (DLIR) have been increasingly deployed in clinical CT. Accurate image quality assessment of these methods is challenging as the performance measured using physical phantoms may not represent the true performance of DLIR in patients since DLIR is trained mostly on patient images. Purpose In this work, we aim to develop a patient‐data‐based virtual imaging trial framework and, as a first application, use it to measure the spatial resolution properties of a DLIR method. Methods The patient‐data‐based virtual imaging trial framework consists of five steps: (1) insertion of lesions into projection domain data using the acquisition geometry of the patient exam to simulate different lesion characteristics; (2) insertion of noise into projection domain data using a realistic photon statistical model of the CT system to simulate different dose levels; (3) creation of DLIR‐processed images from projection or image data; (4) creation of ensembles of DLIR‐processed patient images from a large number of noise and lesion realizations; and (5) evaluation of image quality using ensemble DLIR images. This framework was applied to measure the spatial resolution of a ResNet based deep convolutional neural network (DCNN) trained on patient images. Lesions in a cylindrical shape and different contrast levels (−500, −100, −50, −20, −10 HU) were inserted to the lower right lobe of the liver in a patient case. Multiple dose levels were simulated (50%, 25%, 12.5%). Each lesion and dose condition had 600 noise realizations. Multiple reconstruction and denoising methods were used on all the noise realizations, including the original filtered‐backprojection (FBP), iterative reconstruction (IR), and the DCNN method with three different strength setting (DCNN‐weak, DCNN‐medium, and DCNN‐strong). Mean lesion signal was calculated by performing ensemble averaging of all the noise realizations for each lesion and dose condition and then subtracting the lesion‐present images from the lesion absent images. Modulation transfer functions (MTFs) both in‐plane and along the z‐axis were calculated based on the mean lesion signals. The standard deviations of MTFs at each condition were estimated with bootstrapping: randomly sampling (with replacement) all the DLIR/FBP/IR images from the ensemble data (600 samples) at each condition. The impact of varying lesion contrast, dose levels, and denoising strengths were evaluated. Statistical analysis with paired t‐test was used to compare the z‐axis and in‐plane spatial resolution of five algorithms for five different contrasts and three dose levels. Results The in‐plane and z‐axis spatial resolution degradation of DCNN becomes more severe as the contrast or radiation dose decreased, or DCNN denoising strength increased. In comparison with FBP, a 59.5% and 4.1% reduction of in‐plane and z‐axis MTF (in terms of spatial frequencies at 50% MTF), respectively, was observed at low contrast (−10 HU) for DCNN with the highest denoising strength at 25% routine dose level. When the dose level reduces from 50% to 12.5% of routine dose, the in‐plane and z‐axis MTFs reduces from 92.1% to 76.3%, and from 98.9% to 95.5%, respectively, at contrast of −100 HU, using FBP as the reference. For most conditions of contrasts and dose levels, significant differences were found among the five algorithms, with the following relationship in both in‐plane and cross‐plane spatial resolution: FBP > DCNN‐Weak > IR > DCNN‐Medium > DCNN‐Strong. The spatial resolution difference among algorithms decreases at higher contrast or dose levels. Conclusions A patient‐data‐based virtual imaging trial framework was developed and applied to measuring the spatial resolution properties of a DCNN noise reduction method at different contrast and dose levels using real patient data. As with other non‐linear image reconstruction and post‐processing techniques, the evaluated DCNN method degraded the in‐plane and z‐axis spatial resolution at lower contrast levels, lower radiation dose, and higher denoising strength.

Image quality evaluation in deep‐learning‐based CT noise reduction using virtual imaging trial methods: Contrast‐dependent spatial resolution

Image quality and dose reduction opportunity of deep learning image reconstruction algorithm for CT: a phantom study

Deep Learning Image Reconstruction Algorithms in Low-Dose Radiation Abdominal Computed Tomography: Assessment of Image Quality and Lesion Diagnostic Confidence

Deep Learning Image Reconstruction Algorithm Reduces Image Noise While Alters Radiomics Features in Dual-Energy CT in Comparison with Conventional Iterative Reconstruction Algorithms: a Phantom Study

Performance evaluation of deep learning image reconstruction algorithm for dual-energy spectral CT imaging: A phantom study

Deep learning‐based low‐dose CT simulator for non‐linear reconstruction methods

Assessment of image quality and impact of deep learning-based software in non-contrast head CT scans

Patient-derived PixelPrint phantoms for evaluating clinical imaging performance of a deep learning CT reconstruction algorithm

Low-contrast lesion detection in neck CT: a multireader study comparing deep learning, iterative, and filtered back projection reconstructions using realistic phantoms

Lifelike PixelPrint phantoms for assessing clinical image quality and dose reduction capabilities of a deep learning CT reconstruction algorithm

Investigation of Lesion Detectability Using Deep Learning Based Denoising Methods in Oncology PET: a Cross-Center Phantom Study

Low-dose CT Denoising with a High-Level Feature Refinement and Dynamic Convolution Network

CT image quality evaluation in the age of deep learning: trade-off between functionality and fidelity

Need for objective task-based evaluation of deep learning-based denoising methods: A study in the context of myocardial perfusion SPECT

Deep Cascade Residual Networks (dcrns): Optimizing an Encoder–Decoder Convolutional Neural Network for Low-Dose CT Imaging

Dose reduction and image enhancement in micro-CT using deep learning

Low-Dose CT Image Super-resolution Network with Noise Inhibition Based on Feedback Feature Distillation Mechanism

A Phantom Study Comparing Low-Dose CT Physical Image Quality from Five Different CT Scanners

Deep learning image reconstruction algorithm for abdominal multidetector CT at different tube voltages: assessment of image quality and radiation dose in a phantom study

Impact of deep learning-based image reconstruction on image quality and lesion visibility in renal computed tomography at different doses

Deep Learning Denoising of Low-Dose Computed Tomography Chest Images: A Quantitative and Qualitative Image Analysis.