Abstract:Purpose: Conventional metrics used for assessing digital mammography (DM) and digital breast tomosynthesis (DBT) image quality, including noise, spatial resolution, and detective quantum efficiency, do not necessarily predict how well the system will perform in a clinical task. A number of existing phantom-based methods have their own limitations, such as unrealistic uniform backgrounds, subjective scoring using humans, and regular signal patterns unrepresentative of common clinical findings. We attempted to address this problem with a realistic breast phantom with random hydroxyapatite microcalcifications and semi-automated deep learning-based image scoring. Our goal was to develop a methodology for objective task-based assessment of image quality for tomosynthesis and DM systems, which includes an anthropomorphic phantom, a detection task (microcalcification clusters), and automated performance evaluation using a convolutional neural network. Approach: Experimental 2D and pseudo-3D mammograms of an anthropomorphic inkjet-printed breast phantom with inserted microcalcification clusters were collected on clinical mammography systems to train a signal-present/signal-absent image classifier based on Resnet-18 architecture. In a separate validation study using simulations, this Resnet-18 classifier was shown to approach the performance of an ideal observer. Microcalcification detection performance was evaluated as a function of four dose levels using receiver operating characteristic (ROC) analysis [i.e., area under the ROC curve (AUC)]. To demonstrate the use of this evaluation approach for assessing different technologies, the method was applied to two different mammography systems, as well as to mammograms with re-binned pixels emulating a lower-resolution X-ray detector. Results: Microcalcification detectability, as assessed by the deep learning classifier, was observed to vary with the exposure incident on the breast phantom for both DM and tomosynthesis. At full dose, experimental AUC was 0.96 (for DM) and 0.95 (for DBT), whereas at half dose, it dropped to 0.85 and 0.71, respectively. AUC performance on DM was significantly decreased with an effective larger pixel size obtained with re-binning. The task-based assessment approach also showed the superiority of a newer mammography system compared with an older system. Conclusions: An objective task-based methodology for assessing the image quality of mammography and tomosynthesis systems is proposed. Possible uses for this tool could be quality control, acceptance, and constancy testing, assessing the safety and effectiveness of new technology for regulatory submissions, and system optimization. The results from this study showed that the proposed evaluation method using a deep learning model observer can track differences in microcalcification signal detectability with varied exposure conditions.

Evaluation of the Image in Mammography Application of ALVIM Statistics Phantom Using Computed Radiography(cr)

A Method of Detection Micro-Calcifications in Mammograms Using Wavelets and Adaptive Thresholds

Effect of Monitor Resolution on the Diagnosis of Breast Lesions by Using ALVIM Statistics Phantom

Physics Based Contrast Marking and Inpainting Based Local Texture Comparison for Clustered Microcalcification Detection

Automated quality control analysis for American College of Radiology (ACR) digital mammography (DM) phantom images

How good is the ACR accreditation phantom for assessing image quality in digital mammography?

Automated image quality assessment of mammography phantoms: a systematic review

Regions of Micro-Calcifications Clusters Detection Based on New Features from Imbalance Data in Mammograms

Quantitative Evaluation of Image Quality of Megavoltage Computed Tomography for Guiding Helical Tomotherapy

A Phantom Study Comparing Low-Dose CT Physical Image Quality from Five Different CT Scanners

Automated assessment of task-based performance of digital mammography and tomosynthesis systems using an anthropomorphic breast phantom and deep learning-based scoring

A New Method of Detecting Micro-Calcification Clusters in Mammograms Using Contourlet Transform and Non-Linking Simplified PCNN

Maximum-Likelihood Estimation of Glandular Fraction for Mammography and its Effect on Microcalcification Detection

A New Detection Algorithm for Microcalcification Clusters in Mammographic Screening

Phantom Study in the Quality Control of Low Dose Solid Pulmonary Nodule CT Based on Radiomics Analysis

SU‐FF‐I‐114: Effects of Exposure Level and Anatomical Background on Detection of Simulated Microcalcifications in Digital Mammography

Comparison of Two Digital Imaging Systems in Mammography

FAST SCREENING OUT TRUE NEGATIVE REGIONS FOR MICROCALCIFICATION DETECTION IN DIGITAL MAMMOGRAMS

Convolutional neural network -based phantom image scoring for mammography quality control

A markerless beam's eye view motion monitoring algorithm based on structure conversion and demons registration in medical image with partial data

Comparison of image quality based on deep-learning image reconstruction and iterative reconstruction algorithm for dual-energy CT: a phantom and animal-model study