Abstract:Purpose: Conventional metrics used for assessing digital mammography (DM) and digital breast tomosynthesis (DBT) image quality, including noise, spatial resolution, and detective quantum efficiency, do not necessarily predict how well the system will perform in a clinical task. A number of existing phantom-based methods have their own limitations, such as unrealistic uniform backgrounds, subjective scoring using humans, and regular signal patterns unrepresentative of common clinical findings. We attempted to address this problem with a realistic breast phantom with random hydroxyapatite microcalcifications and semi-automated deep learning-based image scoring. Our goal was to develop a methodology for objective task-based assessment of image quality for tomosynthesis and DM systems, which includes an anthropomorphic phantom, a detection task (microcalcification clusters), and automated performance evaluation using a convolutional neural network. Approach: Experimental 2D and pseudo-3D mammograms of an anthropomorphic inkjet-printed breast phantom with inserted microcalcification clusters were collected on clinical mammography systems to train a signal-present/signal-absent image classifier based on Resnet-18 architecture. In a separate validation study using simulations, this Resnet-18 classifier was shown to approach the performance of an ideal observer. Microcalcification detection performance was evaluated as a function of four dose levels using receiver operating characteristic (ROC) analysis [i.e., area under the ROC curve (AUC)]. To demonstrate the use of this evaluation approach for assessing different technologies, the method was applied to two different mammography systems, as well as to mammograms with re-binned pixels emulating a lower-resolution X-ray detector. Results: Microcalcification detectability, as assessed by the deep learning classifier, was observed to vary with the exposure incident on the breast phantom for both DM and tomosynthesis. At full dose, experimental AUC was 0.96 (for DM) and 0.95 (for DBT), whereas at half dose, it dropped to 0.85 and 0.71, respectively. AUC performance on DM was significantly decreased with an effective larger pixel size obtained with re-binning. The task-based assessment approach also showed the superiority of a newer mammography system compared with an older system. Conclusions: An objective task-based methodology for assessing the image quality of mammography and tomosynthesis systems is proposed. Possible uses for this tool could be quality control, acceptance, and constancy testing, assessing the safety and effectiveness of new technology for regulatory submissions, and system optimization. The results from this study showed that the proposed evaluation method using a deep learning model observer can track differences in microcalcification signal detectability with varied exposure conditions.

Automated image quality assessment of mammography phantoms: a systematic review

Automated quality control analysis for American College of Radiology (ACR) digital mammography (DM) phantom images

Automated assessment of task-based performance of digital mammography and tomosynthesis systems using an anthropomorphic breast phantom and deep learning-based scoring

How good is the ACR accreditation phantom for assessing image quality in digital mammography?

The IAEA remote and automated quality control methodology for radiography and mammography

Clinical image quality assessment and mean glandular dose for full field digital mammography

Objective image quality assurance in cone‐beam CT: Test methods, analysis, and workflow in longitudinal studies

The impact of subjective image quality evaluation in mammography

Convolutional neural network -based phantom image scoring for mammography quality control

Comparing eDQE and eNEQ metrics – is there an alternative approach to assessing image quality in digital mammography?

Evaluation of Combined Artificial Intelligence and Radiologist Assessment to Interpret Screening Mammograms

Proof‐of‐concept study of artificial intelligence‐assisted review of CBCT image guidance

Evaluation of the Image in Mammography Application of ALVIM Statistics Phantom Using Computed Radiography(cr)

Impact of Different Mammography Systems on Artificial Intelligence Performance in Breast Cancer Screening

Improving the Safety of Computed Tomography Through Automated Quality Measurement: A Radiologist Reader Study of Radiation Dose, Image Noise, and Image Quality

Automatic Quantification for Phantom-based Image Quality Assessment in Bone Spect: Computerized Self-classification of Detectability Using a Novel Index

Consistency of Artificial Intelligence (AI)-based Diagnostic Support Software in Short-term Digital Mammography Reimaging After Core Needle Biopsy

Automatic image quality evaluation in digital radiography using for‐processing and for‐presentation images

A spiculated mass target model for clinical image quality control in digital mammography

Computer Assisted Diagnostic (Cad) Methods For X-Ray Imaging And Teleradiology

Descriptive analysis of computational methods for automating mammograms with practical applications