Abstract:Purpose: Conventional metrics used for assessing digital mammography (DM) and digital breast tomosynthesis (DBT) image quality, including noise, spatial resolution, and detective quantum efficiency, do not necessarily predict how well the system will perform in a clinical task. A number of existing phantom-based methods have their own limitations, such as unrealistic uniform backgrounds, subjective scoring using humans, and regular signal patterns unrepresentative of common clinical findings. We attempted to address this problem with a realistic breast phantom with random hydroxyapatite microcalcifications and semi-automated deep learning-based image scoring. Our goal was to develop a methodology for objective task-based assessment of image quality for tomosynthesis and DM systems, which includes an anthropomorphic phantom, a detection task (microcalcification clusters), and automated performance evaluation using a convolutional neural network. Approach: Experimental 2D and pseudo-3D mammograms of an anthropomorphic inkjet-printed breast phantom with inserted microcalcification clusters were collected on clinical mammography systems to train a signal-present/signal-absent image classifier based on Resnet-18 architecture. In a separate validation study using simulations, this Resnet-18 classifier was shown to approach the performance of an ideal observer. Microcalcification detection performance was evaluated as a function of four dose levels using receiver operating characteristic (ROC) analysis [i.e., area under the ROC curve (AUC)]. To demonstrate the use of this evaluation approach for assessing different technologies, the method was applied to two different mammography systems, as well as to mammograms with re-binned pixels emulating a lower-resolution X-ray detector. Results: Microcalcification detectability, as assessed by the deep learning classifier, was observed to vary with the exposure incident on the breast phantom for both DM and tomosynthesis. At full dose, experimental AUC was 0.96 (for DM) and 0.95 (for DBT), whereas at half dose, it dropped to 0.85 and 0.71, respectively. AUC performance on DM was significantly decreased with an effective larger pixel size obtained with re-binning. The task-based assessment approach also showed the superiority of a newer mammography system compared with an older system. Conclusions: An objective task-based methodology for assessing the image quality of mammography and tomosynthesis systems is proposed. Possible uses for this tool could be quality control, acceptance, and constancy testing, assessing the safety and effectiveness of new technology for regulatory submissions, and system optimization. The results from this study showed that the proposed evaluation method using a deep learning model observer can track differences in microcalcification signal detectability with varied exposure conditions.

Automated quality control analysis for American College of Radiology (ACR) digital mammography (DM) phantom images

Automated image quality assessment of mammography phantoms: a systematic review

Automated assessment of task-based performance of digital mammography and tomosynthesis systems using an anthropomorphic breast phantom and deep learning-based scoring

How good is the ACR accreditation phantom for assessing image quality in digital mammography?

The IAEA remote and automated quality control methodology for radiography and mammography

Evaluation of the Image in Mammography Application of ALVIM Statistics Phantom Using Computed Radiography(cr)

Computer Assisted Diagnostic (Cad) Methods For X-Ray Imaging And Teleradiology

Using Machine Learning to Automate Mammogram Images Analysis

A spiculated mass target model for clinical image quality control in digital mammography

Convolutional neural network -based phantom image scoring for mammography quality control

Proof‐of‐concept study of artificial intelligence‐assisted review of CBCT image guidance

Clinical image quality assessment and mean glandular dose for full field digital mammography

Dynamic AI-assisted Ipsilateral Tissue Matching for Digital Breast Tomosynthesis

A new computer-aided detection system of CR mammograms

Objective image quality assurance in cone‐beam CT: Test methods, analysis, and workflow in longitudinal studies

An open source automatic quality assurance (OSAQA) tool for the ACR MRI phantom

Technical Note: Validation of an automatic ACR phantom quality assurance tool for an MR‐guided radiotherapy system

Evaluation of the Combination of Artificial Intelligence and Radiologist Assessments to Interpret Malignant Architectural Distortion on Mammography

The first 10,000 mammography exams performed as part of the “Description and interpretation of mammography data using artificial intelligence” service.

Automatic Quantification for Phantom-based Image Quality Assessment in Bone Spect: Computerized Self-classification of Detectability Using a Novel Index

Automated detection for microcalcifications in digital mammograms using difference-image technique