Abstract:Purpose: Conventional metrics used for assessing digital mammography (DM) and digital breast tomosynthesis (DBT) image quality, including noise, spatial resolution, and detective quantum efficiency, do not necessarily predict how well the system will perform in a clinical task. A number of existing phantom-based methods have their own limitations, such as unrealistic uniform backgrounds, subjective scoring using humans, and regular signal patterns unrepresentative of common clinical findings. We attempted to address this problem with a realistic breast phantom with random hydroxyapatite microcalcifications and semi-automated deep learning-based image scoring. Our goal was to develop a methodology for objective task-based assessment of image quality for tomosynthesis and DM systems, which includes an anthropomorphic phantom, a detection task (microcalcification clusters), and automated performance evaluation using a convolutional neural network. Approach: Experimental 2D and pseudo-3D mammograms of an anthropomorphic inkjet-printed breast phantom with inserted microcalcification clusters were collected on clinical mammography systems to train a signal-present/signal-absent image classifier based on Resnet-18 architecture. In a separate validation study using simulations, this Resnet-18 classifier was shown to approach the performance of an ideal observer. Microcalcification detection performance was evaluated as a function of four dose levels using receiver operating characteristic (ROC) analysis [i.e., area under the ROC curve (AUC)]. To demonstrate the use of this evaluation approach for assessing different technologies, the method was applied to two different mammography systems, as well as to mammograms with re-binned pixels emulating a lower-resolution X-ray detector. Results: Microcalcification detectability, as assessed by the deep learning classifier, was observed to vary with the exposure incident on the breast phantom for both DM and tomosynthesis. At full dose, experimental AUC was 0.96 (for DM) and 0.95 (for DBT), whereas at half dose, it dropped to 0.85 and 0.71, respectively. AUC performance on DM was significantly decreased with an effective larger pixel size obtained with re-binning. The task-based assessment approach also showed the superiority of a newer mammography system compared with an older system. Conclusions: An objective task-based methodology for assessing the image quality of mammography and tomosynthesis systems is proposed. Possible uses for this tool could be quality control, acceptance, and constancy testing, assessing the safety and effectiveness of new technology for regulatory submissions, and system optimization. The results from this study showed that the proposed evaluation method using a deep learning model observer can track differences in microcalcification signal detectability with varied exposure conditions.

Examining the Influence of Digital Phantom Models in Virtual Imaging Trials for Tomographic Breast Imaging

Experimental validation of a three-dimensional linear system model for breast tomosynthesis.

Image Simulation and Realism Evaluation for Mammography and Tomosynthesis Based on the Detailed Breast Phantom

Performance evaluation of digital breast tomosynthesis systems: comparison of current virtual clinical trial methods

Personalization of x-ray tube motion in digital breast tomosynthesis using virtual Defrise phantoms

3-D Stochastic Numerical Breast Phantoms for Enabling Virtual Imaging Trials of Ultrasound Computed Tomography

Investigating Simulation-Based Metrics for Characterizing Linear Iterative Reconstruction in Digital Breast Tomosynthesis

Stochastic three-dimensional numerical phantoms to enable computational studies in quantitative optoacoustic computed tomography of breast cancer

Automated assessment of task-based performance of digital mammography and tomosynthesis systems using an anthropomorphic breast phantom and deep learning-based scoring

Development of an analytic breast phantom for quantitative comparison of reconstruction algorithms for digital breast tomosynthesis

A Multimodal Phantom for Visualization and Assessment of Histotripsy Treatments on Ultrasound and X-Ray Imaging

Optimized signal of calcifications in wide-angle digital breast tomosynthesis: a virtual imaging trial

Practical Iterative Image Reconstruction in Digital Breast Tomosynthesis by Non-Convex Tpv Optimization

A Realistic Breast Phantom Proposal for 3D Image Reconstruction in Digital Breast Tomosynthesis

Optimizing angular range in digital breast tomosynthesis: A phantom study investigating lesion detection across varied breast density and thickness

Exploring advanced 2D acquisitions in breast tomosynthesis: T-shaped and Pentagon geometries

Edge Artifact Removal in Diffuse Optical Tomography Using the Heterogeneous VICTRE Digital Breast Model

Assessment of task‐based performance from five clinical DBT systems using an anthropomorphic breast phantom

A spiculated mass target model for clinical image quality control in digital mammography

Preliminary Study on the Impact of Digital Breast Tomosynthesis Scanning Angle on Micro-Calcification Imaging

Virtual dosimetry study with three cone-beam breast computed tomography scanners using a fast GPU based Monte Carlo code