Abstract:Purpose Synthetic digital mammogram (SDM) is a 2D image generated from digital breast tomosynthesis (DBT) and used as a substitute for a full-field digital mammogram (FFDM) to reduce the radiation dose for breast cancer screening. The previous deep learning-based method used FFDM images as the ground truth, and trained a single neural network to directly generate SDM images with similar appearances (e.g., intensity distribution, textures) to the FFDM images. However, the FFDM image has a different texture pattern from DBT. The difference in texture pattern might make the training of the neural network unstable and result in high-intensity distortion, which makes it hard to decrease intensity distortion and increase perceptual similarity (e.g., generate similar textures) at the same time. Clinically, radiologists want to have a 2D synthesized image that feels like an FFDM image in vision and preserves local structures such as both mass and microcalcifications (MCs) in DBT because radiologists have been trained on reading FFDM images for a long time, while local structures are important for diagnosis. In this study, we proposed to use a deep convolutional neural network to learn the transformation to generate SDM from DBT. Method To decrease intensity distortion and increase perceptual similarity, a multi-scale cascaded network (MSCN) is proposed to generate low-frequency structures (e.g., intensity distribution) and high-frequency structures (e.g., textures) separately. The MSCN consist of two cascaded sub-networks: the first sub-network is used to predict the low-frequency part of the FFDM image; the second sub-network is used to generate a full SDM image with textures similar to the FFDM image based on the prediction of the first sub-network. The mean-squared error (MSE) objective function is used to train the first sub-network, termed low-frequency network, to generate a low-frequency SDM image. The gradient-guided generative adversarial network's objective function is to train the second sub-network, termed high-frequency network, to generate a full SDM image with textures similar to the FFDM image. Results 1646 cases with FFDM and DBT were retrospectively collected from the Hologic Selenia system for training and validation dataset, and 145 cases with masses or MC clusters were independently collected from the Hologic Selenia system for testing dataset. For comparison, the baseline network has the same architecture as the high-frequency network and directly generates a full SDM image. Compared to the baseline method, the proposed MSCN improves the peak-to-noise ratio from 25.3 to 27.9 dB and improves the structural similarity from 0.703 to 0.724, and significantly increases the perceptual similarity. Conclusions The proposed method can stabilize the training and generate SDM images with lower intensity distortion and higher perceptual similarity.

Generating High Resolution Digital Mammogram from Digitized Film Mammogram with Conditional Generative Adversarial Network.

Generating Full-Field Digital Mammogram From Digitized Screen-Film Mammogram for Breast Cancer Screening With High-Resolution Generative Adversarial Network

Domain Invariant Model with Graph Convolutional Network for Mammogram Classification

Synthesis of Mammogram From Digital Breast Tomosynthesis Using Deep Convolutional Neural Network With Gradient Guided cGANs

Deep Convolutional Neural Network for Mammographic Density Segmentation

Multi-scale Cascaded Networks for Synthesis of Mammogram to Decrease Intensity Distortion and Increase Model-Based Perceptual Similarity

Synthesize Mammogram from Digital Breast Tomosynthesis with Gradient Guided cGANs

Automated Mammogram Analysis with a Deep Learning Pipeline

High-resolution synthesis of high-density breast mammograms: Application to improved fairness in deep learning based mass detection

High-Resolution Mammogram Synthesis using Progressive Generative Adversarial Networks

Whole Mammographic Mass Segmentation Using Attention Mechanism and Multiscale Pooling Adversarial Network.

Reliable Breast Cancer Diagnosis with Deep Learning: DCGAN-Driven Mammogram Synthesis and Validity Assessment

DCANet: Dual Contextual Affinity Network for Mass Segmentation in Whole Mammograms.

Optimizing Breast Mass Segmentation Algorithms with Generative Adversarial Nets.

MammoGANesis: Controlled Generation of High-Resolution Mammograms for Radiology Education

Multi-Path Deep Learning Model for Automated Mammographic Density Categorization

Breast Tumor Segmentation and Shape Classification in Mammograms using Generative Adversarial and Convolutional Neural Network

MammoDG: Generalisable Deep Learning Breaks the Limits of Cross-Domain Multi-Center Breast Cancer Screening

The Automatic Segmentation of Mammographic Mass Using the End-To-End Convolutional Network Based on Dense-Prediction.

Adaptation of a deep learning malignancy model from full-field digital mammography to digital breast tomosynthesis

High-Resolution Breast Mri Reconstruction Using A Deep Convolutional Generative Adversarial Network