Abstract:Background and Objective Accurate identification of molecular biomarker statuses is crucial in cancer diagnosis, treatment, and prognosis. Studies have demonstrated that medical images could be utilized for non-invasive prediction of biomarker statues. The biomarker status-associated features extracted from medical images are essential in developing medical image-based non-invasive prediction models. Contrast-enhanced mammography (CEM) is a promising imaging technique for breast cancer diagnosis. This study aims to develop a neural network-based method to extract biomarker-related image features from CEM images and evaluate the potential of CEM in non-invasive biomarker status prediction. Methods An end-to-end learning convolutional neural network with the whole breast images as inputs was proposed to extract CEM features for biomarker status prediction in breast cancer. The network focused on lesion regions and flexibly extracted image features from lesion and peri-tumor regions by employing supervised learning with a smooth L1-based consistency constraint. An image-level weakly supervised segmentation network based on Vision Transformer with cross attention to contrast images of breasts with lesions against the contralateral breast images was developed for automatic lesion segmentation. Finally, prediction models were developed following further selection of significant features and the implementation of random forest-based classification. Results were reported using the area under the curve (AUC), accuracy, sensitivity, and specificity. Results A dataset from 1203 breast cancer patients was utilized to develop and evaluate the proposed method. Compared to the method without lesion attention and with only lesion regions as inputs, the proposed method performed better at biomarker status prediction. Specifically, it achieved an AUC of 0.71 (95% confidence interval [CI]: 0.65, 0.77) for Ki-67 and 0.73 (95% CI: 0.65, 0.80) for human epidermal growth factor receptor 2 (HER2). Conclusions A lesion attention-guided neural network was proposed in this work to extract CEM image features for biomarker status prediction in breast cancer. The promising results demonstrated the potential of CEM in non-invasively predicting the biomarker statuses in breast cancer.

Improving lesion detection in mammograms by leveraging a Cycle-GAN-based lesion remover

Synthesizing lesions using contextual GANs improves breast cancer classification on mammograms

Injecting and removing malignant features in mammography with CycleGAN: Investigation of an automated adversarial attack using neural networks

Conditional Infilling GANs for Data Augmentation in Mammogram Classification

Automated Mammogram Analysis with a Deep Learning Pipeline

Lesion Segmentation in Ultrasound Using Semi-pixel-wise Cycle Generative Adversarial Nets

BR-GAN: Bilateral Residual Generating Adversarial Network for Mammogram Classification

Enhanced WGAN Model for Diagnosing Laryngeal Carcinoma

High-resolution synthesis of high-density breast mammograms: Application to improved fairness in deep learning based mass detection

Lesion detection in contrast enhanced spectral mammography

Mass Image Synthesis in Mammogram with Contextual Information Based on GANs

Mammography Visual Enhancement In Cad-Based Breast Cancer Diagnosis

Detecting Asymmetric Patterns and Localizing Cancers on Mammograms

Prior-guided generative adversarial network for mammogram synthesis

Medical image augmentation for lesion detection using a texture-constrained multichannel progressive GAN

Image Translation of Breast Ultrasound to Pseudo Anatomical Display by CycleGAN

Lesion Attention Guided Neural Network for Contrast-Enhanced Mammography-based Biomarker Status Prediction in Breast Cancer

Breast Tumor Segmentation and Shape Classification in Mammograms using Generative Adversarial and Convolutional Neural Network

Reliable Breast Cancer Diagnosis with Deep Learning: DCGAN-Driven Mammogram Synthesis and Validity Assessment

Image translation of Ultrasound to Pseudo Anatomical Display by CycleGAN

An Attention Based Pipeline for Identifying Pre-Cancer Lesions in Head and Neck Clinical Images