Abstract:Background and Objective Accurate identification of molecular biomarker statuses is crucial in cancer diagnosis, treatment, and prognosis. Studies have demonstrated that medical images could be utilized for non-invasive prediction of biomarker statues. The biomarker status-associated features extracted from medical images are essential in developing medical image-based non-invasive prediction models. Contrast-enhanced mammography (CEM) is a promising imaging technique for breast cancer diagnosis. This study aims to develop a neural network-based method to extract biomarker-related image features from CEM images and evaluate the potential of CEM in non-invasive biomarker status prediction. Methods An end-to-end learning convolutional neural network with the whole breast images as inputs was proposed to extract CEM features for biomarker status prediction in breast cancer. The network focused on lesion regions and flexibly extracted image features from lesion and peri-tumor regions by employing supervised learning with a smooth L1-based consistency constraint. An image-level weakly supervised segmentation network based on Vision Transformer with cross attention to contrast images of breasts with lesions against the contralateral breast images was developed for automatic lesion segmentation. Finally, prediction models were developed following further selection of significant features and the implementation of random forest-based classification. Results were reported using the area under the curve (AUC), accuracy, sensitivity, and specificity. Results A dataset from 1203 breast cancer patients was utilized to develop and evaluate the proposed method. Compared to the method without lesion attention and with only lesion regions as inputs, the proposed method performed better at biomarker status prediction. Specifically, it achieved an AUC of 0.71 (95% confidence interval [CI]: 0.65, 0.77) for Ki-67 and 0.73 (95% CI: 0.65, 0.80) for human epidermal growth factor receptor 2 (HER2). Conclusions A lesion attention-guided neural network was proposed in this work to extract CEM image features for biomarker status prediction in breast cancer. The promising results demonstrated the potential of CEM in non-invasively predicting the biomarker statuses in breast cancer.

Spiculated lesion detection in digital mammogram based on artificial neural network ensemble

System for Breast Cancer Diagnosis Based on Neural Network Ensemble

Improved Breast Lesion Detection in Mammogram Images Using a Deep Neural Network

Spiculation Sign Recognition in a Pulmonary Nodule Based on Spiking Neural P Systems

Lesion Attention Guided Neural Network for Contrast-Enhanced Mammography-based Biomarker Status Prediction in Breast Cancer

Breast lesions classifications of mammographic images using a deep convolutional neural network-based approach

Lesion detection in contrast enhanced spectral mammography

Detecting Cancerous Tissue in Mammograms Using Deep Neural Networks

Contextual Features and Information Bottleneck-Based Multi-Input Network for Breast Cancer Classification from Contrast-Enhanced Spectral Mammography

Lesion Segmentation in Ultrasound Using Semi-pixel-wise Cycle Generative Adversarial Nets

Auxiliary diagnosis of small tumor in mammography based on deep learning

Abnormality Detection in Mammography using Deep Convolutional Neural Networks

Digital Mammography: Mixed Feature Neural Network with Spectral Entropy Decision for Detection of Microcalcifications

Spatiotemporal Breast Mass Detection Network (MD-Net) in 4D DCE-MRI Images

Breast Microcalcification Diagnosis Using Deep Convolutional Neural Network from Digital Mammograms

DisepNet for breast abnormality recognition

Multi-level features combined end-to-end learning for automated pathological grading of breast cancer on digital mammograms

Breast Tumor Detection In Ultrasound Images Using Deep Learning

Quantitative Analysis of Lesion Morphology and Texture Features for Diagnostic Prediction in Breast MRI

Multistage Neural Network for Pattern Recognition in Mammogram Screening

Digital mammographic tumor classification using transfer learning from deep convolutional neural networks