Abstract:Background and Objective Accurate identification of molecular biomarker statuses is crucial in cancer diagnosis, treatment, and prognosis. Studies have demonstrated that medical images could be utilized for non-invasive prediction of biomarker statues. The biomarker status-associated features extracted from medical images are essential in developing medical image-based non-invasive prediction models. Contrast-enhanced mammography (CEM) is a promising imaging technique for breast cancer diagnosis. This study aims to develop a neural network-based method to extract biomarker-related image features from CEM images and evaluate the potential of CEM in non-invasive biomarker status prediction. Methods An end-to-end learning convolutional neural network with the whole breast images as inputs was proposed to extract CEM features for biomarker status prediction in breast cancer. The network focused on lesion regions and flexibly extracted image features from lesion and peri-tumor regions by employing supervised learning with a smooth L1-based consistency constraint. An image-level weakly supervised segmentation network based on Vision Transformer with cross attention to contrast images of breasts with lesions against the contralateral breast images was developed for automatic lesion segmentation. Finally, prediction models were developed following further selection of significant features and the implementation of random forest-based classification. Results were reported using the area under the curve (AUC), accuracy, sensitivity, and specificity. Results A dataset from 1203 breast cancer patients was utilized to develop and evaluate the proposed method. Compared to the method without lesion attention and with only lesion regions as inputs, the proposed method performed better at biomarker status prediction. Specifically, it achieved an AUC of 0.71 (95% confidence interval [CI]: 0.65, 0.77) for Ki-67 and 0.73 (95% CI: 0.65, 0.80) for human epidermal growth factor receptor 2 (HER2). Conclusions A lesion attention-guided neural network was proposed in this work to extract CEM image features for biomarker status prediction in breast cancer. The promising results demonstrated the potential of CEM in non-invasively predicting the biomarker statuses in breast cancer.

System for Breast Cancer Diagnosis Based on Neural Network Ensemble

Spiculated lesion detection in digital mammogram based on artificial neural network ensemble

Histopathological image analysis for breast cancer diagnosis by ensembles of convolutional neural networks and genetic algorithms

Breast lesions classifications of mammographic images using a deep convolutional neural network-based approach

Automated Breast Cancer Detection in Mammography Using Ensemble Classifier and Feature Weighting Algorithms

Ensemble of Deep Features for Breast Cancer Histopathological Image Classification

Breast Cancer Diagnosis by Convolutional Neural Network and Advanced Thermal Exchange Optimization Algorithm

Detecting Cancerous Tissue in Mammograms Using Deep Neural Networks

Breast Cancer Detection in Mammography Images Using Deep Convolutional Neural Networks and Fuzzy Ensemble Modeling Techniques

Early stage lung cancer diagnosis based on neural network ensemble []

Improved Breast Lesion Detection in Mammogram Images Using a Deep Neural Network

Contextual Features and Information Bottleneck-Based Multi-Input Network for Breast Cancer Classification from Contrast-Enhanced Spectral Mammography

Breast Cancer Histopathology Image Classification Using an Ensemble of Deep Learning Models

Detection of Regions of Interest from Breast Tumor Ultrasound Images Using Improved PCNN

Lesion Attention Guided Neural Network for Contrast-Enhanced Mammography-based Biomarker Status Prediction in Breast Cancer

Auxiliary diagnosis of small tumor in mammography based on deep learning

Study on automatic detection and classification of breast nodule using deep convolutional neural network system

A neural network with a human learning paradigm for breast fibroadenoma segmentation in sonography

Medical Breast Ultrasound Image Segmentation by Machine Learning

Computer-aided Diagnosis Applied to US of Solid Breast Nodules by Using Neural Networks

Using Machine Learning to Automate Mammogram Images Analysis