Multi-View Hypercomplex Learning for Breast Cancer Screening

Eleonora Lopez,Eleonora Grassucci,Martina Valleriani,Danilo Comminiello

DOI: https://doi.org/10.48550/arXiv.2204.05798

2024-03-05

Abstract:Traditionally, deep learning methods for breast cancer classification perform a single-view analysis. However, radiologists simultaneously analyze all four views that compose a mammography exam, owing to the correlations contained in mammography views, which present crucial information for identifying tumors. In light of this, some studies have started to propose multi-view methods. Nevertheless, in such existing architectures, mammogram views are processed as independent images by separate convolutional branches, thus losing correlations among them. To overcome such limitations, in this paper, we propose a methodological approach for multi-view breast cancer classification based on parameterized hypercomplex neural networks. Thanks to hypercomplex algebra properties, our networks are able to model, and thus leverage, existing correlations between the different views that comprise a mammogram, thus mimicking the reading process performed by clinicians. This happens because hypercomplex networks capture both global properties, as standard neural models, as well as local relations, i.e., inter-view correlations, which real-valued networks fail at modeling. We define architectures designed to process two-view exams, namely PHResNets, and four-view exams, i.e., PHYSEnet and PHYBOnet. Through an extensive experimental evaluation conducted with publicly available datasets, we demonstrate that our proposed models clearly outperform real-valued counterparts and state-of-the-art methods, proving that breast cancer classification benefits from the proposed multi-view architectures. We also assess the method generalizability beyond mammogram analysis by considering different benchmarks, as well as a finer-scaled task such as segmentation. Full code and pretrained models for complete reproducibility of our experiments are freely available at <a class="link-external link-https" href="https://github.com/ispamm/PHBreast" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to more effectively use multi - view image information for classification in breast cancer screening. Traditional deep - learning methods usually analyze only a single view, while radiologists will simultaneously analyze all four views that make up a mammography examination in the actual diagnosis process, because there is a correlation between these views, which is crucial for identifying tumors. However, existing multi - view methods often treat each view as an independent image process, thus losing the correlation between them. To overcome this limitation, this paper proposes a methodological framework based on parametric hypercomplex neural networks (PHNNs) for multi - view breast cancer classification. Through the properties of hypercomplex algebra, the proposed network can model and utilize the existing correlations between different views that make up a mammography, thus simulating the reading process of clinicians. This method can not only capture global attributes, like standard neural models, but also capture local relationships, that is, the correlations between views, which cannot be achieved by real - valued networks. Specifically, the authors designed two architectures to handle two - view and four - view examinations, namely PHResNets and PHYSEnet and PHYBOnet. Through extensive experimental evaluations, it is proved that the proposed model is significantly superior to the real - valued counterpart models and the state - of - the - art methods, indicating that breast cancer classification can benefit from the proposed multi - view architecture. In addition, the generalization ability of this method on other benchmark datasets was also evaluated, including different tasks such as segmentation.

Multi-View Hypercomplex Learning for Breast Cancer Screening

Attention-Map Augmentation for Hypercomplex Breast Cancer Classification

Mammography classification with multi-view deep learning techniques: Investigating graph and transformer-based architectures

Improved mammographic CAD performance using multi-view information: a Bayesian network framework

Multi-View Convolutional Neural Networks for Mammographic Image Classification

Multi-view Learning for Mammogram Analysis: Auto-Diagnosis Models for Breast Cancer.

Neural network model based on global and local features for multi-view mammogram classification

A Multi-Instance Networks with Multiple Views for Classification of Mammograms.

Breast Mass Classification Via Deeply Integrating the Contextual Information from Multi-View Data.

Multi-view Stereoscopic Attention Network for 3D Tumor Classification in Automated Breast Ultrasound

Multi-View Mammographic Density Classification by Dilated and Attention-Guided Residual Learning.

Multi-modal classification of breast cancer lesions in Digital Mammography and contrast enhanced spectral mammography images

Breast Cancer Diagnosis Method Based on Cross-Mammogram Four-View Interactive Learning

SCREENet: A Multi-view Deep Convolutional Neural Network for Classification of High-resolution Synthetic Mammographic Screening Scans

Multiview multimodal network for breast cancer diagnosis in contrast-enhanced spectral mammography images

Multi-view Local Co-occurrence and Global Consistency Learning Improve Mammogram Classification Generalisation

Multi-scale View-Based Convolutional Neural Network for Breast Cancer Classification in Ultrasound Images.

Classification of breast mass in two-view mammograms via deep learning

Deep Multi-Magnification Networks for multi-class breast cancer image segmentation

Neural Networks Model Based on an Automated Multi-Scale Method for Mammogram Classification.

Delving into Ipsilateral Mammogram Assessment under Multi-View Network