Abstract:Abstract Breast cancer is a deadly disease with a high mortality rate among PAN cancers. The advancements in biomedical information retrieval techniques have been beneficial in developing early prognosis and diagnosis systems for cancer patients. These systems provide the oncologist with plenty of information from several modalities to make the correct and feasible treatment plan for breast cancer patients and protect them from unnecessary therapies and their toxic side effects. The cancer patient’s related information can be collected using various modalities like clinical, copy number variation, DNA-methylation, microRNA sequencing, gene expression, and histopathological whole slide images. High dimensionality and heterogeneity in these modalities demand the development of some intelligent systems to understand related features to the prognosis and diagnosis of diseases and make correct predictions. In this work, we have studied some end-to-end systems having two main components : (a) dimensionality reduction techniques applied to original features from different modalities and (b) classification techniques applied to the fusion of reduced feature vectors from different modalities for automatic predictions of breast cancer patients into two categories: short-time and long-time survivors. Principal component analysis (PCA) and variational auto-encoders (VAEs) are used as the dimensionality reduction techniques, followed by support vector machines (SVM) or random forest as the machine learning classifiers. The study utilizes raw, PCA, and VAE extracted features of the TCGA-BRCA dataset from six different modalities as input to the machine learning classifiers. We conclude this study by suggesting that adding more modalities to the classifiers provides complementary information to the classifier and increases the stability and robustness of the classifiers. In this study, the multimodal classifiers have not been validated on primary data prospectively.

Multimodal Data-Driven Intelligent Systems for Breast Cancer Prediction

Diagnosis of breast cancer molecular subtypes using machine learning models on unimodal and multimodal datasets

Multimodal prediction of breast cancer using radiogenomics and clinical trials with decision fusion

Improving the robustness and stability of a machine learning model for breast cancer prognosis through the use of multi-modal classifiers

Multi-modal advanced deep learning architectures for breast cancer survival prediction

Breast cancer prediction using gated attentive multimodal deep learning

Multi-modal AI for comprehensive breast cancer prognostication

Multimodal Siamese Model for Breast Cancer Survival Prediction

An Integrated Multimodal-Based CAD System for Breast Cancer Diagnosis

A Multimodal Deep Neural Network for Human Breast Cancer Prognosis Prediction by Integrating Multi-Dimensional Data

Enhancing Breast Cancer Survival Prognosis Through Omic and Non-Omic Data Integration

Breast Cancer Prediction Using Deep Learning and Machine Learning Techniques

Performance Evaluation of Deep Learning and Transformer Models Using Multimodal Data for Breast Cancer Classification

Identification and Diagnosis of Breast Cancer At Different Stages By Different Machine Learning Algorithms On The Coimbra Dataset

An intelligent human‐centric systems to diagnose breast cancer using machine learning and optimized feature selection techniques

Prognostically Relevant Subtypes and Survival Prediction for Breast Cancer Based on Multimodal Genomics Data

Unraveling the Multifaceted Nature of Breast Cancer: Harnessing the Power of Machine Learning and Statistical Models for In-depth Investigation, Prognosis, and Treatment Optimization

Intelligent Ultrasound Imaging for Enhanced Breast Cancer Diagnosis: Ensemble Transfer Learning Strategies

Adaptive Machine Learning Approach for Importance Evaluation of Multimodal Breast Cancer Radiomic Features