Abstract:In recent years, significant achievements have been made in the field of histopathological image analysis using convolutional neural networks (CNNs). However, existing CNNs fail to fully capture the important local structures and regional information in histopathological images due to the complex tissue structures and variable pathological features present in these images. They often treat all regions equally, which further exacerbates the challenge of accurately analyzing such images. Current network model can't extract deep layer features efficiently without guiding. To alleviate this problem, we propose a novel network model called Multi-Position Supervised Soft Attention (MPSA). MPSA adds regions of interest (RoI) labels at multiple feature layers for deep supervision, and then uses the supervised layers as soft attention to guide the learning of the classification network, enabling the network to accurately extract features of the lesion target. Additionally, we design a Multi-level Attention Feature Enhancement Module (MAFEM), which combines multiple levels of attention mechanisms to enhance the performance of the convolutional neural network in histopathological image classification. MAFEM includes spatial attention, soft attention of the main branch, and our proposed soft attention for multi-branch feature fusion. The proposed soft attention for multi-branch feature fusion aims to enhance the predictive performance of the classification model by activating relevant neurons in the diagnostic area in a highly activated state, while effectively avoiding noise activation. This innovative approach ensures that the model can focus on the most pertinent information, leading to improved classification accuracy. We conducted classification experiments on the liver cancer histopathological images dataset and the results showed that our method achieved a classification accuracy of 95.79%, indicating that it is very effective in the analysis of liver histopathological images. Our proposed network architecture has also demonstrated good generalization ability in other medical datasets, achieving a classification accuracy of 84.41% on the ultrasound carotid plaque dataset.

Fractal graph convolutional network with MLP-mixer based multi-path feature fusion for classification of histopathological images

A Convolutional Neural Network and Graph Convolutional Network Based Framework for Classification of Breast Histopathological Images

Multi-level Feature Fusion Network for Nuclei Segmentation in Digital Histopathological Images

Attention Multihop Graph and Multiscale Convolutional Fusion Network for Hyperspectral Image Classification

Multi stain graph fusion for multimodal integration in pathology

FMDNN: A Fuzzy-guided Multi-granular Deep Neural Network for Histopathological Image Classification

Multiscale Random-Shape Convolution and Adaptive Graph Convolution Fusion Network for Hyperspectral Image Classification

Multi-feature fusion: Graph neural network and CNN combining for hyperspectral image classification

An Automatic Histopathological Image Segmentation Network Based on Global Context-Aware Module and Deep Feature Aggregation

MPSA: Multi-Position Supervised Soft Attention-based convolutional neural network for histopathological image classification

Multi-task Graph Convolutional Neural Network for Calcification Morphology and Distribution Analysis in Mammograms

Improving High Resolution Histology Image Classification with Deep Spatial Fusion Network

CCF-GNN: A Unified Model Aggregating Appearance, Microenvironment, and Topology for Pathology Image Classification

Fusion model of gray level co-occurrence matrix and convolutional neural network faced for histopathological images

Integrating multiscale topology in digital pathology with pyramidal graph convolutional networks

Hyperspectral Image Classification with a Multiscale Fusion-Evolution Graph Convolutional Network Based on a Feature-Spatial Attention Mechanism

Superpixel Spectral–Spatial Feature Fusion Graph Convolution Network for Hyperspectral Image Classification

A Multi-hop Graph Rectify Attention and Spectral Overlap Grouping Convolutional Fusion Network for Hyperspectral Image Classification

MDFF-Net: A multi-dimensional feature fusion network for breast histopathology image classification

Multiscale Fusion Graph Convolutional Networks for Hyperspectral Image Classification.