Abstract:Background: The automated classification of histological images is crucial for the diagnosis of cancer. The limited availability of well-annotated datasets, especially for rare cancers, poses a significant challenge for deep learning methods due to the small number of relevant images. This has led to the development of few-shot learning approaches, which bear considerable clinical importance, as they are designed to overcome the challenges of data scarcity in deep learning for histological image classification. Traditional methods often ignore the challenges of intraclass diversity and interclass similarities in histological images. To address this, we propose a novel mutual reconstruction network model, aimed at meeting these challenges and improving the few-shot classification performance of histological images. Methods: The key to our approach is the extraction of subtle and discriminative features. We introduce a feature enhancement module (FEM) and a mutual reconstruction module to increase differences between classes while reducing variance within classes. First, we extract features of support and query images using a feature extractor. These features are then processed by the FEM, which uses a self-attention mechanism for self-reconstruction of features, enhancing the learning of detailed features. These enhanced features are then input into the mutual reconstruction module. This module uses enhanced support features to reconstruct enhanced query features and vice versa. The classification of query samples is based on weighted calculations of the distances between query features and reconstructed query features and between support features and reconstructed support features. Results: We extensively evaluated our model using a specially created few-shot histological image dataset. The results showed that in a 5-way 10-shot setup, our model achieved an impressive accuracy of 92.09%. This is a 23.59% improvement in accuracy compared to the model-agnostic meta-learning (MAML) method, which does not focus on fine-grained attributes. In the more challenging, 5-way 1-shot setting, our model also performed well, demonstrating a 18.52% improvement over the ProtoNet, which does not address this challenge. Additional ablation studies indicated the effectiveness and complementary nature of each module and confirmed our method's ability to parse small differences between classes and large variations within classes in histological images. These findings strongly support the superiority of our proposed method in the few-shot classification of histological images. Conclusions: The mutual reconstruction network provides outstanding performance in the few-shot classification of histological images, successfully overcoming the challenges of similarities between classes and diversity within classes. This marks a significant advancement in the automated classification of histological images.

A conditioned feature reconstruction network for few-shot classification

Hybrid Feature Collaborative Reconstruction Network for Few-Shot Fine-Grained Image Classification

Improved Few-Shot Learning for Images Classification

Self-reconstruction network for fine-grained few-shot classification

Fine-Grained Few-Shot Image Classification Based on Feature Dual Reconstruction

DCPNet: Distribution Calibration Prototypical Network for Few-Shot Image Classification

PRSN: Prototype resynthesis network with cross-image semantic alignment for few-shot image classification

Few-Shot Fine-Grained Classification With Rotation-Invariant Feature Map Complementary Reconstruction Network

ReNAP: Relation Network with Adaptive Prototypical Learning for Few-Shot Classification

Reweighting and Information-Guidance Networks for Few-Shot Learning

Compositional Prototypical Networks for Few-Shot Classification

A mutual reconstruction network model for few-shot classification of histological images: addressing interclass similarity and intraclass diversity

Attribute- and attention-guided few-shot classification

Crpn: distinguish novel categories via class-relevant region proposal network for few-shot object detection

Shared Nearest Neighbor Calibration for Few-Shot Classification.

Learning to focus: cascaded feature matching network for few-shot image recognition

Bimodal semantic fusion prototypical network for few-shot classification

Cross Attention Network for Few-shot Classification

Multi-Level Correlation Network For Few-Shot Image Classification

CORE: CORrelation-Guided Feature Enhancement for Few-Shot Image Classification

Class-Irrelevant Feature Removal for Few-Shot Image Classification