Abstract:Background: The automated classification of histological images is crucial for the diagnosis of cancer. The limited availability of well-annotated datasets, especially for rare cancers, poses a significant challenge for deep learning methods due to the small number of relevant images. This has led to the development of few-shot learning approaches, which bear considerable clinical importance, as they are designed to overcome the challenges of data scarcity in deep learning for histological image classification. Traditional methods often ignore the challenges of intraclass diversity and interclass similarities in histological images. To address this, we propose a novel mutual reconstruction network model, aimed at meeting these challenges and improving the few-shot classification performance of histological images. Methods: The key to our approach is the extraction of subtle and discriminative features. We introduce a feature enhancement module (FEM) and a mutual reconstruction module to increase differences between classes while reducing variance within classes. First, we extract features of support and query images using a feature extractor. These features are then processed by the FEM, which uses a self-attention mechanism for self-reconstruction of features, enhancing the learning of detailed features. These enhanced features are then input into the mutual reconstruction module. This module uses enhanced support features to reconstruct enhanced query features and vice versa. The classification of query samples is based on weighted calculations of the distances between query features and reconstructed query features and between support features and reconstructed support features. Results: We extensively evaluated our model using a specially created few-shot histological image dataset. The results showed that in a 5-way 10-shot setup, our model achieved an impressive accuracy of 92.09%. This is a 23.59% improvement in accuracy compared to the model-agnostic meta-learning (MAML) method, which does not focus on fine-grained attributes. In the more challenging, 5-way 1-shot setting, our model also performed well, demonstrating a 18.52% improvement over the ProtoNet, which does not address this challenge. Additional ablation studies indicated the effectiveness and complementary nature of each module and confirmed our method's ability to parse small differences between classes and large variations within classes in histological images. These findings strongly support the superiority of our proposed method in the few-shot classification of histological images. Conclusions: The mutual reconstruction network provides outstanding performance in the few-shot classification of histological images, successfully overcoming the challenges of similarities between classes and diversity within classes. This marks a significant advancement in the automated classification of histological images.

Self-reconstruction network for fine-grained few-shot classification

Hybrid Feature Collaborative Reconstruction Network for Few-Shot Fine-Grained Image Classification

Feature Transformation for Few-Shot Learning

A conditioned feature reconstruction network for few-shot classification

PRSN: Prototype resynthesis network with cross-image semantic alignment for few-shot image classification

Few-Shot Fine-Grained Classification With Rotation-Invariant Feature Map Complementary Reconstruction Network

Fine-Grained Few-Shot Image Classification Based on Feature Dual Reconstruction

Multi-scale Feature Modification Network for FewShot Image Classification

A mutual reconstruction network model for few-shot classification of histological images: addressing interclass similarity and intraclass diversity

Task-Related Saliency for Few-Shot Image Classification

Multi-local feature relation network for few-shot learning

Reweighting and Information-Guidance Networks for Few-Shot Learning

Local Mutual Metric Network for Few-Shot Image Classification

Category Relevance Redirection Network for Few-Shot Classification

Multi-Level Correlation Network For Few-Shot Image Classification

Self-supervised pairwise-sample resistance model for few-shot classification

ReNAP: Relation Network with Adaptive Prototypical Learning for Few-Shot Classification

Adaptive Local Feature Matching for Few-shot Fine-grained Image Recognition

HiReNet: Hierarchical-Relation Network for Few-Shot Remote Sensing Image Scene Classification

BSNet: Bi-Similarity Network for Few-shot Fine-grained Image Classification

Hierarchical Representation based Query-Specific Prototypical Network for Few-Shot Image Classification