Omphalocele with pyloroduodenal obstruction by extrinsic hepatic compression: a case report.

J. Bruce,E. Afshani,M. Karp,T. Jewett

DOI: https://doi.org/10.1016/S0022-3468(88)80012-5

IF: 2.549

1988-11-01

Journal of Pediatric Surgery

Abstract:

What problem does this paper attempt to address?

A Cognition-Driven Framework for Few-Shot Class-Incremental Learning

Xuan Wang,Zhong Ji,Yanwei Pang,Yunlong Yu

DOI: https://doi.org/10.1016/j.neucom.2024.128118

IF: 6

2024-01-01

Neurocomputing

Abstract:Few-Shot Class-Incremental Learning (FSCIL) aims at integrating new concepts from a minimal set of instances while preserving previously acquired knowledge. This study explores the potential of Vision Transformers (ViTs) in addressing the challenges inherent in the FSCIL paradigm, such as catastrophic forgetting and overfitting problems. Drawing insights from cognitive neuroscience, we propose a Cognition-Driven Framework (CoDF) for FSCIL, leveraging Vision Transformers to emulate human cognitive processes from the aspects of Intuitive Acquisition and Structured Cognition. On the one hand, we employ self-supervised learning techniques to imbue the representations with richer information, thereby facilitating a more intuitive acquisition of essential information to solve FSCIL tasks. On the other hand, we propose to structure the learned representations by introducing biases into the prior distribution of the latent factors, which involves a multivariate Gaussian Mixture Model (GMM) and an intra-class distribution assumption. Furthermore, we apply an innovative extended warm-up strategy to effectively harness the acquired representations for downstream tasks. Comprehensive experiments on three public datasets substantiate the efficacy of our proposed framework.
A survey on few-shot class-incremental learning

Songsong Tian,Lusi Li,Weijun Li,Hang Ran,Xin Ning,Prayag Tiwari

DOI: https://doi.org/10.1016/j.neunet.2023.10.039

IF: 7.8

2023-11-02

Neural Networks

Abstract:Large deep learning models are impressive, but they struggle when real-time data is not available. Few-shot class-incremental learning (FSCIL) poses a significant challenge for deep neural networks to learn new tasks from just a few labeled samples without forgetting the previously learned ones. This setup can easily leads to catastrophic forgetting and overfitting problems, severely affecting model performance. Studying FSCIL helps overcome deep learning model limitations on data volume and acquisition time, while improving practicality and adaptability of machine learning models. This paper provides a comprehensive survey on FSCIL. Unlike previous surveys, we aim to synthesize few-shot learning and incremental learning, focusing on introducing FSCIL from two perspectives, while reviewing over 30 theoretical research studies and more than 20 applied research studies. From the theoretical perspective, we provide a novel categorization approach that divides the field into five subcategories, including traditional machine learning methods, meta learning-based methods, feature and feature space-based methods, replay-based methods, and dynamic network structure-based methods. We also evaluate the performance of recent theoretical research on benchmark datasets of FSCIL. From the application perspective, FSCIL has achieved impressive achievements in various fields of computer vision such as image classification, object detection, and image segmentation, as well as in natural language processing and graph. We summarize the important applications. Finally, we point out potential future research directions, including applications, problem setups, and theory development. Overall, this paper offers a comprehensive analysis of the latest advances in FSCIL from a methodological, performance, and application perspective.

computer science, artificial intelligence,neurosciences
Few-Shot Incremental Learning with Continually Evolved Classifiers

Chi Zhang,Nan Song,Guosheng Lin,Yun Zheng,Pan Pan,Yinghui Xu

DOI: https://doi.org/10.1109/cvpr46437.2021.01227

2021-06-01

Abstract:Few-shot class-incremental learning (FSCIL) aims to design machine learning algorithms that can continually learn new concepts from a few data points, without forgetting knowledge of old classes. The difficulty lies in that limited data from new classes not only lead to significant overfitting issues but also exacerbate the notorious catastrophic forgetting problems. Moreover, as training data come in sequence in FSCIL, the learned classifier can only provide discriminative information in individual sessions, while FSCIL requires all classes to be involved for evaluation. In this paper, we address the FSCIL problem from two aspects. First, we adopt a simple but effective decoupled learning strategy of representations and classifiers that only the classifiers are updated in each incremental session, which avoids knowledge forgetting in the representations. By doing so, we demonstrate that a pre-trained backbone plus a non-parametric class mean classifier can beat state-of-the-art methods. Second, to make the classifiers learned on individual sessions applicable to all classes, we propose a Continually Evolved Classifier (CEC) that employs a graph model to propagate context information between classifiers for adaptation. To enable the learning of CEC, we design a pseudo incremental learning paradigm that episodically constructs a pseudo incremental learning task to optimize the graph parameters by sampling data from the base dataset. Experiments on three popular benchmark datasets, including CIFAR100, miniImageNet, and Caltech-USCD Birds-200-2011 (CUB200), show that our method significantly outperforms the baselines and sets new state-of-the-art results with remarkable advantages.
FSCIL-EACA: Few-Shot Class-Incremental Learning Network Based on Embedding Augmentation and Classifier Adaptation for Image Classification

Ruru Zhang,E Haihong,Meina Song,Xun Cao

DOI: https://doi.org/10.23919/cje.2022.00.396

IF: 1.019

2024-01-01

Chinese Journal of Electronics

Abstract:The ability to learn incrementally is critical to the long-term operation of AI systems. Benefiting from the power of few-shot class-incremental learning (FSCIL), deep learning models can continuously recognize new classes with only a few samples. The difficulty is that limited instances of new classes will lead to overfitting and exacerbate the catastrophic forgetting of the old classes. Most previous works alleviate the above problems by imposing strong constraints on the model structure or parameters, but ignoring embedding network transferability and classifier adaptation (CA), failing to guarantee the efficient utilization of visual features and establishing relationships between old and new classes. In this paper, we propose a simple and novel approach from two perspectives: embedding bias and classifier bias. The method learns an embedding augmented (EA) network with cross-class transfer and class-specific discriminative abilities based on self-supervised learning and modulated attention to alleviate embedding bias. Based on the adaptive incremental classifier learning scheme to realize incremental learning capability, guiding the adaptive update of prototypes and feature embeddings to alleviate classifier bias. We conduct extensive experiments on two popular natural image datasets and two medical datasets. The experiments show that our method is significantly better than the baseline and achieves state-of-the-art results.

engineering, electrical & electronic
Enhanced Few-Shot Class-Incremental Learning via Ensemble Models

Mingli Zhu,Zihao Zhu,Sihong Chen,Chen Chen,Baoyuan Wu

2024-03-21

Abstract:Few-shot class-incremental learning (FSCIL) aims to continually fit new classes with limited training data, while maintaining the performance of previously learned classes. The main challenges are overfitting the rare new training samples and forgetting old classes. While catastrophic forgetting has been extensively studied, the overfitting problem has attracted less attention in FSCIL. To tackle overfitting challenge, we design a new ensemble model framework cooperated with data augmentation to boost generalization. In this way, the enhanced model works as a library storing abundant features to guarantee fast adaptation to downstream tasks. Specifically, the multi-input multi-output ensemble structure is applied with a spatial-aware data augmentation strategy, aiming at diversifying the feature extractor and alleviating overfitting in incremental sessions. Moreover, self-supervised learning is also integrated to further improve the model generalization. Comprehensive experimental results show that the proposed method can indeed mitigate the overfitting problem in FSCIL, and outperform the state-of-the-art methods.

Computer Vision and Pattern Recognition
Few-shot class-incremental learning based on representation enhancement

Jun Li,Wenlong Zhou,Guangle Yao,Juntao Zhu

DOI: https://doi.org/10.1117/1.JEI.31.4.043027

2022-07-01

Abstract:Abstract. Few-shot class-incremental learning (FSCIL) is crucial and practical for artificial intelligence in the real world, which learns novel classes incrementally from few samples without forgetting the previously learned classes. However, FSCIL confronts two significant challenges: “catastrophic forgetting” and “overfitting new.” We focus on convolutional neural network (CNN)-based FSCIL and propose a human cognition-inspired FSCIL method, in which the knowledge of novel classes is learned under the guidance of the previously learned knowledge. Specifically, we learn a discriminative and generalized CNN feature extractor from the base classes in the first task. We generate the representations of base and novel classes in unified feature space without training on novel classes, thus avoiding “forgetting old.” For the novel classes in long sequential tasks, beyond the representation generation, we enhance the representation by exploring the correlations with the previously learned classes to alleviate overfitting new and ensure that the novel classes adapt to the feature space. Experimental results show that our proposed method achieves very competitive results on MiniImageNet and CIFAR-100 datasets.

Engineering,Computer Science
Few-Shot Class-Incremental Learning Via Class-Aware Bilateral Distillation

Linglan Zhao,Jing Lu,Yunlu Xu,Zhanzhan Cheng,Dashan Guo,Yi Niu,Xiangzhong Fang

DOI: https://doi.org/10.1109/cvpr52729.2023.01139

2023-01-01

Abstract:Few-Shot Class-Incremental Learning (FSCIL) aims to continually learn novel classes based on only few training samples, which poses a more challenging task than the well-studied Class-Incremental Learning (CIL) due to data scarcity. While knowledge distillation, a prevailing technique in CIL, can alleviate the catastrophic forgetting of older classes by regularizing outputs between current and previous model, it fails to consider the overfitting risk of novel classes in FSCIL. To adapt the powerful distillation technique for FSCIL, we propose a novel distillation structure, by taking the unique challenge of overfitting into account. Concretely, we draw knowledge from two complementary teachers. One is the model trained on abundant data from base classes that carries rich general knowledge, which can be leveraged for easing the overfitting of current novel classes. The other is the updated model from last incremental session that contains the adapted knowledge of previous novel classes, which is used for alleviating their forgetting. To combine the guidances, an adaptive strategy conditioned on the class-wise semantic similarities is introduced. Besides, for better preserving base class knowledge when accommodating novel concepts, we adopt a two-branch network with an attention-based aggregation module to dynamically merge predictions from two complementary branches. Extensive experiments on 3 popular FSCIL datasets: mini-ImageNet, CIFAR100 and CUB200 validate the effectiveness of our method by surpassing existing works by a significant margin. Code is available at https://github.com/LinglanZhao/BiDistFSCIL.
Rethinking Few-shot Class-incremental Learning: Learning from Yourself

Yu-Ming Tang,Yi-Xing Peng,Jingke Meng,Wei-Shi Zheng

2024-07-10

Abstract:Few-shot class-incremental learning (FSCIL) aims to learn sequential classes with limited samples in a few-shot fashion. Inherited from the classical class-incremental learning setting, the popular benchmark of FSCIL uses averaged accuracy (aAcc) and last-task averaged accuracy (lAcc) as the evaluation metrics. However, we reveal that such evaluation metrics may not provide adequate emphasis on the novel class performance, and the continual learning ability of FSCIL methods could be ignored under this benchmark. In this work, as a complement to existing metrics, we offer a new metric called generalized average accuracy (gAcc) which is designed to provide an extra equitable evaluation by incorporating different perspectives of the performance under the guidance of a parameter $\alpha$. We also present an overall metric in the form of the area under the curve (AUC) along the $\alpha$. Under the guidance of gAcc, we release the potential of intermediate features of the vision transformers to boost the novel-class performance. Taking information from intermediate layers which are less class-specific and more generalizable, we manage to rectify the final features, leading to a more generalizable transformer-based FSCIL framework. Without complex network designs or cumbersome training procedures, our method outperforms existing FSCIL methods at aAcc and gAcc on three datasets. See codes at <a class="link-external link-https" href="https://github.com/iSEE-Laboratory/Revisting_FSCIL" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition
FineFMPL: Fine-grained Feature Mining Prompt Learning for Few-Shot Class Incremental Learning

Hongbo Sun,Jiahuan Zhou,Xiangteng He,Jinglin Xu,Yuxin Peng

DOI: https://doi.org/10.24963/ijcai.2024/144

2024-01-01

Abstract:Few-Shot Class Incremental Learning (FSCIL) aims to continually learn new classes with few training samples without forgetting already learned old classes. Existing FSCIL methods generally fix the backbone network in incremental sessions to achieve a balance between suppressing forgetting old classes and learning new classes. However, the fixed backbone network causes insufficient learning of new classes from a few samples. Benefiting from the powerful visual and textual understanding ability of Vision-Language (VL) pre-training models, we propose a Fine-grained Feature Mining Prompt Learning (FineFMPL) approach to adapt the VL model to FSCIL, which comprehensively learns and memorizes fine-grained discriminative information of emerging classes. Concretely, the visual probe prompt is firstly proposed to guide the image encoder of VL model to extract global-level coarse-grained features and object-level fine-grained features, and visual prototypes are preserved based on image patch significance, which contains the discriminative characteristics exclusive to the class. Secondly, the textual context prompt is constructed by cross-modal mapping of visual prototypes, feeding into the text encoder of VL model to memorize the class information as textual prototypes. Finally, integrating visual and textual prototypes based on fine-grained feature mining into the model improves the recognition performance of all classes in FSCIL. Extensive experiments on three benchmark datasets demonstrate that our FineFMPL achieves new state-of-the-art. The code is available at https://github.com/PKU-ICST-MIPL/FineFMPL_IJCAI2024.
A streamlined Approach to Multimodal Few-Shot Class Incremental Learning for Fine-Grained Datasets

Thang Doan,Sima Behpour,Xin Li,Wenbin He,Liang Gou,Liu Ren

DOI: https://doi.org/10.48550/arXiv.2403.06295

2024-03-10

Computer Vision and Pattern Recognition

Abstract:Few-shot Class-Incremental Learning (FSCIL) poses the challenge of retaining prior knowledge while learning from limited new data streams, all without overfitting. The rise of Vision-Language models (VLMs) has unlocked numerous applications, leveraging their existing knowledge to fine-tune on custom data. However, training the whole model is computationally prohibitive, and VLMs while being versatile in general domains still struggle with fine-grained datasets crucial for many applications. We tackle these challenges with two proposed simple modules. The first, Session-Specific Prompts (SSP), enhances the separability of image-text embeddings across sessions. The second, Hyperbolic distance, compresses representations of image-text pairs within the same class while expanding those from different classes, leading to better representations. Experimental results demonstrate an average 10-point increase compared to baselines while requiring at least 8 times fewer trainable parameters. This improvement is further underscored on our three newly introduced fine-grained datasets.
Learning Prompt with Distribution-Based Feature Replay for Few-Shot Class-Incremental Learning

Zitong Huang,Ze Chen,Zhixing Chen,Erjin Zhou,Xinxing Xu,Rick Siow Mong Goh,Yong Liu,Wangmeng Zuo,Chunmei Feng

2024-04-05

Abstract:Few-shot Class-Incremental Learning (FSCIL) aims to continuously learn new classes based on very limited training data without forgetting the old ones encountered. Existing studies solely relied on pure visual networks, while in this paper we solved FSCIL by leveraging the Vision-Language model (e.g., CLIP) and propose a simple yet effective framework, named Learning Prompt with Distribution-based Feature Replay (LP-DiF). We observe that simply using CLIP for zero-shot evaluation can substantially outperform the most influential methods. Then, prompt tuning technique is involved to further improve its adaptation ability, allowing the model to continually capture specific knowledge from each session. To prevent the learnable prompt from forgetting old knowledge in the new session, we propose a pseudo-feature replay approach. Specifically, we preserve the old knowledge of each class by maintaining a feature-level Gaussian distribution with a diagonal covariance matrix, which is estimated by the image features of training images and synthesized features generated from a VAE. When progressing to a new session, pseudo-features are sampled from old-class distributions combined with training images of the current session to optimize the prompt, thus enabling the model to learn new knowledge while retaining old knowledge. Experiments on three prevalent benchmarks, i.e., CIFAR100, mini-ImageNet, CUB-200, and two more challenging benchmarks, i.e., SUN-397 and CUB-200$^*$ proposed in this paper showcase the superiority of LP-DiF, achieving new state-of-the-art (SOTA) in FSCIL. Code is publicly available at

Computer Vision and Pattern Recognition
Bias Mitigating Few-Shot Class-Incremental Learning

Li-Jun Zhao,Zhen-Duo Chen,Zi-Chao Zhang,Xin Luo,Xin-Shun Xu

2024-02-01

Abstract:Few-shot class-incremental learning (FSCIL) aims at recognizing novel classes continually with limited novel class samples. A mainstream baseline for FSCIL is first to train the whole model in the base session, then freeze the feature extractor in the incremental sessions. Despite achieving high overall accuracy, most methods exhibit notably low accuracy for incremental classes. Some recent methods somewhat alleviate the accuracy imbalance between base and incremental classes by fine-tuning the feature extractor in the incremental sessions, but they further cause the accuracy imbalance between past and current incremental classes. In this paper, we study the causes of such classification accuracy imbalance for FSCIL, and abstract them into a unified model bias problem. Based on the analyses, we propose a novel method to mitigate model bias of the FSCIL problem during training and inference processes, which includes mapping ability stimulation, separately dual-feature classification, and self-optimizing classifiers. Extensive experiments on three widely-used FSCIL benchmark datasets show that our method significantly mitigates the model bias problem and achieves state-of-the-art performance.

Computer Vision and Pattern Recognition
Few Shot Class Incremental Learning via Efficient Prototype Replay and Calibration

Wei Zhang,Xiaodong Gu

DOI: https://doi.org/10.3390/e25050776

2023-05-10

Abstract:Few shot class incremental learning (FSCIL) is an extremely challenging but valuable problem in real-world applications. When faced with novel few shot tasks in each incremental stage, it should take into account both catastrophic forgetting of old knowledge and overfitting of new categories with limited training data. In this paper, we propose an efficient prototype replay and calibration (EPRC) method with three stages to improve classification performance. We first perform effective pre-training with rotation and mix-up augmentations in order to obtain a strong backbone. Then a series of pseudo few shot tasks are sampled to perform meta-training, which enhances the generalization ability of both the feature extractor and projection layer and then helps mitigate the over-fitting problem of few shot learning. Furthermore, an even nonlinear transformation function is incorporated into the similarity computation to implicitly calibrate the generated prototypes of different categories and alleviate correlations among them. Finally, we replay the stored prototypes to relieve catastrophic forgetting and rectify prototypes to be more discriminative in the incremental-training stage via an explicit regularization within the loss function. The experimental results on CIFAR-100 and miniImageNet demonstrate that our EPRC significantly boosts the classification performance compared with existing mainstream FSCIL methods.
Model Attention Expansion for Few-Shot Class-Incremental Learning

Xuan Wang,Zhong Ji,Yunlong Yu,Yanwei Pang,Jungong Han

DOI: https://doi.org/10.1109/TIP.2024.3434475

Abstract:Few-Shot Class-Incremental Learning (FSCIL) aims at incrementally learning new knowledge from limited training examples without forgetting previous knowledge. However, we observe that existing methods face a challenge known as supervision collapse, where the model disproportionately emphasizes class-specific features of base classes at the detriment of novel class representations, leading to restricted cognitive capabilities. To alleviate this issue, we propose a new framework, Model aTtention Expansion for Few-Shot Class-Incremental Learning (MTE-FSCIL), aimed at expanding the model attention fields to improve transferability without compromising the discriminative capability for base classes. Specifically, the framework adopts a dual-stage training strategy, comprising pre-training and meta-training stages. In the pre-training stage, we present a new regularization technique, named the Reserver (RS) loss, to expand the global perception and reduce over-reliance on class-specific features by amplifying feature map activations. During the meta-training stage, we introduce the Repeller (RP) loss, a novel pair-based loss that promotes variation in representations and improves the model's recognition of sample uniqueness by scattering intra-class samples within the embedding space. Furthermore, we propose a Transformational Adaptation (TA) strategy to enable continuous incorporation of new knowledge from downstream tasks, thus facilitating cross-task knowledge transfer. Extensive experimental results on mini-ImageNet, CIFAR100, and CUB200 datasets demonstrate that our proposed framework consistently outperforms the state-of-the-art methods.
Coarse-To-Fine Incremental Few-Shot Learning

Xiang,Yuwen Tan,Qian Wan,Jing Ma,Alan Yuille,Gregory D. Hager

DOI: https://doi.org/10.1007/978-3-031-19821-2_12

2021-01-01

Abstract:Different from fine-tuning models pre-trained on a large-scale dataset of preset classes, class-incremental learning (CIL) aims to recognize novel classes over time without forgetting pre-trained classes. However, a given model will be challenged by test images with finer-grained classes, e.g., a basenji is at most recognized as a dog. Such images form a new training set (i.e., support set) so that the incremental model is hoped to recognize a basenji (i.e., query) as a basenji next time. This paper formulates such a hybrid natural problem of coarse-to-fine few-shot (C2FS) recognition as a CIL problem named C2FSCIL, and proposes a simple, effective, and theoretically-sound strategy Knowe: to learn, freeze, and normalize a classifier’s weights from fine labels, once learning an embedding space contrastively from coarse labels. Besides, as CIL aims at a stability-plasticity balance, new overall performance metrics are proposed. In hat sense, on CIFAR-100, BREEDS, and tieredImageNet, Knowe outperforms all recent relevant CIL or FSCIL methods.
Few Shot Class Incremental Learning using Vision-Language models

Anurag Kumar,Chinmay Bharti,Saikat Dutta,Srikrishna Karanam,Biplab Banerjee

2024-08-15

Abstract:Recent advancements in deep learning have demonstrated remarkable performance comparable to human capabilities across various supervised computer vision tasks. However, the prevalent assumption of having an extensive pool of training data encompassing all classes prior to model training often diverges from real-world scenarios, where limited data availability for novel classes is the norm. The challenge emerges in seamlessly integrating new classes with few samples into the training data, demanding the model to adeptly accommodate these additions without compromising its performance on base classes. To address this exigency, the research community has introduced several solutions under the realm of few-shot class incremental learning (FSCIL). In this study, we introduce an innovative FSCIL framework that utilizes language regularizer and subspace regularizer. During base training, the language regularizer helps incorporate semantic information extracted from a Vision-Language model. The subspace regularizer helps in facilitating the model's acquisition of nuanced connections between image and text semantics inherent to base classes during incremental training. Our proposed framework not only empowers the model to embrace novel classes with limited data, but also ensures the preservation of performance on base classes. To substantiate the efficacy of our approach, we conduct comprehensive experiments on three distinct FSCIL benchmarks, where our framework attains state-of-the-art performance.

Computer Vision and Pattern Recognition,Computation and Language,Image and Video Processing
Less is more: Ensemble Learning for Retinal Disease Recognition Under Limited Resources

Jiahao Wang,Hong Peng,Shengchao Chen,Sufen Ren

2024-02-15

Abstract:Retinal optical coherence tomography (OCT) images provide crucial insights into the health of the posterior ocular segment. Therefore, the advancement of automated image analysis methods is imperative to equip clinicians and researchers with quantitative data, thereby facilitating informed decision-making. The application of deep learning (DL)-based approaches has gained extensive traction for executing these analysis tasks, demonstrating remarkable performance compared to labor-intensive manual analyses. However, the acquisition of Retinal OCT images often presents challenges stemming from privacy concerns and the resource-intensive labeling procedures, which contradicts the prevailing notion that DL models necessitate substantial data volumes for achieving superior performance. Moreover, limitations in available computational resources constrain the progress of high-performance medical artificial intelligence, particularly in less developed regions and countries. This paper introduces a novel ensemble learning mechanism designed for recognizing retinal diseases under limited resources (e.g., data, computation). The mechanism leverages insights from multiple pre-trained models, facilitating the transfer and adaptation of their knowledge to Retinal OCT images. This approach establishes a robust model even when confronted with limited labeled data, eliminating the need for an extensive array of parameters, as required in learning from scratch. Comprehensive experimentation on real-world datasets demonstrates that the proposed approach can achieve superior performance in recognizing Retinal OCT images, even when dealing with exceedingly restricted labeled datasets. Furthermore, this method obviates the necessity of learning extensive-scale parameters, making it well-suited for deployment in low-resource scenarios.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
FEDI: Few-shot learning based on Earth Mover's Distance algorithm combined with deep residual network to identify diabetic retinopathy

Liangrui Pan,Boya Ji,Peng Xi,Xiaoqi Wang,Mitchai Chongcheawchamnan,Shaoliang Peng

DOI: https://doi.org/10.48550/arXiv.2108.09711

2022-03-09

Abstract:Diabetic retinopathy(DR) is the main cause of blindness in diabetic patients. However, DR can easily delay the occurrence of blindness through the diagnosis of the fundus. In view of the reality, it is difficult to collect a large amount of diabetic retina data in clinical practice. This paper proposes a few-shot learning model of a deep residual network based on Earth Mover's Distance algorithm to assist in diagnosing DR. We build training and validation classification tasks for few-shot learning based on 39 categories of 1000 sample data, train deep residual networks, and obtain experience maximization pre-training models. Based on the weights of the pre-trained model, the Earth Mover's Distance algorithm calculates the distance between the images, obtains the similarity between the images, and changes the model's parameters to improve the accuracy of the training model. Finally, the experimental construction of the small sample classification task of the test set to optimize the model further, and finally, an accuracy of 93.5667% on the 3way10shot task of the diabetic retina test set. For the experimental code and results, please refer to: <a class="link-external link-https" href="https://github.com/panliangrui/few-shot-learning-funds" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
Few-Shot Class-Incremental Learning by Sampling Multi-Phase Tasks

Da-Wei Zhou,Han-Jia Ye,Liang Ma,Di Xie,Shiliang Pu,De-Chuan Zhan

DOI: https://doi.org/10.48550/arXiv.2203.17030

2022-08-19

Abstract:New classes arise frequently in our ever-changing world, e.g., emerging topics in social media and new types of products in e-commerce. A model should recognize new classes and meanwhile maintain discriminability over old classes. Under severe circumstances, only limited novel instances are available to incrementally update the model. The task of recognizing few-shot new classes without forgetting old classes is called few-shot class-incremental learning (FSCIL). In this work, we propose a new paradigm for FSCIL based on meta-learning by LearnIng Multi-phase Incremental Tasks (LIMIT), which synthesizes fake FSCIL tasks from the base dataset. The data format of fake tasks is consistent with the `real' incremental tasks, and we can build a generalizable feature space for the unseen tasks through meta-learning. Besides, LIMIT also constructs a calibration module based on transformer, which calibrates the old class classifiers and new class prototypes into the same scale and fills in the semantic gap. The calibration module also adaptively contextualizes the instance-specific embedding with a set-to-set function. LIMIT efficiently adapts to new classes and meanwhile resists forgetting over old classes. Experiments on three benchmark datasets (CIFAR100, miniImageNet, and CUB200) and large-scale dataset, i.e., ImageNet ILSVRC2012 validate that LIMIT achieves state-of-the-art performance.

Computer Vision and Pattern Recognition,Machine Learning
CA-CLIP: category-aware adaptation of CLIP model for few-shot class-incremental learning

Xu, Yuqiao,Huang, Shucheng,Zhou, Haoliang

DOI: https://doi.org/10.1007/s00530-024-01322-y

IF: 3.9

2024-04-24

Multimedia Systems

Abstract:Few-shot class-incremental learning (FSCIL) learns from continuously arriving new categories, each with only a small number of training samples. As a challenging problem, FSCIL aims to mitigate the catastrophic forgetting of old knowledge while preventing overfitting to new categories. Vision-language pre-training (VLP) models achieve effective cross-modal interaction between visual and textual information, providing generalized representations. However, when fine-tuning VLP models, e.g., CLIP, to handle the FSCIL problem, learning category-specific features from continuously coming new categories with few-shot samples remains arduous and is often accompanied by the forgetting of old knowledge. To address the aforementioned problem, we propose category-aware adaptation of CLIP model (CA-CLIP) for FSCIL. To retain category-agnostic knowledge while extracting useful category-specific information, we introduce a target-focused adapter (TFA). By leveraging semantic-rich image patch embeddings, the TFA enables the class token to focus more on the category-related target features. Additionally, to filter semantic-rich patch embeddings, we propose a patch filtering (PF) module, which selects patch embeddings with positive contributions to the class token based on the attention distribution. Moreover, we apply the bi-level optimization strategy based on meta-learning to optimize the model to learn how to balance the retention of old knowledge and the learning of new knowledge. Numerous experiments demonstrate that our approach achieves competitive results compared to state-of-the-art methods on three FSCIL benchmark datasets.

computer science, information systems, theory & methods

Omphalocele with pyloroduodenal obstruction by extrinsic hepatic compression: a case report.

A Cognition-Driven Framework for Few-Shot Class-Incremental Learning

A survey on few-shot class-incremental learning

Few-Shot Incremental Learning with Continually Evolved Classifiers

FSCIL-EACA: Few-Shot Class-Incremental Learning Network Based on Embedding Augmentation and Classifier Adaptation for Image Classification

Enhanced Few-Shot Class-Incremental Learning via Ensemble Models

Few-shot class-incremental learning based on representation enhancement

Few-Shot Class-Incremental Learning Via Class-Aware Bilateral Distillation

Rethinking Few-shot Class-incremental Learning: Learning from Yourself

FineFMPL: Fine-grained Feature Mining Prompt Learning for Few-Shot Class Incremental Learning

A streamlined Approach to Multimodal Few-Shot Class Incremental Learning for Fine-Grained Datasets

Learning Prompt with Distribution-Based Feature Replay for Few-Shot Class-Incremental Learning

Bias Mitigating Few-Shot Class-Incremental Learning

Few Shot Class Incremental Learning via Efficient Prototype Replay and Calibration

Model Attention Expansion for Few-Shot Class-Incremental Learning

Coarse-To-Fine Incremental Few-Shot Learning

Few Shot Class Incremental Learning using Vision-Language models

Less is more: Ensemble Learning for Retinal Disease Recognition Under Limited Resources

FEDI: Few-shot learning based on Earth Mover's Distance algorithm combined with deep residual network to identify diabetic retinopathy

Few-Shot Class-Incremental Learning by Sampling Multi-Phase Tasks

CA-CLIP: category-aware adaptation of CLIP model for few-shot class-incremental learning