Parameters and sites of brainstem stimulation capable of eliciting the rabbit nictitating membrane response

B. Schreurs

DOI: https://doi.org/10.1016/0166-4328(87)90008-8

IF: 3.352

1987-08-01

Behavioural Brain Research

Abstract:

What problem does this paper attempt to address?

Learning Class-level Prototypes for Few-shot Learning

Minglei Yuan,Wenhai Wang,Tao Wang,Chunhao Cai,Qian Xu,Tong Lu

2021-01-01

Abstract: Few-shot learning aims to recognize new categories using very few labeled samples. Although few-shot learning has witnessed promising development in recent years, most existing methods adopt an average operation to calculate prototypes, thus limited by the outlier samples. In this work, we propose a simple yet effective framework for few-shot classification, which can learn to generate preferable prototypes from few support data, with the help of an episodic prototype generator module. The generated prototype is meant to be close to a certain \textit{\targetproto{}} and is less influenced by outlier samples. Extensive experiments demonstrate the effectiveness of this module, and our approach gets a significant raise over baseline models, and get a competitive result compared to previous methods on \textit{mini}ImageNet, \textit{tiered}ImageNet, and cross-domain (\textit{mini}ImageNet $\rightarrow$ CUB-200-2011) datasets.
Feature Transformation for Few-Shot Learning

Peizheng Wang,Qifei Zhang,Jie Zhang,Gang Li,Chao Wu

DOI: https://doi.org/10.1109/ijcnn60899.2024.10650078

2024-01-01

Abstract:The goal of few-shot learning is to classify new classes of samples with a few labeled training samples. State-of-the-art few-shot learners train a backbone on sufficient datasets and use its extracted features for classification. However, biased data distributions can lead to severe overfitting in few-shot learning. In this paper, we propose a novel feature transformation method that utilizes the statistical characteristics of sufficient data to perform feature transformation on few-shot data to alleviate overfitting caused by biased data distributions. We show an interesting phenomenon that removing the component along the mean feature of the base classes in meta-testing improves the performance for few-shot learning. Our method can be used on off-the-shelf pretrained feature extractors without extra parameters. We show that our method achieves the new state-of-the-art accuracy in the prototype-based method and comparable accuracy with state-of-the-art accuracy in the optimization-based method.
Distributed Few-Shot Learning with Prototype Distribution Correction

Zhiling Fu,Dongfang Tang,Pingchuan Ma,Zhe Wang,Wen Gao

DOI: https://doi.org/10.1007/s10489-023-05103-4

IF: 5.3

2023-01-01

Applied Intelligence

Abstract:Few-shot learning aims to learn a classifier that can perform well even if a few labeled samples are used for training. Many methods based on prototype models have recently been proposed and show good performance in few-shot learning. However, in the few-shot scenario, data is scarce. There is a deviation between the prototype calculated employing only a small amount of data in the support set and the actual prototype. Moreover, the features of the novel class extracted from the pre-trained model trained using base class data exhibit a bias. Additionally, the pre-trained model demonstrates high complexity and poor training efficiency. Therefore, we propose the Distributed Few-shot Learning with Prototype Distribution Correction to this end. Specifically, we employ pseudo-labels to fuse the sample features of the query set and modify the prototype to reduce the bias between the support and the query set. Then we utilize the features of the Gaussian distribution to transfer the base class features to the novel class to reduce the bias between novel classes and base classes. Finally, we combine distributed learning to improve the efficiency of the pre-trained model. We evaluate our method on Mini-ImageNet, Tiered-ImageNet, and CUB, three few-shot learning public datasets. The classification accuracy of our method improves in every case on every dataset and achieves state-of-the-art performance. In particular, the accuracy improves by 10.12% on 1-shot Mini-ImageNet.
Few-Shot Learning With Global Class Representations

Aoxue Li,Tiange Luo,Tao Xiang,Weiran Huang,Liwei Wang

DOI: https://doi.org/10.1109/iccv.2019.00981

2019-10-01

Abstract:In this paper, we propose to tackle the challenging fewshot learning (FSL) problem by learning global class representations using both base and novel class training samples. In each training episode, an episodic class mean computed from a support set is registered with the global representation via a registration module. This produces a registered global class representation for computing the classification loss using a query set. Though following a similar episodic training pipeline as existing meta learning based approaches, our method differs significantly in that novel class training samples are involved in the training from the beginning. To compensate for the lack of novel class training samples, an effective sample synthesis strategy is developed to avoid overfitting. Importantly, by joint base-novel class training, our approach can be easily extended to a more practical yet challenging FSL setting, i. e., generalized FSL, where the label space of test data is extended to both base and novel classes. Extensive experiments show that our approach is effective for both of the two FSL settings.
Prototype Completion for Few-Shot Learning

Baoquan Zhang,Xutao Li,Yunming Ye,Shanshan Feng

DOI: https://doi.org/10.1109/tpami.2023.3277881

IF: 23.6

2023-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Few-shot learning (FSL) aims to recognize novel classes with few examples. Pre-training based methods effectively tackle the problem by pre-training a feature extractor and then fine-tuning it through the nearest centroid based meta-learning. However, results show that the fine-tuning step makes marginal improvements. In this paper, 1) we figure out the reason, i.e., in the pre-trained feature space, the base classes already form compact clusters while novel classes spread as groups with large variances, which implies that fine-tuning feature extractor is less meaningful; 2) instead of fine-tuning feature extractor, we focus on estimating more representative prototypes. Consequently, we propose a novel prototype completion based meta-learning framework. This framework first introduces primitive knowledge (i.e., class-level part or attribute annotations) and extracts representative features for seen attributes as priors. Second, a part/attribute transfer network is designed to learn to infer the representative features for unseen attributes as supplementary priors. Finally, a prototype completion network is devised to learn to complete prototypes with these priors. Moreover, to avoid the prototype completion error, we further develop a Gaussian based prototype fusion strategy that fuses the mean-based and completed prototypes by exploiting the unlabeled samples. At last, we also develop an economic prototype completion version for FSL, which does not need to collect primitive knowledge, for a fair comparison with existing FSL methods without external knowledge. Extensive experiments show that our method: (i) obtains more accurate prototypes; (ii) achieves superior performance on both inductive and transductive FSL settings. Our codes are open-sourced at https://github.com/zhangbq-research/Prototype_Completion_for_FSL.

computer science, artificial intelligence,engineering, electrical & electronic
Representative local feature mining for few-shot learning

Kun Yan,Lingbo Liu,Jun Hou,Ping Wang

DOI: https://doi.org/10.1109/ICASSP39728.2021.9413890

2021-01-01

Abstract:Few-shot learning aims to recognize unseen images of new classes with only a few training examples. While great progress has been made with deep learning technology, most metric-based works rely on the measurement based on global feature representation of images, which is sensitive to background factors due to the scarcity of training data. Given this, we propose a novel method that chooses representative local features to facilitate few-shot learning. Specifically, we propose a "task-specific guided" strategy to mine local features that are task-specific and discriminative. For each task, we first mine representative local features for labeled images by a loss guided mechanism. Then these local features are used to guide a classifier to mine representative local features for unlabeled images. In this way, task-specific representative local features can be selected for better classification. We empirically show our method can effectively alleviate the negative effect introduced by background factors. Extensive experiments on two few-shot benchmarks show the effectiveness of the proposed method.
Self-Promoted Prototype Refinement for Few-Shot Class-Incremental Learning

Kai Zhu,Yang Cao,Wei Zhai,Jie Cheng,Zheng-Jun Zha

DOI: https://doi.org/10.1109/cvpr46437.2021.00673

2021-01-01

Computer Vision and Pattern Recognition

Abstract:Few-shot class-incremental learning is to recognize the new classes given few samples and not forget the old classes. It is a challenging task since representation optimization and prototype reorganization can only be achieved under little supervision. To address this problem, we propose a novel incremental prototype learning scheme. Our scheme consists of a random episode selection strategy that adapts the feature representation to various generated incremental episodes to enhance the corresponding extensibility, and a self-promoted prototype refinement mechanism which strengthens the expression ability of the new classes by explicitly considering the dependencies among different classes. Particularly, a dynamic relation projection module is proposed to calculate the relation matrix in a shared embedding space and leverage it as the factor for bootstrapping the update of prototypes. Extensive experiments on three benchmark datasets demonstrate the above-par incremental performance, outperforming state-of-the-art methods by a margin of 13%, 17% and 11%, respectively.
Attentive Prototype Few-Shot Learning with Capsule Network-Based Embedding

Fangyu Wu,Jeremy S. Smith,Wenjin Lu,Chaoyi Pang,Bailing Zhang

DOI: https://doi.org/10.1007/978-3-030-58604-1_15

2020-01-01

Abstract:Few-shot learning, namely recognizing novel categories with a very small amount of training examples, is a challenging area of machine learning research. Traditional deep learning methods require massive training data to tune the huge number of parameters, which is often impractical and prone to over-fitting. In this work, we further research on the well-known few-shot learning method known as prototypical networks for better performance. Our contributions include (1) a new embedding structure to encode relative spatial relationships between features by applying a capsule network; (2) a new triplet loss designated to enhance the semantic feature embedding where similar samples are close to each other while dissimilar samples are farther apart; and (3) an effective non-parametric classifier termed attentive prototypes in place of the simple prototypes in current few-shot learning. The proposed attentive prototype aggregates all of the instances in a support class which are weighted by their importance, defined by the reconstruction error for a given query. The reconstruction error allows the classification posterior probability to be estimated, which corresponds to the classification confidence score. Extensive experiments on three benchmark datasets demonstrate that our approach is effective for the few-shot classification task.
Adaptive Parametric Prototype Learning for Cross-Domain Few-Shot Classification

Marzi Heidari,Abdullah Alchihabi,Qing En,Yuhong Guo

DOI: https://doi.org/10.48550/arXiv.2309.01342

2023-09-04

Abstract:Cross-domain few-shot classification induces a much more challenging problem than its in-domain counterpart due to the existence of domain shifts between the training and test tasks. In this paper, we develop a novel Adaptive Parametric Prototype Learning (APPL) method under the meta-learning convention for cross-domain few-shot classification. Different from existing prototypical few-shot methods that use the averages of support instances to calculate the class prototypes, we propose to learn class prototypes from the concatenated features of the support set in a parametric fashion and meta-learn the model by enforcing prototype-based regularization on the query set. In addition, we fine-tune the model in the target domain in a transductive manner using a weighted-moving-average self-training approach on the query instances. We conduct experiments on multiple cross-domain few-shot benchmark datasets. The empirical results demonstrate that APPL yields superior performance than many state-of-the-art cross-domain few-shot learning methods.

Computer Vision and Pattern Recognition,Machine Learning
Local descriptor-based multi-prototype network for few-shot Learning

Hongwei Huang,Zhangkai Wu,Wenbin Li,Jing Huo,Yang Gao

DOI: https://doi.org/10.1016/j.patcog.2021.107935

IF: 8

2021-08-01

Pattern Recognition

Abstract:Prototype-based few-shot learning methods are promising in that they are simple yet effective to handle any-shot problems, and many prototype associated works are raised since then. However, these traditional prototype-based methods generally use only one single prototype to represent a class, which essentially cannot effectively estimate the complicated distribution of a class. To tackle this problem, we propose a novel Local descriptor-based Multi-Prototype Network (LMPNet) in this paper, a well-designed framework that generates an embedding space with multiple prototypes. Specifically, the proposed LMPNet employs local descriptors to represent each image, which can capture more informative and subtler cues of an image than the normally adopted image-level features. Moreover, to alleviate the uncertainty introduced by the fixed construction (averaging over samples) of prototypes, we introduce a channel squeeze and spatial excitation (sSE) attention module to learn multiple local descriptor-based prototypes for each class through end-to-end learning. Extensive experiments on both few-shot and fine-grained few-shot image classification tasks have been conducted on various benchmark datasets, including miniImageNet, tieredImageNet, Stanford Dogs, Stanford Cars, and CUB-200-2010. The experimental results of our LMPNet on above datasets show tangibly learning performance improvements and distinguishable outcomes over the baseline models.

computer science, artificial intelligence,engineering, electrical & electronic
PrototypeFormer: Learning to Explore Prototype Relationships for Few-shot Image Classification

Feihong He,Gang Li,Lingyu Si,Leilei Yan,Fanzhang Li,Fuchun Sun

2023-10-05

Abstract:Few-shot image classification has received considerable attention for addressing the challenge of poor classification performance with limited samples in novel classes. However, numerous studies have employed sophisticated learning strategies and diversified feature extraction methods to address this issue. In this paper, we propose our method called PrototypeFormer, which aims to significantly advance traditional few-shot image classification approaches by exploring prototype relationships. Specifically, we utilize a transformer architecture to build a prototype extraction module, aiming to extract class representations that are more discriminative for few-shot classification. Additionally, during the model training process, we propose a contrastive learning-based optimization approach to optimize prototype features in few-shot learning scenarios. Despite its simplicity, the method performs remarkably well, with no bells and whistles. We have experimented with our approach on several popular few-shot image classification benchmark datasets, which shows that our method outperforms all current state-of-the-art methods. In particular, our method achieves 97.07% and 90.88% on 5-way 5-shot and 5-way 1-shot tasks of miniImageNet, which surpasses the state-of-the-art results with accuracy of 7.27% and 8.72%, respectively. The code will be released later.

Computer Vision and Pattern Recognition
Reweighting and Information-Guidance Networks for Few-Shot Learning

Zhong Ji,Xingliang Chai,Yunlong Yu,Zhongfei Zhang

DOI: https://doi.org/10.1016/j.neucom.2020.07.128

IF: 6

2020-01-01

Neurocomputing

Abstract:Few-Shot Learning (FSL) aims at recognizing new categories from a few available samples. In this paper, we propose two strategies on the basis of Prototypical Networks [1] to improve the discriminativeness and representativeness of the visual prototypes for few-shot learning task. Firstly, we propose a reweighting mechanism to distribute different weights for accesses the instance representativeness to the class. Secondly, we propose an information-guidance mechanism to encode discriminative knowledge into the class prototypes to compensate for more information across classes. Extensive experimental results on two benchmark datasets empirically show that both the proposed strategies improve the Prototypical Networks and achieve the state-of-the-art performances. Besides, the information-guidance mechanism could be seamlessly combined into some existing approaches to substantially improve their performances on few-shot classification.
Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning

Yanbin Liu,Juho Lee,Minseop Park,Saehoon Kim,Eunho Yang,Sung Ju Hwang,Yi Yang

DOI: https://doi.org/10.48550/arXiv.1805.10002

2019-02-08

Abstract:The goal of few-shot learning is to learn a classifier that generalizes well even when trained with a limited number of training instances per class. The recently introduced meta-learning approaches tackle this problem by learning a generic classifier across a large number of multiclass classification tasks and generalizing the model to a new task. Yet, even with such meta-learning, the low-data problem in the novel classification task still remains. In this paper, we propose Transductive Propagation Network (TPN), a novel meta-learning framework for transductive inference that classifies the entire test set at once to alleviate the low-data problem. Specifically, we propose to learn to propagate labels from labeled instances to unlabeled test instances, by learning a graph construction module that exploits the manifold structure in the data. TPN jointly learns both the parameters of feature embedding and the graph construction in an end-to-end manner. We validate TPN on multiple benchmark datasets, on which it largely outperforms existing few-shot learning approaches and achieves the state-of-the-art results.

Machine Learning,Computer Vision and Pattern Recognition,Neural and Evolutionary Computing
Bimodal semantic fusion prototypical network for few-shot classification

Xilang Huang,Seon Han Choi

DOI: https://doi.org/10.1016/j.inffus.2024.102421

IF: 18.6

2024-04-19

Information Fusion

Abstract:Few-shot classification learns from a small number of image samples to recognize unseen images. Recent few-shot learning exploits auxiliary text information, such as class labels and names, to obtain more discriminative class prototypes. However, most existing approaches rarely consider using text information as a clue to highlight important feature regions and do not consider feature alignment between prototypes and targets, leading to prototype ambiguity owing to information gaps. To address this issue, a prototype generator module was developed to perform interactions between the text knowledge of the class name and visual feature maps in the spatial and channel dimensions. This module learns how to assign mixture weights to essential regions of each sample feature to obtain informative prototypes. In addition, a feature refinement module was proposed to embed text information into query images without knowing their labels. It generates attention from concatenated features between query and text features through pairwise distance loss. To improve the alignment between the prototype and relevant targets, a prototype calibration module was designed to preserve the important features of the prototype by considering the interrelationships between the prototype and query features. Extensive experiments were conducted on five few-shot classification benchmarks, and the results demonstrated the superiority of the proposed method over state-of-the-art methods in 1-shot and 5-shot settings.

computer science, artificial intelligence, theory & methods
Improved prototypical network for active few-shot learning

Yaqiang Wu,Yifei Li,Tianzhe Zhao,Lingling Zhang,Bifan Wei,Jun Liu,Qinghua Zheng

DOI: https://doi.org/10.1016/j.patrec.2023.06.015

IF: 4.757

2023-06-27

Pattern Recognition Letters

Abstract:Different from deep learning with large scale supervision, few-shot learning aims to learn the samples' characteristics from few labeled examples. Apparently, few-shot learning is more in line with the visual cognitive mechanism of the human brain. In recent years, few-shot learning has attracted more researchers' attention. They all assume that each category only contains a few labeled samples and without unlabeled samples during the few-shot training. However, in reality, each visual categories also includes some unlabeled samples which store rich semantic information. Labeling all unlabeled samples is time-consuming and laborious. Therefore, we combine the few-shot learning and active learning together, and propose an active few-shot learning model (AC-FSL) based on prototype network. This model includes two core modules: few-shot classification module and loss prediction module. The former is used for classification task under few labeled samples, while the latter is applied to choose some unlabeled samples of high value for labeling, and then assist for the few-shot classification task. We conduct extensive experiments on two image benchmark datasets. The results show that the proposed model AC-FSL can effectively improve the classification performance of current methods on few-shot setting.

computer science, artificial intelligence
Membership-Grade Based Prototype Rectification for Fine-Grained Few-Shot Classification

Sa Ning,Rundong Qi,Yong Jiang

DOI: https://doi.org/10.1007/978-3-031-44201-8_2

2023-01-01

Abstract:Few-shot fine-grained classification aims to recognize novel fine-grained categories with the help of a few examples. Under the impact of the low inter-class and high intra-class differences properties of fine-grained datasets, the prototype-based approach, which originally performed well in general FS classification, could not achieve the expected results. In this paper, we propose a transductive method consisting of a feature mapping module and a prototype rectification module. Specifically, the feature mapping module removes redundant attributes from the feature space to enhance the inter-class difference. The prototype rectification module assigns a pseudo-label for each query sample according to the membership-grade between the query samples and the prototypes and uses them to update the prototypes. Experiments on multiple popular fine-grained benchmark datasets and few-shot general classification datasets demonstrate the effectiveness of our approach.
Prototype Rectification with Region-Wise Foreground Enhancement for Few-Shot Classification.

Rundong Qi,Sa Ning,Yong Jiang

DOI: https://doi.org/10.1007/978-981-99-8462-6_2

2024-01-01

Abstract:Few-Shot Classification is a challenging problem as it uses only very few labeled examples to assign labels for query samples. The Prototypical Network effectively addresses the issue by matching the nearest mean-based prototype for each query sample. However, the scarce labeled examples limit the ability of a model to represent the data distribution, which in turn biases the computed prototypes. In this paper, we propose a transductive bias diminishing method based on spatial similarity, which consists of a region-wise foreground enhancement (RFE) module and a prototype rectification (PR) module. RFE reconstructs the query sample’s features to emphasize the discriminative parts while preserving local region consistency. PR uses the difference in prediction scores between the nearest and second nearest prototypes of the enhanced query samples to rectify the prototypes by label propagation. We validate the effectiveness of our method with extensive experiments on four Few-Shot Classification datasets: miniImageNet, tieredImageNet, Stanford Dogs, and CUB. Our method achieves competitive performance across different settings and datasets.
Transductive Few-shot Learning with Prototype-based Label Propagation by Iterative Graph Refinement

Hao Zhu,Piotr Koniusz

2023-04-23

Abstract:Few-shot learning (FSL) is popular due to its ability to adapt to novel classes. Compared with inductive few-shot learning, transductive models typically perform better as they leverage all samples of the query set. The two existing classes of methods, prototype-based and graph-based, have the disadvantages of inaccurate prototype estimation and sub-optimal graph construction with kernel functions, respectively. In this paper, we propose a novel prototype-based label propagation to solve these issues. Specifically, our graph construction is based on the relation between prototypes and samples rather than between samples. As prototypes are being updated, the graph changes. We also estimate the label of each prototype instead of considering a prototype be the class centre. On mini-ImageNet, tiered-ImageNet, CIFAR-FS and CUB datasets, we show the proposed method outperforms other state-of-the-art methods in transductive FSL and semi-supervised FSL when some unlabeled data accompanies the novel few-shot task.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
Few-Shot Learning with Improved Local Representations Via Bias Rectify Module

Chao Dong,Qi Ye,Wenchao Meng,Kaixiang Yang

DOI: https://doi.org/10.1109/icassp43922.2022.9746156

2022-01-01

Abstract:Recent approaches based on metric learning have achieved great progress in few-shot learning. However, most of them are limited to image-level representation manners, which fail to properly deal with the intra-class variations and spatial knowledge and thus produce undesirable performance. In this paper, we propose a Deep Bias Rectify Network (DBRN) to fully exploit the spatial information that exists in the structure of the feature representations. We first employ a bias rectify module, which is able to focus on the features that are more discriminative for classification by giving different weights, to alleviate the adverse impact caused by the intra-class variations. To make full use of the training data, we design a prototype augment mechanism that can make the prototypes generated from the support set to be more representative. To validate the effectiveness of our method, we conducted extensive experiments on various popular few-shot classification benchmarks and our methods can outperform state-of-the-art methods.
Few-shot Action Recognition with Prototype-centered Attentive Learning

Xiatian Zhu,Antoine Toisoul,Juan-Manuel Perez-Rua,Li Zhang,Brais Martinez,Tao Xiang

DOI: https://doi.org/10.48550/arxiv.2101.08085

2021-01-01

Abstract:Few-shot action recognition aims to recognize action classes with few training samples. Most existing methods adopt a meta-learning approach with episodic training. In each episode, the few samples in a meta-training task are split into support and query sets. The former is used to build a classifier, which is then evaluated on the latter using a query-centered loss for model updating. There are however two major limitations: lack of data efficiency due to the query-centered only loss design and inability to deal with the support set outlying samples and inter-class distribution overlapping problems. In this paper, we overcome both limitations by proposing a new Prototype-centered Attentive Learning (PAL) model composed of two novel components. First, a prototype-centered contrastive learning loss is introduced to complement the conventional query-centered learning objective, in order to make full use of the limited training samples in each episode. Second, PAL further integrates a hybrid attentive learning mechanism that can minimize the negative impacts of outliers and promote class separation. Extensive experiments on four standard few-shot action benchmarks show that our method clearly outperforms previous state-of-the-art methods, with the improvement particularly significant (10+\%) on the most challenging fine-grained action recognition benchmark.

Parameters and sites of brainstem stimulation capable of eliciting the rabbit nictitating membrane response

Learning Class-level Prototypes for Few-shot Learning

Feature Transformation for Few-Shot Learning

Distributed Few-Shot Learning with Prototype Distribution Correction

Few-Shot Learning With Global Class Representations

Prototype Completion for Few-Shot Learning

Representative local feature mining for few-shot learning

Self-Promoted Prototype Refinement for Few-Shot Class-Incremental Learning

Attentive Prototype Few-Shot Learning with Capsule Network-Based Embedding

Adaptive Parametric Prototype Learning for Cross-Domain Few-Shot Classification

Local descriptor-based multi-prototype network for few-shot Learning

PrototypeFormer: Learning to Explore Prototype Relationships for Few-shot Image Classification

Reweighting and Information-Guidance Networks for Few-Shot Learning

Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning

Bimodal semantic fusion prototypical network for few-shot classification

Improved prototypical network for active few-shot learning

Membership-Grade Based Prototype Rectification for Fine-Grained Few-Shot Classification

Prototype Rectification with Region-Wise Foreground Enhancement for Few-Shot Classification.

Transductive Few-shot Learning with Prototype-based Label Propagation by Iterative Graph Refinement

Few-Shot Learning with Improved Local Representations Via Bias Rectify Module

Few-shot Action Recognition with Prototype-centered Attentive Learning