Hematorheological disturbance in traumatic shock.

L. Gelin

Acta Chirurgica Belgica

Abstract:

What problem does this paper attempt to address?

ICSFF: Information Constraint on Self-Supervised Feature Fusion for Few-Shot Remote Sensing Image Classification

Chen Yang,Tongtong Liu,Guanhua Chen,Wenhui Li

DOI: https://doi.org/10.1109/tgrs.2024.3360237

IF: 8.2

2024-02-14

IEEE Transactions on Geoscience and Remote Sensing

Abstract:The self-supervised few-shot remote sensing image classification task is to achieve efficient and accurate remote sensing image classification through autonomous learning and feature exploitation with limited data labels. However, at this stage, one common challenge in self-supervised learning is the significant disparity between the self-supervised learning task and the main classification task. This disparity can lead to a situation where the model overly emphasizes features or local information emphasized by the self-supervised task while neglecting the essential global semantic information relevant to the main classification task. To solve these problems, this article proposes a few-shot remote sensing image classification framework based on information constraint on self-supervised feature fusion (ICSFF). First, we train a supervised model to capture important semantic information. Then, we leverage this supervised information to constrain the learning process of the self-supervised model. We utilize an attention mechanism to integrate supervised information and self-supervised information through a graph structural feature fusion approach, resulting in enhanced feature representations. In addition, we design a new feature extractor called GCCANet. It helps the model to better utilize the key features by incorporating the global attention module, the group convolution, the residual operation, and the channel shuffle module techniques. We conduct comparative experiments on three public remote sensing datasets, and the experimental results show that ICSFF achieves outstanding performance in the remote sensing image classification task.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
PatchMix Augmentation to Identify Causal Features in Few-shot Learning

Chengming Xu,Chen Liu,Xinwei Sun,Siqian Yang,Yabiao Wang,Chengjie Wang,Yanwei Fu

DOI: https://doi.org/10.1109/tpami.2022.3223784

IF: 23.6

2022-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:The task of Few-shot learning (FSL) aims to transfer the knowledge learned from base categories with sufficient labelled data to novel categories with scarce known information. It is currently an important research question and has great practical values in the real-world applications. Despite extensive previous efforts are made on few-shot learning tasks, we emphasize that most existing methods did not take into account the distributional shift caused by sample selection bias in the FSL scenario. Such a selection bias can induce spurious correlation between the semantic causal features, that are causally and semantically related to the class label, and the other non-causal features. Critically, the former ones should be invariant across changes in distributions, highly related to the classes of interest, and thus well generalizable to novel classes, while the latter ones are not stable to changes in the distribution. To resolve this problem, we propose a novel data augmentation strategy dubbed as PatchMix that can break this spurious dependency by replacing the patch-level information and supervision of the query images with random gallery images from different classes from the query ones. We theoretically show that such an augmentation mechanism, different from existing ones, is able to identify the causal features. To further make these features to be discriminative enough for classification, we propose Correlation-guided Reconstruction (CGR) and Hardness-Aware module for instance discrimination and easier discrimination between similar classes. Moreover, such a framework can be adapted to the unsupervised FSL scenario. The utility of our method is demonstrated on the state-of-the-art results consistently achieved on several benchmarks including mini ImageNet, tiered ImageNet, CIFAR-FS, CUB, Cars, Places and Plantae, in all settings of single-domain, cross-domain and unsupervised FSL. By studying the intra-variance property of learned features and visualizing the learned features, we further quantitatively and qualitatively show that such a promising result is due to the effectiveness in learning causal features.
Hybrid Feature Collaborative Reconstruction Network for Few-Shot Fine-Grained Image Classification

Shulei Qiu,Wanqi Yang,Ming Yang

2024-07-02

Abstract:Our research focuses on few-shot fine-grained image classification, which faces two major challenges: appearance similarity of fine-grained objects and limited number of samples. To preserve the appearance details of images, traditional feature reconstruction networks usually enhance the representation ability of key features by spatial feature reconstruction and minimizing the reconstruction error. However, we find that relying solely on a single type of feature is insufficient for accurately capturing inter-class differences of fine-grained objects in scenarios with limited samples. In contrast, the introduction of channel features provides additional information dimensions, aiding in better understanding and distinguishing the inter-class differences of fine-grained objects. Therefore, in this paper, we design a new Hybrid Feature Collaborative Reconstruction Network (HFCR-Net) for few-shot fine-grained image classification, which includes a Hybrid Feature Fusion Process (HFFP) and a Hybrid Feature Reconstruction Process (HFRP). In HFRP, we fuse the channel features and the spatial features. Through dynamic weight adjustment, we aggregate the spatial dependencies between arbitrary two positions and the correlations between different channels of each image to increase the inter-class differences. Additionally, we introduce the reconstruction of channel dimension in HFRP. Through the collaborative reconstruction of channel dimension and spatial dimension, the inter-class differences are further increased in the process of support-to-query reconstruction, while the intra-class differences are reduced in the process of query-to-support reconstruction. Ultimately, our extensive experiments on three widely used fine-grained datasets demonstrate the effectiveness and superiority of our approach.

Computer Vision and Pattern Recognition
Few-Shot Fine-Grained Image Classification via Multi-Frequency Neighborhood and Double-Cross Modulation

Hegui Zhu,Zhan Gao,Jiayi Wang,Yange Zhou,Chengqing Li

DOI: https://doi.org/10.1109/tmm.2024.3405713

IF: 7.3

2024-10-19

IEEE Transactions on Multimedia

Abstract:Traditional fine-grained image classification typically relies on large-scale training samples with annotated ground truth. However, some fine-grained categories in the real world have few available images, and the existing few-shot models have difficulty in distinguishing the subtle differences among them. Moreover, the intra-class distances between some fine-grained categories may be very large, but the inter-class ones are small, which makes the distinguishing features of each category are different for distinct tasks. To solve the challenges, we propose a novel network (FicNet) using multi-frequency neighborhood (MFN) and double-cross modulation (DCM). MFN captures the multi-frequency structure representation that is irrelevant to the background by integrating the spatial and frequency domain information, and then reduces the intra-class distance. DCM modulates the representation by global context and inter-class relationships, which enables both support and query features to have complete targets and respond to the same parts, and then accurately identify subtle inter-class differences. Comprehensive experiments on three fine-grained benchmark datasets for two few-shot tasks verify that FicNet has excellent performance compared to the state-of-the-art methods. Notably, it can obtain classification accuracy 93.17% and 95.36% on datasets "Caltech-UCSD Birds" and "Stanford Cars", respectively, surpassing the benchmarks set by general fine-grained image classification methods.

computer science, information systems,telecommunications, software engineering
Adaptive Local Feature Matching for Few-shot Fine-grained Image Recognition

Litao Yu,Yike Wu,Jian Zhang

DOI: https://doi.org/10.1109/DICTA60407.2023.00076

2023-11-28

Abstract:Few-shot fine-grained image recognition aims to recognize fine categories with subtle differences, given only a few labeled examples. Existing methods try to mine the discriminative local regions to do fine-grained image recognition but still suffer from large variations of the same semantic object and noisy background disturbance. To this end, we propose an adaptive local feature matching network to do few-shot fine-grained image recognition, which matches local features between the support and query images adaptively according to their belonged semantics. Specifically, an Adaptive Thresholding Module (ATM) is proposed to automatically depress the irrelevant and noisy background regions for enlarging inter-class differences. Then a Local Feature Matching Module (LFM) is used for learning consistent local features of the same class. We conduct extensive experiments on three benchmark datasets, CUB-200-2011, Stanford Dogs, and Stanford Cars. The results illustrate the effectiveness and superiority of our proposed method.

Computer Science
IFSM: an Iterative Feature Selection Mechanism for Few-Shot Image Classification

Chunhao Cai,Minglei Yuan,Tong Lu

DOI: https://doi.org/10.1109/icpr48806.2021.9412864

2021-01-01

Abstract:Nowadays many deep learning algorithms have been employed to solve different types of problems in the area of computer vision; however, most of them require a great amount of training data and tend to struggle in few-shot learning tasks. On the other hand, those methods designed for few-shot learning usually face the difficulty that once one or more samples show a relatively large bias, the predicted result may be much less reliable due to the fact that the sample will cause a large shift of class-level features during few-shot learning. To solve this problem, this paper presents a novel and Iterative Feature Selection Mechanism (IFSM) for few-shot image classification, which can be applied to lots of metric-based few-shot learners. IFSM learns to construct a more feasible class-level feature which is less affected by samples with relatively large biases, using an iterative approach. The proposed mechanism is tested on three previous state-of-the-art few-shot learning methods, and the experimental results show that the proposed mechanism considerably improves (by 1% to 2%) the image classification accuracies of both methods on the miniImageNet, tieredImageNet or CUB benchmarks in 5-way 5-shot tasks. This approves the effectiveness and generality of the proposed mechanism.
Few-Shot Fine-Grained Image Classification: A Comprehensive Review

Jie Ren,Changmiao Li,Yaohui An,Weichuan Zhang,Changming Sun

DOI: https://doi.org/10.3390/ai5010020

2024-03-06

AI

Abstract:Few-shot fine-grained image classification (FSFGIC) methods refer to the classification of images (e.g., birds, flowers, and airplanes) belonging to different subclasses of the same species by a small number of labeled samples. Through feature representation learning, FSFGIC methods can make better use of limited sample information, learn more discriminative feature representations, greatly improve the classification accuracy and generalization ability, and thus achieve better results in FSFGIC tasks. In this paper, starting from the definition of FSFGIC, a taxonomy of feature representation learning for FSFGIC is proposed. According to this taxonomy, we discuss key issues on FSFGIC (including data augmentation, local and/or global deep feature representation learning, class representation learning, and task-specific feature representation learning). In addition, the existing popular datasets, current challenges and future development trends of feature representation learning on FSFGIC are also described.
Feature fusion network based on few-shot fine-grained classification

Yajie Yang,Yuxuan Feng,Li Zhu,Haitao Fu,Xin Pan,Chenlei Jin

DOI: https://doi.org/10.3389/fnbot.2023.1301192

IF: 3.493

2023-11-09

Frontiers in Neurorobotics

Abstract:The objective of few-shot fine-grained learning is to identify subclasses within a primary class using a limited number of labeled samples. However, many current methodologies rely on the metric of singular feature, which is either global or local. In fine-grained image classification tasks, where the inter-class distance is small and the intra-class distance is big, relying on a singular similarity measurement can lead to the omission of either inter-class or intra-class information. We delve into inter-class information through global measures and tap into intra-class information via local measures. In this study, we introduce the Feature Fusion Similarity Network (FFSNet). This model employs global measures to accentuate the differences between classes, while utilizing local measures to consolidate intra-class data. Such an approach enables the model to learn features characterized by enlarge inter-class distances and reduce intra-class distances, even with a limited dataset of fine-grained images. Consequently, this greatly enhances the model's generalization capabilities. Our experimental results demonstrated that the proposed paradigm stands its ground against state-of-the-art models across multiple established fine-grained image benchmark datasets.

robotics,computer science, artificial intelligence,neurosciences
Multi-Level Correlation Network For Few-Shot Image Classification

Yunkai Dang,Min Zhang,Zhengyu Chen,Xinliang Zhang,Zheng Wang,Meijun Sun,Donglin Wang

DOI: https://doi.org/10.1109/ICME55011.2023.00494

2024-12-04

Abstract:Few-shot image classification(FSIC) aims to recognize novel classes given few labeled images from base classes. Recent works have achieved promising classification performance, especially for metric-learning methods, where a measure at only image feature level is usually used. In this paper, we argue that measure at such a level may not be effective enough to generalize from base to novel classes when using only a few images. Instead, a multi-level descriptor of an image is taken for consideration in this paper. We propose a multi-level correlation network (MLCN) for FSIC to tackle this problem by effectively capturing local information. Concretely, we present the self-correlation module and cross-correlation module to learn the semantic correspondence relation of local information based on learned representations. Moreover, we propose a pattern-correlation module to capture the pattern of fine-grained images and find relevant structural patterns between base classes and novel classes. Extensive experiments and analysis show the effectiveness of our proposed method on four widely-used FSIC benchmarks. The code for our approach is available at: <a class="link-external link-https" href="https://github.com/Yunkai696/MLCN" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Computation and Language
Local Descriptors Weighted Adaptive Threshold Filtering For Few-Shot Learning

Bingchen Yan

2024-08-29

Abstract:Few-shot image classification is a challenging task in the field of machine learning, involving the identification of new categories using a limited number of labeled samples. In recent years, methods based on local descriptors have made significant progress in this area. However, the key to improving classification accuracy lies in effectively filtering background noise and accurately selecting critical local descriptors highly relevant to image category information. To address this challenge, we propose an innovative weighted adaptive threshold filtering (WATF) strategy for local descriptors. This strategy can dynamically adjust based on the current task and image context, thereby selecting local descriptors most relevant to the image category. This enables the model to better focus on category-related information while effectively mitigating interference from irrelevant background regions. To evaluate the effectiveness of our method, we adopted the N-way K-shot experimental framework. Experimental results show that our method not only improves the clustering effect of selected local descriptors but also significantly enhances the discriminative ability between image categories. Notably, our method maintains a simple and lightweight design philosophy without introducing additional learnable parameters. This feature ensures consistency in filtering capability during both training and testing phases, further enhancing the reliability and practicality of the method.

Computer Vision and Pattern Recognition,Artificial Intelligence
Feature Aligning Few shot Learning Method Using Local Descriptors Weighted Rules

Bingchen Yan

2024-08-26

Abstract:Few-shot classification involves identifying new categories using a limited number of labeled samples. Current few-shot classification methods based on local descriptors primarily leverage underlying consistent features across visible and invisible classes, facing challenges including redundant neighboring information, noisy representations, and limited interpretability. This paper proposes a Feature Aligning Few-shot Learning Method Using Local Descriptors Weighted Rules (FAFD-LDWR). It innovatively introduces a cross-normalization method into few-shot image classification to preserve the discriminative information of local descriptors as much as possible; and enhances classification performance by aligning key local descriptors of support and query sets to remove background noise. FAFD-LDWR performs excellently on three benchmark datasets , outperforming state-of-the-art methods in both 1-shot and 5-shot settings. The designed visualization experiments also demonstrate FAFD-LDWR's improvement in prediction interpretability.

Computer Vision and Pattern Recognition
Category Relevance Redirection Network for Few-Shot Classification

Xiangtao Tian,Zhengli Zhao,Peng Jiang,Jianxin Wu,Guoqiang Zhong

DOI: https://doi.org/10.1109/ACCESS.2022.3199003

IF: 3.9

2022-01-01

IEEE Access

Abstract:The metric learning method has been successfully developed in few-shot learning by learning the deeply embedded metric space. However, many methods ignore the relationship between the support set and the query set. In this paper, we propose the category relevance redirection network (CRRNet), which is a novel metric learning-based few-shot learning classification network. The learning of CRRNet includes two stages. In the category relevance pre-training stage, the convolutional block attention module (CBAM) and the classifier are jointly trained using the center loss and cross entropy loss. In the category redirection training stage, the meta fusion block and the weight generator are used to represent the weighted query set features, which are then input into the spatial attention generator to obtain the discriminative features for classification. CRRNet can not only learn the relevant category characteristics of the support set samples, but emphasizes the relevant category characteristics of the current task's query samples. Experiments on three datasets show that CRRNet can greatly improve the embedding learning performance and classification accuracy of metric-based few-shot classification. For the 5-way 1-shot and 5-way 5-shot scenarios, CRRNet may produce 9.68 percent and 12.42 percent increases over the traditional methods on the miniImageNet dataset, respectively.
Few-Shot Fine-Grained Classification With Rotation-Invariant Feature Map Complementary Reconstruction Network

Yangfan Li,Liang Chen,Wei Li,Nan Wang

DOI: https://doi.org/10.1109/tgrs.2024.3361501

IF: 8.2

2024-02-16

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Fine-grained classification is of significant importance in the field of remote sensing. However, obtaining valuable and rare target images is often a challenging task, giving rise to the few-shot fine-grained classification problem. In response to this challenge, various meta-learning approaches have been introduced, with the feature map reconstruction network (FRN) emerging as a prominent method. Targets in remote-sensing images exhibit arbitrary orientation, substantial interclass similarity, and intraclass diversity. Nevertheless, the conventional FRN exhibits subpar performance due to its inability to handle rotational variations. Moreover, it only reconstructs features from a single-channel dimension of support features, neglecting the interplay between different dimensions and resulting in inaccurate reconstruction errors. To overcome the challenges of imprecise rotational variation features for reconstruction and inaccurate reconstruction errors, we propose a rotation-invariant feature map complementary reconstruction network (RIFCRN). The RIFCRN involves several key innovations. First, we introduce a novel rotation-invariant module (RIM) based on active rotating filters (ARFs) and oriented response pooling, enabling the extraction of rotation-invariant features for reconstruction. This modification enhances the suitability of the FRN for the few-shot fine-grained classification problem. Second, we put forward a novel feature map complementary reconstruction (CPR) method that calculates the CPR errors (CREs) which effectively captures relationships among different feature map dimensions and results in more accurate reconstruction errors. Finally, extensive experiments have been conducted to validate the effectiveness of the proposed RIFCRN in addressing the few-shot fine-grained classification problem. The code will be available at https://github.com/liyangfan0/RIFCRN.

imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
Disentangled Feature Representation for Few-shot Image Classification

Hao Cheng,Yufei Wang,Haoliang Li,Alex C. Kot,Bihan Wen

DOI: https://doi.org/10.48550/arXiv.2109.12548

2021-09-26

Abstract:Learning the generalizable feature representation is critical for few-shot image classification. While recent works exploited task-specific feature embedding using meta-tasks for few-shot learning, they are limited in many challenging tasks as being distracted by the excursive features such as the background, domain and style of the image samples. In this work, we propose a novel Disentangled Feature Representation framework, dubbed DFR, for few-shot learning applications. DFR can adaptively decouple the discriminative features that are modeled by the classification branch, from the class-irrelevant component of the variation branch. In general, most of the popular deep few-shot learning methods can be plugged in as the classification branch, thus DFR can boost their performance on various few-shot tasks. Furthermore, we propose a novel FS-DomainNet dataset based on DomainNet, for benchmarking the few-shot domain generalization tasks. We conducted extensive experiments to evaluate the proposed DFR on general and fine-grained few-shot classification, as well as few-shot domain generalization, using the corresponding four benchmarks, i.e., mini-ImageNet, tiered-ImageNet, CUB, as well as the proposed FS-DomainNet. Thanks to the effective feature disentangling, the DFR-based few-shot classifiers achieved the state-of-the-art results on all datasets.

Computer Vision and Pattern Recognition
Multi-local feature relation network for few-shot learning

Li Ren,Guiduo Duan,Tianxi Huang,Zhao Kang

DOI: https://doi.org/10.1007/s00521-021-06840-8

2022-01-03

Neural Computing and Applications

Abstract:Recently, few-shot learning has received considerable attention from researchers. Compared to deep learning, which requires abundant data for training, few-shot learning only requires a few labeled samples. Therefore, few-shot learning has been extensively used in scenarios in which a large number of samples cannot be obtained. However, effectively extracting features from a limited number of samples are the most important problem in few-shot learning. To solve this limitation, a multi-local feature relation network (MLFRNet) is proposed to improve the accuracy of few-shot image classification. First, we obtain the local sub-images of each image by random cropping, which is used to obtain local features. Second, we propose support-query local feature attention by exploring local feature relationships between the support and query sets. Using the local feature attention, the importance of local features of each class prototype can be calculated to classify query data. Moreover, we explore local feature relationship between the support set and the support set, and we propose support-support local feature similarity. Using local feature similarity, we can adaptively determine the margin loss of the local features, which then improves the network accuracy. Experiments on two benchmark datasets show that the proposed MLFRNet achieves state-of-the-art performance. In particular, for the miniImageNet dataset, the proposed method achieves 66.79% (1-shot) and 83.16% (5-shot) accuracy.

computer science, artificial intelligence
Few-shot Learning for Domain-specific Fine-grained Image Classification

Xin Sun,Hongwei Xv,Junyu Dong,Qiong Li,Changrui Chen

DOI: https://doi.org/10.48550/arXiv.1907.09647

2020-06-01

Abstract:Learning to recognize novel visual categories from a few examples is a challenging task for machines in real-world industrial applications. In contrast, humans have the ability to discriminate even similar objects with little supervision. This paper attempts to address the few shot fine-grained image classification problem. We propose a feature fusion model to explore discriminative features by focusing on key regions. The model utilizes the focus area location mechanism to discover the perceptually similar regions among objects. High-order integration is employed to capture the interaction information among intra-parts. We also design a Center Neighbor Loss to form robust embedding space distributions. Furthermore, we build a typical fine-grained and few-shot learning dataset miniPPlankton from the real-world application in the area of marine ecological environments. Extensive experiments are carried out to validate the performance of our method. The results demonstrate that our model achieves competitive performance compared with state-of-the-art models. Our work is a valuable complement to the model domain-specific industrial applications.

Computer Vision and Pattern Recognition
Fine-Grained Few-Shot Image Classification Based on Feature Dual Reconstruction

Shudong Liu,Wenlong Zhong,Furong Guo,Jia Cong,Boyu Gu

DOI: https://doi.org/10.3390/electronics13142751

IF: 2.9

2024-07-14

Electronics

Abstract:Fine-grained few-shot image classification is a popular research area in deep learning. The main goal is to identify subcategories within a broader category using a limited number of samples. The challenge stems from the high intra-class variability and low inter-class variability of fine-grained images, which often hamper classification performance. To overcome this, we propose a fine-grained few-shot image classification algorithm based on bidirectional feature reconstruction. This algorithm introduces a Mixed Residual Attention Block (MRA Block), combining channel attention and window-based self-attention to capture local details in images. Additionally, the Dual Reconstruction Feature Fusion (DRFF) module is designed to enhance the model's adaptability to both inter-class and intra-class variations by integrating features of different scales across layers. Cosine similarity networks are employed for similarity measurement, enabling precise predictions. The experiments demonstrate that the proposed method achieves classification accuracies of 96.99%, 98.53%, and 89.78% on the CUB-200-2011, Stanford Cars, and Stanford Dogs datasets, respectively, confirming the method's efficacy in fine-grained classification tasks.

engineering, electrical & electronic,physics, applied,computer science, information systems
Balancing Feature Alignment and Uniformity for Few-Shot Classification.

Yunlong Yu,Dingyi Zhang,Zhong Ji,Xi Li,Jungong Han,Zhongfei Zhang

DOI: https://doi.org/10.1109/tip.2023.3328475

IF: 10.6

2023-01-01

IEEE Transactions on Image Processing

Abstract:In Few-Shot Learning (FSL), the objective is to correctly recognize new samples from novel classes with only a few available samples per class. Existing methods in FSL primarily focus on learning transferable knowledge from base classes by maximizing the information between feature representations and their corresponding labels. However, this approach may suffer from the "supervision collapse" issue, which arises due to a bias towards the base classes. In this paper, we propose a solution to address this issue by preserving the intrinsic structure of the data and enabling the learning of a generalized model for the novel classes. Following the InfoMax principle, our approach maximizes two types of mutual information (MI): between the samples and their feature representations, and between the feature representations and their class labels. This allows us to strike a balance between discrimination (capturing class-specific information) and generalization (capturing common characteristics across different classes) in the feature representations. To achieve this, we adopt a unified framework that perturbs the feature embedding space using two low-bias estimators. The first estimator maximizes the MI between a pair of intra-class samples, while the second estimator maximizes the MI between a sample and its augmented views. This framework effectively combines knowledge distillation between class-wise pairs and enlarges the diversity in feature representations. By conducting extensive experiments on popular FSL benchmarks, our proposed approach achieves comparable performances with state-of-the-art competitors. For example, we achieved an accuracy of 69.53% on the miniImageNet dataset and 77.06% on the CIFAR-FS dataset for the 5-way 1-shot task.
Learning to focus: cascaded feature matching network for few-shot image recognition

Mengting Chen,Xinggang Wang,Heng Luo,Yifeng Geng,Wenyu Liu

DOI: https://doi.org/10.1007/s11432-020-2973-7

2021-07-30

Science China Information Sciences

Abstract:Generally, deep networks learn to recognize a category of objects by training on a large number of annotated images accurately. However, a meta-learning problem known as a low-shot image recognition task occurs when a few images with annotations are available for learning a recognition model for a single category. Consequently, the objects in testing/query and training/support image datasets are likely to vary in terms of size, location, style, and so on. In this paper, we propose a method, cascaded feature matching network (CFMN), to solve this problem. We train the meta-learner to learn a more fine-grained and adaptive deep distance metric using feature matching block, which aligns associated features together and naturally ignores non-discriminative features. By applying the proposed feature matching block in different layers of the network, multi-scale information among the compared images is incorporated into the final cascaded matching feature, which boosts the recognition performance and generalizes better by learning on relationships. Moreover, the experiments for few-shot learning (FSL) using two standard datasets: miniImageNet and Omniglot, confirm the effectiveness of our proposed method. Besides, the multi-label few-shot task is first studied on a new data split of the COCO dataset, which further shows the superiority of the proposed feature matching network when performing the FSL in complex images.

computer science, information systems,engineering, electrical & electronic
Revisiting Local Descriptor Based Image-To-Class Measure for Few-Shot Learning

Wenbin Li,Lei Wang,Jingming Xu,Jing Huo,Yang Gao,Jiebo Luo

DOI: https://doi.org/10.1109/cvpr.2019.00743

2019-01-01

Abstract:Few-shot learning in image classification aims to learn a classifier to classify images when only few training examples are available for each class. Recent work has achieved promising classification performance, where an image-level feature based measure is usually used. In this paper, we argue that a measure at such a level may not be effective enough in light of the scarcity of examples in few-shot learning. Instead, we think a local descriptor based image-to-class measure should be taken, inspired by its surprising success in the heydays of local invariant features. Specifically, building upon the recent episodic training mechanism, we propose a Deep Nearest Neighbor Neural Network (DN4 in short) and train it in an end-to-end manner. Its key difference from the literature is the replacement of the image-level feature based measure in the final layer by a local descriptor based image-to-class measure. This measure is conducted online via a k-nearest neighbor search over the deep local descriptors of convolutional feature maps. The proposed DN4 not only learns the optimal deep local descriptors for the image-to-class measure, but also utilizes the higher efficiency of such a measure in the case of example scarcity, thanks to the exchangeability of visual patterns across the images in the same class. Our work leads to a simple, effective, and computationally efficient framework for few-shot learning. Experimental study on benchmark datasets consistently shows its superiority over the related state-of-the-art, with the largest absolute improvement of 17% over the next best. The source code can be available from https://github.com/WenbinLee/DN4.git.

Hematorheological disturbance in traumatic shock.

ICSFF: Information Constraint on Self-Supervised Feature Fusion for Few-Shot Remote Sensing Image Classification

PatchMix Augmentation to Identify Causal Features in Few-shot Learning

Hybrid Feature Collaborative Reconstruction Network for Few-Shot Fine-Grained Image Classification

Few-Shot Fine-Grained Image Classification via Multi-Frequency Neighborhood and Double-Cross Modulation

Adaptive Local Feature Matching for Few-shot Fine-grained Image Recognition

IFSM: an Iterative Feature Selection Mechanism for Few-Shot Image Classification

Few-Shot Fine-Grained Image Classification: A Comprehensive Review

Feature fusion network based on few-shot fine-grained classification

Multi-Level Correlation Network For Few-Shot Image Classification

Local Descriptors Weighted Adaptive Threshold Filtering For Few-Shot Learning

Feature Aligning Few shot Learning Method Using Local Descriptors Weighted Rules

Category Relevance Redirection Network for Few-Shot Classification

Few-Shot Fine-Grained Classification With Rotation-Invariant Feature Map Complementary Reconstruction Network

Disentangled Feature Representation for Few-shot Image Classification

Multi-local feature relation network for few-shot learning

Few-shot Learning for Domain-specific Fine-grained Image Classification

Fine-Grained Few-Shot Image Classification Based on Feature Dual Reconstruction

Balancing Feature Alignment and Uniformity for Few-Shot Classification.

Learning to focus: cascaded feature matching network for few-shot image recognition

Revisiting Local Descriptor Based Image-To-Class Measure for Few-Shot Learning