Abstract:Humans can solve image classification tasks by learning from a few images and reusing prior-knowledge. In Artificial Intelligence, deep-learning models have been implemented to simulate human learning and face problems with little data available, few-shot learning. Nevertheless, one crucial problem of deep-learning is the selection of architectures and initial parameters that accomplish the requirements for a specific task. Therefore, we propose a novel methodology based on the meta-learning paradigm, which reuses prior- and meta-knowledge to select the best architecture and its initial parameters to solve different few-shot image classification tasks, as humans do. Our methodology was designed to understand the knowledge flow of the meta-learning paradigm by dividing the learning into prior-models, meta-models, meta-unsupervised algorithm, and base-models. We considered 9 architectures of deep convolutional neural networks as prior-models. Also, we propose a meta-unsupervised algorithm inspired by the human-cognitive problem-solving process, which acquires knowledge by solving tasks to recommend initial parameters to solve other new tasks. Furthermore, we propose a New Task Distribution Scheme to better evaluate few-shot learning models and analyze the difficulty of the new tasks. We evaluated our meta-learning methodology by applying the NTDS to the Mini-ImageNet and Caltech-UCSD-Birds-200-2011 (CUB) datasets. The achieved Adjusted Mutual Information average scores are 0.955 (zero-shot) and 0.957 (five-shot) for Mini-ImageNet, and 0.822 (zero-shot) and 0.848 (five-shot) for CUB. Moreover, we demonstrated the applicability of our meta-learning methodology in a real-world scenario using a new copro-parasite dataset. The performances of our meta-learning methodology are competitive regarding the state-of-the-art unsupervised few-shot learning models.

Few-Shot Text Ranking with Meta Adapted Synthetic Weak Supervision

Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification.

Investigating Weak Supervision in Deep Ranking.

When Low Resource NLP Meets Unsupervised Language Model: Meta-Pretraining then Meta-Learning for Few-Shot Text Classification (Student Abstract)

DUQGen: Effective Unsupervised Domain Adaptation of Neural Rankers by Diversifying Synthetic Query Generation

RankDNN: Learning to Rank for Few-shot Learning

Meta Adaptive Neural Ranking with Contrastive Synthetic Supervision

Meta Learning to Rank for Sparsely Supervised Queries

MetaAdapt: Domain Adaptive Few-Shot Misinformation Detection via Meta Learning

Unsupervised Domain Adaption for Neural Information Retrieval

Few-shot Prompting for Pairwise Ranking: An Effective Non-Parametric Retrieval Model

Generalized Weak Supervision for Neural Information Retrieval

Training Deep Ranking Model with Weak Relevance Labels

UDAPDR: Unsupervised Domain Adaptation via LLM Prompting and Distillation of Rerankers

Dense Re-Ranking with Weak Supervision for RDF Dataset Search

Meta-learning methodology based on meta-unsupervised algorithm for meta-model selection to solve few-shot base-tasks

Improve Meta-learning for Few-Shot Text Classification with All You Can Acquire from the Tasks

Understanding and Improving Neural Ranking Models from a Term Dependence View.

InRanker: Distilled Rankers for Zero-shot Information Retrieval

Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning

Meta Navigator: Search for a Good Adaptation Policy for Few-shot Learning