Abstract:With the development of deep learning and sensors and sensor collection methods, computer vision inspection technology has developed rapidly. The deep-learning-based classification algorithm requires the acquisition of a model with superior generalization capabilities through the utilization of a substantial quantity of training samples. However, due to issues such as privacy, annotation costs, and sensor-captured images, how to make full use of limited samples has become a major challenge for practical training and deployment. Furthermore, when simulating models and transferring them to actual image scenarios, discrepancies often arise between the common training sets and the target domain (domain offset). Currently, meta-learning offers a promising solution for few-shot learning problems. However, the quantity of supporting set data on the target domain remains limited, leading to limited cross-domain learning effectiveness. To address this challenge, we have developed a self-distillation and mixing (SDM) method utilizing a Teacher–Student framework. This method effectively transfers knowledge from the source domain to the target domain by applying self-distillation techniques and mixed data augmentation, learning better image representations from relatively abundant datasets, and achieving fine-tuning in the target domain. In comparison with nine classical models, the experimental results demonstrate that the SDM method excels in terms of training time and accuracy. Furthermore, SDM effectively transfers knowledge from the source domain to the target domain, even with a limited number of target domain samples.

Perspectives of Calibrated Adaptation for Few-shot Cross-domain Classification

Adaptive Parametric Prototype Learning for Cross-Domain Few-Shot Classification

Multiscale Attention-Based Subdomain Dynamic Adaptation for Cross-Domain Scene Classification

Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification.

Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning

Cross-Domain Few-Shot Classification Via Adversarial Task Augmentation

Discriminative Sample-Guided and Parameter-Efficient Feature Space Adaptation for Cross-Domain Few-Shot Learning

Leveraging Normalization Layer in Adapters With Progressive Learning and Adaptive Distillation for Cross-Domain Few-Shot Learning

Target Oriented Dynamic Adaption for Cross-Domain Few-Shot Learning

Towards Fair Cross-Domain Adaptation via Generative Learning

Adaptive Cross-Modal Few-Shot Learning

Convert Cross-Domain Classification into Few-Shot Learning: A Unified Prompt-Tuning Framework for Unsupervised Domain Adaptation

Research on a Cross-Domain Few-Shot Adaptive Classification Algorithm Based on Knowledge Distillation Technology

Cross-Domain Few-Shot Learning via Adaptive Transformer Networks

Ranking Distance Calibration for Cross-Domain Few-Shot Learning

Variational Neuron Shifting for Few-Shot Image Classification Across Domains

Cross-domain Few-Shot Classification Through Feature Confusion

Adaptive Fine-Tuning Strategy for Few-Shot Learning

Cross-Domain Few-Shot Classification via Dense-Sparse-Dense Regularization

Learning Instance-Specific Adaptation for Cross-Domain Segmentation