Abstract:Few-shot fault diagnosis is a challenging problem for complex engineering systems due to the shortage of enough annotated failure samples. This problem is increased by varying working conditions that are commonly encountered in real-world systems. Meta-learning is a promising strategy to solve this point, open issues remain unresolved in practical applications, such as domain adaptation, domain generalization, etc. This article attempts to improve domain adaptation and generalization by focusing on the distribution-shift robustness of meta-learning from the task generation perspective. In fact, few-shot fault diagnosis under varying working conditions allows to address the distribution shift problem in a natural way. An unsupervised across-tasks meta-learning strategy with distributional similarity preference is proposed, where the core is the distribution-distance-weighting mechanism. Differently from the naive random meta-train task generation strategy used in existing meta-learning methods, the source instances that present a more similar distribution with respect to the target instances gain larger weightings in the task generation. This strategy leads to a meta-task training set that is enough diverse, and at the same time can be easily learned due to the distribution similarity features of the source tasks. The proposed method introduces the concept of maximum mean discrepancy that is applied to derive the distribution distance of the measurements. Moreover, a model-agnostic meta-learning is applied to realize few-shot fault diagnosis under varying working conditions. The proposed solutions are verified and compared by considering two public datasets used for bearing fault diagnosis. The results show that the proposed strategy outperforms different related few-shot fault diagnosis methods under varying working conditions. Moreover, it is thus proved that, meta-learning with distribution similarity feature represents an effective approach for domain adaptation and generalization.

Meta-learning of feature distribution alignment for enhanced feature sharing

MCKD: Mutually Collaborative Knowledge Distillation for Federated Domain Adaptation and Generalization

A Task-Aware Attention-Based Method for Improved Meta-Learning.

Hierarchical Knowledge Amalgamation with Dual Discriminative Feature Alignment

Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification.

Task-Distributionally Robust Data-Free Meta-Learning.

Improve Meta-learning for Few-Shot Text Classification with All You Can Acquire from the Tasks

Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning

A Joint Optimization Framework of the Embedding Model and Classifier for Meta-Learning

Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains

Enhancement of Knowledge Distillation via Non-Linear Feature Alignment

The meta-learning method for the ensemble model based on situational meta-task

Learning transferable features in meta-learning for few-shot text classification

Meta-Learning With Distributional Similarity Preference for Few-Shot Fault Diagnosis Under Varying Working Conditions

MetaDistiller: Network Self-Boosting Via Meta-Learned Top-Down Distillation

A Meta Understanding of Meta-Learning

Revisiting Meta-Learning As Supervised Learning

Towards Well-Generalizing Meta-Learning Via Adversarial Task Augmentation

Model-Agnostic Learning to Meta-Learn

Dual-Branch Meta-Learning Network With Distribution Alignment for Face Anti-Spoofing

Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning