Abstract:Intelligent fault diagnosis has made extraordinary advancements currently. Nonetheless, few works tackle class-incremental learning for fault diagnosis under limited fault data, i.e., imbalanced and long-tailed fault diagnosis, which brings about various notable challenges. Initially, it is difficult to extract discriminative features from limited fault data. Moreover, a well-trained model must be retrained from scratch to classify the samples from new classes, thus causing a high computational burden and time consumption. Furthermore, the model may suffer from catastrophic forgetting when trained incrementally. Finally, the model decision is biased toward the new classes due to the class imbalance. The problems can consequently lead to performance degradation of fault diagnosis models. Accordingly, we introduce a supervised contrastive knowledge distillation for incremental fault diagnosis under limited fault data (SCLIFD) framework to address these issues, which extends the classical incremental classifier and representation learning (iCaRL) framework from three perspectives. Primarily, we adopt supervised contrastive knowledge distillation (KD) to enhance its representation learning capability under limited fault data. Moreover, we propose a novel prioritized exemplar selection method adaptive herding (AdaHerding) to restrict the increase of the computational burden, which is also combined with KD to alleviate catastrophic forgetting. Additionally, we adopt the cosine classifier to mitigate the adverse impact of class imbalance. We conduct extensive experiments on simulated and real-world industrial processes under different imbalance ratios. Experimental results show that our SCLIFD outperforms the existing methods by a large margin.

Imbalanced Fault Diagnosis by Supervised Contrastive Learning

A class-aware supervised contrastive learning framework for imbalanced fault diagnosis

A Novel Imbalanced Data Classification Method Based on Weakly Supervised Learning for Fault Diagnosis

Self-supervised Knowledge Mining from Unlabeled Data for Bearing Fault Diagnosis under Limited Annotations

Imbalanced fault diagnosis based on semi-supervised ensemble learning

Open-Set Fault Diagnosis Via Supervised Contrastive Learning with Negative Out-of-Distribution Data Augmentation.

Imbalanced Sample Selection with Deep Reinforcement Learning for Fault Diagnosis

Robust Supervised Contrastive Learning for Fault Diagnosis Under Different Noises and Conditions

Progressively Balanced Supervised Contrastive Representation Learning for Long-Tailed Fault Diagnosis

An adaptive fault diagnosis framework under class-imbalanced conditions based on contrastive augmented deep reinforcement learning

A contrastive learning-based fault diagnosis method for rotating machinery with limited and imbalanced labels

SCLIFD: Supervised Contrastive Knowledge Distillation for Incremental Fault Diagnosis under Limited Fault Data

Debiased Contrastive Learning with Supervision Guidance for Industrial Fault Detection

SCLIFD:Supervised Contrastive Knowledge Distillation for Incremental Fault Diagnosis under Limited Fault Data

Domain Discrepancy-guided Contrastive Feature Learning for Few-shot Industrial Fault Diagnosis under Variable Working Conditions

A self-attention based contrastive learning method for bearing fault diagnosis

A novel unsupervised deep transfer learning method based on contrast pre-training for fault diagnosis

Matching contrastive learning: An effective and intelligent method for wind turbine fault diagnosis with imbalanced SCADA data

Self-degraded contrastive domain adaptation for industrial fault diagnosis with bi-imbalanced data

Domain Knowledge-Guided Contrastive Learning Framework Based on Complementary Views for Fault Diagnosis With Limited Labeled Data

Contrastive Feature-Based Learning-Guided Elevated Deep Reinforcement Learning: Developing an Imbalanced Fault Quantitative Diagnosis under Variable Working Conditions