Abstract:Intelligent fault diagnosis has made extraordinary advancements currently. Nonetheless, few works tackle class-incremental learning for fault diagnosis under limited fault data, i.e., imbalanced and long-tailed fault diagnosis, which brings about various notable challenges. Initially, it is difficult to extract discriminative features from limited fault data. Moreover, a well-trained model must be retrained from scratch to classify the samples from new classes, thus causing a high computational burden and time consumption. Furthermore, the model may suffer from catastrophic forgetting when trained incrementally. Finally, the model decision is biased toward the new classes due to the class imbalance. The problems can consequently lead to performance degradation of fault diagnosis models. Accordingly, we introduce a supervised contrastive knowledge distillation for incremental fault diagnosis under limited fault data (SCLIFD) framework to address these issues, which extends the classical incremental classifier and representation learning (iCaRL) framework from three perspectives. Primarily, we adopt supervised contrastive knowledge distillation (KD) to enhance its representation learning capability under limited fault data. Moreover, we propose a novel prioritized exemplar selection method adaptive herding (AdaHerding) to restrict the increase of the computational burden, which is also combined with KD to alleviate catastrophic forgetting. Additionally, we adopt the cosine classifier to mitigate the adverse impact of class imbalance. We conduct extensive experiments on simulated and real-world industrial processes under different imbalance ratios. Experimental results show that our SCLIFD outperforms the existing methods by a large margin.

Dilated dynamic supervised contrastive learning framework for fault diagnosis under imbalanced dataset conditions

An adaptive fault diagnosis framework under class-imbalanced conditions based on contrastive augmented deep reinforcement learning

A class-aware supervised contrastive learning framework for imbalanced fault diagnosis

Imbalanced Fault Diagnosis by Supervised Contrastive Learning

A Novel Imbalanced Data Classification Method Based on Weakly Supervised Learning for Fault Diagnosis

A contrastive learning-based fault diagnosis method for rotating machinery with limited and imbalanced labels

Machinery fault diagnosis using multi-scale feature focused network and adaptive cost-sensitive loss towards imbalanced dataset

Fault Diagnosis Method for Imbalanced Data Based on Multi-Signal Fusion and Improved Deep Convolution Generative Adversarial Network

SCLIFD: Supervised Contrastive Knowledge Distillation for Incremental Fault Diagnosis under Limited Fault Data

SCLIFD:Supervised Contrastive Knowledge Distillation for Incremental Fault Diagnosis under Limited Fault Data

Contrastive Feature-Based Learning-Guided Elevated Deep Reinforcement Learning: Developing an Imbalanced Fault Quantitative Diagnosis under Variable Working Conditions

Dual Contrastive Learning for Semi-Supervised Fault Diagnosis Under Extremely Low Label Rate

Imbalanced Fault Diagnosis Based on Supervised Prototypical Contrastive Network

Domain Discrepancy-guided Contrastive Feature Learning for Few-shot Industrial Fault Diagnosis under Variable Working Conditions

Dynamic Normalization Supervised Contrastive Network with Multiscale Compound Attention Mechanism for Gearbox Imbalanced Fault Diagnosis

Deep Transfer Learning Network for Fault Diagnosis Under Variable Working Conditions.

A novel imbalance fault diagnosis method based on data augmentation and hybrid deep learning models

Rolling bearing intelligent fault diagnosis towards variable speed and imbalanced samples using multiscale dynamic supervised contrast learning

Clustering-Based Contrastive Learning for Fault Diagnosis with Few Labeled Samples

Small-Sample-Oriented Multi-Condition Fault Diagnosis Framework Based on Classifier-Free Denoising Diffusion Implicit Model with Multi-Class Contrastive Learning

Lightweight Network with Variable Asymmetric Rebalancing Strategy for Small and Imbalanced Fault Diagnosis