Abstract:Intelligent fault diagnosis has made extraordinary advancements currently. Nonetheless, few works tackle class-incremental learning for fault diagnosis under limited fault data, i.e., imbalanced and long-tailed fault diagnosis, which brings about various notable challenges. Initially, it is difficult to extract discriminative features from limited fault data. Moreover, a well-trained model must be retrained from scratch to classify the samples from new classes, thus causing a high computational burden and time consumption. Furthermore, the model may suffer from catastrophic forgetting when trained incrementally. Finally, the model decision is biased toward the new classes due to the class imbalance. The problems can consequently lead to performance degradation of fault diagnosis models. Accordingly, we introduce a supervised contrastive knowledge distillation for incremental fault diagnosis under limited fault data (SCLIFD) framework to address these issues, which extends the classical incremental classifier and representation learning (iCaRL) framework from three perspectives. Primarily, we adopt supervised contrastive knowledge distillation (KD) to enhance its representation learning capability under limited fault data. Moreover, we propose a novel prioritized exemplar selection method adaptive herding (AdaHerding) to restrict the increase of the computational burden, which is also combined with KD to alleviate catastrophic forgetting. Additionally, we adopt the cosine classifier to mitigate the adverse impact of class imbalance. We conduct extensive experiments on simulated and real-world industrial processes under different imbalance ratios. Experimental results show that our SCLIFD outperforms the existing methods by a large margin.

Disconnector Fault Diagnosis Based on Multi-Granularity Contrast Learning

Information-guided signal multi-granularity contrastive feature learning for fault diagnosis with few labeled data

Domain Discrepancy-guided Contrastive Feature Learning for Few-shot Industrial Fault Diagnosis under Variable Working Conditions

Dual Contrastive Learning for Semi-Supervised Fault Diagnosis Under Extremely Low Label Rate

Fault Diagnosis and Location Approach of Modular Multilevel Converter Based on Dual One-Dimensional Convolutional Neural Network

Imbalanced Fault Diagnosis by Supervised Contrastive Learning

Debiased Contrastive Learning with Supervision Guidance for Industrial Fault Detection

Domain Generalized Open-Set Intelligent Fault Diagnosis Based on Feature Disentanglement Meta-Learning

SCLIFD:Supervised Contrastive Knowledge Distillation for Incremental Fault Diagnosis under Limited Fault Data

SCLIFD: Supervised Contrastive Knowledge Distillation for Incremental Fault Diagnosis under Limited Fault Data

An adaptive fault diagnosis framework under class-imbalanced conditions based on contrastive augmented deep reinforcement learning

A grid fault diagnosis framework based on adaptive integrated decomposition and cross-modal attention fusion

A Generalized Graph Contrastive Learning Framework for Few-Shot Machine Fault Diagnosis

One-stage self-supervised momentum contrastive learning network for open-set cross-domain fault diagnosis

A novel unsupervised deep transfer learning method based on contrast pre-training for fault diagnosis

Incipient fault detection enhancement based on spatial-temporal multi-mode siamese feature contrast learning for industrial dynamic process

A reliable feature-assisted contrastive generalization net for intelligent fault diagnosis under unseen machines and working conditions

A synchronization-induced cross-modal contrastive learning strategy for fault diagnosis of electromechanical systems under semi-supervised learning with current signal

A Multi-Channel Contrastive Learning Network Based Intrusion Detection Method

A multi-scale graph convolutional network with contrastive-learning enhanced self-attention pooling for intelligent fault diagnosis of gearbox

Internal Contrastive Learning for Generalized Out-of-distribution Fault Diagnosis (GOOFD) Framework