Abstract:In practical industrial applications, it is crucial to train a robust fault diagnosis (FD) model that can quickly adapt to new working conditions or fault modes using a few labeled fault samples. Therefore, a novel convolutional multi-head self-attention network-based meta-transfer learning approach (CMS-MTL) for few-shot fault diagnosis (FSFD) is proposed. Firstly, a convolutional multi-head self-attention network (CMHSAN) is designed, which ingeniously combines the multi-head self-attention (MHSA) blocks and convolution blocks. The local and global feature information of the input time-frequency images are fully considered through the mutual cooperation of MHSA and convolution, so as to fully extract the discriminative features among various fault classes. Secondly, a three-stage CMHSAN-based meta-transfer learning (MTL) scheme is proposed, which provides a good initialization state for the meta-training of the CMHSAN model through the pre-training stage, updates the pre-trained model with the scaling and shifting parameters in the meta-training stage, and fine-tunes the updated model in the meta-testing stage, so as to quickly adapt to new FSFD tasks from the target domain. Thirdly, aiming at the fault classes that are difficult to be diagnosed during meta-training, a meta-task re-training (MTRT) strategy is designed to learn more valuable transferable knowledge in the meta-training stage, thereby improving the adaptability of the CMHSAN model to hard FSFD tasks. Finally, extensive experiments are conducted under different FSFD scenarios to verify the effectiveness of the proposed approach. The results prove that the approach can quickly adapt to new FSFD tasks through the learned meta-knowledge and achieve high diagnosis accuracies.

Few-shot Fault Diagnosis of Turnout Switch Machine Based on Flexible Semi-Supervised Meta-Learning Network

Few-shot fault diagnosis of turnout switch machine based on semi-supervised weighted prototypical network

Few-shot Fault Diagnosis of Switch Machine Based on Data Fusion and Balanced Regularized Prototypical Network

Few-shot Transfer Learning Method Based on Meta-Learning and Graph Convolution Network for Machinery Fault Diagnosis

A Semi-Supervised Adaptive Matrix Machine Approach for Fault Diagnosis in Railway Switch Machine

Semi-supervised meta-learning networks with squeeze-and-excitation attention for few-shot fault diagnosis

Intelligent fault diagnosis for rail transit switch machine based on adaptive feature selection and improved LightGBM

A novel meta-transfer learning approach via convolutional multi-head self-attention network for few-shot fault diagnosis

Reweighted Regularized Prototypical Network for Few-Shot Fault Diagnosis

Attention-based Deep Meta-Transfer Learning for Few-Shot Fine-Grained Fault Diagnosis

A Novel Hybrid Meta-Learning for Few-Shot Gas-Insulated Switchgear Insulation Defect Diagnosis

A feature pseudo-fusion method for intelligent fault diagnosis of electro-hydraulic switch machine inspired by contrastive learning

Fault diagnosis method of switch machine based on adaptive neural fuzzy network

A Few-Shot Machinery Fault Diagnosis Framework Based on Self-Supervised Signal Representation Learning

Cross-Machine Few-Shot Fault Diagnosis for Rotating Machinery with Asymmetric Distribution Measure Network

Few-shot transfer learning for intelligent fault diagnosis of machine

A Novel Fault Diagnosis Method of High-Speed Train Based on Few-Shot Learning

Meta-learning as a promising approach for few-shot cross-domain fault diagnosis: Algorithms, applications, and prospects

A Fine-Tuning Prototypical Network for Few-shot Cross-domain Fault Diagnosis

Few-shot intelligent fault diagnosis based on an improved meta-relation network

Metric-based Meta-Learning Model for Few-Shot Fault Diagnosis under Multiple Limited Data Conditions