Abstract:The great achievements of intelligent fault diagnosis technique are based on the balance of different health conditions. However, in practical engineering, difficulty in acquisition of fault signals results in the long-tailed distribution of data which leads to overfitting problems. Meanwhile, domain shift caused by speed variation further deteriorates the reliability of the model. To overcome these challenges, a Multi-expert Attention Network with Unsupervised Aggregation (UA-MAN) is proposed for long-tailed fault diagnosis under speed variation. Specifically, each expert network consists of Transformer blocks and utilizes the global dependency modeling capability of self-attention calculation to suppress the domain shift. To compensate for the lack of self-attention calculation for detailed feature acquisition, a convolutional network with residual connection is designed as the shared backbone before each expert. Additionally, the expert networks are trained with different loss functions which allows each expert can adapt to diverse class distributions. Finally, an unsupervised contrastive learning technique is developed to aggregate experts to handle the test dataset with unknown class distribution. The superiority and reliability of the proposed method is verified under different class distributions in two datasets. Furthermore, ablation experiments demonstrate that unsupervised aggregation adapt to the varied distribution of the test set effectively. • A Multi-expert Attention Network with Unsupervised Aggregation (UA-MAN) was proposed for long-tailed fault diagnosis under speed variation. • Multi-expert network is designed to learn capabilities of tackling different class distributions from the single long-tailed train dataset. • Swin transformer block is adopted as the backbone for each expert network to suppress domain shift caused by speed variation. • The performance of UA-MAN is verified with two comparative case studies under speed variation with different imbalanced distributions.

Graph attention U-Net to fuse multi-sensor signals for long-tailed distribution fault diagnosis

Attention-aware temporal-spatial graph neural network with multi-sensor information fusion for fault diagnosis

Rotating Machinery Fault Diagnosis Based on Multi-sensor Information Fusion Using Graph Attention Network.

Graph features dynamic fusion learning driven by multi-head attention for large rotating machinery fault diagnosis with multi-sensor data

Unsupervised Graph Transfer Network with Hybrid Attention Mechanisms for Fault Diagnosis under Variable Operating Conditions

Heterogeneous Sensor Fault Detection for Networked Systems Based on a Graph Transformer

MCAGU-Net: A model for composite fault diagnosis of multi-sensor node networks

Fault Diagnosis of Energy Networks: A Graph Embedding Learning Approach

Fault Diagnosis for Mobile Robots Based on Spatial–Temporal Graph Attention Network under Imbalanced Data

Multi-Sensor Temporal-Spatial Graph Network Fusion Empirical Mode Decomposition Convolution for Machine Fault Diagnosis

Graph attention Network-Based model for multiple fault detection and identification of sensors in nuclear power plant

Temporal-Spatial Attention Network: A Novel Axial Piston Pump Coupled Fault Diagnosis Method

MSGAFN: Multi-scale graph attention fusion network for machine fault diagnosis

Graph Attention Network-Based Fault Detection for UAVs With Multivariant Time Series Flight Data

Multi-expert Attention Network with Unsupervised Aggregation for Long-Tailed Fault Diagnosis under Speed Variation

Fault location method for distribution networks based on multi-head graph attention networks

A novel approach of fault diagnosis based on multi-source signals and attention mechanism

Gas Sensor Array Fault Diagnosis Based on Multi-Dimensional Fusion, an Attention Mechanism, and Multi-Task Learning

Multi-head Spatio-Temporal Attention Based Parallel GRU Architecture: a Novel Multi-Sensor Fusion Method for Mechanical Fault Diagnosis

Multi-sensor Based Graph Convolution Fault Diagnosis Method

ASG-HOMGAT: A high-order multi-head graph attention network with adaptive small graph structure for rolling bearing fault diagnosis