Abstract:Spiking neural networks (SNNs) transmit information via low-power binary spikes and have received widespread attention in areas such as computer vision and reinforcement learning. However, there have been very few explorations of SNNs in more practical industrial scenarios. In this paper, we focus on the application of SNNs in bearing fault diagnosis to facilitate the integration of high-performance AI algorithms and real-world industries. In particular, we identify two key limitations of existing SNN fault diagnosis methods: inadequate encoding capacity that necessitates cumbersome data preprocessing, and non-spike-oriented architectures that constrain the performance of SNNs. To alleviate these problems, we propose a Multi-scale Residual Attention SNN (MRA-SNN) to simultaneously improve the efficiency, performance, and robustness of SNN methods. By incorporating a lightweight attention mechanism, we have designed a multi-scale attention encoding module to extract multiscale fault features from vibration signals and encode them as spatio-temporal spikes, eliminating the need for complicated preprocessing. Then, the spike residual attention block extracts high-dimensional fault features and enhances the expressiveness of sparse spikes with the attention mechanism for end-to-end diagnosis. In addition, the performance and robustness of MRA-SNN is further enhanced by introducing the lightweight attention mechanism within the spiking neurons to simulate the biological dendritic filtering effect. Extensive experiments on MFPT and JNU benchmark datasets demonstrate that MRA-SNN significantly outperforms existing methods in terms of accuracy, energy consumption and noise robustness, and is more feasible for deployment in real-world industrial scenarios.

Spiking autoencoder for nonlinear industrial process fault detection

Fault Detection Based on Variational Autoencoders for Complex Nonlinear Processes

Stacked Spatial–Temporal Autoencoder for Quality Prediction in Industrial Processes

Deep Neural Network-Embedded Stochastic Nonlinear State-Space Models and Their Applications to Process Monitoring

A Novel Label-Aware Global Graph Construction Method and Spiking-Coded Graph Neural Network for Intelligent Process Fault Diagnosis

Fault detection of industrial processes using attention-based gated recurrent unit autoencoder with skip connection

Semi-supervised Fault Classification Based on Dynamic Sparse Stacked Auto-Encoders Model

Adaptive Positive Semidefinite Matrix-Based Contribution For Nonlinear Process Diagnosis

Systematic Development of a New Variational Autoencoder Model Based on Uncertain Data for Monitoring Nonlinear Processes

Nonlinear Dynamic System Based on SAE-LDS Model for Fault Diagnosis

Industrial Process Fault Detection Based on Siamese Recurrent Autoencoder

Stacked Sparse Auto Encoder Network Based Multimode Process Monitoring.

Industrial Process Modeling and Fault Detection with Recurrent Kalman Variational Autoencoder

Robust Monitoring and Fault Isolation of Nonlinear Industrial Processes Using Denoising Autoencoder and Elastic Net

Convolutional Long Short-Term Memory Autoencoder-Based Feature Learning for Fault Detection in Industrial Processes

STAGED: A Spatial-Temporal Aware Graph Encoder–Decoder for Fault Diagnosis in Industrial Processes

Toward End-to-End Bearing Fault Diagnosis for Industrial Scenarios with Spiking Neural Networks

A Novel Fault Detection and Identification Method for Complex Chemical Processes Based on OSCAE and CNN

Detecting sensor faults for a chemical reactor rig via adaptive neural network model

A method for fault detection in multi-component systems based on sparse autoencoder-based deep neural networks

Nonlinear Dynamic Process Monitoring Based on Discriminative Denoising Autoencoder and Canonical Variate Analysis