Abstract:Predictive maintenance advocates the use of artificial intelligence to analyze big data and provides support for monitoring health conditions and planning maintenance activities in smart manufacturing systems. However, deep networks with massive parameters incur high computational costs, hindering its practical applications. Knowledge distillation (KD) transfers knowledge from a deep network to a lightweight network at the cost of an evident decline in diagnostic accuracy . Instead of an accuracy-size trade-off, a framework for creating a lightweight residual network with higher diagnostic accuracy is proposed in this paper. First, the generalization ability of the teacher network is enhanced based on a domain-adversarial neural network (DANN) with normalization attention mechanism (NAM) and ResNet18. Then, a small student network, ResNet6, efficiently learns the knowledge from its well-learned teacher network through the improved probability KD (IPKD) and uniform quantization. The IPKD is designed to obtain the utmost knowledge, represented as probability distributions of labels and feature space, and narrow the gap between teacher and student networks. Meanwhile, the uniform quantization is incorporated into the distillation process for quantization and distillation co-optimization, further compressing the student network. Experiments on two open-source and one wheelset bearing sets are conducted for performance verification and comparison. The results demonstrate that the obtained lightweight student network has a similar accuracy to the deep network for cross-domain fault diagnosis of bearings with various damages and speeds, even bearing sources, and its quantized network has a much smaller size while retaining a comparatively similar accuracy, which makes it more practical for actual industrial equipment.

Prior knowledge-based residuals shrinkage prototype networks for cross-domain fault diagnosis

A Novel Transfer Learning Method for Robot Bearing Fault Diagnosis Based on Deep Convolutional Residual Wasserstein Adversarial Network.

Domain-Adaptive Prototype-Recalibrated Network with Transductive Learning Paradigm for Intelligent Fault Diagnosis under Various Limited Data Conditions

Knowledge-informed deep networks for robust fault diagnosis of rolling bearings

Knowledge and data dual-driven transfer network for industrial robot fault diagnosis

Multi-scale deep residual shrinkage networks with a hybrid attention mechanism for rolling bearing fault diagnosis

Prior knowledge-embedded meta-transfer learning for few-shot fault diagnosis under variable operating conditions

A lightweight residual network based on improved knowledge transfer and quantized distillation for cross-domain fault diagnosis of rolling bearings

An improved prototypical network with L2 prototype correction for few-shot cross-domain fault diagnosis

A multi-scale collaborative fusion residual neural network-based approach for bearing fault diagnosis

A novel domain generalization network with multidomain specific auxiliary classifiers for machinery fault diagnosis under unseen working conditions

Deep Prototypical Networks Based Domain Adaptation for Fault Diagnosis

Residual deep subdomain adaptation network: A new method for intelligent fault diagnosis of bearings across multiple domains

An enhanced domain-adversarial neural networks for intelligent cross-domain fault diagnosis of rotating machinery

Deep Spiking Residual Shrinkage Network for Bearing Fault Diagnosis

Knowledge-driven domain adaptation strategy for rotating machinery fault diagnosis under varying working condition

A New Deep Convolutional Domain Adaptation Network for Bearing Fault Diagnosis under Different Working Conditions

Few-Shot Learning for Fault Diagnosis: Semi-Supervised Prototypical Network with Pseudo-Labels

A Meta-learning Method for Few-shot Bearing Fault Diagnosis under Variable Working Conditions

Cross-Domain Fault Diagnosis of Powertrain System Using Sparse Representation

Knowledge Embedded Autoencoder Network for Harmonic Drive Fault Diagnosis Under Few-Shot Industrial Scenarios