Abstract:Predictive maintenance advocates the use of artificial intelligence to analyze big data and provides support for monitoring health conditions and planning maintenance activities in smart manufacturing systems. However, deep networks with massive parameters incur high computational costs, hindering its practical applications. Knowledge distillation (KD) transfers knowledge from a deep network to a lightweight network at the cost of an evident decline in diagnostic accuracy . Instead of an accuracy-size trade-off, a framework for creating a lightweight residual network with higher diagnostic accuracy is proposed in this paper. First, the generalization ability of the teacher network is enhanced based on a domain-adversarial neural network (DANN) with normalization attention mechanism (NAM) and ResNet18. Then, a small student network, ResNet6, efficiently learns the knowledge from its well-learned teacher network through the improved probability KD (IPKD) and uniform quantization. The IPKD is designed to obtain the utmost knowledge, represented as probability distributions of labels and feature space, and narrow the gap between teacher and student networks. Meanwhile, the uniform quantization is incorporated into the distillation process for quantization and distillation co-optimization, further compressing the student network. Experiments on two open-source and one wheelset bearing sets are conducted for performance verification and comparison. The results demonstrate that the obtained lightweight student network has a similar accuracy to the deep network for cross-domain fault diagnosis of bearings with various damages and speeds, even bearing sources, and its quantized network has a much smaller size while retaining a comparatively similar accuracy, which makes it more practical for actual industrial equipment.

DecouplingNet: A Stable Knowledge Distillation Decoupling Net for Fault Detection of Rotating Machines under Varying Speeds

Online Knowledge Distillation Based Multiscale Threshold Denoising Networks for Fault Diagnosis of Transmission Systems

DKDL-Net: A Lightweight Bearing Fault Detection Model via Decoupled Knowledge Distillation and Low-Rank Adaptation Fine-tuning

A lightweight residual network based on improved knowledge transfer and quantized distillation for cross-domain fault diagnosis of rolling bearings

A Multi-Branch Redundant Adversarial Net for Intelligent Fault Diagnosis of Multiple Components under Drastically Variable Speeds.

An Asymmetric Direct-Connected Network for Rolling Bearing Fault Diagnosis

DNOCNet: A Novel End-to-End Network for Induction Motor Drive Systems Fault Diagnosis Under Speed Fluctuation Condition

Semi-Physical Simulation-Driven Contrastive Decoupling Net for Intelligent Fault Diagnosis of Unseen Machines under Varying Speed

An auto-regulated universal domain adaptation network for uncertain diagnostic scenarios of rotating machinery

A novel decoupling method of compound faults with incomplete dataset of rotating machinery

Fault diagnosis systems for rotating machines operating with fluid-film bearings

Deep Dynamic Adaptive Transfer Network for Rolling Bearing Fault Diagnosis With Considering Cross-Machine Instance

Average Descent Rate Singular Value Decomposition and Two-Dimensional Residual Neural Network for Fault Diagnosis of Rotating Machinery

A Global and Joint Knowledge Distillation Method with Gradient-Modulated Dynamic Parameter Adaption for EMU Bogie Bearing Fault Diagnosis

Novelty Detection and Fault Diagnosis Method for Bearing Faults Based on the Hybrid Deep Autoencoder Network

Unified Flowing Normality Learning for Rotating Machinery Anomaly Detection in Continuous Time-Varying Conditions

Knowledge-informed deep networks for robust fault diagnosis of rolling bearings

A Two-Stage Transfer Adversarial Network for Intelligent Fault Diagnosis of Rotating Machinery With Multiple New Faults

Dynamic Temporal Denoise Neural Network with Multi-Head Attention for Fault Diagnosis Under Noise Background

LiftingNet: A Novel Deep Learning Network with Layerwise Feature Learning from Noisy Mechanical Data for Fault Classification

A fault diagnosis method for rotating machinery with variable speed based on multi-feature fusion and improved ShuffleNet V2