Adaptive Knowledge Distillation Based Lightweight Intelligent Fault Diagnosis Framework in IoT Edge Computing

Yanzhi Wang,Ziyang Yu,Jinhong Wu,Chu Wang,Qi Zhou,Jiexiang Hu
DOI: https://doi.org/10.1109/jiot.2024.3387328
IF: 10.6
2024-01-01
IEEE Internet of Things Journal
Abstract:Intelligent fault diagnosis of mechanical equipment is crucial to ensure reliable operation. However, cloud-based fault diagnosis methods often encounter challenges, such as time delays and data loss. Therefore, edge computing-based fault diagnosis has emerged as a promising alternative. However, the limited hardware resources of edge devices in the industrial Internet of Things (IoT) pose significant challenges in striking a balance between diagnostic capabilities and operational efficiency. This article introduces a novel lightweight intelligent fault diagnosis method, which is tailored for IoT edge computing scenarios. Optimal weights are trained on cloud computing and inference is performed on edge computing to ensure timely diagnosis. Based on adaptive knowledge distillation, fault knowledge is transferred from a cloud-based deep neural network model (T-model) to an edge-based lightweight model (S-model). By dynamically adjusting the distillation temperature, the S-model effectively acquires and deeply understands the knowledge representation from the T-model. Additionally, we explore practical considerations and potential challenges in the application of the proposed approach. Verification experiments were conducted on two experimental devices, and the NVIDIA Jetson Xavier NX suite was selected as the edge computing platform. The proposed method exhibited significant enhancements in diagnostic accuracy, demonstrating an average improvement of 10.7% compared to existing methods. In lightweight tests, our method achieved an average 25.5% increase in inference speed compared to current approaches. Furthermore, our method reduced memory usage by 96.58% compared to the T-model, concurrently boosting processing speed by a factor of 8.79.
What problem does this paper attempt to address?