A Lightweight and Adaptive Knowledge Distillation Framework for Remaining Useful Life Prediction

Lei Ren,Tao Wang,Zidi Jia,Fangyu Li,Honggui Han
DOI: https://doi.org/10.1109/tii.2022.3224969
IF: 12.3
2022-01-01
IEEE Transactions on Industrial Informatics
Abstract:For prognostics and health management of industrial systems, machine remaining useful life (RUL) prediction is an essential task. While deep learning-based methods have achieved great successes in RUL prediction tasks, large-scale neural networks are still difficult to deploy on edge devices owing to the constraints of memory capacity and computing power. In this paper, we propose a lightweight and adaptive knowledge distillation (KD) framework to alleviate this problem. Firstly, multiple teacher models are compressed into a student model through KD to improve the industrial prediction accuracy. Secondly, a dynamic exiting method is studied to enable an adaptive inference on the distilled student model. Finally, we develop a reparameterization scheme to further lessen the student network. Experiments on two turbofan engine degradation datasets and a bearing degradation dataset demonstrate that our method significantly outperforms the state-of-the-art KD methods and enables the distilled model with an adaptive inference ability.
automation & control systems,computer science, interdisciplinary applications,engineering, industrial
What problem does this paper attempt to address?