Self-supervised Knowledge Mining from Unlabeled Data for Bearing Fault Diagnosis under Limited Annotations

Depeng Kong,Libo Zhao,Xiaoyan Huang,Weidi Huang,Jianjun Ding,Yeming Yao,Lilin Xu,Po Yang,Geng Yang
DOI: https://doi.org/10.1016/j.measurement.2023.113387
IF: 5.6
2023-01-01
Measurement
Abstract:Deep learning has become a popular approach for fault diagnosis due to its powerful feature extraction and adaptability. However, its reliance on extensive annotations poses challenges in real-world applications. To confront this issue, this article proposes the CLTrans, a contrastive learning-based knowledge transfer method for semi-supervised fault diagnosis. CLTrans utilizes large-scale unlabeled data to benefit downstream tasks by simply performing unsupervised similarity matching. A feature encoder pre-trained by CLTrans can extract discriminative representations of vibration signals and can efficiently adapt to various tasks, even with data under different distributions. Experimental results of inner-dataset and inter-dataset knowledge transfer demonstrate that CLTrans outperforms conventional deep learning and state-of-the-art semi-supervised fault diagnosis approaches in terms of accuracy and domain adaptability, especially under limited labels. The capability of unsupervised knowledge mining and transfer allows for reducing the burden of data collection and annotation.
What problem does this paper attempt to address?