Machine Fault Diagnosis through Vibration Analysis: Continuous Wavelet Transform with Complex Morlet Wavelet and Time–Frequency RGB Image Recognition via Convolutional Neural Network

Dominik Łuczak
DOI: https://doi.org/10.3390/electronics13020452
IF: 2.9
2024-01-23
Electronics
Abstract:In pursuit of advancing fault diagnosis in electromechanical systems, this research focusses on vibration analysis through innovative techniques. The study unfolds in a structured manner, beginning with an introduction that situates the research question in a broader context, emphasising the critical role of fault diagnosis. Subsequently, the methods section offers a concise summary of the primary techniques employed, highlighting the utilisation of short-time Fourier transform (STFT) and continuous wavelet transform (CWT) for extracting time–frequency components from the signal. The results section succinctly summarises the main findings of the article, showcasing the results of features extraction by CWT and subsequently utilising a convolutional neural network (CNN) for fault diagnosis. The proposed method, named CWTx6-CNN, was compared with the STFTx6-CNN method of the previous stage of the investigation. Visual insights into the time–frequency characteristics of the inertial measurement unit (IMU) data are presented for various operational classes, offering a clear representation of fault-related features. Finally, the conclusion section underscores the advantages of the suggested method, particularly the concentration of single-frequency components for enhanced fault representation. The research demonstrates commendable classification performance, highlighting the efficiency of the suggested approach in real-time scenarios of fault analysis in less than 50 ms. Calculation by CWT with a complex Morlet wavelet of six time–frequency images and combining them into a single colour image took less than 35 ms. In this study, interpretability techniques have been employed to address the imperative need for transparency in intricate neural network models, particularly in the context of the case presented. Notably, techniques such as Grad-CAM (gradient-weighted class activation mapping), occlusion, and LIME (locally interpretable model-agnostic explanation) have proven instrumental in elucidating the inner workings of the model. Through a comparative analysis of the proposed CWTx6-CNN method and the reference STFTx6-CNN method, the application of interpretability techniques, including Grad-CAM, occlusion, and LIME, has played a pivotal role in revealing the distinctive spectral representations of these methodologies.
engineering, electrical & electronic,computer science, information systems,physics, applied
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to improve the fault diagnosis ability of electromechanical systems through vibration analysis. Specifically, the author aims to develop a more effective method to identify and classify faults in electromechanical systems, especially by using the continuous wavelet transform (CWT) combined with the complex Morlet wavelet and the time - frequency RGB image recognition technology to perform fault diagnosis through the convolutional neural network (CNN). ### Main problems and goals 1. **Improve the accuracy of fault diagnosis**: The traditional short - time Fourier transform (STFT) has the problem of spectral blurring when dealing with non - stationary signals, resulting in unclear fault features. This paper proposes to use the continuous wavelet transform (CWT) combined with the complex Morlet wavelet to better extract time - frequency features, thereby improving the accuracy of fault diagnosis. 2. **Comprehensive analysis of multi - axis vibration signals**: Traditional fault diagnosis methods usually only use single - axis sensor data, while the method proposed in this paper utilizes the six - degree - of - freedom inertial measurement unit (6DOF IMU), including data from the three - axis accelerometer and the three - axis gyroscope. By converting these multi - axis vibration signals into time - frequency RGB images, fault features can be captured more comprehensively. 3. **Real - time fault diagnosis**: The method proposed in this paper can complete fault diagnosis within less than 50 milliseconds, meeting the requirements of real - time application scenarios. Specifically, the process of calculating the CWT and generating six time - frequency images and then combining them into a color image takes less than 35 milliseconds. 4. **Model interpretability**: In order to improve the transparency and interpretability of the model, the author adopts interpretability techniques such as Grad - CAM, occlusion method and LIME to help understand the decision - making process of the CNN in fault diagnosis. ### Method overview - **Data collection and pre - processing**: Use 6DOF IMU sensors to collect multi - axis vibration signals and perform necessary pre - processing. - **Feature extraction**: Extract time - frequency features through CWT combined with the complex Morlet wavelet to generate six time - frequency images. - **Image generation**: Combine the six time - frequency images into an RGB image. - **Fault diagnosis**: Use the CNN to classify the generated RGB image and identify different fault states. - **Model interpretation**: Adopt interpretability techniques such as Grad - CAM to enhance the transparency and credibility of the model. Through the above methods, this paper shows how to use advanced signal processing and deep learning technologies to achieve more efficient, accurate and interpretable fault diagnosis of electromechanical systems.