Abstract:Monitoring and diagnostics are vitally important in smart manufacturing systems since early detection can reduce downtime, protect environment, improve work efficiency, and save cost. The current work for monitoring and diagnostics mainly process the system condition data from multisensor by some mainstream machine learning and deep learning methods. However, these methods' performance is limited by the following weaknesses: (1) The multi-sensor information are not well used, and its feature fusion is not considerd. (2) Current advanced methods, such as convolution neural network (CNN), long short-term memory neural network (LSTM), are still facing some problems due to their inherent structures. CNN does not consider the sequential and temporal dependency; LSTM does not consider spatial correlation. Thus, a novel integrated model based on deep learning and multi-sensor feature fusion is proposed. The developed parallel convolutional neural network (PCNN) in the integrated model can achieve multisensory feature fusion to overcome the first weakness. The integrated CNN, deep residual networks (DRN), LSTM, can solve the second point. Specifically, the signals collected from multiple sensors are turned into multi-channel images, and the PCNN is designed to extract and fused the features of the converted images. Then, DRN and LSTM are developed to accept the extracted high-dimensional features by the designed CNN and generate the prediction results by fully connected neural networks. Two experiments, including cutting tool monitoring and bearing fault diagnosis, are conducted to validate the superiority and robustness of the proposed method. Compared with the state-of-the-art algorithms, the results show that the proposed model is more robust and accurate. (C) 2020 Elsevier Ltd. All rights reserved.

Intelligent Mechanical Fault Diagnosis Using Multisensor Fusion and Convolution Neural Network

A convolutional multisensor fusion fault diagnosis framework based on multidimensional distance matrix for rotating machinery

Research on Mechanical Fault Diagnosis Based on Multi-Scale IDCNN-LSTM

Intelligent Fault Diagnosis of Hydraulic Systems Based on Multi-Sensor Fusion and Deep Learning

A novel intelligent fault diagnosis method based on dual convolutional neural network with multi-level information fusion

Intelligent monitoring and diagnostics using a novel integrated model based on deep learning and multi-sensor feature fusion

Cross-modal Fusion Convolutional Neural Networks with Online Soft Label Training Strategy for Mechanical Fault Diagnosis

A Deep Learning Framework for Intelligent Fault Diagnosis Using AutoML-CNN and Image-like Data Fusion

Multi-channel Data Fusion and Intelligent Fault Diagnosis Based on Deep Learning

Bearing-Fault Diagnosis with Signal-to-RGB Image Mapping and Multichannel Multiscale Convolutional Neural Network

A Robust Approach of Multi-sensor Fusion for Fault Diagnosis Using Convolution Neural Network

Fusion Innovation: Multi-Scale Dilated Collaborative Model of ConvNeXt and MSDA for Fault Diagnosis

An Enhanced Intelligent Diagnosis Method Based on Multi-Sensor Image Fusion via Improved Deep Learning Network

An Adaptive Data Fusion Strategy for Fault Diagnosis Based on the Convolutional Neural Network

An integrated approach for mechanical fault diagnosis using maximum mean square discrepancy representation and CNN-based mixed information fusion

Deep Multimodal Learning and Fusion Based Intelligent Fault Diagnosis Approach

Multi-feature fusion for fault diagnosis of rotating machinery based on convolutional neural network

A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method

Fault Diagnosis of Industrial Robots Based on Multi-sensor Information Fusion and 1D Convolutional Neural Network

Research on Mechanical Equipment Fault Diagnosis Method Based on Deep Learning and Information Fusion