Temporal Convolutional Memory Networks for Remaining Useful Life Estimation of Industrial Machinery

Lahiru Jayasinghe,Tharaka Samarasinghe,Chau Yuen,Jenny Chen Ni Low,Shuzhi Sam Ge
DOI: https://doi.org/10.48550/arXiv.1810.05644
2018-12-10
Abstract:Accurately estimating the remaining useful life (RUL) of industrial machinery is beneficial in many real-world applications. Estimation techniques have mainly utilized linear models or neural network based approaches with a focus on short term time dependencies. This paper, introduces a system model that incorporates temporal convolutions with both long term and short term time dependencies. The proposed network learns salient features and complex temporal variations in sensor values, and predicts the RUL. A data augmentation method is used for increased accuracy. The proposed method is compared with several state-of-the-art algorithms on publicly available datasets. It demonstrates promising results, with superior results for datasets obtained from complex environments.
Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the Remaining Useful Life (RUL) estimation problem of industrial machinery. Accurately estimating the RUL of industrial machinery is of great significance in practical applications, such as predicting failures to make maintenance decisions in advance, thereby preventing permanent damage and significantly reducing operation and maintenance costs. ### Problem Background 1. **Limitations of Existing Methods**: - Existing RUL estimation methods mainly rely on linear models or neural - network - based methods, but these methods usually only focus on short - term time - dependencies. - The sliding - window method only considers the relationships within the sliding window, so it can only capture short - term dependencies. - Although the Hidden Markov Model (HMM) can model long - term dependencies, it has high computational complexity and storage requirements. - Although the Recurrent Neural Network (RNN) can learn time - dependencies, it is prone to the vanishing - gradient problem when dealing with long - term dependencies. 2. **Research Motivation**: - The RUL estimation of industrial machinery is crucial for equipment health management and preventive maintenance. - Data - driven methods have more advantages than physical - model - based methods because it is difficult to establish an accurate physical failure model for the latter. ### Solutions Proposed in the Paper This paper proposes a deep - learning architecture that combines Temporal Convolutional Layers and Long - Short - Term Memory (LSTM) networks, aiming to capture both short - and long - term time - dependencies in sensor data simultaneously. Specifically: - **Temporal Convolutional Layers**: Extract the time features of sensor data through 1D convolution operations, avoiding the noise that may be introduced by 2D convolution. - **LSTM Layers**: Learn long - term time - dependencies by stacking LSTM layers. - **Data Augmentation**: Use a new data - augmentation algorithm to generate partial training trajectories to improve the generalization ability and accuracy of the model. ### Main Contributions 1. **Improved Feature Extraction**: Combining temporal convolution and LSTM can more effectively extract and learn the complex time - variations in sensor data. 2. **Data Augmentation**: The proposed data - augmentation algorithm generates partial training trajectories, making the model perform better in the test phase. 3. **Superior Performance**: On complex environmental data sets, especially on the FD002 and FD004 sub - data sets, this method performs excellently and outperforms the existing advanced algorithms. ### Summary This paper provides a novel and effective RUL estimation method by combining temporal convolution and LSTM networks and introducing data - augmentation techniques, which is especially suitable for industrial machinery and equipment in complex environments.