A Novel Semi-Supervised Pre-Training Strategy for Deep Networks and Its Application for Quality Variable Prediction in Industrial Processes

Xiaofeng Yuan,Chen Ou,Yalin Wang,Chunhua Yang,Weihua Gui
DOI: https://doi.org/10.1016/j.ces.2020.115509
IF: 4.7
2020-01-01
Chemical Engineering Science
Abstract:Deep learning-based soft sensor has been a hot topic for quality variable prediction in modern industrial processes. Feature representation with deep learning is the key step to build an accurate and reliable soft sensor model from massive process data. To deal with the limited labeled data and abundant unlabeled data, a semi-supervised pre-training strategy is proposed for deep learning network in this paper, which is based on semi-supervised stacked autoencoder (SS-SAE). For traditional deep networks like SAE, the pre-training procedure is unsupervised and may discard important information in the labeled data. Different from them, SS-SAE automatically adjusts the training strategy according to the given data type. For unlabeled data, it learns the shape of the input distribution layer by layer. While for labeled data, it additionally learns quality-related features with the guidance of quality information. The proposed method is validated on two refining industries of a debutanizer column and a hydrocracking process. The results show that SS-SAE can utilize both labeled and unlabeled data to extract quality-relevant features for soft sensor modeling, which is superior to multi-layer neural network, traditional SAE and DBN. (C) 2020 Elsevier Ltd. All rights reserved.
What problem does this paper attempt to address?