Abstract:VAE as an unsupervised deep generated model has been widely applied to process modeling for industrial processes due to its excellent ability in nonlinear and uncertain feature extraction. However, soft sensor based on VAE model faces three challenges. Firstly, the constructed supervised VAE model makes it difficult to describe the correlation between input and output based on self-network. Secondly, the output of the VAE may suffer from instability and uncontrollability. In addition, the limited labeled data in industries is the third challenge. To solve the above problems, a semi-supervised deep conditional variational auto-encoder (SS-DCVAE) is constructed for soft sensor based on a supervised DCVAE (S-DCVAE) and an unsupervised DCVAE (U-DCVAE). The S-DCVAE model is constructed by injecting unlabeled data, the actual labels and estimated labels as constraint conditions from the pre-neural network. Based on such a conditional supervised structure, the input-output correlation can be strengthened and the generated data can be controlled towards the aim direction. Furthermore, the U-DCVAE model can be built by making the latent distribution as similar as possible to S-DCVAE, as well as only using unlabeled data with corresponding estimated labels. In this way, the unlabeled data can be fully utilized and online prediction can be achieved. Finally, combining the decoder of S-DCVAE model with the encoder of U-DCVAE, the SS-DCVAE model is constructed with both advantages. The effectiveness and superiority of the SS-DCVAE model are demonstrated by comparing the prediction results of the proposed model with other deep learning methods based on industrial cases.

Development of NVW-SAEs with Nonlinear Correlation Metrics for Quality-Relevant Feature Learning in Process Data Modeling

Nonlinear Vw-Sae Based Deep Learning For Quality-Related Feature Learning And Soft Sensor Modeling

Deep Quality-Related Feature Extraction for Soft Sensing Modeling: A Deep Learning Approach with Hybrid VW-SAE

Long-short Memory with Feature Representation by Latent-variable Model for Industrial Soft Sensor

Deep Learning of Process Data with Supervised Variational Auto-encoder for Soft Sensor

Weighted Nonlinear Dynamic System for Deep Extraction of Nonlinear Dynamic Latent Variables and Industrial Application

Gated Quality-Driven Feature Extraction with A Hybrid SIAE Model for Industrial Soft Sensor

Stacked Spatial–Temporal Autoencoder for Quality Prediction in Industrial Processes

Deep Learning-Based Feature Representation and Its Application for Soft Sensor Modeling with Variable-Wise Weighted SAE

Supervised Nonlinear Dynamic System for Soft Sensor Application Aided by Variational Auto-Encoder

Soft-Sensor Development Through Deep Learning with Spatial and Temporal Feature Extraction of Complex Processes

Dynamic Features Incorporated Locally Weighted Deep Learning Model for Soft Sensor Development.

Hierarchical Quality-Relevant Feature Representation for Soft Sensor Modeling: A Novel Deep Learning Strategy

Semi-supervised Deep Conditional Variational Auto-encoder for Soft Sensor Modeling

Nonlinear Probabilistic Latent Variable Regression Models for Soft Sensor Application: from Shallow to Deep Structure

Cooperative Deep Dynamic Feature Extraction and Variable Time-Delay Estimation for Industrial Quality Prediction

Gated Stacked Target-Related Autoencoder: A Novel Deep Feature Extraction and Layerwise Ensemble Method for Industrial Soft Sensor Application

Deep Nonlinear Dynamic Feature Extraction for Quality Prediction Based on Spatiotemporal Neighborhood Preserving SAE

A Novel Semi-Supervised Pre-Training Strategy for Deep Networks and Its Application for Quality Variable Prediction in Industrial Processes

Nonlinear Feature Extraction for Soft Sensor Modeling Based on Weighted Probabilistic PCA

VAE4RSS: A VAE-based Neural Network Approach for Robust Soft Sensor with Application to Zinc Roasting Process