Abstract:Despite their high prediction accuracy, deep learning-based soft sensor (DLSS) models face challenges related to adversarial robustness against malicious adversarial attacks, which hinder their widespread deployment and safe application. Although adversarial training is the primary method for enhancing adversarial robustness, existing adversarial-training-based defense methods often struggle with accurately estimating transfer gradients and avoiding adversarial robust overfitting. To address these issues, we propose a novel adversarial training approach, namely domain-adaptive adversarial training (DAAT). DAAT comprises two stages: historical gradient-based adversarial attack (HGAA) and domain-adaptive training. In the first stage, HGAA incorporates historical gradient information into the iterative process of generating adversarial samples. It considers gradient similarity between iterative steps to stabilize the updating direction, resulting in improved transfer gradient estimation and stronger adversarial samples. In the second stage, a soft sensor domain-adaptive training model is developed to learn common features from adversarial and original samples through domain-adaptive training, thereby avoiding excessive leaning toward either side and enhancing the adversarial robustness of DLSS without robust overfitting. To demonstrate the effectiveness of DAAT, a DLSS model for crystal quality variables in silicon single-crystal growth manufacturing processes is used as a case study. Through DAAT, the DLSS achieves a balance between defense against adversarial samples and prediction accuracy on normal samples to some extent, offering an effective approach for enhancing the adversarial robustness of DLSS.

Adversarial Transferred Data-Assisted Soft Sensor for Enhanced Multigrade Quality Prediction

Development of an Adversarial Transfer Learning-Based Soft Sensor in Industrial Systems

Transfer Learning Soft Sensor for Product Quality Prediction in Multi-Grade Processes

Deep Subdomain Learning Adaptation Network: A Sensor Fault-Tolerant Soft Sensor for Industrial Processes

Stacked Spatial–Temporal Autoencoder for Quality Prediction in Industrial Processes

Transductive transfer broad learning for cross-domain information exploration and multigrade soft sensor application

Adaptive Soft Sensor Modeling Method Based on Multi-Model Dynamic Fusion and Its Industrial Application.

Soft sensor development based on just-in-time learning and dynamic time warping for multi-grade processes

Probabilistic Sequential Network for Deep Learning of Complex Process Data and Soft Sensor Application

Soft-Sensor Development Through Deep Learning with Spatial and Temporal Feature Extraction of Complex Processes

Adaptive soft sensor based on time difference model and locally weighted partial least squares regression

Synthesizing labeled data to enhance soft sensor performance in data-scarce regions

Adaptive Local Kernel-Based Learning for Soft Sensor Modeling of Nonlinear Processes

Integrated soft sensor using just-in-time support vector regression and probabilistic analysis for quality prediction of multi-grade processes

Adversarial Robustness Enhancement for Deep Learning-Based Soft Sensors: An Adversarial Training Strategy Using Historical Gradients and Domain Adaptation

Subspace Metric-Based Transfer Learning for Spindle Thermal Error Prediction under Time-Varying Conditions

A Deep Probabilistic Transfer Learning Framework for Soft Sensor Modeling With Missing Data

Adaptive Soft Sensors for Quality Prediction under the Framework of Bayesian Network

Enhanced Soft Sensor with Qualified Augmented Samples for Quality Prediction of the Polyethylene Process

Improving the Performance of Just-In-Time Learning-Based Soft Sensor Through Data Augmentation

An improved transfer learning approach based on geodesic flow kernel for multiphase batch process soft sensor modeling