A Process Data Prediction Method for Chemical Process Based on the Frozen Pretrained Transformer Model

Yiming Bai,Jinsong Zhao
DOI: https://doi.org/10.1016/b978-0-443-15274-0.50273-0
2023-01-01
Abstract:With the reform of industrial production digitization and automation, process fault detection and diagnosis (FDD) has been an indispensable technical method to realize the safe and efficient production of chemical process, even if there may be some delay and inaccuracy. Fault prognosis could predict the occurrence of faults in advance, which would give operators more time and reduce the impact of faults. Frozen Pretrained Transformer (FPT) has shown language-pretrained transformers can obtain strong performance on a variety of simple non-language classification tasks. Inspired by the pre-trained models, we proposed a chemical process data prediction method based on FPT models. Specifically, we take a transformer model pretrained on natural language data and finetune some parameters on the chemical process data. And the Tennessee Eastman process (TEP) was used to demonstrate the validity of the method. Finally, we discussed the relevant issues in applying language-pretrained models to process data.
What problem does this paper attempt to address?