Dynamic fault detection and diagnosis of industrial alkaline water electrolyzer process with variational Bayesian dictionary learning

Qi Zhang,Lei Xie,Weihua Xu,Hongye Su

2024-04-15

Abstract:Alkaline Water Electrolysis (AWE) is one of the simplest green hydrogen production method using renewable energy.

Machine Learning

What problem does this paper attempt to address?

Dynamic fault detection and diagnosis for alkaline water electrolyzer with variational Bayesian Sparse principal component analysis

Qi Zhang,Weihua Xu,Lei Xie,Hongye Su

DOI: https://doi.org/10.1016/j.jprocont.2024.103173

IF: 3.951

2024-01-27

Journal of Process Control

Abstract:Electrolytic hydrogen production serves as not only a vital source of green hydrogen but also a key strategy for addressing renewable energy consumption challenges. For the safe production of hydrogen through Alkaline water electrolyzer (AWE), dependable process monitoring technology is essential. However, random noise can easily contaminate the AWE process data collected in industrial settings, presenting new challenges for monitoring methods. In this study, we develop the variational Bayesian sparse principal component analysis (VBSPCA) method for process monitoring. VBSPCA methods based on Gaussian prior and Laplace prior are derived to obtain the sparsity of the projection matrix, which corresponds to l2 regularization and l1 regularization, respectively. The correlation of dynamic latent variables is then analyzed by sparse autoregression and fault variables are diagnosed by fault reconstruction. The effectiveness of the method is verified by an industrial hydrogen production process, and the test results demonstrated that both Gaussian prior and Laplace prior based VBSPCA can effectively detect and diagnose critical faults in AWEs.

automation & control systems,engineering, chemical
Ontology-Based Fault Diagnosis for Chemical Process

Wang Lei,Huang Dao

DOI: https://doi.org/10.3969/j.issn.1006-5911.2005.04.025

2005-01-01

Computer Integrated Manufacturing Systems

Abstract:Considering the characteristics and fault mechanism of giant chemical process, this paper introduces MAS technology into the domain of fault diagnosis for chemical process, decomposes the chemical process into some comparatively independent components, and assigns specific Diagnosis Agents to them. Through cooperation among agents, the fault diagnosis result of whole process can be get by taking full advantage of the partial: information. In conclusion, the satisfactory results are obtained in the application of fault diagnosis for methanol synthesis process.
Fault Diagnosis in Chemical Processes Based on WPA and WLS-SVM

TIAN yu,XIAO Juan,HUANG Dao

DOI: https://doi.org/10.14107/j.cnki.kzgc.2010.s2.004

2010-01-01

Abstract:Multi-variable,system-complex,non-linear are the characteristics of the fault diagnosis in chemical process.This makes the conventional methods difficult to establish the accurate model and adjust the parameters,make the speed of convergence slow,multiple faults can not be correctly identified.Based on the tennessee eastman process models,the model features and the difficulties in fault diagnosis are combined,the wavelet packet algorithm is adopted to filter noises to restore the original signal,and data scaling is used to unify the measurement.Weighted least squares support Vector machine(WLS-SVM) is taken as the model,the weight coefficients are determined by K-clustering method,to selected the model parameters are selected by cross-validation.A set of concrete solutions are proposed.Simulation experiments are carried out to show the validity of the algorithm and the feasibility in the fault diagnosis in the chemical process and a number of prospects are concluded.
Variational Bayesian State Space Model for Dynamic Process Fault Detection

Qi Zhang,Shan Lu,Lei Xie,Shaowu Gu,Hongye Su

DOI: https://doi.org/10.1016/j.jprocont.2023.02.004

IF: 3.951

2023-01-01

Journal of Process Control

Abstract:Industrial processes are subject to various noise disturbances that lead to the stochastic nature of the modeled system and the uncertainty of the model parameters. In this paper, a variational Bayesian State Space Model (VBSSM) model is developed for dynamic process monitoring, allowing the uncertainty of parameters to be described by probabilities. The conjugate prior allows the posterior distribution of the parameters to be estimated iteratively through the Rauch Tung Striebel (RTS) smoothing estimation with the VB framework. The next state can be better predicted even in the presence of noisy perturbations, and imperceptible correlations among multiple variables can be found. By maximizing the lower bound of the objective function to approximate the true posterior distribution of the parameters, the fault detection index is constructed by the corresponding residual. Finally, the effectiveness and superiority of the proposed method is verified by numerical simulations, Tennessee Eastman process and hot rolling industry examples.
A Variational Bayesian Dictionary Learning for Process Monitoring

Qi Zhang,Lei Xie,Weihua Xu,Hongye Su

DOI: https://doi.org/10.1109/ddcls58216.2023.10166191

2023-01-01

Abstract:Industrial process data acquisition is inevitably disturbed by noise, and data contamination makes process data carry too much redundant information, which will greatly limit the interpretation capability of data-driven modeling approaches. Given that sparse representations can effectively handle noise, a process monitoring method for variational Bayesian dictionary learning (VBDL) is developed in this work. Conventional dictionary learning requires a priori knowledge of the assumed noise variance and sparsity levels, which is not available in real industrial processes. The derived VBDL is built on a Bernoulli distribution with the beta distribution as the conjugate prior, the number of dictionary atoms and their relative importance can be inferred nonparametrically with the iterative update of the variational inference. Since the collected data exhibits temporal correlation, the large noise interference makes dynamic analysis infeasible. A low-rank vector autoregression is developed to dynamically analyze the reconstructed samples, thereby improving the robustness of the model to noise. To illustrate the feasibility and efficacy, the proposed algorithm is verified by a numerical simulation and the CSTR simulation.
A Variable Moving Window Approach for On-Line Fault Diagnosis in Industrial Processes

Shaoyuan Zhou,Lei Xie,Shuqing Wang

DOI: https://doi.org/10.1109/wcica.2004.1340975

2004-01-01

Abstract:Although there are many literatures on process on-line fault diagnosis, the moving window of fixed length is used in most of cases. In this study, an approach based on hidden Markov model (HMM) for on-line fault diagnosis in industrial processes is proposed. In variable moving window, the length of which is modified with time, is applied to track process dynamic variables. Before fault diagnosis, the process operating condition is monitored using principal component analysis (PCA) until abnormal operation in the process is detected. Case studies from the Tennessee Eastman plant illustrate that the proposed method is effective.
On-line fault diagnosis in industrial processes using variable moving window and hidden Markov model

周韶园,谢磊,王树青,SY Zhou,L Xie,SQ Wang

IF: 3.8

2005-01-01

Chinese Journal of Chemical Engineering

Abstract:An integrated framework is presented to represent and classify process data for on-line identifying abnormal operating conditions. It is based on pattern recognition principles and consists of a feature extraction step, by which wavelet transform and principal component analysis are used to capture the inherent characteristics from process measurements, followed by a similarity assessment step using hidden Markov model (HMM) for pattern comparison. In most previous cases, a fixed-length moving window was employed to track dynamic data, and often failed to capture enough information for each fault and sometimes even deteriorated the diagnostic performance. A variable moving window, the length of which is modified with time, is introduced in this paper and case studies on the Tennessee Eastman process illustrate the potential of the proposed method.
Dynamic Process Monitoring Based on Variational Bayesian Canonical Variate Analysis

Jiaxin Yu,Lingjian Ye,Le Zhou,Zeyu Yang,Feifan Shen,Zhihuan Song

DOI: https://doi.org/10.1109/tsmc.2021.3051054

2022-01-01

Abstract:Fault detection and fault identification are consecutive steps of multivariate statistical process monitoring. In recent years, increasing attention has been paid to process dynamics. For dynamic process modeling, canonical variate analysis (CVA) extracts process dynamics effectively. However, process noises are not well analyzed in traditional CVA and corresponding fault identification methods are less studied. To solve these issues, a variational Bayesian CVA (VBCVA) model is proposed for dynamic process monitoring. Through a probabilistic perspective, the inevitable noises in realistic industrial processes can be captured in the new model. Moreover, the proposed model is further extended in the variational Bayesian framework to overcome the common problems in probabilistic methods. Besides, an improved fault identification approach based on fault relevance is introduced, which avoids the smearing effect caused by data reconstruction. Finally, the feasibility of the proposed process monitoring scheme is verified on the TE benchmark and a real wastewater treatment process.
Online Dynamic Parameter Estimation of an Alkaline Electrolysis System Based on Bayesian Inference

Xiaoyan Qiu,Hang Zhang,Yiwei Qiu,Buxiang Zhou,Tianlei Zang,Ruomei Qi,Jin Lin,Jiepeng Wang

DOI: https://doi.org/10.48550/arXiv.2203.03883

2022-03-08

Abstract:When directly coupled with fluctuating energy sources such as wind and photovoltage power, the alkaline electrolysis (AEL) in a power-to-hydrogen (P2H) system is required to operate flexibly by dynamically adjusting its hydrogen production rate. The flex-ibility characteristics, e.g., loading range and ramping rate, of an AEL system are significantly influenced by some parameters re-lated to the dynamic processes of the AEL system. These parame-ters are usually difficult to measure directly and may even change with time. To accurately evaluate the flexibility of an AEL system in online operation, this paper presents a Bayesian Inference-based Markov Chain Monte Carlo (MCMC) method to estimate these parameters. Meanwhile, posterior joint probability distribu-tions of the estimated parameters are obtained as a byproduct, which provides valuable physical insight into the AEL systems. Experiments on a 25 kW electrolyzer validate the proposed pa-rameter estimation method.

Systems and Control,Optimization and Control
A Variational Bayesian Robust Linear Dynamic System Approach for Dynamic Process Modelling and Fault Detection

Jinlin Zhu Zhiqiang Ge,Zhihuan Song

DOI: https://doi.org/10.1016/j.ifacol.2015.09.581

2015-01-01

IFAC-PapersOnLine

Abstract:In this work, a variational Bayesian robust linear dynamic system (VBRLDS) approach is proposed for dynamic process modeling and monitoring. Traditional linear dynamic system (LDS) constructed with Kalman filter is designed by Gaussian assumption which can be easily violated in outlier contaminated modeling situations. To deal with this issue, the conventional Gaussian-based Kalman filter is modified with heavy tailed Student's t-distribution so as to deal with modeling outliers. Then, a variational Bayesian expectation maximization (VBEM) algorithm is developed for learning parameters of the robust linear dynamic system. For process monitoring, traditional residual space modeling method of SPE statistics are modified. To explore the feasibility and effectiveness, our proposed method is applied into fault detection and is comparatively studied with several other methods on the Tennessee Eastman benchmark.
An Effective Fault Diagnosis Approach Based on Optimal Weighted Least Squares Support Vector Machine

Shiming He,Xinggao Liu,Yalin Wang,Shenghu Xu,Jiangang Lu,Chunhua Yang,Shengwu Zhou,Youxian Sun,Weihua Gui,Weizhong Qin

DOI: https://doi.org/10.1002/cjce.22865

2017-01-01

The Canadian Journal of Chemical Engineering

Abstract:Fault diagnosis is always a vital technology in the chemical industry and is influenced by a large number of process variables in the practical manufacturing process. Thus, an effective diagnosis method is crucial in practical chemical processes. A novel fault diagnosis method is proposed based on the weighted least squares support vector machine (WLSVM) to deal with the small sample and non‐linear partition data. It provides the strong potential in predicting faults, especially by further employing a suitable particle swarm optimization (PSO) algorithm to determine the most important parameters of the punishment factor and the Gaussian RBF kernel, which has the advantages of high accuracy and low false alarm rate. PSO‐WLSSVM is further accomplished with the data from the classic benchmark test set Tennessee Eastman (TE) process. Also, the models SVM, PSO‐SVM, and PSO‐LSSVM are employed on the TE process to compare the performance of PSO‐WLSSVM. The results show the validity of the proposed approach on the TE process.
Dynamic parameter estimation of the alkaline electrolysis system combining Bayesian inference and adaptive polynomial surrogate models

Xiaoyan Qiu,Hang Zhang,Yiwei Qiu,Yi Zhou,Tianlei Zang,Buxiang Zhou,Ruomei Qi,Jin Lin,Jiepeng Wang

DOI: https://doi.org/10.1016/j.apenergy.2023.121533

IF: 11.2

2023-07-12

Applied Energy

Abstract:Utility-scale hydrogen production via alkaline electrolysis (AEL) is a promising pathway toward the decarbonization of the power, transportation, and chemical industries. The efficiency, load flexibility, and operational safety of the AEL system are subject to electrochemical, thermal, and mass transfer dynamics, and the corresponding parameters, including overvoltage coefficients, heat capacities and resistances of the stack and lye-gas separators, thickness and permeability of the diaphragm, etc. The community has developed many models to depict these dynamic behaviors. However, due to the lack of a comprehensive parameter estimation method, these models are generally tuned manually in industrial applications, which can be inaccurate and cannot fit their time-varying nature. To fill this gap, we present a fast and accurate parameter estimation method for the AEL system. Specifically, to address the difficulties of strong nonlinearity of the dynamic electrolyzer models and correlation between different parameters, a Bayesian inference-based Markov chain Monte Carlo method is proposed. To reduce the computing time for online estimation, data-driven adaptive polynomial surrogate models are established to replace repeated time-domain simulations of the electrolyzer model so that estimation can be finished within a few minutes. Experiments on a 5 Nm 3 /hr-rated AEL system validate the proposed method. Compared with the existing Kalman filter variants, the estimation error is reduced by at most 71.1% in terms of RMSE and NRMSE. In addition, the proposed method provides approaches to fault diagnosis and global sensitivity analysis for operating and designing AEL systems.

energy & fuels,engineering, chemical
Deep-learning model with flow-leveraged polarization function and set-value cross-attention mechanism for accurate dynamic thermoelectric of alkaline water electrolyzer

Zixuan Shangguan,Zhongkai Zhao,Hao Li,Wenbo Li,Bowen Yang,Liming Jin,Cunman Zhang

DOI: https://doi.org/10.1016/j.ijhydene.2024.06.394

IF: 7.2

2024-07-13

International Journal of Hydrogen Energy

Abstract:The efficient production and sustainable operation of water electrolysis hydrogen production equipment within renewable energy systems, characterized by intermittency and volatility, necessitates dynamic simulation for the development of optimized control systems. This paper proposes the application and modification of a data-driven deep-learning model to simultaneously simulate the thermal and electrochemical responses of an alkaline water electrolyzer (AWE), yielding exceptional performance and versatility. By utilizing 4840 h of comprehensive experimental data, the causal relationships among electrolyzer operating parameters are resolved, classifying them into set values and response values for the proposed dynamic model. The model architecture is based on an attention mechanism and designed with hybrid input. Notable enhancements include embedding flow-leveraged polarization function, creating set-value cross-attention, and adopting probability-sparse attention, all of which are validated through both the validation and simulation results. Extensive exploration of various structural and training parameters leads to the selection of the best-performing model. When applied to simulation across all experimental data, the median mean percentage absolute error of the optimal model in cell voltage is a mere 1.3%, while the error in temperature is only 3.5%. Moreover, under typical operating conditions, the simulation error for both voltage and temperature remain below 2%, highlighting the outstanding dynamic modeling and simulation capabilities. These results demonstrate the potential of the proposed model for future hydrogen energy applications in dynamic control and operational optimization within renewable energy system for higher performance and better conversion efficiency.

chemistry, physical,electrochemistry,energy & fuels
Latent and Small Fault Detection and Diagnosis for Dynamic Processes

zhiqiang ge,zhihuan song

DOI: https://doi.org/10.3182/20080706-5-kr-1001.00434

2008-01-01

IFAC Proceedings Volumes

Abstract:Compared to large process faults, the latent and small ones are difficult to be detected. However, the accumulation of these faults may even more harmful to the process. A novel fault detection and diagnosis method is proposed which is based on similarity factor and a variable moving window. The new method is based on the idea that a change of process can be reflected in the distribution of the data, which can be detected more easily by the proposed similarity factor. Meanwhile, it has no Gaussian distribution limitation of the process data, since the mixed similarity factor is introduced. The independent component analysis (ICA) factor and the principal component analysis (PCA) factor are used for similarity comparison for Gaussian and non-Gaussian information, respectively. Besides, in order to determine the dynamic step accurately and cut the computation cost, the conventional dynamic method is modified by using autocorrelation analysis. A case study of Tennessee Eastman (TE) benchmark process shows the efficiency of the new proposed method.
Supervised Linear Dynamic System Model for Quality Related Fault Detection in Dynamic Processes

Zhiqiang Ge,Xinru Chen

DOI: https://doi.org/10.1016/j.jprocont.2016.06.003

IF: 3.951

2016-01-01

Journal of Process Control

Abstract:Dynamic and uncertainty are two main features of industrial processes data which should be paid attentions when carrying out process monitoring and fault diagnosis. As a typical dynamic Bayesian network model, linear dynamic system (LDS) can efficiently deal with both dynamic and uncertain features of the process data. However, the quality information has been ignored by the LDS model, which could serve as a supervised term for information extraction and fault detection. In this paper, a supervised form of the LDS model is developed, which can successfully incorporate the information of quality variables. With this additional data information, the new supervised LDS model can provide a quality related fault detection scheme for dynamic processes. A detailed industrial case study on the Tennessee Eastman benchmark process is carried out for performance evaluation of the developed method. (C) 2016 Elsevier Ltd. All rights reserved.
A Novel Dynamic Baysian Canonical Correlation Analysis Method for Fault Detection

Jiaxin Yu,Zeyu Yang,Le Zhou,Lingjian Ye,Zhihuan Song

DOI: https://doi.org/10.1016/j.ifacol.2020.12.874

2020-01-01

IFAC-PapersOnLine

Abstract:In the field of Multivariate Statistical Process Monitoring (MSPM), process dynamics has always been the focus. Besides, considering the uncertainty in chemical processes, latent variable models are extended to the probabilistic framework, in which maximum likelihood estimation with expectation maximization (EM) algorithm is adopted for parameter learning. However, the modelling performance is restricted owing to the reason that these models either neglect the static characteristics reflecting process structure or suffer from over fitting and local optimum. To tackle these issues, a dynamic Baysian canonical correlation analysis (DBCCA) model is developed through combining the consideration of process dynamics with the variational CCA and utilized for fault detection. More specifically, both static structural characteristics and process dynamics can be simultaneously captured in DBCCA model. In essence, the variational Bayesian approach renders effects of regularization, alleviating the dilemma in traditional maximum likelihood estimation methods by nature. The effectiveness of proposed method is testified on the well-known Tennessee Eastman (TE) benchmark, where improvements are attained.
Mathematical Modeling and Experimental Validation for a 50 Kw Alkaline Water Electrolyzer

Min Liu,Xinyu Zheng,Yansong Jia,Guining Shao,Jianfeng Shi,Sheng Zeng,Kun Wang,Yang Li,Chaohua Gu

DOI: https://doi.org/10.3390/pr12122616

IF: 3.5

2024-01-01

Processes

Abstract:Due to its high maturity and low cost, alkaline water electrolysis (AWE) technology has been widely integrated with large-scale renewable energy systems (RESs) for green hydrogen (H2) production. Here, to evaluate the operational performance of a 50 kW AWE electrolyzer under different operation conditions, we developed an empirical modeling and experimental validation approach. The model particularly focuses on the polarization curve and the hydrogen to oxygen ratio (HTO). The relevant parameters of the empirical model were obtained by fitting the experimental data with MATLAB. The validity and accuracy of the established model and parameters were verified by comparing the fitted values with experimental values, and a good correlation was found. Since the experiments were performed in the sub-cell of 5 MW scale AWE electrolyzers, this model can also predict the performance of industrial MW-scale AWE electrolyzers and serve as a tool for the optimal design and control of industrial AWE electrolyzers. The results demonstrated that the models can achieve an accuracy with an R2 value exceeding 0.95 across a range of operational conditions.
A Novel Fault Detection and Identification Method for Complex Chemical Processes Based on OSCAE and CNN

Shangbo Han,Lining Yang,Dawei Duan,Longchao Yao,Kai Gao,Qingyuan Zhang,Yanwen Xiao,Weihong Wu,Jian Yang,Weijie Liu,Xiang Gao

DOI: https://doi.org/10.1016/j.psep.2024.08.055

IF: 7.8

2024-01-01

Process Safety and Environmental Protection

Abstract:The safety and reliability of chemical processes are of paramount importance. However, due to the complicated heat, mass, and momentum transfer processes coupled with chemical reactions, and the interrelated effects among various equipment units, it is difficult to accurately detect and identify faults occurring in the chemical system. This study proposes an innovative fault diagnosis framework specifically designed for chemical systems. A method based on orthogonal self-attention convolutional autoencoder (OSCAE) is constructed for fault detection. The convolutional autoencoder is combined with an orthogonal attention mechanism to extract time-series characteristic information of the operational state, thereby achieving precise detection of fault conditions. Additionally, a convolutional neural network (CNN) model uses both raw signals and data reconstructed by OSCAE to identify different faults, which enhances the features of the input and enables highly accurate fault identification. The effectiveness and robustness of the propose method is validated with simulation data of our self-established chemical distillation system and the publicly available Tennessee Eastman process system. The diagnosis efficacy in fault detection and identification is validated by applying fault detection metrics, high-dimensional feature visualizations, and confusion matrix analyses across two case studies. This paper not only provides an effective diagnostic framework for chemical systems but also offers a usable benchmark dataset for chemical distillation systems to the academic community, with the hope that the research content can enhance the stability and reliability of chemical processes.
Nonlinear Dynamic System Based on SAE-LDS Model for Fault Diagnosis

Xiaochu Tang,Yi Zhang,Xinmin Zhang,Zhihuan Song

DOI: https://doi.org/10.1109/ddcls61622.2024.10606815

2024-01-01

Abstract:Dynamic, uncertainty and nonlinearity are three very important characteristics of complex industrial process data. In this paper, a method of fault detection and classification based on stacked autoencoder-linear dynamic system (SAE-LDS) model is proposed. This method aims to simultaneously consider multiple characteristics of industrial process data for fault detection and classification. Firstly, the deep learning algorithm SAE is used to mine the nonlinear characteristic of process data. On this basis, the SAE model is embedded into the LDS model. The LDS model is used to further extract the dynamics and uncertainty, so as to establish a SAE-LDS model that can comprehensively consider multiple characteristics of data. Finally, the SAE-LDS model is applied to the TE process, compared with the traditional method for fault detection and fault classification. The experimental results show that SAE- LDS model has good effectiveness.

Dynamic fault detection and diagnosis of industrial alkaline water electrolyzer process with variational Bayesian dictionary learning

Dynamic fault detection and diagnosis for alkaline water electrolyzer with variational Bayesian Sparse principal component analysis

Ontology-Based Fault Diagnosis for Chemical Process

Fault Diagnosis in Chemical Processes Based on WPA and WLS-SVM

Variational Bayesian State Space Model for Dynamic Process Fault Detection

A Variational Bayesian Dictionary Learning for Process Monitoring

A Variable Moving Window Approach for On-Line Fault Diagnosis in Industrial Processes

On-line fault diagnosis in industrial processes using variable moving window and hidden Markov model

Dynamic Process Monitoring Based on Variational Bayesian Canonical Variate Analysis

Online Dynamic Parameter Estimation of an Alkaline Electrolysis System Based on Bayesian Inference

A Variational Bayesian Robust Linear Dynamic System Approach for Dynamic Process Modelling and Fault Detection

An Effective Fault Diagnosis Approach Based on Optimal Weighted Least Squares Support Vector Machine

Dynamic parameter estimation of the alkaline electrolysis system combining Bayesian inference and adaptive polynomial surrogate models

Deep-learning model with flow-leveraged polarization function and set-value cross-attention mechanism for accurate dynamic thermoelectric of alkaline water electrolyzer

Latent and Small Fault Detection and Diagnosis for Dynamic Processes

Supervised Linear Dynamic System Model for Quality Related Fault Detection in Dynamic Processes

A Novel Dynamic Baysian Canonical Correlation Analysis Method for Fault Detection

Mathematical Modeling and Experimental Validation for a 50 Kw Alkaline Water Electrolyzer

A Novel Fault Detection and Identification Method for Complex Chemical Processes Based on OSCAE and CNN

Nonlinear Dynamic System Based on SAE-LDS Model for Fault Diagnosis