Data-Driven Fault Detection and Reasoning for Industrial Monitoring

Jing Wang,Jinglin Zhou,Xiaolu Chen

DOI: https://doi.org/10.1007/978-981-16-8044-1

2022-01-01

Abstract:This book assesses the potential of data-driven methods in industrial process monitoring engineering and establishes a basic framework for this topic This is an open access book.

What problem does this paper attempt to address?

Rapid Sensor Fault Detection in Process Industry

Xiao-Qin BAI,Lian-kui DAI

DOI: https://doi.org/10.3969/j.issn.1000-3932.2008.01.009

2008-01-01

Abstract:According to statistic analysis of large real industry data,the variance of measured data can be a good characterization of the sensor's steady-state performance.So a rapid sensor fault detection algorithm was presented,and on the basis of the algorithm developed an online sensor fault detection system.Detection database was the core of the system,which included real-time data acquisition,online fault detection,preservation and query of fault data,self-study of eetection parameters,remote access and so on.The application results in actual industrial process show that this fault detection method can rapidly detect early fault with clear physical meaning.It applies to large-scale industrial processes.
Concurrent Fault Detection and Anomaly Location in Closed-Loop Dynamic Systems with Measured Disturbances.

Kai Wang,Junghui Chen,Zhihuan Song

DOI: https://doi.org/10.1109/tase.2018.2865628

IF: 6.636

2019-01-01

IEEE Transactions on Automation Science and Engineering

Abstract:Most data-driven process monitoring approaches consider the fault detection as a binary classification issue: normal or abnormal. All deviations from the nominal operating condition can trigger the same alarms. They fail to distinguish different fluctuation patterns and locate the positions of anomalies, such as the normal deviations in operating conditions, sensors faults, actuator faults, and process faults. A new process monitoring strategy based on orthogonal decomposition (OD) is proposed for the concurrent detection and location of different deviation patterns. OD is performed to discriminate the dynamics of data driven by measured disturbances and unmeasured disturbances in the same control system. This way, the original variable space is decomposed into the deterministic subspace and stochastic subspace. A dynamic principal component analysis-based subspace identification technique is used to construct the monitoring indices in the deterministic and stochastic subspaces, respectively. Two case studies show the validity of the OD-based process monitoring approach. Note to Practitioners—Fault diagnosis based on process data models always focused on analyzing variables’ contributions to the anomaly in the past practice. But it is frequently difficult to decide the root causes just using the variables’ contributions because different faults may induce a similar variation of the same variable. This paper provides a new scheme to locate the faulty components, including the sensor faults, actuator faults, process faults, and disturbance variations. It is more pertinent to learn about the fault locations than variables’ contributions. Moreover, by locating faults first and then figuring out variables’ contributions to a specific location, more detailed and precise diagnosis conclusions can be drawn when being compared with the results of using the variables’ contributions in a global system. This new method is purely data driven and it has no demand for complex process knowledge.
Data-Driven Process Monitoring and Fault Diagnosis: A Comprehensive Survey

Afrânio Melo,Maurício Melo Câmara,José Carlos Pinto

DOI: https://doi.org/10.3390/pr12020251

IF: 3.5

2024-01-24

Processes

Abstract:This paper presents a comprehensive review of the historical development, the current state of the art, and prospects of data-driven approaches for industrial process monitoring. The subject covers a vast and diverse range of works, which are compiled and critically evaluated based on the different perspectives they provide. Data-driven modeling techniques are surveyed and categorized into two main groups: multivariate statistics and machine learning. Representative models, namely principal component analysis, partial least squares and artificial neural networks, are detailed in a didactic manner. Topics not typically covered by other reviews, such as process data exploration and treatment, software and benchmarks availability, and real-world industrial implementations, are thoroughly analyzed. Finally, future research perspectives are discussed, covering aspects related to system performance, the significance and usefulness of the approaches, and the development environment. This work aims to be a reference for practitioners and researchers navigating the extensive literature on data-driven industrial process monitoring.

engineering, chemical
A Review on Data-Driven Process Monitoring Methods: Characterization and Mining of Industrial Data

Cheng Ji,Wei Sun

DOI: https://doi.org/10.3390/pr10020335

IF: 3.5

2022-02-10

Processes

Abstract:Safe and stable operation plays an important role in the chemical industry. Fault detection and diagnosis (FDD) make it possible to identify abnormal process deviations early and assist operators in taking proper action against fault propagation. After decades of development, data-driven process monitoring technologies have gradually attracted attention from process industries. Although many promising FDD methods have been proposed from both academia and industry, challenges remain due to the complex characteristics of industrial data. In this work, classical and recent research on data-driven process monitoring methods is reviewed from the perspective of characterizing and mining industrial data. The implementation framework of data-driven process monitoring methods is first introduced. State of art of process monitoring methods corresponding to common industrial data characteristics are then reviewed. Finally, the challenges and possible solutions for actual industrial applications are discussed.

engineering, chemical
A Data-Driven Fault Detection Framework Using Mahalanobis Distance Based Dynamic Time Warping

Yulin Si,Zheng Chen,Jili Sun,Dahai Zhang,Peng Qian

DOI: https://doi.org/10.1109/ACCESS.2020.3001379

IF: 3.9

2020-01-01

IEEE Access

Abstract:Fault detection module is one of the most important components in modern industrial systems. In this paper, we propose a novel fault detection framework which makes use of both normal and faulty measurement signals at the same time. In this framework, the multivariate time series (MTS) pieces which are extracted from measurement signals in a time interval are used as the training and testing samples, and a -nearest neighbour rule of MTS pieces is applied for fault detection. Moreover, a Mahalanobis distance based dynamic time warping method is used to measure the divergence among MTS pieces, and a one-class metric learning algorithm is proposed to learn the appropriate Mahalanobis distance. Experimental results on the Tennessee Eastman process demonstrate that the proposed method has improved fault detection performance compared with classical approaches on certain kinds of faults.
A Review of Data Driven-based Incipient Fault Diagnosis

Cheng-Lin WEN,Fei-Ya LV,Zhe-Jing BAO,Mei-Qin LIU

DOI: https://doi.org/10.16383/j.aas.2016.c160105

2016-01-01

Abstract:As timely incipient fault diagnosis is the key to guarantee operation safety and suppress fault deterioration, this paper gives a review of data driven-based researches for incipient faults, which have low amplitude and may be covered by system disturbance and noise easily. Data driven-based incipient fault diagnosis can be divided into three parts, i.e., statistical analysis-based technology, signal processing-based technology, artificial intelligence-based technology. Their basic ideas, research progresses, application and limitations are discussed in detail. Furthermore, this paper not only points out the existing problems about complex systems, but also looks forward to the advance of this area by means of adding new information, mining unused implied information, using new mathematical tools. Finally, four thoughts worth exploring are proposed: diagnosis based on correlation analysis, multi-source information fusion, machine learning and time-frequency transform.
A Review of Real-Time Fault Diagnosis Methods for Industrial Smart Manufacturing

Wenhao Yan,Jing Wang,Shan Lu,Meng Zhou,Xin Peng

DOI: https://doi.org/10.3390/pr11020369

IF: 3.5

2023-01-25

Processes

Abstract:In the era of Industry 4.0, highly complex production equipment is becoming increasingly integrated and intelligent, posing new challenges for data-driven process monitoring and fault diagnosis. Technologies such as IIoT, CPS, and AI are seeing increasing use in modern industrial smart manufacturing. Cloud computing and big data storage greatly facilitate the processing and management of industrial information flow, which helps the development of real-time fault diagnosis (RTFD) technology. This paper provides a comprehensive review of the latest RTFD technologies in the field of industrial process monitoring and machine condition monitoring. The RTFD process is introduced in detail, starting with the data acquisition process. The current RTFD methods are divided into methods based on independent feature extraction, methods based on "end-to-end" neural networks, and methods based on qualitative knowledge reasoning from a new perspective. In addition, this paper discusses the challenges and potential trends of RTFD in future development to provide a reference for researchers focusing on this field.

engineering, chemical
Industrial Big Data for Fault Diagnosis: Taxonomy, Review, and Applications

Yan Xu,Yanming Sun,Jiafu Wan,Xiaolong Liu,Zhiting Song

DOI: https://doi.org/10.1109/access.2017.2731945

IF: 3.9

2017-01-01

IEEE Access

Abstract:Fault diagnosis is an important topic both in practice and research. There is intense pressure on industrial systems to continue reducing unscheduled downtime, performance degradation, and safety hazards, which requires detecting and recovering from potential faults as early as possible. From the historical perspective, this paper divides fault diagnosis into previous research and industrial big data era. According to primary drivers, this paper classifies fault diagnosis into knowledge-driven, data-driven, and value-driven methods. Among them, the former two approaches belong to the previous research on fault diagnosis. They mainly depend on expert experience and shallow models to detect and extract failures from relatively small size data. With the continuous exponential growth of data, it is insufficient to mine valuable fault information from massive multi-source heterogeneous data. The huge diagnostic value embodied in industrial big data has driven the emergence of the third category, which belongs to fault diagnosis based on big data. It consists of big data processing and analysis corresponding to high efficiency, cost effectiveness, and generality, which can deal well with problems that previous methods faced. We introduce the concept of a device electrocardiogram from the perspective of applicability to outline the present status of fault diagnosis for big data, and compare it with traditional diagnostic system. We also discuss issues and challenges that need to be further considered. It would be great valuable to integrate or explore more advanced diagnostic methods to handle collected industrial big data and put them into practice to mine the huge hidden diagnostic value.

computer science, information systems,telecommunications,engineering, electrical & electronic
Plant-Wide Industrial Process Monitoring: A Distributed Modeling Framework

Zhiqiang Ge,Junghui Chen

DOI: https://doi.org/10.1109/tii.2015.2509247

IF: 12.3

2016-01-01

IEEE Transactions on Industrial Informatics

Abstract:With the growing complexity of the modern industrial process, monitoring large-scale plant-wide processes has become quite popular. Unlike traditional processes, the measured data in the plant-wide process pose great challenges to information capture, data management, and storage. More importantly, it is difficult to efficiently interpret the information hidden within those data. In this paper, the road map of a distributedmodeling framework for plant-wide process monitoring is introduced. Based on this framework, the whole plant-wide process is decomposed into different blocks, and statistical data models are constructed in those blocks. For online monitoring, the results obtained from different blocks are integrated through the decision fusion algorithm. A detailed case study is carried out for performance evaluation of the plant-wide monitoring method. Research challenges and perspectives are discussed and highlighted for future work.
Data-driven sensor fault diagnosis systems for linear feedback control loops

Kai Wang,Junghui Chen,Zhihuan Song

DOI: https://doi.org/10.1016/j.jprocont.2017.03.001

IF: 3.951

2017-01-01

Journal of Process Control

Abstract:•Dynamic modeling with feedback control using state space models.•Decoupled residual generation design for multivariate control loops.•Residual evaluation for detecting and isolating incipient sensor faults.•Multi-class detectable sensor faults, i.e. biases, drifts and precision degradation.
Fault detection of wind turbine system based on data-driven methods: a comparative study

Lamiaa M. Elshenawy,Ahmed A. Gafar,Hamdi A. Awad,Mahmoud S. AbouOmar

DOI: https://doi.org/10.1007/s00521-024-09604-2

2024-03-14

Neural Computing and Applications

Abstract:Abstract Fault detection plays a crucial role in ensuring the safety, availability, and reliability of modern industrial processes. This study focuses on data-driven fault detection methods, which have gained significant attention across various industrial sectors due to the rapid development of industrial automation technologies and the availability of extensive datasets. The objectives of this paper are to comprehensively review and present the theoretical foundations of widely used data-driven fault detection approaches. Specifically, these approaches are applied to fault detection in wind turbine systems, with performance evaluation conducted using multiple statistical measures. The data utilized in this study were collected from a simulated benchmark of a wind turbine system. The data-driven methods are tested under the assumption that the wind turbine operates in a steady-state region. Additionally, a comparative study is conducted to identify and discuss the primary challenges associated with the practical application of these methods in real-world scenarios. Simulation results show the effectiveness and efficacy of data-driven approaches concerning the sensitivity and robustness of wind turbine sensor faults as applied in practical industrial environments.

computer science, artificial intelligence
An integrated methodology for system-level early fault detection and isolation

Jinxin Wang,Xiuquan Sun,Chi Zhang,Xiuzhen Ma

DOI: https://doi.org/10.1016/j.eswa.2022.117080

IF: 8.5

2022-09-01

Expert Systems with Applications

Abstract:Fault diagnosis is an indispensable technique to ensure the high-performance operation of a mechanical system during its life-cycle. Existing research works mainly limits in the diagnosis of single component or some certain components of interest. The systematic investigation of fault diagnosis for a full system is rare, making it inefficient to implement the method developed in the practice of a complete engineering system. In this paper, a system-level fault diagnosis methodology is proposed based on fault behaviour analysis, optimal sensor placement and intelligent data analytics for multiple fault detection and isolation in a complex machine system. A dynamical model of a mechanical system is firstly constructed using Bond graph, and the response characteristics of observable parameters under different faults are derived by analysing the functional relationships of system variables. A set partitioning theory-based sensor placement approach is then presented for designing a condition monitoring system with a quantity-optimal set of sensors for a desired performance of fault isolatability. Two multivariate statistic measures, i.e. Hotelling's T2 and Q are calculated from the system operation parameters as the indices to detect the potential faults. The abnormal parameters are separated by constructing a contribution plot once a fault is reported. The separated abnormal parameters are then input to a Bayesian network model, and the real root cause of the abnormity is isolated by blending the observations with expert knowledge of diagnosis. The diesel engine lubrication system, which involves three common domains: mechanical, hydraulic and thermodynamic processes, is taken as an example to show the implementation and performance of proposed approach. This approach can be used to design a system-level fault diagnosis scheme that including various tasks such as fault behaviour analysis, sensor placement, data collection, data processing, information fusion in order to achieve an accurate fault isolation ultimately.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
Industrial data-driven modeling for imbalanced fault diagnosis

Kuo-Yi Lin,Thitipong Jamrus

DOI: https://doi.org/10.1108/imds-12-2023-0927

IF: 4.803

2024-05-30

Industrial Management & Data Systems

Abstract:Purpose Motivated by recent research indicating the significant challenges posed by imbalanced datasets in industrial settings, this paper presents a novel framework for Industrial Data-driven Modeling for Imbalanced Fault Diagnosis, aiming to improve fault detection accuracy and reliability. Design/methodology/approach This study addressing the challenge of imbalanced datasets in predicting hard drive failures is both innovative and comprehensive. By integrating data enhancement techniques with cost-sensitive methods, the research pioneers a solution that directly targets the intrinsic issues posed by imbalanced data, a common obstacle in predictive maintenance and reliability analysis. Findings In real industrial environments, there is a critical demand for addressing the issue of imbalanced datasets. When faced with limited data for rare events or a heavily skewed distribution of categories, it becomes essential for models to effectively mine insights from the original imbalanced dataset. This involves employing techniques like data augmentation to generate new insights and rules, enhancing the model's ability to accurately identify and predict failures. Originality/value Previous research has highlighted the complexity of diagnosing faults within imbalanced industrial datasets, often leading to suboptimal predictive accuracy. This paper bridges this gap by introducing a robust framework for Industrial Data-driven Modeling for Imbalanced Fault Diagnosis. It combines data enhancement and cost-sensitive methods to effectively manage the challenges posed by imbalanced datasets, further innovating with a bagging method to refine model optimization. The validation of the proposed approach demonstrates superior accuracy compared to existing methods, showcasing its potential to significantly improve fault diagnosis in industrial applications.

computer science, interdisciplinary applications,engineering, industrial
Joint Data-Driven Fault Diagnosis Integrating Causality Graph With Statistical Process Monitoring for Complex Industrial Processes

Jie Dong,Mengyuan Wang,Xiong Zhang,Liang Ma,Kaixiang Peng

DOI: https://doi.org/10.1109/access.2017.2766235

IF: 3.9

2017-01-01

IEEE Access

Abstract:In this paper, an integrated fault diagnosis method is proposed to deal with fault location and propagation path identification. A causality graph is first constructed for the system according to the a priori knowledge. Afterward, a correlation index (CI) based on the partial correlation coefficient is proposed to analyze the correlation of variables in causality graph quantitatively. To achieve accurate fault detection results, the proposed CI is monitored by probability principal component analysis. Moreover, the concept of weighted average value is introduced to identify fault propagation path based on reconstruction-based contribution and causality graph after detecting a fault. Finally, the new proposed scheme would be practiced with real industrial HSMP data, where the individual steps as well as the complete framework were extensively tested.

computer science, information systems,telecommunications,engineering, electrical & electronic
A Novel Decentralized Detection Framework for Quality-Related Faults in Manufacturing Industrial Processes.

Liang Ma,Jie Dong,Changjun Hu,Kaixiang Peng

DOI: https://doi.org/10.1016/j.neucom.2020.11.045

IF: 6

2020-01-01

Neurocomputing

Abstract:Quality-related fault detection is the key subject under process monitoring and fault diagnosis (PM-FD) framework, which is an effective mean to guarantee safety production and obtain reliable product quality, and thus, has recently become active areas of process control fields. In this paper, a novel decentralized detection method for quality-related faults is proposed for manufacturing industrial processes, which will help field engineers to purposefully and real-time observe the operation state of the production process. Specifically, the main innovations are: 1) the linear and nonlinear dynamic interdependencies between process and quality variables are revealed and quantified by the minimal redundancy maximal relevance (mRMR) algorithm, and the most representative variables are selected in each subprocess; 2) a new mixed kernel function based dynamic mixed kernel principal component analysis (DMKPCA) model is designed for enhancing the generalization ability and maintaining the data characteristics of original sample space; 3) unified monitoring statistics are constructed in the subprocess level, and Bayesian fusion is implemented for forming monitoring decisions from the plant-wide level. Finally, a case study on an actual hot rolling mill process (HSMP) is finally given to validate the effectiveness of the proposed scheme, and several competitive methods are applied to carry out the quality-related fault detection process.
A Review on Fault Detection and Process Diagnostics in Industrial Processes

You-Jin Park,Shu-Kai S. Fan,Chia-Yu Hsu

DOI: https://doi.org/10.3390/pr8091123

IF: 3.5

2020-09-09

Processes

Abstract:The main roles of fault detection and diagnosis (FDD) for industrial processes are to make an effective indicator which can identify faulty status of a process and then to take a proper action against a future failure or unfavorable accidents. In order to enhance many process performances (e.g., quality and throughput), FDD has attracted great attention from various industrial sectors. Many traditional FDD techniques have been developed for checking the existence of a trend or pattern in the process or whether a certain process variable behaves normally or not. However, they might fail to produce several hidden characteristics of the process or fail to discover the faults in processes due to underlying process dynamics. In this paper, we present current research and developments of FDD approaches for process monitoring as well as a broad literature review of many useful FDD approaches.

engineering, chemical
Recent Advances in Intelligent Algorithms for Fault Detection and Diagnosis

Paolo Mercorelli

DOI: https://doi.org/10.3390/s24082656

IF: 3.9

2024-04-23

Sensors

Abstract:Fault-finding diagnostics is a model-driven approach that identifies a system's malfunctioning portion. It uses residual generators to identify faults, and various methods like isolation techniques and structural analysis are used. However, diagnostic equipment doesn't measure the remaining signal-to-noise ratio. Residual selection identifies fault-detecting generators. Fault detective diagnostic (FDD) approaches have been investigated and implemented for various industrial processes. However, industrial operations make it difficult to implement FDD techniques. To bridge the gap between theoretical methodologies and implementations, hybrid approaches and intelligent procedures are needed. Future research should focus on improving fault prognosis, allowing for accurate prediction of process failures and avoiding safety hazards. Real-time and comprehensive FDD strategies should be implemented in the age of big data.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
An Automated Machine Learning Approach for Real-Time Fault Detection and Diagnosis

Denis Leite,Aldonso Martins Jr,Diego Rativa,Joao F L De Oliveira,Alexandre M A Maciel

DOI: https://doi.org/10.3390/s22166138

2022-08-17

Abstract:This work presents a novel Automated Machine Learning (AutoML) approach for Real-Time Fault Detection and Diagnosis (RT-FDD). The approach's particular characteristics are: it uses only data that are commonly available in industrial automation systems; it automates all ML processes without human intervention; a non-ML expert can deploy it; and it considers the behavior of cyclic sequential machines, combining discrete timed events and continuous variables as features. The capacity for fault detection is analyzed in two case studies, using data from a 3D machine simulation system with faulty and non-faulty conditions. The enhancement of the RT-FDD performance when the proposed approach is applied is proved with the Feature Importance, Confusion Matrix, and F1 Score analysis, reaching mean values of 85% and 100% in each case study. Finally, considering that faults are rare events, the sensitivity of the models to the number of faulty samples is analyzed.
Intelligent Fault Diagnosis for Industrial Big Data

Jia Si,Yibin Li,Sile Ma

DOI: https://doi.org/10.1007/s11265-017-1316-9

2018-01-09

Journal of Signal Processing Systems

Abstract:With the rapid development of the Internet of Things (IoT), industrial big data can now be collected through many different sources, such as multimedia. Intelligent fault diagnosis is recognized as an important and promising approach in using these data, because it can provide accurate diagnosis and adjust to different deployed environments. In this study, intelligent fault diagnosis approaches for real machine data sets are comprehensively investigated. First, support vector machine (SVM) and popular neural network approaches are implemented and compared. Results show that while the neural network-based method is very efficient in many high-dimensional applications, such as video, SVM performs well enough for intelligent fault diagnosis. Second, the relation between the number of samples and the efficiency of diagnosis are studied, Findings indicate that a small number of samples can produce an optimal result. Furthermore, accuracy does not increase with training data because of the inherent fuzziness of machine monitoring data. Finally, the accuracy of conditioning and diagnosis is demonstrated for several kinds of machine data.

Data-Driven Fault Detection and Reasoning for Industrial Monitoring

Rapid Sensor Fault Detection in Process Industry

Concurrent Fault Detection and Anomaly Location in Closed-Loop Dynamic Systems with Measured Disturbances.

Data-Driven Process Monitoring and Fault Diagnosis: A Comprehensive Survey

A Review on Data-Driven Process Monitoring Methods: Characterization and Mining of Industrial Data

A Data-Driven Fault Detection Framework Using Mahalanobis Distance Based Dynamic Time Warping

A Review of Data Driven-based Incipient Fault Diagnosis

A Review of Real-Time Fault Diagnosis Methods for Industrial Smart Manufacturing

Industrial Big Data for Fault Diagnosis: Taxonomy, Review, and Applications

Plant-Wide Industrial Process Monitoring: A Distributed Modeling Framework

Data-driven sensor fault diagnosis systems for linear feedback control loops

Fault detection of wind turbine system based on data-driven methods: a comparative study

An integrated methodology for system-level early fault detection and isolation

Industrial data-driven modeling for imbalanced fault diagnosis

Joint Data-Driven Fault Diagnosis Integrating Causality Graph With Statistical Process Monitoring for Complex Industrial Processes

A Novel Decentralized Detection Framework for Quality-Related Faults in Manufacturing Industrial Processes.

A Review on Fault Detection and Process Diagnostics in Industrial Processes

Recent Advances in Intelligent Algorithms for Fault Detection and Diagnosis

An Automated Machine Learning Approach for Real-Time Fault Detection and Diagnosis

Intelligent Fault Diagnosis for Industrial Big Data