Interpretable Data-driven Anomaly Detection in Industrial Processes with ExIFFI

Davide Frizzo,Francesco Borsatti,Alessio Arcudi,Antonio De Moliner,Roberto Oboe,Gian Antonio Susto
2024-05-02
Abstract:Anomaly detection (AD) is a crucial process often required in industrial settings. Anomalies can signal underlying issues within a system, prompting further investigation. Industrial processes aim to streamline operations as much as possible, encompassing the production of the final product, making AD an essential mean to reach this goal.Conventional anomaly detection methodologies typically classify observations as either normal or anomalous without providing insight into the reasons behind these classifications.Consequently, in light of the emergence of Industry 5.0, a more desirable approach involves providing interpretable outcomes, enabling users to understand the rationale behind the results.This paper presents the first industrial application of ExIFFI, a recently developed approach focused on the production of fast and efficient explanations for the Extended Isolation Forest (EIF) Anomaly detection method. ExIFFI is tested on two publicly available industrial datasets demonstrating superior effectiveness in explanations and computational efficiency with the respect to other state-of-the-art explainable AD models.
Machine Learning,Artificial Intelligence
What problem does this paper attempt to address?
The paper primarily aims to address the issue of Anomaly Detection (AD) in industrial environments, with a particular focus on improving the interpretability of anomaly detection models. Specifically, the paper proposes a new method called ExIFFI, which is a feature importance evaluation algorithm designed specifically for the Extended Isolation Forest (EIF) anomaly detection method. Through ExIFFI, researchers can quickly and efficiently explain how the EIF model makes decisions, thereby helping users understand the logic behind the model's identification of anomalies. Key points in the paper include: - **Background and Motivation**: In the context of the Industrial Internet of Things (IIoT), anomaly detection is crucial for timely identification of system failures. Traditional anomaly detection methods often only provide a classification result of normal or abnormal without explaining the reasons, which limits their value in practical applications. Therefore, with the development of Industry 5.0, researchers are increasingly focusing on the interpretability of models. - **Proposed Method**: The ExIFFI algorithm is designed to provide a quick explanation of the EIF model's decision-making process. It determines the importance of features by evaluating each feature's contribution to the imbalance degree of anomaly samples. - **Experimental Validation**: To validate the effectiveness of ExIFFI, researchers conducted experiments on two public industrial datasets: the Tennessee Eastman Process (TEP) and the Packaging Industry Anomaly Detection (PIADE) datasets. The results show that ExIFFI can not only accurately identify anomalies but also its explanation results align with known causes of anomalies. - **Comparison with Other Methods**: ExIFFI was compared with existing explainable AI methods such as DIFFI, AcME-AD, and KernelSHAP. Experiments indicate that ExIFFI excels in terms of explanation quality and computational efficiency, particularly outperforming other methods in time efficiency. - **Conclusion and Future Work**: ExIFFI provides effective and easy-to-understand explanations for anomaly detection in industrial environments. Future research may explore how to apply ExIFFI to resource-constrained devices to enhance their anomaly detection capabilities. In summary, by proposing the ExIFFI method, the paper addresses the issue of model interpretability in industrial anomaly detection, providing valuable tools and technical support for industrial practice.