Memory-Enhanced Spatial-Temporal Encoding Framework for Industrial Anomaly Detection System

Yang Liu,Bobo Ju,Dingkang Yang,Liyuan Peng,Di Li,Peng Sun,Chengfang Li,Hao Yang,Jing Liu,Liang Song
DOI: https://doi.org/10.1016/j.eswa.2024.123718
IF: 8.5
2024-01-01
Expert Systems with Applications
Abstract:The development of modern manufacturing has raised greater demands on the accuracy, response speed, and operating cost of industrial accident warnings. Compared to conventional contact sensors, surveillance cameras can contactlessly capture spatial-temporal information of the open workspace with stable data quality, widely used in industrial process monitoring. However, due to the scarcity of industrial video datasets and the rarity and diversity of abnormal events, existing video -based anomaly detection models perform poorly in manufacturing scenarios. In this regard, we collect two datasets from typical industrial sites and propose a memory -enhanced spatial-temporal encoding (MSTE) framework for automatic industrial anomaly detection. The proposed MSTE framework learns spatial and temporal normality as well as spatial-temporal correlations with parallel structures and simultaneously measures deviations in appearance, motion, and consistency to respond to complex industrial anomalies accurately. Experimental results on public benchmarks and realworld industrial videos show that our method outperforms existing methods and achieves accurate temporal localization of various spatial-temporal anomalies, which helps to improve the safety and reliability of intelligent manufacturing.
What problem does this paper attempt to address?