Enhancing Anomaly Detection for Cultural Heritage via Long Short-Term Memory with Attention Mechanism

Yuhan Wu,Yabo Dong,Zeyang Shan,Xiyu Meng,Yang He,Ping Jia,Dongming Lu
DOI: https://doi.org/10.3390/electronics13071254
IF: 2.9
2024-03-29
Electronics
Abstract:Cultural heritages are invaluable and non-renewable resources. Existing warning mechanisms usually rely on degradation analysis to assess environmental risk factors. However, they have limitations such as complex research, poor generalization, and inadequate warnings. To address these issues, we propose a hybrid model that combines the long short-term memory network (LSTM) and attention mechanisms with environmental factors to detect anomalies in cultural heritage. The attention mechanism extracts temporal dependencies, while LSTM captures global long-term patterns, enhancing the reconstruction capability. Additionally, we introduce the seasonal, trend, shapelet, and mixed anomalies to enrich the positive and negative samples and propose a novel threshold extraction method to reduce the reliance on prior knowledge. Extensive experiments demonstrate that LSTM-Attention outperforms previous methods, with a root mean square error (RMSE) of 34.328, mean absolute error (MAE) of 27.060, and the largest area under the receiver operating characteristic curve (AUC) value, highlighting the superiority and effectiveness of our method. The ablation study proves the contribution of the attention mechanism, and the reconstruction step can be flexibly adjusted according to practical needs. Finally, the algorithm has been successfully implemented in engineering and employed in practice, providing valuable guidelines for the preservation of ancient buildings worldwide.
engineering, electrical & electronic,computer science, information systems,physics, applied
What problem does this paper attempt to address?
### Problems Addressed by the Paper This paper aims to enhance anomaly detection capabilities in cultural heritage by combining Long Short-Term Memory (LSTM) networks and attention mechanisms. Specifically, the paper addresses the following key issues: 1. **Limitations of Existing Early Warning Mechanisms**: - Existing early warning mechanisms typically rely on analyzing the degradation of cultural heritage to assess environmental risk factors. However, these methods face issues such as complexity in research, poor generalization ability, and insufficient early warning. 2. **Scarcity of Anomalous Data**: - The daily state of ancient buildings is relatively stable, resulting in very limited anomalous data. To enhance the robustness and generalization ability of the model, the paper introduces seasonal, trend, shape subsequences, and mixed anomalies to expand the dataset. 3. **Accuracy and Generalization Ability of the Model**: - By combining the attention mechanism with LSTM, a new LSTM-Attention model is proposed to better extract temporal dependencies in monitoring data, thereby improving the prediction accuracy of the model. 4. **Threshold Extraction Method**: - A new threshold extraction method based on Extreme Value Theory (EVT) and Recurrence Interval Calculation (RIC) is proposed to reduce dependence on prior knowledge and automatically extract different early warning threshold intervals. ### Main Contributions 1. **Novel Algorithm**: - A novel algorithm combining environmental factors and the structure of ancient buildings is proposed to improve prediction accuracy. 2. **Data Augmentation Strategy**: - Seasonal, trend, shape subsequences, and mixed anomalies are introduced to increase the positive and negative samples in the dataset. 3. **Application of Attention Mechanism**: - The attention mechanism is introduced into anomaly detection of ancient buildings and combined with the LSTM architecture to more effectively extract intrinsic features of monitoring data, especially temporal dependencies. 4. **New Threshold Extraction Method**: - A new threshold extraction method based on Extreme Value Theory and Recurrence Interval Calculation is proposed, reducing dependence on prior knowledge and allowing automatic extraction of different early warning threshold intervals. 5. **Practical Application**: - An anomaly early warning program is implemented and deployed, providing guidance for the protection of cultural heritage at other locations. Through these methods, the paper proposes a practical and effective solution for preventing potential damage to ancient buildings.