CLformer: Constraint-based Locality Enhanced Transformer for Anomaly Detection of Ancient Building Structures
Yuhan Wu,Yabo Dong,Wentao Zhu,Junru Zhang,Shijie Liu,Dongming Lu,Nan Zeng,Yinhui Li
DOI: https://doi.org/10.1016/j.engappai.2023.107072
IF: 8
2023-01-01
Engineering Applications of Artificial Intelligence
Abstract:Ancient buildings are valuable heritage and non-renewable resources. Existing warning mechanisms typically rely on degradation causation analysis. However, it has limitations of complex research, poor generalization, and inadequate warnings. To address these challenges, we propose a novel algorithm, the core component is the constraint-based locality enhanced transformer (CLformer), leveraging multi-scale causal convolution (MSCC) to enhance the local features extraction. Utilizing a generative prediction to reduce error accumulation and improve accuracy. Additionally, a block recurrent prediction strategy is introduced to further optimize the model, reducing the time complexity to O(Lk∙k2) and the space complexity to O(k2), accelerating the inference speed and run efficiency. Then, CLformer is compared with five other models using two ancient building cases. The results show that the root mean square error (RMSE) and mean absolute error (MAE) of CLformer have significantly improved, and the area under the receiver operating characteristic curve (AUC) value is the largest, which proves its superiority and effectiveness. The generalization and robustness are validated through ablation experiments and six additional real cases. Finally, the algorithm is implemented in engineering and employed in practice, providing valuable guidelines and applications for the conservation of ancient buildings worldwide.