Supervised abnormal event detection based on ChatGPT attention mechanism
Feng Tian,Yuanyuan Lu,Fang Liu,Guibao Ma,Neili Zong,Xin Wang,Chao Liu,Ningbin Wei,Kaiguang Cao
DOI: https://doi.org/10.1007/s11042-024-18551-y
IF: 2.577
2024-02-18
Multimedia Tools and Applications
Abstract:Aiming at the problem of abnormal target occlusion and unclearness caused by insufficient light and different shooting angles during abnormal event detection, referring to the idea of Chat GPT using attention mechanism to conduct a large number of text training to learn dialogue mode and structure, a supervised abnormal event detection model integrating attention learning is proposed. The model consists of a target detection module and a behavior classification module. Firstly, the target detection network YOLOv7 is used as the basic model to extract the foreground target. Secondly, the three-channel attention module CSAM of Chat GPT is integrated. Through spatial attention, channel attention and self-attention, the problem of target occlusion and target ambiguity can be effectively solved. Finally, the relevant output of the C3 D network model is extracted as the spatio-temporal feature of the foreground target, and the abnormal event detection is realized by classifying the positive and abnormal events through the full connection layer and the activation function. In this paper, AUC evaluation index is used to conduct experiments on public datasets UCSD and UCF-Crime. The results showed that the AUC value of abnormal event detection in UCSD reached 93.17, and the AUC value in UCF-Crime reached 89.13. This method effectively improves the accuracy of abnormal event detection, reduces the rate of missed detection and error detection, and has practical application value.
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering