Utilizing enhanced deep learning methods for residential burglary detection via analysis of human behavior patterns

Pavithra, S.,Muruganantham, B.
DOI: https://doi.org/10.1007/s11042-024-19097-9
IF: 2.577
2024-04-26
Multimedia Tools and Applications
Abstract:Residential burglary is a severe crime that affects millions of residents each year. It is critical to analyze patterns of human behavior in surveillance video data and discover suspicious actions to avoid and deter this crime. However, the complexity and diversity of human behavior make this undertaking challenging. In this research, we provide a unique system that uses advanced deep learning algorithms to detect abnormal actions that signal burglar attempts at time intervals. We use the state-of-the-art object identification method YOLOv7 to detect an object and its trajectories in video data. We additionally extract the time intervals between the object's movements and utilize them as a categorization feature. Based on the COCO dataset and three videos of distinct scenarios: abnormal activity, burglary attempt, and false alarm, we evaluate our system with earlier versions of YOLO and additional detection methods. On the COCO dataset, our method outperforms all other models with a precision of 93.9%, an f1 score of 94.42%, a recall of 94.71, and an accuracy of 95%. We also show that our algorithm can effectively discriminate between suspicious and normal behaviors based on the motion region's length, width, energy, and orientation variance, achieving an accuracy of 92% on average over three videos. Our system can provide practical domestic protection by automatically detecting and preventing burglary attempts and violent scenarios. Our method can also contribute to the advancement of knowledge in the fields of human behavior analysis and object recognition.
computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
What problem does this paper attempt to address?