Abstract:The growing concern over high-profile violence has led to a widespread adoption of intelligent smart video surveillance systems in educational institutions. However, accurately identifying abnormal events in the video stream remains a complex task due to the absence of a definitive generic definition for abnormal actions, heavily reliant on contextual factors. In this paper, we propose a fog-assisted abnormal motion recognition system utilizing an ontology-based semantic algorithm to bolster security within university campuses under real-time surveillance. Our ontology-based semantic analysis is meticulously designed to characterize intricate spatio-temporal interactions and contextual relationships in the video scene, thereby significantly improving the sensitivity in distinguishing abnormal events based on their severity level. To ensure swift responses to specific abnormal events, the video streams captured through surveillance cameras are processed at the edge of the network. Prior to semantic analysis, two crucial steps—foreground object segmentation and object tracking—are executed to streamline the detection process. These steps involve segmenting the target foreground using a connected components labeling algorithm and tracking motion patterns based on velocity, direction, and acceleration, employing the Kalman filter. The rule-based reasoning of the ontology accurately defines abnormal conditions in the video scene, providing a clearer understanding of the decision-making process. Furthermore, we incorporate a context-aware refinement step aimed at enhancing detection accuracy. This step distinguishes abnormal events based on their severity and generates corresponding alerts. We conducted extensive experiments and evaluated the proposed system using various measures, demonstrating its potential in real-time video analysis. The results showcase an impressive prediction success ratio of 0.989, affirming the reliability and robustness of our system in detecting abnormal events.

Towards a Forensic Event Ontology to Assist Video Surveillance-based Vandalism Detection

Event Composition with Imperfect Information for Bus Surveillance

Fog-Assisted Abnormal Motion Detection System: A Semantic Ontology Approach

Event Description and Detection in Cyber-Physical Systems: an Ontology-Based Language and Approach

Abnormal Event Recognition: A Hybrid Approach Using SemanticWeb Technologies

Event Analogy Based Privacy Preservation In Visual Surveillance

Ontology-based Surveillance Video Archive and Retrieval System

Large Scale Audio-Visual Video Analytics Platform for Forensic Investigations of Terroristic Attacks

A Framework for an Event Driven Video Surveillance System

Ontology-driven Event Type Classification in Images

Security Event Recognition for Visual Surveillance

A complete formalized knowledge representation model for advanced digital forensics timeline analysis

Logical concept mapping and social media analytics relating to cyber criminal activities for ontology creation

Robust Detection of Critical Events in the Context of Railway Security Based on Multimodal Sensor Data Fusion

OntoED: Low-resource Event Detection with Ontology Embedding

Semantic based representing and organizing surveillance big data using video structural description technology

A Smart City Infrastructure Ontology for Threats, Cybercrime, and Digital Forensic Investigation

How Ontologies Have Supported Digital Forensics: Review and Recommendations

Ontology-Based Event Modeling and High-Confidence Processing in IoT-Enabled High-Speed Train Control System

Visual Semantic Multimedia Event Model for Complex Event Detection in Video Streams

Recent Advances in Video Analytics for Rail Network Surveillance for Security, Trespass and Suicide Prevention—A Survey