Abstract:Monitoring continuously captured surveillance videos is a challenging and time consuming task. To assist this issue, a new framework is introduced that applies anomaly detection, semantic annotation and provides a concept-based search interface. In particular, novel optical flow based features are used for abnormal crowd behaviour detection. Then, processed surveillance videos are annotated using a new semantic metadata model based on multimedia standards using Semantic Web technologies. In this way, globally inter-operable metadata about abnormal crowd behaviours are generated. Finally, for the first time, based on crowd behaviours, a novel concept-based semantic search interface is proposed. In the proposed interface, along with search results (video segments), statistical data about crowd behaviours are also presented. With extensive user studies, it is demonstrated that the proposed concept-based semantic search interface enables efficient search and analysis of abnormal crowd behaviours. Although there are existing works to achieve (a) crowd anomaly detection, (b) semantic annotation and (c) semantic search interface, none of the existing works combine these three system components in a novel framework like the one proposed in this paper. In each system component, we introduce contributions to the field as well as use the Semantic Web technologies to combine and standardize output of different system components; output of the anomaly detection is automatically annotated with metadata and stored to a semantic database. When continuous surveillance videos are processed, only the semantic database is updated. Finally, the user interface queries the updated database for searching/analyzing surveillance videos without changing any coding. Thus, the framework supports re-usability. This paper explains and evaluates different components of the framework.

Detecting Changes in Crowdsourced Social Media Images

Determining Intent of Changes to Ascertain Fake Crowdsourced Image Services

Exif2Vec: A Framework to Ascertain Untrustworthy Crowdsourced Images Using Metadata

Crowdsourcing Detection of Sampling Biases in Image Datasets

A Photo-Based Mobile Crowdsourcing Framework for Event Reporting

CrowdService: Serving the Individuals Through Mobile Crowdsourcing and Service Composition

A novel framework and concept-based semantic search Interface for abnormal crowd behaviour analysis in surveillance videos

A Deep Learning Based Platform for Remote Sensing Images Change Detection Integrating Crowdsourcing and Active Learning

Design and Evaluation of Camera-Centric Mobile Crowdsourcing Applications

A Deep Learning Spatiotemporal Prediction Framework for Mobile Crowdsourced Services

Fcm: A Fine-Grained Crowdsourcing Model Based On Ontology In Crowd-Sensing

Data Leak Aware Crowdsourcing in Social Network

Visual Crowd Analysis: Open Research Problems

Deep Active Learning Framework for Crowdsourcing-Enhanced Image Classification and Segmentation

Novel Change Detection Framework in Remote Sensing Imagery Using Diffusion Models and Structural Similarity Index (SSIM)

Towards Security as a Service to Protect the Critical Resources of Mobile Computing Devices

Automated Service Discovery for Social Internet-of-Things Systems

A Crowd Monitoring Framework using Emotion Analysis of Social Media for Emergency Management in Mass Gatherings

Crowdsourcing Cybersecurity: Cyber Attack Detection using Social Media

Mobile Crowdsourced Sensors Selection for Journey Services

A service relation model for web-based land cover change detection