Abstract:Social event is something that occurs at specific place and time associated with some specific actions, and it consists of many stories over time. With the explosion of Web 2.0 platforms, a popular social event that is happening around us and around the world can spread very fast. As a result, social event analysis becomes more and more important for users to understand the whole evolutionary trend of social event over time. However, it is very challenging to do social event analysis because social event data from different social media sites have multi-modal, multi-domain, and large-scale properties. The goal of our research is to design advanced multimedia techniques to deal with the above issues and establish an effective and robust social event analysis framework for social event representation, detection, tracking and evolution analysis. (1) For social event representation, we propose a novel cross-domain collaborative learning algorithm based on non-parametric Bayesian dictionary learning model. It can make use of the shared domain priors and modality priors to collaboratively learn the data's representations by considering the domain discrepancy and the multi-modal property.(2) For social event detection, we propose a boosted multi-modal supervised Latent Dirichlet Allocation model. It can effectively exploit multi-modality information and utilize boosting weighted sampling strategy for large-scale data processing. (3) For social event tracking, we propose a novel multi-modal event topic model, which can effectively model the correlations between textual and visual modalities, and obtain their topics over time. (4) For social event evolution analysis, we propose a novel multi-modal multi-view topic-opinion mining model to conduct fined-grained topic and opinion analysis for social events from multiple social media sites collaboratively. It can discover multi-modal topics and the corresponding opinions over time to understand the evolutionary processes of social event. Extensive experimental results show that the proposed algorithms perform favorably against state-of-the-art methods for social event analysis.

A Crowd Monitoring Framework using Emotion Analysis of Social Media for Emergency Management in Mass Gatherings

Crowd Sensing of Urban Emergency Events Based on Social Media Big Data

Anomaly Detection and Localisation in the Crowd Scenes Using a Block-Based Social Force Model

Topic-Emotion Propagation Mechanism of Public Emergencies in Social Networks

From Faces to Traffic Lights: A Multi-Scale Approach for Emotional State Representation

Abnormal Behavior Learning Based on Edge Computing toward a Crowd Monitoring System

Detecting and Quantifying Crowd-Level Abnormal Behaviors in Crowd Events

Crowdsourcing Based Description of Urban Emergency Events Using Social Media Big Data

A Generic Framework for Social Event Analysis.

Contextual Enrichment of Crowds from Mobile Phone Data through Multimodal Geo-Social Media Analysis

Exploiting Community Emotion for Microblog Event Detection

Towards a Dedicated Computer Vision Tool set for Crowd Simulation Models

Analysis of Unstructured High-Density Crowded Scenes for Crowd Monitoring

Understanding Crowd Behaviors in a Social Event by Passive WiFi Sensing and Data Mining

Public Place Crowd Transaction Monitoring System

Advancements In Crowd-Monitoring System: A Comprehensive Analysis of Systematic Approaches and Automation Algorithms: State-of-The-Art

Measuring Online Emotional Reactions to Events

An emotional crowd simulation method based on audiovisual linkage for terrorist attacks

Emotion-Based Crowd Simulation Model Based on Physical Strength Consumption for Emergency Scenarios

Crowdsourcing based spatial mining of urban emergency events using social media

Participatory Sensing-Based Semantic and Spatial Analysis of Urban Emergency Events Using Mobile Social Media