Abstract:Social event is something that occurs at specific place and time associated with some specific actions, and it consists of many stories over time. With the explosion of Web 2.0 platforms, a popular social event that is happening around us and around the world can spread very fast. As a result, social event analysis becomes more and more important for users to understand the whole evolutionary trend of social event over time. However, it is very challenging to do social event analysis because social event data from different social media sites have multi-modal, multi-domain, and large-scale properties. The goal of our research is to design advanced multimedia techniques to deal with the above issues and establish an effective and robust social event analysis framework for social event representation, detection, tracking and evolution analysis. (1) For social event representation, we propose a novel cross-domain collaborative learning algorithm based on non-parametric Bayesian dictionary learning model. It can make use of the shared domain priors and modality priors to collaboratively learn the data's representations by considering the domain discrepancy and the multi-modal property.(2) For social event detection, we propose a boosted multi-modal supervised Latent Dirichlet Allocation model. It can effectively exploit multi-modality information and utilize boosting weighted sampling strategy for large-scale data processing. (3) For social event tracking, we propose a novel multi-modal event topic model, which can effectively model the correlations between textual and visual modalities, and obtain their topics over time. (4) For social event evolution analysis, we propose a novel multi-modal multi-view topic-opinion mining model to conduct fined-grained topic and opinion analysis for social events from multiple social media sites collaboratively. It can discover multi-modal topics and the corresponding opinions over time to understand the evolutionary processes of social event. Extensive experimental results show that the proposed algorithms perform favorably against state-of-the-art methods for social event analysis.

Cross-Domain Multi-Event Tracking Via Co-Pmht

Multi-Modal Event Topic Model for Social Event Analysis.

Multi-scale Harmonic Mean Time Surfaces for Event-based Object Classification

A General and Parallel Platform for Mining Co-Movement Patterns over Large-scale Trajectories.

Online Multimodal Multiexpert Learning for Social Event Tracking

Robust multi-object tracking via cross-domain contextual information for sports video analysis

PTP: Parallelized Tracking and Prediction With Graph Neural Networks and Diversity Sampling

Multiple Hypothesis Tracking Algorithm for Multi-Target Multi-Camera Tracking with Disjoint Views

TOPIC: A Parallel Association Paradigm for Multi-Object Tracking under Complex Motions and Diverse Scenes

Towards Effective Multi-Moving-Camera Tracking: A New Dataset and Lightweight Link Model

Joint Object Detection and Multi-Object Tracking Based on Hypergraph Matching

PTMOT: A Probabilistic Multiple Object Tracker Enhanced by Tracklet Confidence for Autonomous Driving

Temporal Correlation Meets Embedding: Towards a 2nd Generation of JDE-based Real-Time Multi-Object Tracking

Exploring the State-of-the-Art in Multi-Object Tracking: A Comprehensive Survey, Evaluation, Challenges, and Future Directions

A Generic Framework for Social Event Analysis.

HSTrack: Bootstrap End-to-End Multi-Camera 3D Multi-object Tracking with Hybrid Supervision

Cross-Domain Collaborative Learning in Social Multimedia

Single and Multiple View Detection, Tracking and Video Analysis in Crowded Environments

Towards Generalizable Multi-Object Tracking

Recent Advances in Embedding Methods for Multi-Object Tracking: A Survey

GMT: A Robust Global Association Model for Multi-Target Multi-Camera Tracking