Abstract:With the rapidly increasing popularity of social media sites, a large amount of user-generated data has been injected into the web. The data include a wide variety of real-world events. As a consequence, especially for social multimedia objects, it has become increasingly difficult to allow the browsing and organization of multimedia collections in a more effective manner. The approach we propose in this study addresses this problem, thus enabling the browsing and organization of multimedia collections in a natural way, i.e., by events. There have been some research studies on this problem. However, most of the previous approaches merge multiple types of features (e.g., textual content, visual content, user information and temporal information) of social media using a relatively simple mechanism. In this study, we merge multiple types of features in an integrated manner to identify the event associated with user-contributed social multimedia objects. We exploit the correlations between different types of features, i.e., textual content, visual content, user information and temporal information, to classify new social multimedia objects into their corresponding event categories. We accomplish this through a feature correlation graph ( FCG ) that uses features as nodes and the correlations among these features as edges for each event and individual multimedia object. We then employ a probabilistic model based on Markov random field to connect each new multimedia object with the correct event. We evaluate the algorithm on large-scale, real-world datasets of event images downloaded from Flickr, and the experimental results confirm the superiority of our approach over state-of-the-art approaches.

Multimodal Topic Modeling Based Geo-Annotation For Social Event Detection In Large Photo Collections

Topic Based Context-Aware Travel Recommendation Method Exploiting Geotagged Photos

Location Prediction of Social Images via Generative Model

A Geographic Topic Model with Author Relationship

Knowledge-Based Topic Model for Multi-Modal Social Event Analysis

Distance Metric Learning from Uncertain Side Information with Application to Automated Photo Tagging

Multi-Modal Event Topic Model for Social Event Analysis.

Multi-modal multi-layered topic classification model for social event analysis

A Spatial‐temporal‐semantic Approach for Detecting Local Events Using Geo‐social Media Data

A Survey on Multi-Modal Social Event Detection.

Visual topic model for web image annotation.

Multimodal Collaboration Networks for Geospatial Vehicle Detection in Dense, Occluded, and Large-Scale Events

Geo-informative discriminative image representation by semi-supervised hierarchical topic modeling

Multimodal Information Joint Learning for Geotagged Image Search.

Using Local Discriminant Topic To Improve Generative Model Based Image Annotation

Topic models for image annotation and text illustration

Segmentation and recognition of multi-model photo event

A novel label-based multimodal topic model for social media analysis

Joint Image-Text News Topic Detection and Tracking by Multimodal Topic And-Or Graph

Integrating Multiple Types of Features for Event Identification in Social Images