Abstract:Video summarization has great potential in many application areas that enable fast browsing and efficient video indexing. Viewers prefer to browse a video summary containing the contents that they enjoy since watching an entire video may be time-consuming. We believe that it is necessary to create an automated tool that is capable of generating personalized video summaries. In this paper, we propose a new event detection-based personalized video summarization framework and deploy it to create film and soccer video summaries. In order to obtain effective event detection performance, we introduce two transfer learning method. The first event detection method is achieved based on the combination of convolutional neural network and support vector machine (CNNs–SVM). The second method is achieved using a fine-tuned summarization network (SumNet) that fuses fine-tuned object and scene networks. In this study, the training data consists of two datasets: (1) a 21K set of web images of back hugging, hand shaking, and standing talking used to detect a film event, and (2) a 30K set of web soccer match images of goals, fouls, and yellow cards to detect soccer events. Given an original video, we first segment it into shots and then use the trained model for event detection. Finally, based on the specification of user preferences, we generate a personalized event-based summary. We test our framework with several film videos and soccer videos. Experimental results demonstrate that the proposed fine-tuned SumNet achieves the best performance of 96.88% and \(98.50\%\), which is effective for generating personalized video summaries.

CrowdStory

Creating Personalized Video Summaries Via Semantic Event Detection

SentiStory: Multi-Grained Sentiment Analysis and Event Summarization with Crowdsourced Social Media Data

Social Media Based Event Summarization by User–text–image Co-Clustering

Summarizing Complex Events: a Cross-Modal Solution of Storylines Extraction and Reconstruction.

Storia: Summarizing Social Media Content based on Narrative Theory using Crowdsourcing

Comprehensive Event Storyline Generation from Microblogs

Event Detection and Summarization on Microblogs

Building the Multi-Modal Storytelling of Urban Emergency Events Based on Crowdsensing of Social Media Analytics

An Efficient Approach to Summarizing Events from Microblogs

Towards Effective Event Detection, Tracking And Summarization On Microblog Data

Toward Real-Time And Cooperative Mobile Visual Sensing And Sharing

Cross the Data Desert: Generating Textual-Visual Summary on the Evolutionary Microblog Stream

Event Sensing and Multimodal Event Vein Generation Leveraging Social Media

Summarizing Events from Massive News Reports on the Web

$$E^2SGM$$: Event Enrichment and Summarization by Graph Model

Optimized Event Storyline Generation Based on Mixture-Event-Aspect Model.

A Participant-based Approach for Event Summarization Using Twitter Streams.

TRACES: Generating Twitter Stories Via Shared Subspace and Temporal Smoothness

Generating Event Storylines from Microblogs

News Event Summarization Complemented by Micropoints.