Abstract:Video summarization facilitates rapid browsing and efficient video indexing in many video browsing website applications, such as sport video highlights, dynamic video cover. In these applications, it is most important to generate user video summaries that capture interesting video content that users prefer. While many existing methods generate video summaries based on low-level features, this paper first proposes to mine large-scale Flickr images and find "interest" and "non-interest" images from Flickr for the same query to learn what is of interest to users. Unlike existing pairwise ranking-based methods for video summarization, we then propose an improved triplet deep ranking model that is easier to converge to learn the relationship between "interest" and "non-interest" Flickr images, and exploit what visual content of the original video is indeed preferred by users. In the training process, triplets (interest image p+, interest image p '+, non-interest image p '') are selected as input to train a model with three parallel deep convolutional networks. In the video summarization process, an efficient entropy-based video segmentation method is proposed for dividing the original video into segments and the visual interest scores of the segments are estimated using the trained ranking network for summarization (SumNet). Then, an optimal subset of the segments is selected to create a summary capturing interesting visual content. We evaluate and compare our method with several state-of-the-art methods, experimental results show that our method achieves an improvement over the best baseline method by 9.6% in terms of mean Average Precision (mAP) accuracy.

An Adaptive and Link-Based Method for Video Scene Clustering and Visualization

Real-Time, Adaptive, and Locality-Based Graph Partitioning Method for Video Scene Clustering

Learning User Interest with Improved Triplet Deep Ranking and Web-Image Priors for Topic-Related Video Summarization.

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

Video abstraction based on the visual attention model and online clustering

Video Scene Clustering by Graph Partitioning

Video Abstraction via Attention Model and On-Line Clustering

A novel video abstraction method based on fast clustering of the regions of interest in key frames

Hierarchical Video Data Modeling and Indexing for Virtual Scene Construction

Unsupervised Sports Video Scene Clustering And Its Applications To Story Units Detection

An Efficient Scene Detection Using Rough Set-Based Fuzzy Clustering for Film Video

On Model-Based Clustering of Video Scenes Using Scenelets.

Efficient shot cluster-based scene detection method for movie video retrieval

Video Shot Grouping Using Best-First Model Merging

An Unsupervised Approach To Dominant Video Scene Clustering

Optimized Video Scene Segmentation.

Video Presentation Board : A Semantic Visualization of Video Sequence

Video Scene Segmentation Using Sequential Change Detection

Towards Hierarchical Context: Unfolding Visual Community Potential for Interactive Video Retrieval

Automatic Video Summarization By Discovering Frequent Patterns With Support Vector Clustering

Adaptive Key Frame Extraction Using Unsupervised Clustering