Abstract:The aim of video summarization is to shorten videos automatically while retaining the key information necessary to convey the overall story. Video summarization methods mainly rely on visual factors, such as visual consecutiveness and diversity, which may not be sufficient to fully understand the content of the video. There are other non-visual factors, such as interestingness, representativeness, and storyline consistency that should also be considered for generating high-quality video summaries. Current methods do not adequately take into account these non-visual factors, resulting in suboptimal performance. In this work, a new approach to video summarization is proposed based on insights gained from how humans create ground truth video summaries. The method utilizes a conditional modeling perspective and introduces multiple meaningful random variables and joint distributions to characterize the key components of video summarization. Helper distributions are employed to improve the training of the model. A conditional attention module is designed to mitigate potential performance degradation in the presence of multi-modal input. The proposed video summarization method incorporates the above innovative design choices that aim to narrow the gap between human-generated and machine-generated video summaries. Extensive experiments show that the proposed approach outperforms existing methods and achieves state-of-the-art performance on commonly used video summarization datasets.

A novel vector quantization-based video summarization method using independent component analysis mixture model

A Novel Compact Yet Rich Key Frame Creation Method for Compressed Video Summarization

Gaussian Mixture Vector Quantization-Based Video Summarization Using Independent Component Analysis

Memorable and Rich Video Summarization

Creating Memorable Video Summaries That Satisfy the User's Intention for Taking the Videos.

An Unsupervised Video Summarization Method Based on Multimodal Representation.

Video Thumbnail Extraction Using Video Time Density Function and Independent Component Analysis Mixture Model.

A novel video thumbnail extraction method using spatiotemporal vector quantization.

Query-Aware Sparse Coding for Multi-Video Summarization

Video retrieval using VQ-based global motion features

Modality correlation-based video summarization

A New Hierarchical Key Frame Tree-Based Video Representation Method Using Independent Component Analysis

Automatic Video Summarization By Discovering Frequent Patterns With Support Vector Clustering

An efficient encoding algorithm for vector quantization based on subvector technique.

Conditional Modeling Based Automatic Video Summarization

Fuzzy C-mean clustering technique based visual features fusion for automatic video summarization method

DeepQAMVS: Query-Aware Hierarchical Pointer Networks for Multi-Video Summarization

An ICA Mixture Hidden Markov Model for Video Content Analysis

Image Conditioned Keyframe-Based Video Summarization Using Object Detection

An Effective Video Summarization Framework Toward Handheld Devices

Video summarization by redundancy removing and content ranking