Abstract:During the last few years, several technological advances have led to an increase in the creation and consumption of audiovisual multimedia content. Users are overexposed to videos via several social media or video sharing websites and mobile phone applications. For efficient browsing, searching, and navigation across several multimedia collections and repositories, e.g., for finding videos that are relevant to a particular topic or interest, this ever-increasing content should be efficiently described by informative yet concise content representations. A common solution to this problem is the construction of a brief summary of a video, which could be presented to the user, instead of the full video, so that she/he could then decide whether to watch or ignore the whole video. Such summaries are ideally more expressive than other alternatives, such as brief textual descriptions or keywords. In this work, the video summarization problem is approached as a supervised classification task, which relies on feature fusion of audio and visual data. Specifically, the goal of this work is to generate dynamic video summaries, i.e., compositions of parts of the original video, which include its most essential video segments, while preserving the original temporal sequence. This work relies on annotated datasets on a per-frame basis, wherein parts of videos are annotated as being “informative” or “noninformative”, with the latter being excluded from the produced summary. The novelties of the proposed approach are, (a) prior to classification, a transfer learning strategy to use deep features from pretrained models is employed. These models have been used as input to the classifiers, making them more intuitive and robust to objectiveness, and (b) the training dataset was augmented by using other publicly available datasets. The proposed approach is evaluated using three datasets of user-generated videos, and it is demonstrated that deep features and data augmentation are able to improve the accuracy of video summaries based on human annotations. Moreover, it is domain independent, could be used on any video, and could be extended to rely on richer feature representations or include other data modalities.

Feature fusion over hyperbolic graph convolution networks for video summarisation

Creating Memorable Video Summaries That Satisfy the User's Intention for Taking the Videos.

Creating Personalized Video Summaries Via Semantic Event Detection

A Novel Compact Yet Rich Key Frame Creation Method for Compressed Video Summarization

Learning User Interest with Improved Triplet Deep Ranking and Web-Image Priors for Topic-Related Video Summarization.

Memorable and Rich Video Summarization

A Human-Machine Collaborative Video Summarization Framework Using Pupillary Response Signals

A GAN Based Video Summarization Method with Representation Loss

An Unsupervised Video Summarization Method Based on Multimodal Representation.

Video Summarization Generation Network Based on Dynamic Graph Contrastive Learning and Feature Fusion

Dynamic graph convolutional network for multi-video summarization

MHSCNet: A Multimodal Hierarchical Shot-aware Convolutional Network for Video Summarization

Convolutional Hierarchical Attention Network for Query-Focused Video Summarization.

Learning Multiscale Hierarchical Attention for Video Summarization

A Hierarchical Spatial–Temporal Cross-Attention Scheme for Video Summarization Using Contrastive Learning

Video summarization via knowledge-aware multimodal deep networks

Unsupervised Video Summarization with a Convolutional Attentive Adversarial Network

Fuzzy C-mean clustering technique based visual features fusion for automatic video summarization method

Deep Semantic and Attentive Network for Unsupervised Video Summarization

Hierarchical multimodal transformer to summarize videos

Video Summarization Based on Feature Fusion and Data Augmentation