Abstract:Video summarization aims to analyze the structure and content of videos and extract key segments to construct summarization that can accurately summarize the main content, allowing users to quickly access the core information without browsing the full video. However, existing methods have difficulties in capturing long-term dependencies when dealing with long videos. On the other hand, there is a large amount of noise in graph structures, which may lead to the influence of redundant information and is not conducive to the effective learning of video features. To solve the above problems, we propose a video summarization generation network based on dynamic graph contrastive learning and feature fusion, which mainly consists of three modules: feature extraction, video encoder, and feature fusion. Firstly, we compute the shot features and construct a dynamic graph by using the shot features as nodes of the graph and the similarity between the shot features as the weights of the edges. In the video encoder, we extract the temporal and structural features in the video using stacked L-G Blocks, where the L-G Block consists of a bidirectional long short-term memory network and a graph convolutional network. Then, the shallow-level features are obtained after processing by L-G Blocks. In order to remove the redundant information in the graph, graph contrastive learning is used to obtain the optimized deep-level features. Finally, to fully exploit the feature information of the video, a feature fusion gate using the gating mechanism is designed to fully fuse the shallow-level features with the deep-level features. Extensive experiments are conducted on two benchmark datasets, TVSum and SumMe, and the experimental results show that our proposed method outperforms most of the current state-of-the-art video summarization methods.

Graph Attention Networks Adjusted Bi-LSTM for Video Summarization

Semantic Representation and Attention Alignment for Graph Information Bottleneck in Video Summarization

Memorable and Rich Video Summarization

A GAN Based Video Summarization Method with Representation Loss

A Human-Machine Collaborative Video Summarization Framework Using Pupillary Response Signals

Creating Memorable Video Summaries That Satisfy the User's Intention for Taking the Videos.

A Hierarchical Spatial–Temporal Cross-Attention Scheme for Video Summarization Using Contrastive Learning

An Unsupervised Video Summarization Method Based on Multimodal Representation.

Unsupervised video summarization with adversarial graph-based attention network

A Novel Compact Yet Rich Key Frame Creation Method for Compressed Video Summarization

Spatiotemporal Two-Stream LSTM Network for Unsupervised Video Summarization

Exploring global diverse attention via pairwise temporal relation for video summarization

Learning Multiscale Hierarchical Attention for Video Summarization

Gated Graph Neural Attention Networks for abstractive summarization

Video Summarization with Long Short-term Memory

CSTA: CNN-based Spatiotemporal Attention for Video Summarization

Unsupervised Video Summarization with a Convolutional Attentive Adversarial Network

Video Summarization Generation Network Based on Dynamic Graph Contrastive Learning and Feature Fusion

Deep Semantic and Attentive Network for Unsupervised Video Summarization

Reconstructive Sequence-Graph Network for Video Summarization

Text Summarization Method Based on Gated Attention Graph Neural Network