Abstract:With the rapid growth of video data, video summarization technique plays a key role in reducing people's efforts to explore the content of videos by generating concise but informative summaries. Though supervised video summarization approaches have been well studied and achieved state-of-the-art performance, unsupervised methods are still highly demanded due to the intrinsic difficulty of obtaining high-quality annotations. In this paper, we propose a novel yet simple unsupervised video summarization method with attentive conditional Generative Adversarial Networks (GANs). Firstly, we build our framework upon Generative Adversarial Networks in an unsupervised manner. Specifically, the generator produces high-level weighted frame features and predicts frame-level importance scores, while the discriminator tries to distinguish between weighted frame features and raw frame features. Furthermore, we utilize a conditional feature selector to guide GAN model to focus on more important temporal regions of the whole video frames. Secondly, we are the first to introduce the frame-level multi-head self-attention for video summarization, which learns long-range temporal dependencies along the whole video sequence and overcomes the local constraints of recurrent units, e.g., LSTMs. Extensive evaluations on two datasets, SumMe and TVSum, show that our proposed framework surpasses state-of-the-art unsupervised methods by a large margin, and even outperforms most of the supervised methods. Additionally, we also conduct the ablation study to unveil the influence of each component and parameter settings in our framework.

Jointly Learning Guidance Induction and Faithful Summary Generation Via Conditional Variational Autoencoders.

A GAN Based Video Summarization Method with Representation Loss

Automatic Document Summarization Via Deep Neural Networks

Neural Entity Summarization with Joint Encoding and Weak Supervision

Weakly-Supervised Video Summarization Using Variational Encoder-Decoder And Web Prior

Unsupervised Video Summarization with Attentive Conditional Generative Adversarial Networks

GSum: A General Framework for Guided Neural Abstractive Summarization

Abstract Summarization Model Based on Semantic Graphs and Entity Pointers

Learning to Encode Text As Human-Readable Summaries Using Generative Adversarial Networks.

Unsupervised Video Summarization with a Convolutional Attentive Adversarial Network

Conditional Modeling Based Automatic Video Summarization

Faithful to the Original: Fact Aware Neural Abstractive Summarization

Joint Parsing and Generation for Abstractive Summarization

Pre-train and Plug-in: Flexible Conditional Text Generation with Variational Auto-Encoders

Self-Supervised Adversarial Video Summarizer with Context Latent Sequence Learning.

Topic-Guided Abstractive Text Summarization: a Joint Learning Approach

Faithful Abstractive Summarization Via Fact-aware Consistency-constrained Transformer.

Content Learning with Structure-Aware Writing: A Graph-Infused Dual Conditional Variational Autoencoder for Automatic Storytelling

SA-HAVE: A Self-Attention based Hierarchical VAEs Network for Abstractive Summarization

Draft and Edit: Automatic Storytelling Through Multi-Pass Hierarchical Conditional Variational Autoencoder