Abstract:Automatic text summarization aims at condensing a document to a shorter version while preserving the key information. Different from extractive summarization which simply selects text fragments from the document, abstractive summarization generates the summary in a word-by-word manner. Most current state-of-the-art (SOTA) abstractive summarization methods are based on the Transformer-based encoder-decoder architecture and focus on novel self-supervised objectives in pre-training. While these models well capture the contextual information among words in documents, little attention has been paid to incorporating global semantics to better fine-tune for the downstream abstractive summarization task. In this study, we propose a topic-aware abstractive summarization (TAAS) framework by leveraging the underlying semantic structure of documents represented by their latent topics. Specifically, TAAS seamlessly incorporates a neural topic modeling into an encoder-decoder based sequence generation procedure via attention for summarization. This design is able to learn and preserve global semantics of documents and thus makes summarization effective, which has been proved by our experiments on real-world datasets. As compared to several cutting-edge baseline methods, we show that TAAS outperforms BART, a well-recognized SOTA model, by 2%, 8%, and 12% regarding the F measure of ROUGE-1, ROUGE-2, and ROUGE-L, respectively. TAAS also achieves comparable performance to PEGASUS and ProphetNet, which is difficult to accomplish given that training PEGASUS and ProphetNet requires enormous computing capacity beyond what we used in this study.

SemSUM: Semantic Dependency Guided Neural Abstractive Summarization

Automatic Document Summarization Via Deep Neural Networks

Abstract Summarization Model Based on Semantic Graphs and Entity Pointers

Joint Parsing and Generation for Abstractive Summarization

Topic-Guided Abstractive Text Summarization: a Joint Learning Approach

A Syntax-Augmented and Headline-Aware Neural Text Summarization Method

Abstractive summarization incorporating graph knowledge

Abstractive Document Summarization with a Graph-Based Attentional Neural Model.

GATSum: Graph-Based Topic-Aware Abstract Text Summarization

A Semantic Relevance Based Neural Network for Text Summarization and Text Simplification

Neural Entity Summarization with Joint Encoding and Weak Supervision

Integrating Semantic Scenario and Word Relations for Abstractive Sentence Summarization.

Semantic-Preserving Abstractive Text Summarization with Siamese Generative Adversarial Net.

Frame Semantics guided network for Abstractive Sentence Summarization

Abstractive Summarization Improved by WordNet-based Extractive Sentences

Leveraging Graph to Improve Abstractive Multi-Document Summarization.

Improving Semantic Relevance For Sequence-To-Sequence Learning Of Chinese Social Media Text Summarization

Abstractive Document Summarization via Neural Model with Joint Attention

Text Summarization Generation Based on Semantic Similarity

Topic-Aware Abstractive Text Summarization

Towards a Neural Network Approach to Abstractive Multi-Document Summarization.