Abstract:Automatic text summarization aims at condensing a document to a shorter version while preserving the key information. Different from extractive summarization which simply selects text fragments from the document, abstractive summarization generates the summary in a word-by-word manner. Most current state-of-the-art (SOTA) abstractive summarization methods are based on the Transformer-based encoder-decoder architecture and focus on novel self-supervised objectives in pre-training. While these models well capture the contextual information among words in documents, little attention has been paid to incorporating global semantics to better fine-tune for the downstream abstractive summarization task. In this study, we propose a topic-aware abstractive summarization (TAAS) framework by leveraging the underlying semantic structure of documents represented by their latent topics. Specifically, TAAS seamlessly incorporates a neural topic modeling into an encoder-decoder based sequence generation procedure via attention for summarization. This design is able to learn and preserve global semantics of documents and thus makes summarization effective, which has been proved by our experiments on real-world datasets. As compared to several cutting-edge baseline methods, we show that TAAS outperforms BART, a well-recognized SOTA model, by 2%, 8%, and 12% regarding the F measure of ROUGE-1, ROUGE-2, and ROUGE-L, respectively. TAAS also achieves comparable performance to PEGASUS and ProphetNet, which is difficult to accomplish given that training PEGASUS and ProphetNet requires enormous computing capacity beyond what we used in this study.

Study on Topic Partition in Automatic Abstracting System

Study on Topic Partition Based on Sequential Paragraphic Similarity

Text structure partition for automatic summarization

An automatic approach for efficient text segmentation

Multi-documents Automatic Abstracting Based on Text Clustering and Semantic Analysis

Research on Automatic Summarization Based on Rules and Statistics for Chinese Texts

Study of Automatic Abstracting Based on Corpus and Hierarchical Dictionary

Inferring Links Between Concerns and Methods with Multi-abstraction Vector Space Model.

Topic Decomposition and Summarization.

Automatic Abstraction of Long Chinese Patent Texts Based on P-Bertsum Model

Researches on Automatic Text Processing

Topic-Aware Abstractive Text Summarization

Automatic Text Summarization Approaches to Speed up Topic Model Learning Process

Research of Automatic News Summary Report with Topic

Topic Modeling Based Text Summarization Approach

Automatic Labeling of Topic Models Using Text Summaries

Design and Development of Partitional Topic Model

Advancing Topic Segmentation and Outline Generation in Chinese Texts: The Paragraph-level Topic Representation, Corpus, and Benchmark

An N-gram based approach to auto-extracting topics from research articles

GATSum: Graph-Based Topic-Aware Abstract Text Summarization

Research on the Text Similarity Algorithms in Automatic Scoring of Subjective Questions