Abstract:Compared to traditional RNN-based models, abstractive summarization systems based on Pre-trained Language Models (PTMs) achieve dramatic improvements in readability. Thus, in the field of abstractive summarization, more attention should be devoted to the faithfulness issue that predicted summaries are not factually consistent with source texts. To alleviate this disadvantage, we propose a novel Syntax-Enriched Abstractive Summarization (SEASum) framework, which utilizes graph attention networks (GATs) to introduce syntactic features of source texts to generate faithful summaries. In the SEASum framework, the PTM-based semantic encoder encodes word sequence, while the GAT-based syntactic encoder captures explicit syntax, i.e., part-of-speech tags, parse trees, and dependency-based relative positions of source documents. A feature fusion module is introduced to incorporate encoded syntactic features into the summarization framework. Based on the proposed SEASum framework, we develop two summarization models: 1) parallel SEASum model, in which the semantic encoder and syntactic encoder work in parallel, a multi-head attention module fused two-stream features for the following decoding process; 2) cascaded SEASum model, which takes contextual word embeddings from semantic encoder as node embeddings for the syntactic encoder and employs highway networks to regulate information flow. Experimental results on CNN/DailyMail and Reddit-TIFU (short) datasets show our parallel SEASum model and cascaded SEASum model outperform state-of-the-art abstractive summarization approaches in the faithfulness measurement. The results also demonstrate that cascaded SEASum model is more effective than parallel SEASum model in boosting faithfulness.

Resilient Abstractive Summarization Model with Adaptively Weighted Training Loss

A GAN Based Video Summarization Method with Representation Loss

Research on Abstractive Automatic Summarization Technology Based on Deep Learning

An Abstractive Summarization Model Based on Joint-Attention Mechanism and a Priori Knowledge

SEASum: Syntax-Enriched Abstractive Summarization

Generative Adversarial Network for Abstractive Text Summarization.

Abstractive Document Summarization via Neural Model with Joint Attention

A Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss

Abstractive Summarization Improved by WordNet-based Extractive Sentences

Abstractive Document Summarization with a Graph-Based Attentional Neural Model.

Topic-Aware Abstractive Text Summarization

Topic-Guided Abstractive Text Summarization: a Joint Learning Approach

HITS-based attentional neural model for abstractive summarization

A Syntax-Augmented and Headline-Aware Neural Text Summarization Method

A Text Abstraction Summary Model Based on BERT Word Embedding and Reinforcement Learning

A Video Summarization Model Based on Deep Reinforcement Learning with Long-Term Dependency

Keywords-Based Auxiliary Information Network for Abstractive Summarization

Balancing Lexical and Semantic Quality in Abstractive Summarization

Learning to Consider Relevance and Redundancy Dynamically for Abstractive Multi-document Summarization

Abstractive Text Summarization by Incorporating Reader Comments.

Hie-Transformer: A Hierarchical Hybrid Transformer For Abstractive Article Summarization