Abstract:Compared to traditional RNN-based models, abstractive summarization systems based on Pre-trained Language Models (PTMs) achieve dramatic improvements in readability. Thus, in the field of abstractive summarization, more attention should be devoted to the faithfulness issue that predicted summaries are not factually consistent with source texts. To alleviate this disadvantage, we propose a novel Syntax-Enriched Abstractive Summarization (SEASum) framework, which utilizes graph attention networks (GATs) to introduce syntactic features of source texts to generate faithful summaries. In the SEASum framework, the PTM-based semantic encoder encodes word sequence, while the GAT-based syntactic encoder captures explicit syntax, i.e., part-of-speech tags, parse trees, and dependency-based relative positions of source documents. A feature fusion module is introduced to incorporate encoded syntactic features into the summarization framework. Based on the proposed SEASum framework, we develop two summarization models: 1) parallel SEASum model, in which the semantic encoder and syntactic encoder work in parallel, a multi-head attention module fused two-stream features for the following decoding process; 2) cascaded SEASum model, which takes contextual word embeddings from semantic encoder as node embeddings for the syntactic encoder and employs highway networks to regulate information flow. Experimental results on CNN/DailyMail and Reddit-TIFU (short) datasets show our parallel SEASum model and cascaded SEASum model outperform state-of-the-art abstractive summarization approaches in the faithfulness measurement. The results also demonstrate that cascaded SEASum model is more effective than parallel SEASum model in boosting faithfulness.

Learning to Rank Salient Content for Query-focused Summarization

QontSum: On Contrasting Salient Content for Query-focused Summarization

Exploring hypergraph-based semi-supervised ranking for query-oriented summarization

Exploring Neural Models for Query-Focused Summarization

Learning to Rank Utterances for Query-Focused Meeting Summarization

IDEAL: Leveraging Infinite and Dynamic Characterizations of Large Language Models for Query-focused Summarization

SEASum: Syntax-Enriched Abstractive Summarization

Contrastive Learning with High-Quality and Low-Quality Augmented Data for Query-Focused Summarization.

A Lightweight Constrained Generation Alternative for Query-focused Summarization

Reducing Quantity Hallucinations in Abstractive Summarization

AttSum: Joint Learning of Focusing and Summarization with Neural Attention.

Learning to Rank for Query-Focused Multi-document Summarization

Improving Query Focused Summarization Using Look-Ahead Strategy

Improving Query-Focused Meeting Summarization with Query-Relevant Knowledge

A Novel Relational Learning-To-Rank Approach For Topic-Focused Multi-Document Summarization

Balancing Lexical and Semantic Quality in Abstractive Summarization

Query-focused Abstractive Summarization Via Question-answering Model

RankSum An unsupervised extractive text summarization based on rank fusion

Domain Adaptation and Summary Distillation for Unsupervised Query Focused Summarization

Learning Summary Prior Representation for Extractive Summarization.

FineSurE: Fine-grained Summarization Evaluation using LLMs