Abstract:Extractive document summarization is a fundamental task in natural language processing (NLP). Recently, several Graph Neural Networks (GNNs) are proposed for this task. However, most existing GNN-based models can neither effectively encode semantic nodes of multiple granularity level apart from sentences nor substantially capture different cross-sentence meta-paths. To address these issues, we propose MHgatSum, a novel Multi-granularity Heterogeneous Graph ATtention networks for extractive document SUMmarization. Specifically, we first build a multi-granularity heterogeneous graph (HetG) for each document, which is better to represent the semantic meaning of the document. The HetG contains not only sentence nodes but also multiple other granularity effective semantic units with different semantic levels, including keyphrases and topics. These additional nodes act as the intermediary between sentences to build the meta-paths involved in sentence node (i.e., Sentence-Keyphrase-Sentence and Sentence-Topic-Sentence). Then, we propose a heterogeneous graph attention networks to embed the constructed HetG for extractive summarization, which enjoys multi-granularity semantic representations. The model is based on a hierarchical attention mechanism, including node-level and semantic-level attentions. The node-level attention can learn the importance between a node and its meta-path based neighbors, while the semantic-level attention is able to learn the importance of different meta-paths. Moreover, to better integrate sentence global knowledge, we further incorporate sentence node global importance in local node-level attention. We conduct empirical experiments on two benchmark datasets, which demonstrates the superiority of MHgatSum over previous SOTA models on the task of extractive summarization.

Multistage Mixed-Attention Unsupervised Keyword Extraction for Summary Generation

Exploring Simultaneous Keyword and Key Sentence Extraction

Exploring simultaneous keyword and key sentence extraction: improve graph-based ranking using wikipedia.

A New Approach to Overgenerating and Scoring Abstractive Summaries

UPER: Boosting Multi-Document Summarization with an Unsupervised Prompt-based Extractor.

Multi-granularity heterogeneous graph attention networks for extractive document summarization

DMSeqNet-mBART: A State-of-the-Art Adaptive-DropMessage Enhanced Mbart Architecture for Superior Chinese Short News Text Summarization

Abstractive Summarization with Keyword and Generated Word Attention.

Unsupervised Abstractive Summarization Via Sentence Rewriting

Reading More Efficiently: Multi-Sentence Summarization With A Dual Attention And Copy-Generator Network

Write Summary Step-by-Step: A Pilot Study of Stepwise Summarization

Extractive-abstractive Summarization with Pointer and Coverage Mechanism

Multi-View Metrics Enhanced Heterogeneous Graph Neural Network for Extractive Summarization

Abstractive text summarization model combining a hierarchical attention mechanism and multiobjective reinforcement learning

Text summarization based on multi-head self-attention mechanism and pointer network

Efficient Two-stage Approach for Long Document Summarization

Adapting Generative Pretrained Language Model for Open-domain Multimodal Sentence Summarization

Query-oriented unsupervised multi-document summarization via deep learning model

Summarize, Outline, and Elaborate: Long-Text Generation via Hierarchical Supervision from Extractive Summaries

A Syntax-Augmented and Headline-Aware Neural Text Summarization Method

Improving Abstractive Multi-document Summarization with Predicate-Argument Structure Extraction.