Abstract:Extractive document summarization is a fundamental task in natural language processing (NLP). Recently, several Graph Neural Networks (GNNs) are proposed for this task. However, most existing GNN-based models can neither effectively encode semantic nodes of multiple granularity level apart from sentences nor substantially capture different cross-sentence meta-paths. To address these issues, we propose MHgatSum, a novel Multi-granularity Heterogeneous Graph ATtention networks for extractive document SUMmarization. Specifically, we first build a multi-granularity heterogeneous graph (HetG) for each document, which is better to represent the semantic meaning of the document. The HetG contains not only sentence nodes but also multiple other granularity effective semantic units with different semantic levels, including keyphrases and topics. These additional nodes act as the intermediary between sentences to build the meta-paths involved in sentence node (i.e., Sentence-Keyphrase-Sentence and Sentence-Topic-Sentence). Then, we propose a heterogeneous graph attention networks to embed the constructed HetG for extractive summarization, which enjoys multi-granularity semantic representations. The model is based on a hierarchical attention mechanism, including node-level and semantic-level attentions. The node-level attention can learn the importance between a node and its meta-path based neighbors, while the semantic-level attention is able to learn the importance of different meta-paths. Moreover, to better integrate sentence global knowledge, we further incorporate sentence node global importance in local node-level attention. We conduct empirical experiments on two benchmark datasets, which demonstrates the superiority of MHgatSum over previous SOTA models on the task of extractive summarization.

Hierarchical Graph Summarization: Leveraging Hybrid Information through Visible and Invisible Linkage

Exploring hypergraph-based semi-supervised ranking for query-oriented summarization

Summarizing Scale-Free Networks Based on Virtual and Real Links

Update Summarization using a Multi-level Hierarchical Dirichlet Process Model.

HyperSum: hypergraph based semi-supervised sentence ranking for query-oriented summarization.

Abstractive Summarization Guided by Latent Hierarchical Document Structure

Heterogeneous Graph Neural Networks for Extractive Document Summarization

Hierarchical Attention Graph for Scientific Document Summarization in Global and Local Level

An Exploration of Document Impact on Graph-Based Multi-Document Summarization

Using Only Cross-Document Relationships for Both Generic and Topic-Focused Multi-Document Summarizations

Multi-granularity heterogeneous graph attention networks for extractive document summarization

Double-Hypergraph Based Sentence Ranking for Query-Focused Multi-document Summarizaton

An Integrated Graph Model For Document Summarization

Unsupervised Extractive Summarization with Heterogeneous Graph Embeddings for Chinese Document

SgSum: Transforming Multi-document Summarization into Sub-graph Selection

Summarizing Documents by Measuring the Importance of a Subset of Vertices Within a Graph

Leveraging Graph to Improve Abstractive Multi-Document Summarization.

Hierarchical Heterogeneous Graph Attention Network for Syntax-Aware Summarization

Learning with fuzzy hypergraphs: a topical approach to query-oriented text summarization

A Multi-Granularity Heterogeneous Graph for Extractive Text Summarization

HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarization