Abstract:Extractive document summarization is a fundamental task in natural language processing (NLP). Recently, several Graph Neural Networks (GNNs) are proposed for this task. However, most existing GNN-based models can neither effectively encode semantic nodes of multiple granularity level apart from sentences nor substantially capture different cross-sentence meta-paths. To address these issues, we propose MHgatSum, a novel Multi-granularity Heterogeneous Graph ATtention networks for extractive document SUMmarization. Specifically, we first build a multi-granularity heterogeneous graph (HetG) for each document, which is better to represent the semantic meaning of the document. The HetG contains not only sentence nodes but also multiple other granularity effective semantic units with different semantic levels, including keyphrases and topics. These additional nodes act as the intermediary between sentences to build the meta-paths involved in sentence node (i.e., Sentence-Keyphrase-Sentence and Sentence-Topic-Sentence). Then, we propose a heterogeneous graph attention networks to embed the constructed HetG for extractive summarization, which enjoys multi-granularity semantic representations. The model is based on a hierarchical attention mechanism, including node-level and semantic-level attentions. The node-level attention can learn the importance between a node and its meta-path based neighbors, while the semantic-level attention is able to learn the importance of different meta-paths. Moreover, to better integrate sentence global knowledge, we further incorporate sentence node global importance in local node-level attention. We conduct empirical experiments on two benchmark datasets, which demonstrates the superiority of MHgatSum over previous SOTA models on the task of extractive summarization.

Multi-Granularity Interaction Network for Extractive and Abstractive Multi-Document Summarization.

Multi-granularity heterogeneous graph attention networks for extractive document summarization

Query-focused Multi-document Summarization: Combining a Novel Topic Model with Graph-based Semi-supervised Learning

A Multi-Granularity Heterogeneous Graph for Extractive Text Summarization

Abstractive Multi-Document Summarization Via Joint Learning with Single-Document Summarization.

Abstractive Multi-Document Summarization Based on Semantic Link Network

Towards A Unified Approach Based On Affinity Graph To Various Multi-Document Summarizations

Towards a Neural Network Approach to Abstractive Multi-Document Summarization.

Unsupervised Multi-Granularity Summarization

Leveraging Graph to Improve Abstractive Multi-Document Summarization.

Multiplex Graph Neural Network for Extractive Text Summarization

Abstractive Document Summarization with a Graph-Based Attentional Neural Model.

Towards a Unified Approach to Simultaneous Single-Document and Multi-Document Summarizations

Multi-Granularity Interaction and Integration Network for Video Question Answering

Deep Dependency Substructure-Based Learning for Multidocument Summarization.

Improved affinity graph based multi-document summarization

An Unsupervised Multi-Document Summarization Framework Based on Neural Document Model.

Incorporating word attention with convolutional neural networks for abstractive summarization

Large-Scale Multi-Document Summarization with Information Extraction and Compression

Multi-layered graph-based multi-document summarization model

Selective and Coverage Multi-head Attention for Abstractive Summarization