Abstract:Extractive document summarization is a fundamental task in natural language processing (NLP). Recently, several Graph Neural Networks (GNNs) are proposed for this task. However, most existing GNN-based models can neither effectively encode semantic nodes of multiple granularity level apart from sentences nor substantially capture different cross-sentence meta-paths. To address these issues, we propose MHgatSum, a novel Multi-granularity Heterogeneous Graph ATtention networks for extractive document SUMmarization. Specifically, we first build a multi-granularity heterogeneous graph (HetG) for each document, which is better to represent the semantic meaning of the document. The HetG contains not only sentence nodes but also multiple other granularity effective semantic units with different semantic levels, including keyphrases and topics. These additional nodes act as the intermediary between sentences to build the meta-paths involved in sentence node (i.e., Sentence-Keyphrase-Sentence and Sentence-Topic-Sentence). Then, we propose a heterogeneous graph attention networks to embed the constructed HetG for extractive summarization, which enjoys multi-granularity semantic representations. The model is based on a hierarchical attention mechanism, including node-level and semantic-level attentions. The node-level attention can learn the importance between a node and its meta-path based neighbors, while the semantic-level attention is able to learn the importance of different meta-paths. Moreover, to better integrate sentence global knowledge, we further incorporate sentence node global importance in local node-level attention. We conduct empirical experiments on two benchmark datasets, which demonstrates the superiority of MHgatSum over previous SOTA models on the task of extractive summarization.

Heterogeneous Graph Interaction based Event Extraction with Attentional Position Embeddings

Document-level Event Extraction Via Heterogeneous Graph-based Interaction Model with a Tracker

A Multi-Channel Hierarchical Graph Attention Network for Open Event Extraction

Task-Oriented Genetic Activation for Large-Scale Complex Heterogeneous Graph Embedding.

Dialogue Relation Extraction with Document-Level Heterogeneous Graph Attention Networks

Syntax-based dynamic latent graph for event relation extraction

A Multi-Graph Representation for Event Extraction

Knowledge Graph Enhanced Event Extraction in Financial Documents

TGIN: Document-level event extraction with two-phase graph inference network

Document-level relation extraction with multi-layer heterogeneous graph attention network

Biomedical Event Extraction with Hierarchical Knowledge Graphs

Event Detection with Dual Relational Graph Attention Networks.

PGRA: Projected graph relation-feature attention network for heterogeneous information network embedding

Learning graph attention-aware knowledge graph embedding

Document-level event causality identification via graph inference mechanism

Fine-grained Event Categorization with Heterogeneous Graph Convolutional Networks

Advancing Graph Neural Networks with HL-HGAT: A Hodge-Laplacian and Attention Mechanism Approach for Heterogeneous Graph-Structured Data

Multi-granularity heterogeneous graph attention networks for extractive document summarization

Advancing document-level event extraction: Integration across texts and reciprocal feedback

Unsupervised Extractive Summarization with Heterogeneous Graph Embeddings for Chinese Document

GATE: Graph Attention Transformer Encoder for Cross-lingual Relation and Event Extraction