Abstract:Existing text classification models based on graph convolutional networks usually simply fuse the neighborhood information of different orders through the adjacency matrix to update the representation of node in graph,resulting in insufficientrepresentation of the word sense information of the nodes.In addition,the model based on conventional attention mechanism only provides a positive weighted representation of the word embedding,ignoring the impact of words that produce negative effects on the final classification.To overcome the above problems,a model based on bidirectional attention mechanism and gated graph convolutional networks is proposed in the paper.Firstly,the model uses the gated graph convolutional networks to selectively fuse the multi-order neighborhood information of nodes in the graph,retaining the information of previous orders,to enrich the feature representation of nodes in graph.Secondly,the model learns the influence of different words on text classification results by the bidirectional attention mechanism,giving positive weights to words with positive effects on the classification and negative weights to words with negative effects to weaken their influence in the vector representation,to improve the model's ability to distinguish nodes with different properties in the document.Finally,the maximum pooling and average pooling are used to fuse the word representation in text to get the document representation for the final classification,where the average pooling can make each word play a role in generating a graph-level representation of the document and the maximum pooling can make the important words play a greater role in document embedding.Extensive experiments on four benchmark datasets show that the proposed model significantly outperforms the baseline model.

KGAT: An Enhanced Graph-Based Model for Text Classification

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Text Classification with Attention Gated Graph Neural Network

RB-GAT: A Text Classification Model Based on RoBERTa-BiGRU with Graph ATtention Network

A Heterogeneous Directed Graph Attention Network for Inductive Text Classification Using Multilevel Semantic Embeddings

geoGAT: Graph Model Based on Attention Mechanism for Geographic Text Classification

Graph Convolution Word Embedding and Attention for Text Classification∗

Contrastive Graph Convolutional Networks with adaptive augmentation for text classification

GazeGCN: Gaze-aware Graph Convolutional Network for Text Classification

Text Classification Based on Attention Gated Graph Neural Network

Text Classification Based on Knowledge Graphs and Improved Attention Mechanism

Revisiting Attention-Based Graph Neural Networks for Graph Classification

Text Classification Method Based on Bidirectional Attention and Gated Graph Convolutional Networks

Multilabel Text Classification Using Multilayer DGAT

A Graph Neural Network Fused with Multi-Head Attention for Text Classification

Understanding When and Why Graph Attention Mechanisms Work via Node Classification

TW-TGNN: Two Windows Graph-Based Model for Text Classification

Enhancing Heterogeneous Knowledge Graph Completion with a Novel GAT-based Approach

Enhanced Text Classification with Label-Aware Graph Convolutional Networks

A Gated Graph Neural Network With Attention for Text Classification Based on Coupled P Systems