Abstract:Text classification is an important research topic in natural language processing (NLP), and Graph Neural Networks (GNNs) have recently been applied in this task. However, in existing graph-based models, text graphs constructed by rules are not real graph data and introduce massive noise. More importantly, for fixed corpus-level graph structure, these models cannot sufficiently exploit the labeled and unlabeled information of nodes. Meanwhile, contrastive learning has been developed as an effective method in graph domain to fully utilize the information of nodes. Therefore, we propose a new graph-based model for text classification named CGA2TC, which introduces contrastive learning with an adaptive augmentation strategy into obtaining more robust node representation. First, we explore word co-occurrence and document word relationships to construct a text graph. Then, we design an adaptive augmentation strategy for the text graph with noise to generate two contrastive views that effectively solve the noise problem and preserve essential structure. Specifically, we design noise-based and centrality-based augmentation strategies on the topological structure of text graph to disturb the unimportant connections and thus highlight the relatively important edges. As for the labeled nodes, we take the nodes with same label as multiple positive samples and assign them to anchor node, while we employ consistency training on unlabeled nodes to constrain model predictions. Finally, to reduce the resource consumption of contrastive learning, we adopt a random sample method to select some nodes to calculate contrastive loss. The experimental results on several benchmark datasets can demonstrate the effectiveness of CGA2TC on the text classification task.

Label Incorporated Graph Neural Networks for Text Classification

GNN-SL: Sequence Labeling Based on Nearest Examples Via GNN

Label Attentive Distillation for GNN-Based Graph Classification

Graph Fusion Network for Text Classification

GNN Cleaner: Label Cleaner for Graph Structured Data

Towards Robust Graph Neural Networks against Label Noise

Recursive Graphical Neural Networks for Text Classification

Enhanced Text Classification with Label-Aware Graph Convolutional Networks

Tensor Graph Convolutional Networks for Text Classification

Text Level Graph Neural Network for Text Classification

Semisupervised Graph Neural Networks for Graph Classification

Multilabel Classification Based on Graph Neural Networks

Text classification optimization algorithm based on graph neural network

Understanding Graph Convolutional Networks for Text Classification

Self-consistent Graph Neural Networks for Semi-supervised Node Classification

Learning on Graphs under Label Noise

Connecting the Dots: What Graph-Based Text Representations Work Best for Text Classification Using Graph Neural Networks?

Contrastive Graph Convolutional Networks with adaptive augmentation for text classification

Graph Neural Networks on Discriminative Graphs of Words

Word Order is Considerable: Contextual Position-aware Graph Neural Network for Text Classification