Abstract:Graph contrastive learning has been successfully applied in text classification due to its remarkable ability for self-supervised node representation learning. However, explicit graph augmentations may lead to a loss of semantics in the contrastive views. Secondly, existing methods tend to overlook edge features and the varying significance of node features during multi-graph learning. Moreover, the contrastive loss suffer from false negatives. To address these limitations, we propose a novel method of contrastive multi-graph learning with neighbor hierarchical sifting for semi-supervised text classification, namely ConNHS. Specifically, we exploit core features to form a multi-relational text graph, enhancing semantic connections among texts. By separating text graphs, we provide diverse views for contrastive learning. Our approach ensures optimal preservation of the graph information, minimizing data loss and distortion. Then, we separately execute relation-aware propagation and cross-graph attention propagation, which effectively leverages the varying correlations between nodes and edge features while harmonising the information fusion across graphs. Subsequently, we present the neighbor hierarchical sifting loss (NHS) to refine the negative selection. For one thing, following the homophily assumption, NHS masks first-order neighbors of the anchor and positives from being negatives. For another, NHS excludes the high-order neighbors analogous to the anchor based on their similarities. Consequently, it effectively reduces the occurrence of false negatives, preventing the expansion of the distance between similar samples in the embedding space. Our experiments on ThuCNews, SogouNews, 20 Newsgroups, and Ohsumed datasets achieved 95.86\%, 97.52\%, 87.43\%, and 70.65\%, which demonstrates competitive results in semi-supervised text classification.

ConGraT: Self-Supervised Contrastive Pretraining for Joint Graph and Text Embeddings

SimGRACE: A Simple Framework for Graph Contrastive Learning Without Data Augmentation

G-Censor: Graph Contrastive Learning with Task-Oriented Counterfactual Views

GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training

Full-Attention Driven Graph Contrastive Learning: with Effective Mutual Information Insight

GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphs

GAugLLM: Improving Graph Contrastive Learning for Text-Attributed Graphs with Large Language Models

High-Frequency-aware Hierarchical Contrastive Selective Coding for Representation Learning on Text-attributed Graphs

Contrastive Graph Convolutional Networks with adaptive augmentation for text classification

Contrastive Multi-graph Learning with Neighbor Hierarchical Sifting for Semi-supervised Text Classification

LATEX-GCL: Large Language Models (LLMs)-Based Data Augmentation for Text-Attributed Graph Contrastive Learning

Triplet teaching graph contrastive networks with self-evolving adaptive augmentation

TP-GCL: graph contrastive learning from the tensor perspective

Co-Modality Graph Contrastive Learning for Imbalanced Node Classification

Accurate graph classification via two-staged contrastive curriculum learning

GTC: GNN-Transformer co-contrastive learning for self-supervised heterogeneous graph representation

Supervised contrastive learning for graph representation enhancement

Graph Contrastive Learning with Augmentations

Bayesian Robust Graph Contrastive Learning

Tensor-Fused Multi-View Graph Contrastive Learning