Abstract:Graph contrastive learning has been successfully applied in text classification due to its remarkable ability for self-supervised node representation learning. However, explicit graph augmentations may lead to a loss of semantics in the contrastive views. Secondly, existing methods tend to overlook edge features and the varying significance of node features during multi-graph learning. Moreover, the contrastive loss suffer from false negatives. To address these limitations, we propose a novel method of contrastive multi-graph learning with neighbor hierarchical sifting for semi-supervised text classification, namely ConNHS. Specifically, we exploit core features to form a multi-relational text graph, enhancing semantic connections among texts. By separating text graphs, we provide diverse views for contrastive learning. Our approach ensures optimal preservation of the graph information, minimizing data loss and distortion. Then, we separately execute relation-aware propagation and cross-graph attention propagation, which effectively leverages the varying correlations between nodes and edge features while harmonising the information fusion across graphs. Subsequently, we present the neighbor hierarchical sifting loss (NHS) to refine the negative selection. For one thing, following the homophily assumption, NHS masks first-order neighbors of the anchor and positives from being negatives. For another, NHS excludes the high-order neighbors analogous to the anchor based on their similarities. Consequently, it effectively reduces the occurrence of false negatives, preventing the expansion of the distance between similar samples in the embedding space. Our experiments on ThuCNews, SogouNews, 20 Newsgroups, and Ohsumed datasets achieved 95.86\%, 97.52\%, 87.43\%, and 70.65\%, which demonstrates competitive results in semi-supervised text classification.

DualGraph: Improving Semi-supervised Graph Classification Via Dual Contrastive Learning

Dual Path Structural Contrastive Embeddings for Learning Novel Objects

Dual Graph Convolutional Networks for Graph-Based Semi-Supervised Classification

Dual-Channel Graph Contrastive Learning for Self-Supervised Graph-Level Representation Learning

Semi-Supervised Graph Contrastive Learning with Virtual Adversarial Augmentation

Dual Contrastive Learning Network for Graph Clustering

Hypergraph-enhanced Dual Semi-supervised Graph Classification

Self-Supervised Conditional Distribution Learning on Graphs

Pseudo Contrastive Learning for Graph-based Semi-supervised Learning

Dual-perspective Cross Contrastive Learning in Graph Transformers

Multi-Scale Subgraph Contrastive Learning

Contrastive Multi-graph Learning with Neighbor Hierarchical Sifting for Semi-supervised Text Classification

Dual-channel graph contrastive learning for multi-label classification with label-specific features and label correlations

Semi-supervised Domain Adaptation on Graphs with Contrastive Learning and Minimax Entropy

Graph Contrastive Multi-view Learning: A Pre-training Framework for Graph Classification

Graph Convolutional Network For Semi-supervised Node Classification With Subgraph Sketching

Deep Graph Contrastive Representation Learning

Unsupervised Structure-Adaptive Graph Contrastive Learning.

Contrastive Disentangled Learning on Graph for Node Classification

DualHGNN: A Dual Hypergraph Neural Network for Semi-Supervised Node Classification based on Multi-View Learning and Density Awareness

Label-invariant Augmentation for Semi-Supervised Graph Classification