Abstract:Graph contrastive learning has been successfully applied in text classification due to its remarkable ability for self-supervised node representation learning. However, explicit graph augmentations may lead to a loss of semantics in the contrastive views. Secondly, existing methods tend to overlook edge features and the varying significance of node features during multi-graph learning. Moreover, the contrastive loss suffer from false negatives. To address these limitations, we propose a novel method of contrastive multi-graph learning with neighbor hierarchical sifting for semi-supervised text classification, namely ConNHS. Specifically, we exploit core features to form a multi-relational text graph, enhancing semantic connections among texts. By separating text graphs, we provide diverse views for contrastive learning. Our approach ensures optimal preservation of the graph information, minimizing data loss and distortion. Then, we separately execute relation-aware propagation and cross-graph attention propagation, which effectively leverages the varying correlations between nodes and edge features while harmonising the information fusion across graphs. Subsequently, we present the neighbor hierarchical sifting loss (NHS) to refine the negative selection. For one thing, following the homophily assumption, NHS masks first-order neighbors of the anchor and positives from being negatives. For another, NHS excludes the high-order neighbors analogous to the anchor based on their similarities. Consequently, it effectively reduces the occurrence of false negatives, preventing the expansion of the distance between similar samples in the embedding space. Our experiments on ThuCNews, SogouNews, 20 Newsgroups, and Ohsumed datasets achieved 95.86\%, 97.52\%, 87.43\%, and 70.65\%, which demonstrates competitive results in semi-supervised text classification.

Multi-MCCR: Multiple models regularization for semi-supervised text classification with few labels

Learning the Unlearned: Mitigating Feature Suppression in Contrastive Learning

Contrastive Multi-graph Learning with Neighbor Hierarchical Sifting for Semi-supervised Text Classification

Contrastive Learning-Enhanced Nearest Neighbor Mechanism for Multi-Label Text Classification.

Multi-Label Contrastive Learning : A Comprehensive Study

Connecting Multi-modal Contrastive Representations

Multi-Scale Classification and Contrastive Regularization: Weakly Supervised Large-Scale 3D Point Cloud Semantic Segmentation

Cross-modal contrastive learning for multimodal sentiment recognition

Conditional Consistency Regularization for Semi-Supervised Multi-label Image Classification

A multi‐label social short text classification method based on contrastive learning and improved ml‐KNN

Multi-label Text Classification Model Based on Multi-level Constraint Augmentation and Label Association Attention

Text-Centric Multimodal Contrastive Learning for Sentiment Analysis

Comparing effectiveness of regularization methods on text classification: Simple and complex model in data shortage situation

Few-shot Text Classification with Dual Contrastive Consistency

Extending Multi-modal Contrastive Representations

Contrastive Learning for Multi-Modal Automatic Code Review

Contrastive classification: A label-independent generalization model for text classification

Improving the Consistency in Cross-Lingual Cross-Modal Retrieval with 1-to-K Contrastive Learning

An Effective Deployment of Contrastive Learning in Multi-label Text Classification

Exploring Contrastive Learning for Long-Tailed Multi-Label Text Classification

Semi-Supervised Multinomial Naive Bayes for Text Classification by Leveraging Word-Level Statistical Constraint