Abstract:Augmentation techniques and sampling strategies are crucial in contrastive learning, but in most existing works, augmentation techniques require careful design, and their sampling strategies can only capture a small amount of intrinsic supervision information. Additionally, the existing methods require complex designs to obtain two different representations of the data. To overcome these limitations, we propose a novel framework called the Self-Contrastive Graph Diffusion Network (SCGDN). Our framework consists of two main components: the Attentional Module (AttM) and the Diffusion Module (DiFM). AttM aggregates higher-order structure and feature information to get an excellent embedding, while DiFM balances the state of each node in the graph through Laplacian diffusion learning and allows the cooperative evolution of adjacency and feature information in the graph. Unlike existing methodologies, SCGDN is an augmentation-free approach that avoids "sampling bias" and semantic drift, without the need for pre-training. We conduct a high-quality sampling of samples based on structure and feature information. If two nodes are neighbors, they are considered positive samples of each other. If two disconnected nodes are also unrelated on $k$NN graph, they are considered negative samples for each other. The contrastive objective reasonably uses our proposed sampling strategies, and the redundancy reduction term minimizes redundant information in the embedding and can well retain more discriminative information. In this novel framework, the graph self-contrastive learning paradigm gives expression to a powerful force. SCGDN effectively balances between preserving high-order structure information and avoiding overfitting. The results manifest that SCGDN can consistently generate outperformance over both the contrastive methods and the classical methods.

Community-Enhanced Contrastive Siamese Networks for Graph Representation Learning.

Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning

Dual Contrastive Learning Network for Graph Clustering

Graph Contrastive Learning Method with Sample Disparity Constraint and Feature Structure Graph for Node Classification.

Community-Enhanced Contrastive Learning for Graph Collaborative Filtering

Deep Graph Contrastive Representation Learning

Cluster-guided Contrastive Graph Clustering Network

Multi-Scale Subgraph Contrastive Learning

Graph contrastive learning with cross-encoder for community discovery

Multi-Graph Contrastive Learning Clustering Network

Graph Communal Contrastive Learning

Self-Contrastive Graph Diffusion Network

SACL: Siamese Adaptive Contrastive Learning for Recommendation

Cross-scale contrastive triplet networks for graph representation learning

Community-CL: An Enhanced Community Detection Algorithm Based on Contrastive Learning

Multi-Perspective Semantic Enhanced Model for Heterogeneous Graph Embedding with Contrastive Learning.

GRE^2-MDCL: Graph Representation Embedding Enhanced via Multidimensional Contrastive Learning

Self-supervised graph representation learning using multi-scale subgraph views contrast

Single-View Graph Contrastive Learning with Soft Neighborhood Awareness

A multi-view contrastive learning for heterogeneous network embedding

Enhanced contrastive representation in network