Influence of long-term diabetes on liver glycogen metabolism in the rat.

E. Ferrannini,A. Lanfranchi,F. Rohner-Jeanrenaud,G. Manfredini,G. van de Werve

DOI: https://doi.org/10.1016/0026-0495(90)90170-H

1990-10-01

Abstract:

What problem does this paper attempt to address?

Automated Graph Self-supervised Learning via Multi-teacher Knowledge Distillation

Lirong Wu,Yufei Huang,Haitao Lin,Zicheng Liu,Tianyu Fan,Stan Z. Li

DOI: https://doi.org/10.48550/arxiv.2210.02099

2022-01-01

Abstract: Self-supervised learning on graphs has recently achieved remarkable success in graph representation learning. With hundreds of self-supervised pretext tasks proposed over the past few years, the research community has greatly developed, and the key is no longer to design more powerful but complex pretext tasks, but to make more effective use of those already on hand. This paper studies the problem of how to automatically, adaptively, and dynamically learn instance-level self-supervised learning strategies for each node from a given pool of pretext tasks. In this paper, we propose a novel multi-teacher knowledge distillation framework for Automated Graph Self-Supervised Learning (AGSSL), which consists of two main branches: (i) Knowledge Extraction: training multiple teachers with different pretext tasks, so as to extract different levels of knowledge with different inductive biases; (ii) Knowledge Integration: integrating different levels of knowledge and distilling them into the student model. Without simply treating different teachers as equally important, we provide a provable theoretical guideline for how to integrate the knowledge of different teachers, i.e., the integrated teacher probability should be close to the true Bayesian class-probability. To approach the theoretical optimum in practice, two adaptive knowledge integration strategies are proposed to construct a relatively "good" integrated teacher. Extensive experiments on eight datasets show that AGSSL can benefit from multiple pretext tasks, outperforming the corresponding individual tasks; by combining a few simple but classical pretext tasks, the resulting performance is comparable to other leading counterparts.
Homophily-Enhanced Self-Supervision for Graph Structure Learning: Insights and Directions.

Lirong Wu,Haitao Lin,Zihan Liu,Zicheng Liu,Yufei Huang,Stan Z. Li

DOI: https://doi.org/10.1109/tnnls.2023.3257325

IF: 14.255

2023-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Graph neural networks (GNNs) have recently achieved remarkable success on a variety of graph-related tasks, while such success relies heavily on a given graph structure that may not always be available in real-world applications. To address this problem, graph structure learning (GSL) is emerging as a promising research topic where task-specific graph structure and GNN parameters are jointly learned in an end-to-end unified framework. Despite their great progress, existing approaches mostly focus on the design of similarity metrics or graph construction, but directly default to adopting downstream objectives as supervision, which lacks deep insight into the power of supervision signals. More importantly, these approaches struggle to explain how GSL helps GNNs, and when and why this help fails. In this article, we conduct a systematic experimental evaluation to reveal that GSL and GNNs enjoy consistent optimization goals in terms of improving the graph homophily. Furthermore, we demonstrate theoretically and experimentally that task-specific downstream supervision may be insufficient to support the learning of both graph structure and GNN parameters, especially when the labeled data are extremely limited. Therefore, as a complement to downstream supervision, we propose homophily-enhanced self-supervision for GSL (HES-GSL), a method that provides more supervision for learning an underlying graph structure. A comprehensive experimental study demonstrates that HES-GSL scales well to various datasets and outperforms other leading methods. Our code will be available in https://github.com/LirongWu/Homophily-Enhanced-Self-supervision.
An end-to-end graph convolutional network for semi-supervised subspace clustering via label self-expressiveness

Tingting Qi,Xiangchu Feng,Bian Gao,Kun Wang

DOI: https://doi.org/10.1016/j.knosys.2024.111393

IF: 8.139

2024-01-12

Knowledge-Based Systems

Abstract:Semi-supervised clustering provides accurate assignments by leveraging a limited amount of supervisory information. There are two main groups of conventional semi-supervised subspace clustering algorithms: Pairwise Constraints (PC)-based methods and Gaussian Fields and Harmonic Function (GFHF)-based methods. Nevertheless, PC-based methods are limited because of their reliance on weak supervisory information. GFHF-based methods, on the other hand, focus on the local relationship between the affinity matrix and the assignment matrix, which restricts their clustering efficacy. Recently, graph convolutional network (GCN) has been employed to effectively transmit the local graph topology of the raw data into the feature domain, which motivates the proposed GCN model for Semi-supervised Subspace Clustering via label self-expressiveness (GSSC). Conventional semi-supervised clustering has been enhanced by incorporating a novel concept known as label self-expressiveness, which serves as a guiding factor for the clustering process. Furthermore, GSSC considers the global geometric structure of the assignment matrix and generates a discriminable assignment matrix using an end-to-end mechanism. Additionally, a well-designed loss function is introduced to train the novel GSSC. The experimental results conducted on four benchmark datasets demonstrate that the proposed GSSC algorithm exhibits superior performance compared to existing semi-supervised clustering algorithms.

computer science, artificial intelligence
Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering Perspective

Yujie Mo,Zhihe Lu,Runpeng Yu,Xiaofeng Zhu,Xinchao Wang

2024-12-01

Abstract:Self-supervised heterogeneous graph learning (SHGL) has shown promising potential in diverse scenarios. However, while existing SHGL methods share a similar essential with clustering approaches, they encounter two significant limitations: (i) noise in graph structures is often introduced during the message-passing process to weaken node representations, and (ii) cluster-level information may be inadequately captured and leveraged, diminishing the performance in downstream tasks. In this paper, we address these limitations by theoretically revisiting SHGL from the spectral clustering perspective and introducing a novel framework enhanced by rank and dual consistency constraints. Specifically, our framework incorporates a rank-constrained spectral clustering method that refines the affinity matrix to exclude noise effectively. Additionally, we integrate node-level and cluster-level consistency constraints that concurrently capture invariant and clustering information to facilitate learning in downstream tasks. We theoretically demonstrate that the learned representations are divided into distinct partitions based on the number of classes and exhibit enhanced generalization ability across tasks. Experimental results affirm the superiority of our method, showcasing remarkable improvements in several downstream tasks compared to existing methods.

Artificial Intelligence
Self-Supervised Conditional Distribution Learning on Graphs

Jie Chen,Hua Mao,Yuanbiao Gou,Zhu Wang,Xi Peng

2024-11-20

Abstract:Graph contrastive learning (GCL) has shown promising performance in semisupervised graph classification. However, existing studies still encounter significant challenges in GCL. First, successive layers in graph neural network (GNN) tend to produce more similar node embeddings, while GCL aims to increase the dissimilarity between negative pairs of node embeddings. This inevitably results in a conflict between the message-passing mechanism of GNNs and the contrastive learning of negative pairs via intraviews. Second, leveraging the diversity and quantity of data provided by graph-structured data augmentations while preserving intrinsic semantic information is challenging. In this paper, we propose a self-supervised conditional distribution learning (SSCDL) method designed to learn graph representations from graph-structured data for semisupervised graph classification. Specifically, we present an end-to-end graph representation learning model to align the conditional distributions of weakly and strongly augmented features over the original features. This alignment effectively reduces the risk of disrupting intrinsic semantic information through graph-structured data augmentation. To avoid conflict between the message-passing mechanism and contrastive learning of negative pairs, positive pairs of node representations are retained for measuring the similarity between the original features and the corresponding weakly augmented features. Extensive experiments with several benchmark graph datasets demonstrate the effectiveness of the proposed SSCDL method.

Machine Learning,Artificial Intelligence
Self-supervised Contrastive Attributed Graph Clustering

Wei Xia,Quanxue Gao,Ming Yang,Xinbo Gao

DOI: https://doi.org/10.1109/TMM.2022.3213208

2021-10-15

Abstract:Attributed graph clustering, which learns node representation from node attribute and topological graph for clustering, is a fundamental but challenging task for graph analysis. Recently, methods based on graph contrastive learning (GCL) have obtained impressive clustering performance on this task. Yet, we observe that existing GCL-based methods 1) fail to benefit from imprecise clustering labels; 2) require a post-processing operation to get clustering labels; 3) cannot solve out-of-sample (OOS) problem. To address these issues, we propose a novel attributed graph clustering network, namely Self-supervised Contrastive Attributed Graph Clustering (SCAGC). In SCAGC, by leveraging inaccurate clustering labels, a self-supervised contrastive loss, which aims to maximize the similarities of intra-cluster nodes while minimizing the similarities of inter-cluster nodes, are designed for node representation learning. Meanwhile, a clustering module is built to directly output clustering labels by contrasting the representation of different clusters. Thus, for the OOS nodes, SCAGC can directly calculate their clustering labels. Extensive experimental results on four benchmark datasets have shown that SCAGC consistently outperforms 11 competitive clustering methods.

Machine Learning,Artificial Intelligence
Self-Supervised Contrastive Graph Clustering Network via Structural Information Fusion

Xiaoyang Ji,Yuchen Zhou,Haofu Yang,Shiyue Xu,Jiahao Li

DOI: https://doi.org/10.1109/CSCWD61410.2024.10580852

2024-08-08

Abstract:Graph clustering, a classical task in graph learning, involves partitioning the nodes of a graph into distinct clusters. This task has applications in various real-world scenarios, such as anomaly detection, social network analysis, and community discovery. Current graph clustering methods commonly rely on module pre-training to obtain a reliable prior distribution for the model, which is then used as the optimization objective. However, these methods often overlook deeper supervised signals, leading to sub-optimal reliability of the prior distribution. To address this issue, we propose a novel deep graph clustering method called CGCN. Our approach introduces contrastive signals and deep structural information into the pre-training process. Specifically, CGCN utilizes a contrastive learning mechanism to foster information interoperability among multiple modules and allows the model to adaptively adjust the degree of information aggregation for different order structures. Our CGCN method has been experimentally validated on multiple real-world graph datasets, showcasing its ability to boost the dependability of prior clustering distributions acquired through pre-training. As a result, we observed notable enhancements in the performance of the model.

Machine Learning,Emerging Technologies
Boosting Pseudo-Labeling With Curriculum Self-Reflection for Attributed Graph Clustering

Pengfei Zhu,Jialu Li,Yu Wang,Bin Xiao,Jinglin Zhang,Wanyu Lin,Qinghua Hu

DOI: https://doi.org/10.1109/TNNLS.2024.3416167

2024-09-09

Abstract:Attributed graph clustering is an unsupervised learning task that aims to partition various nodes of a graph into distinct groups. Existing approaches focus on devising diverse pretext tasks to obtain suitable supervised information for representation learning, among which the predictive methods show great potential. However, these methods 1) generate auxiliary task bias toward the clustering target and 2) introduce label noise due to static thresholds. To address this issue, we propose a new self-supervised learning method, namely, pseudo-labeling with curriculum self-reflection (PLCSR), that learns reliable pseudo-labels by mining its information to achieve progressive processing of nodes in a self-reflection manner. First, a self-auxiliary encoder is constructed using the exponential moving average (EMA) of the original encoder's parameters to replace the auxiliary tasks, which provides an additional perspective of finding highly confident pseudo-labels. Second, a curriculum selection strategy using dynamic thresholds is designed to take full advantage of graph nodes more accurately. Besides simple nodes with high confidence at the initial stage, nodes that yield consistent predictions from both encoders are then assigned pseudo-labels to avoid the under-learning problem. For the rest difficult nodes that are highly uncertain, we abstain from making judgments to minimize their adverse impact on the model. Extensive experiments have shown that PLCSR significantly outperforms the state-of-the-art predictive method CDRS, achieving more than 6% improvements in terms of clustering accuracy. The code is available at: https://github.com/Jillian555/PLCSR.
Structured graph learning for clustering and semi-supervised classification

Zhao Kang,Chong Peng,Qiang Cheng,Xinwang Liu,Xi Peng,Zenglin Xu,Ling Tian

DOI: https://doi.org/10.1016/j.patcog.2020.107627

IF: 8

2021-02-01

Pattern Recognition

Abstract:Graphs have become increasingly popular in modeling structures and interactions in a wide variety of problems during the last decade. Graph-based clustering and semi-supervised classification techniques have shown impressive performance. This paper proposes a graph learning framework to preserve both the local and global structure of data. Specifically, our method uses the self-expressiveness of samples to capture the global structure and adaptive neighbor approach to respect the local structure. Furthermore, most existing graph-based methods conduct clustering and semi-supervised classification on the graph learned from the original data matrix, which doesn't have explicit cluster structure, thus they might not achieve the optimal performance. By considering rank constraint, the achieved graph will have exactly c connected components if there are c clusters or classes. As a byproduct of this, graph learning and label inference are jointly and iteratively implemented in a principled way. Theoretically, we show that our model is equivalent to a combination of kernel k-means and k-means methods under certain condition. Extensive experiments on clustering and semi-supervised classification demonstrate that the proposed method outperforms other state-of-the-art methods.

computer science, artificial intelligence,engineering, electrical & electronic
Graph Contrastive Learning via Cluster-refined Negative Sampling for Semi-supervised Text Classification

Wei Ai,Jianbin Li,Ze Wang,Jiayi Du,Tao Meng,Yuntao Shou,Keqin Li

2024-10-19

Abstract:Graph contrastive learning (GCL) has been widely applied to text classification tasks due to its ability to generate self-supervised signals from unlabeled data, thus facilitating model training. However, existing GCL-based text classification methods often suffer from negative sampling bias, where similar nodes are incorrectly paired as negative pairs. This can lead to over-clustering, where instances of the same class are divided into different clusters. To address the over-clustering issue, we propose an innovative GCL-based method of graph contrastive learning via cluster-refined negative sampling for semi-supervised text classification, namely ClusterText. Firstly, we combine the pre-trained model Bert with graph neural networks to learn text representations. Secondly, we introduce a clustering refinement strategy, which clusters the learned text representations to obtain pseudo labels. For each text node, its negative sample set is drawn from different clusters. Additionally, we propose a self-correction mechanism to mitigate the loss of true negative samples caused by clustering inconsistency. By calculating the Euclidean distance between each text node and other nodes within the same cluster, distant nodes are still selected as negative samples. Our proposed ClusterText demonstrates good scalable computing, as it can effectively extract important information from from a large amount of data. Experimental results demonstrate the superiority of ClusterText in text classification tasks.

Machine Learning,Computation and Language
Eliciting Structural and Semantic Global Knowledge in Unsupervised Graph Contrastive Learning

Kaize Ding,Yancheng Wang,Yingzhen Yang,Huan Liu

DOI: https://doi.org/10.48550/arXiv.2202.08480

2022-12-05

Abstract:Graph Contrastive Learning (GCL) has recently drawn much research interest for learning generalizable node representations in a self-supervised manner. In general, the contrastive learning process in GCL is performed on top of the representations learned by a graph neural network (GNN) backbone, which transforms and propagates the node contextual information based on its local neighborhoods. However, nodes sharing similar characteristics may not always be geographically close, which poses a great challenge for unsupervised GCL efforts due to their inherent limitations in capturing such global graph knowledge. In this work, we address their inherent limitations by proposing a simple yet effective framework -- Simple Neural Networks with Structural and Semantic Contrastive Learning} (S^3-CL). Notably, by virtue of the proposed structural and semantic contrastive learning algorithms, even a simple neural network can learn expressive node representations that preserve valuable global structural and semantic patterns. Our experiments demonstrate that the node representations learned by S^3-CL achieve superior performance on different downstream tasks compared with the state-of-the-art unsupervised GCL methods. Implementation and more experimental details are publicly available at \url{<a class="link-external link-https" href="https://github.com/kaize0409/S-3-CL" rel="external noopener nofollow">this https URL</a>.}

Machine Learning
Multi-Task Curriculum Graph Contrastive Learning with Clustering Entropy Guidance

Chusheng Zeng,Bocheng Wang,Jinghui Yuan,Rong Wang,Mulin Chen

2024-08-22

Abstract:Recent advances in unsupervised deep graph clustering have been significantly promoted by contrastive learning. Despite the strides, most graph contrastive learning models face challenges: 1) graph augmentation is used to improve learning diversity, but commonly used random augmentation methods may destroy inherent semantics and cause noise; 2) the fixed positive and negative sample selection strategy is limited to deal with complex real data, thereby impeding the model's capability to capture fine-grained patterns and relationships. To reduce these problems, we propose the Clustering-guided Curriculum Graph contrastive Learning (CCGL) framework. CCGL uses clustering entropy as the guidance of the following graph augmentation and contrastive learning. Specifically, according to the clustering entropy, the intra-class edges and important features are emphasized in augmentation. Then, a multi-task curriculum learning scheme is proposed, which employs the clustering guidance to shift the focus from the discrimination task to the clustering task. In this way, the sample selection strategy of contrastive learning can be adjusted adaptively from early to late stage, which enhances the model's flexibility for complex data structure. Experimental results demonstrate that CCGL has achieved excellent performance compared to state-of-the-art competitors.

Machine Learning
Graph Soft-Contrastive Learning via Neighborhood Ranking

Zhiyuan Ning,Pengfei Wang,Pengyang Wang,Ziyue Qiao,Wei Fan,Denghui Zhang,Yi Du,Yuanchun Zhou

2023-08-02

Abstract:Graph Contrastive Learning (GCL) has emerged as a promising approach in the realm of graph self-supervised learning. Prevailing GCL methods mainly derive from the principles of contrastive learning in the field of computer vision: modeling invariance by specifying absolutely similar pairs. However, when applied to graph data, this paradigm encounters two significant limitations: (1) the validity of the generated views cannot be guaranteed: graph perturbation may produce invalid views against semantics and intrinsic topology of graph data; (2) specifying absolutely similar pairs in the graph views is unreliable: for abstract and non-Euclidean graph data, it is difficult for humans to decide the absolute similarity and dissimilarity intuitively. Despite the notable performance of current GCL methods, these challenges necessitate a reevaluation: Could GCL be more effectively tailored to the intrinsic properties of graphs, rather than merely adopting principles from computer vision? In response to this query, we propose a novel paradigm, Graph Soft-Contrastive Learning (GSCL). This approach facilitates GCL via neighborhood ranking, avoiding the need to specify absolutely similar pairs. GSCL leverages the underlying graph characteristic of diminishing label consistency, asserting that nodes that are closer in the graph are overall more similar than far-distant nodes. Within the GSCL framework, we introduce pairwise and listwise gated ranking InfoNCE loss functions to effectively preserve the relative similarity ranking within neighborhoods. Moreover, as the neighborhood size exponentially expands with more hops considered, we propose neighborhood sampling strategies to improve learning efficiency. Our extensive empirical results across 11 commonly used graph datasets-including 8 homophily graphs and 3 heterophily graphs-demonstrate GSCL's superior performance compared to 20 SOTA GCL methods.

Machine Learning,Artificial Intelligence
Supervised contrastive learning for graph representation enhancement

Mohadeseh Ghayekhloo,Ahmad Nickabadi

DOI: https://doi.org/10.1016/j.neucom.2024.127710

IF: 6

2024-04-19

Neurocomputing

Abstract:Graph Neural Networks (GNNs) have exhibited significant success in various applications, but they face challenges when labeled nodes are limited. A novel self-supervised learning paradigm has emerged, enabling GNN training without labeled nodes and even surpassing GNNs with limited labeled data. However, self-supervised methods lack class-discriminative node representations due to the absence of labeled information during training. In this paper, we exploit a supervised graph contrastive learning approach (SGCL 1 ) framework to tackle the issue of limited labeled nodes, ensuring coherent grouping of nodes within the same class. We introduce augmentation techniques based on a novel centrality function to highlight important topological structures. Additionally, we inject noise into less informative node features, compelling the model to extract underlying semantic information. Our approach combines supervised contrastive loss and node similarity regularization while achieving consistent grouping of unlabeled nodes with labeled ones. Furthermore, we utilize the pseudo-labeling technique to propagate label information to distant nodes and address the underfitting problem, especially with low-degree nodes. Experimental results on real-world graphs demonstrate that SGCL outperforms both semi-supervised and self-supervised methods in node classification.

computer science, artificial intelligence
CLEAR: Cluster-Enhanced Contrast for Self-Supervised Graph Representation Learning.

Xiao Luo,Wei Ju,Meng Qu,Yiyang Gu,Chong Chen,Minghua Deng,Xian-Sheng Hua,Ming Zhang

DOI: https://doi.org/10.1109/tnnls.2022.3177775

IF: 14.255

2024-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:This article studies self-supervised graph representation learning, which is critical to various tasks, such as protein property prediction. Existing methods typically aggregate representations of each individual node as graph representations, but fail to comprehensively explore local substructures (i.e., motifs and subgraphs), which also play important roles in many graph mining tasks. In this article, we propose a self-supervised graph representation learning framework named cluster-enhanced Contrast (CLEAR) that models the structural semantics of a graph from graph-level and substructure-level granularities, i.e., global semantics and local semantics, respectively. Specifically, we use graph-level augmentation strategies followed by a graph neural network-based encoder to explore global semantics. As for local semantics, we first use graph clustering techniques to partition each whole graph into several subgraphs while preserving as much semantic information as possible. We further employ a self-attention interaction module to aggregate the semantics of all subgraphs into a local-view graph representation. Moreover, we integrate both global semantics and local semantics into a multiview graph contrastive learning framework, enhancing the semantic-discriminative ability of graph representations. Extensive experiments on various real-world benchmarks demonstrate the efficacy of the proposed CLEAR over current graph self-supervised representation learning approaches on both graph classification and transfer learning tasks.
Knowledge-Aware Graph Self-Supervised Learning for Recommendation

Shanshan Li,Yutong Jia,You Wu,Ning Wei,Liyan Zhang,Jingfeng Guo

DOI: https://doi.org/10.3390/electronics12234869

IF: 2.9

2023-12-03

Electronics

Abstract:Collaborative filtering (CF) based on graph neural networks (GNN) can capture higher-order relationships between nodes, which in turn improves recommendation performance. Although effective, GNN-based methods still face the challenges of sparsity and noise in real scenarios. In recent years, researchers have introduced graph self-supervised learning (SSL) techniques into CF to alleviate the sparse supervision problem. The technique first augments the data to obtain contrastive views and then utilizes the mutual information maximization to provide self-supervised signals for the contrastive views. However, the existing approaches based on graph self-supervised signals still face the following challenges: (i) Most of the works fail to effectively mine and exploit the supervised information from the item knowledge graph, resulting in suboptimal performance. (ii) Existing data augmentation methods are unable to fully exploit the potential of contrastive learning, because they primarily focus on the contrastive view of data structure changes and neglect the adjacent relationship among users and items. To address these issues, we propose a novel self-supervised learning approach, namely Knowledge-aware Graph Self-supervised Learning (KGSL). Specifically, we calculate node similarity based on semantic relations between items in the knowledge graph to generate a semantic-based item similarity graph. Then, the self-supervised learning contrast views are generated from both the user–item interaction graph and the item similarity graph, respectively. Maximization of the information from these contrastive views provides additional self-supervised signals to enhance the node representation capacity. Finally, we establish a joint training strategy for the self-supervised learning task and the recommendation task to further optimize the learning process of KGSL. Extensive comparative experiments as well as ablation experiments are conducted on three real-world datasets to verify the effectiveness of KGSL.

engineering, electrical & electronic,computer science, information systems,physics, applied
From Cluster Assumption to Graph Convolution: Graph-based Semi-Supervised Learning Revisited

Zheng Wang,Hongming Ding,Li Pan,Jianhua Li,Zhiguo Gong,Philip S. Yu

2024-06-03

Abstract:Graph-based semi-supervised learning (GSSL) has long been a hot research topic. Traditional methods are generally shallow learners, based on the cluster assumption. Recently, graph convolutional networks (GCNs) have become the predominant techniques for their promising performance. In this paper, we theoretically discuss the relationship between these two types of methods in a unified optimization framework. One of the most intriguing findings is that, unlike traditional ones, typical GCNs may not jointly consider the graph structure and label information at each layer. Motivated by this, we further propose three simple but powerful graph convolution methods. The first is a supervised method OGC which guides the graph convolution process with labels. The others are two unsupervised methods: GGC and its multi-scale version GGCM, both aiming to preserve the graph structure information during the convolution process. Finally, we conduct extensive experiments to show the effectiveness of our methods.

Machine Learning,Artificial Intelligence
Community-Aware Efficient Graph Contrastive Learning via Personalized Self-Training

Yuecheng Li,Yanming Hu,Lele Fu,Chuan Chen,Lei Yang,Zibin Zheng

2023-11-18

Abstract:In recent years, graph contrastive learning (GCL) has emerged as one of the optimal solutions for various supervised tasks at the node level. However, for unsupervised and structure-related tasks such as community detection, current GCL algorithms face difficulties in acquiring the necessary community-level information, resulting in poor performance. In addition, general contrastive learning algorithms improve the performance of downstream tasks by increasing the number of negative samples, which leads to severe class collision and unfairness of community detection. To address above issues, we propose a novel Community-aware Efficient Graph Contrastive Learning Framework (CEGCL) to jointly learn community partition and node representations in an end-to-end manner. Specifically, we first design a personalized self-training (PeST) strategy for unsupervised scenarios, which enables our model to capture precise community-level personalized information in a graph. With the benefit of the PeST, we alleviate class collision and unfairness without sacrificing the overall model performance. Furthermore, the aligned graph clustering (AlGC) is employed to obtain the community partition. In this module, we align the clustering space of our downstream task with that in PeST to achieve more consistent node embeddings. Finally, we demonstrate the effectiveness of our model for community detection both theoretically and experimentally. Extensive experimental results also show that our CEGCL exhibits state-of-the-art performance on three benchmark datasets with different scales.

Social and Information Networks,Artificial Intelligence,Machine Learning
A self-supervised learning model for graph clustering optimization problems

Qingqiong Cai,Xingyue Guo,Shenwei Huang

DOI: https://doi.org/10.1016/j.knosys.2024.111549

IF: 8.139

2024-03-03

Knowledge-Based Systems

Abstract:The graph clustering optimization problems are ubiquitous in both scientific and engineering fields, for example the graph partitioning problem and facility location problem. Since most of these problems are NP-hard, it is challenging to design effective algorithms for them. Recently, deep learning has achieved promising performances in solving combinatorial optimization problems. However, existing supervised learning-based methods are limited by the absence of labeled instances, while reinforcement learning-based methods tend to be hard to train and converge slowly for large instances. In this paper, we propose a self-supervised model named GCOM to address NP-hard graph clustering optimization problems. It adopts a pre-training and fine-tuning framework. In the pre-training process, we utilize graph contrastive learning to mine the latent clustering relations and useful optimization strategies, which can be generalized to the downstream tasks. Additionally, two effective graph encodings are introduced to enhance the expressive power of our model. We evaluate our model on facility location problem (FLP) and balanced graph partitioning (BGP). Extensive experiments conducted on both synthetic and real-world datasets validate superior performance, strong generalization ability and high sample-efficiency of our model.

computer science, artificial intelligence
SSGCL: Simple Social Recommendation with Graph Contrastive Learning

Zhihua Duan,Chun Wang,Wending Zhong

DOI: https://doi.org/10.3390/math12071107

IF: 2.4

2024-04-07

Mathematics

Abstract:As user–item interaction information is typically limited, collaborative filtering (CF)-based recommender systems often suffer from the data sparsity issue. To address this issue, recent recommender systems have turned to graph neural networks (GNNs) due to their superior performance in capturing high-order relationships. Furthermore, some of these GNN-based recommendation models also attempt to incorporate other information. They either extract self-supervised signals to mitigate the data sparsity problem or employ social information to assist with learning better representations under a social recommendation setting. However, only a few methods can take full advantage of these different aspects of information. Based on some testing, we believe most of these methods are complex and redundantly designed, which may lead to sub-optimal results. In this paper, we propose SSGCL, which is a recommendation system model that utilizes both social information and self-supervised information. We design a GNN-based propagation strategy that integrates social information with interest information in a simple yet effective way to learn user–item representations for recommendations. In addition, a specially designed contrastive learning module is employed to take advantage of the self-supervised signals for a better user–item representation distribution. The contrastive learning module is jointly optimized with the recommendation module to benefit the final recommendation result. Experiments on several benchmark data sets demonstrate the significant improvement in performance achieved by our model when compared with baseline models.

mathematics

Influence of long-term diabetes on liver glycogen metabolism in the rat.

Automated Graph Self-supervised Learning via Multi-teacher Knowledge Distillation

Homophily-Enhanced Self-Supervision for Graph Structure Learning: Insights and Directions.

An end-to-end graph convolutional network for semi-supervised subspace clustering via label self-expressiveness

Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering Perspective

Self-Supervised Conditional Distribution Learning on Graphs

Self-supervised Contrastive Attributed Graph Clustering

Self-Supervised Contrastive Graph Clustering Network via Structural Information Fusion

Boosting Pseudo-Labeling With Curriculum Self-Reflection for Attributed Graph Clustering

Structured graph learning for clustering and semi-supervised classification

Graph Contrastive Learning via Cluster-refined Negative Sampling for Semi-supervised Text Classification

Eliciting Structural and Semantic Global Knowledge in Unsupervised Graph Contrastive Learning

Multi-Task Curriculum Graph Contrastive Learning with Clustering Entropy Guidance

Graph Soft-Contrastive Learning via Neighborhood Ranking

Supervised contrastive learning for graph representation enhancement

CLEAR: Cluster-Enhanced Contrast for Self-Supervised Graph Representation Learning.

Knowledge-Aware Graph Self-Supervised Learning for Recommendation

From Cluster Assumption to Graph Convolution: Graph-based Semi-Supervised Learning Revisited

Community-Aware Efficient Graph Contrastive Learning via Personalized Self-Training

A self-supervised learning model for graph clustering optimization problems

SSGCL: Simple Social Recommendation with Graph Contrastive Learning