The value of carpal compression test (CCT) as an alternative provocative clinical manoeuvre.

P. Nathan,R. Keniston,K. D. Meadows,L. Lockwood

DOI: https://doi.org/10.1016/S0266-7681(97)80461-5

1997-12-01

Abstract:

What problem does this paper attempt to address?

ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learning

Jun Xia,Lirong Wu,Ge Wang,Jintao Chen,Stan Z. Li

DOI: https://doi.org/10.48550/arxiv.2110.02027

2022-01-01

Abstract:Contrastive Learning (CL) has emerged as a dominant technique for unsupervised representation learning which embeds augmented versions of the anchor close to each other (positive samples) and pushes the embeddings of other samples (negatives) apart. As revealed in recent studies, CL can benefit from hard negatives (negatives that are most similar to the anchor). However, we observe limited benefits when we adopt existing hard negative mining techniques of other domains in Graph Contrastive Learning (GCL). We perform both experimental and theoretical analysis on this phenomenon and find it can be attributed to the message passing of Graph Neural Networks (GNNs). Unlike CL in other domains, most hard negatives are potentially false negatives (negatives that share the same class with the anchor) if they are selected merely according to the similarities between anchor and themselves, which will undesirably push away the samples of the same class. To remedy this deficiency, we propose an effective method, dubbed \textbf{ProGCL}, to estimate the probability of a negative being true one, which constitutes a more suitable measure for negatives' hardness together with similarity. Additionally, we devise two schemes (i.e., \textbf{ProGCL-weight} and \textbf{ProGCL-mix}) to boost the performance of GCL. Extensive experiments demonstrate that ProGCL brings notable and consistent improvements over base GCL methods and yields multiple state-of-the-art results on several unsupervised benchmarks or even exceeds the performance of supervised ones. Also, ProGCL is readily pluggable into various negatives-based GCL methods for performance improvement. We release the code at \textcolor{magenta}{\url{https://github.com/junxia97/ProGCL}}.
Debiased Graph Contrastive Learning.

Jun Xia,Lirong Wu,Jintao Chen,Ge Wang,Stan Z. Li

2021-01-01

Abstract:Contrastive learning (CL) has emerged as a dominant technique for unsupervised representation learning which embeds augmented versions of the anchor close to each other (positive samples) and pushes the embeddings of other samples (negative samples) apart. As revealed in recent works, CL can benefit from hard negative samples (negative samples that are difficult to distinguish from the anchor). However, we observe minor improvement or even performance drop when we adopt existing hard negative mining techniques in Graph Contrastive Learning (GCL). We find that many hard negative samples similar to anchor point are false negative ones (samples from the same class as anchor point) in GCL, which is different from CL in computer vision and will lead to unsatisfactory performance of existing hard negative mining techniques in GCL. To eliminate this bias, we propose Debiased Graph Contrastive Learning (DGCL), a novel and effective method to estimate the probability whether each negative sample is true or not. With this probability, we devise two schemes (i.e., DGCL-weight and DGCL-mix) to boost the performance of GCL. Empirically, DGCL outperforms or matches previous unsupervised state-of-the-art results on several benchmarks and even exceeds the performance of supervised ones.
AHP: Learning to Negative Sample for Hyperedge Prediction

Hyunjin Hwang,Seungwoo Lee,Chanyoung Park,Kijung Shin

DOI: https://doi.org/10.48550/arXiv.2204.06353

2022-04-16

Abstract:Hypergraphs (i.e., sets of hyperedges) naturally represent group relations (e.g., researchers co-authoring a paper and ingredients used together in a recipe), each of which corresponds to a hyperedge (i.e., a subset of nodes). Predicting future or missing hyperedges bears significant implications for many applications (e.g., collaboration and recipe recommendation). What makes hyperedge prediction particularly challenging is the vast number of non-hyperedge subsets, which grows exponentially with the number of nodes. Since it is prohibitive to use all of them as negative examples for model training, it is inevitable to sample a very small portion of them, and to this end, heuristic sampling schemes have been employed. However, trained models suffer from poor generalization capability for examples of different natures. In this paper, we propose AHP, an adversarial training-based hyperedge-prediction method. It learns to sample negative examples without relying on any heuristic schemes. Using six real hypergraphs, we show that AHP generalizes better to negative examples of various natures. It yields up to 28.2% higher AUROC than the best existing methods and often even outperforms its variants with sampling schemes tailored to test sets.

Machine Learning,Social and Information Networks
Aggregative and Contrastive Dual-View Graph Attention Network for Hyperspectral Image Classification

Haoyu Jing,Sensen Wu,Laifu Zhang,Fanen Meng,Tian Feng,Yiming Yan,Yuanyuan Wang,Zhenhong Du

DOI: https://doi.org/10.1109/tgrs.2024.3443953

2024-01-01

Abstract:Graph convolutional networks (GCNs) have recently gained prominence in hyperspectral images (HSIs) classification tasks given their superior performance on non-Euclidean data. However, GCN-based methods are heavily reliant on complete graph structural information, which can cause the aggregation and transmission of information across nodes from differing classes, thereby compromising the classification performance. Furthermore, the scarcity of labeled pixels in HSIs often limits the representational capability of such methods. To address these issues, we propose an aggregative and contrastive dual-view graph attention network (ACoD-GAT) for HSI classification. Specifically, we present a progressive aggregation module, including a pixel clustering submodule and a node aggregation submodule to exploit semantic information at various levels. Besides, we integrate multiscale manipulation with a diffusion matrix to construct the dual view to further extract semantic information from both local and global perspectives. Moreover, we design an unsupervised contrastive loss function and a supervised contrastive loss function to facilitate contrastive learning on the dual view, improving the representational capabilities of ACoD-GAT with very few labeled samples. The extensive experimental results on four benchmark datasets demonstrate the superiority of the proposed ACoD-GAT compared with other state-of-the-art methods.
Negative samples selecting strategy for graph contrastive learning

Rui Miao,Yintao Yang,Yao Ma,Xin Juan,Haotian Xue,Jiliang Tang,Ying Wang,Xin Wang

DOI: https://doi.org/10.1016/j.ins.2022.09.024

IF: 8.1

2022-10-01

Information Sciences

Abstract:Graph neural networks (GNNs) have emerged as a successful method on graph structured data. Limited by expensive labeled data, contrastive learning has been adopted to the graph domain. In most existing node-level graph contrastive learning methods, when applying contrastive learning to a certain unlabeled node (the center node), its corresponding “similar” node (positive sample) is usually generated by data augmentation. Other nodes in the graph are served as the “dissimilar” nodes (negative samples), which leads to two major problems. First, the computational cost can be prohibitively expensive, especially when the graph is large. Second, utilizing some nodes which share the same label with the center node as the negative samples will damage the learning process. Hence, to address these issues, we explore the feasibility of only sampling a part of nodes for graph contrastive learning process. And unlike the previous self-supervised contrastive methods, we use joint training to exploit supervised signals as much as possible in contrastive learning. Hence, we propose a Negative Samples Selecting Strategy to utilize the classification prediction to guide the selection of the negative samples for sampled nodes. Then, we further incorporate this strategy for performing contrastive learning on graphs and propose a framework named Graph Contrastive Learning with Negative Samples Selecting Strategy (GCNSS). We demonstrate that GCNSS can be trained much faster with much less computation memory than graph contrastive learning baselines, and GCNSS can effectively boost the performance of existing GNN models on semi-supervised node classification tasks across many different datasets. The code is in: https://github.com/MR9812/GCNSS.

computer science, information systems
Negative Samples Mining Matters: Reconsidering Hyperspectral Image Classification with Contrastive Learning

Hui Liu,Chenjia Huang,Ning Chen,Tao Xie,Mingyue Lu,Zhou Huang

DOI: https://doi.org/10.1109/tgrs.2024.3491074

IF: 8.2

2024-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:In recent years, there have been significant advancements in Hyperspectral Image (HSI) classification methods utilizing contrastive learning. However, these methods often fail to effectively screen and mine negative samples during the construction of contrastive learning pairs. This oversight introduces negative samples that belong to the same class as the positive samples, thereby limiting the effectiveness of contrastive learning. To address this issue, we propose a novel HSI classification framework based on contrastive learning that flexibly supports the selection and mining of negative samples. Specifically, before training the contrastive learning task, we utilize pseudo-label information to guide the mining of negative samples, eliminating those with pseudo-labels of the same class as the anchor samples. This approach strengthens the alignment between the optimization directions of the contrastive learning task and the classification task. Additionally, we improve the contrastive learning process by introducing a controlled mixture of hard and easy negative samples, which enhances the accuracy of HSI classification. The pivotal characteristic of this study lies in enhancing the effectiveness of HSI classification based on contrastive learning through effective filtering and mining of negative samples. Experimental comparisons across multiple public datasets demonstrate the superiority of our proposed method over state-of-the-art algorithms.
Hard Sample Aware Network for Contrastive Deep Graph Clustering

Yue Liu,Xihong Yang,Sihang Zhou,Xinwang Liu,Zhen Wang,Ke Liang,Wenxuan Tu,Liang Li,Jingcan Duan,Cancan Chen

DOI: https://doi.org/10.48550/arXiv.2212.08665

2023-01-28

Abstract:Contrastive deep graph clustering, which aims to divide nodes into disjoint groups via contrastive mechanisms, is a challenging research spot. Among the recent works, hard sample mining-based algorithms have achieved great attention for their promising performance. However, we find that the existing hard sample mining methods have two problems as follows. 1) In the hardness measurement, the important structural information is overlooked for similarity calculation, degrading the representativeness of the selected hard negative samples. 2) Previous works merely focus on the hard negative sample pairs while neglecting the hard positive sample pairs. Nevertheless, samples within the same cluster but with low similarity should also be carefully learned. To solve the problems, we propose a novel contrastive deep graph clustering method dubbed Hard Sample Aware Network (HSAN) by introducing a comprehensive similarity measure criterion and a general dynamic sample weighing strategy. Concretely, in our algorithm, the similarities between samples are calculated by considering both the attribute embeddings and the structure embeddings, better revealing sample relationships and assisting hardness measurement. Moreover, under the guidance of the carefully collected high-confidence clustering information, our proposed weight modulating function will first recognize the positive and negative samples and then dynamically up-weight the hard sample pairs while down-weighting the easy ones. In this way, our method can mine not only the hard negative samples but also the hard positive sample, thus improving the discriminative capability of the samples further. Extensive experiments and analyses demonstrate the superiority and effectiveness of our proposed method.

Machine Learning,Artificial Intelligence
Ha-gnn: a novel graph neural network based on hyperbolic attention

Hongbo Qu,Yu-Rong Song,Minglei Zhang,Guo-Ping Jiang,Ruqi Li,Bo Song

DOI: https://doi.org/10.1007/s00521-024-09689-9

2024-04-21

Neural Computing and Applications

Abstract:Graph neural networks (GNNs) are powerful tools for data mining on graph-structured data in various domains, such as social science, finance, and biology. However, most existing GNNs operate in Euclidean space and may fail to preserve the intrinsic network properties, such as self-similarity and hierarchy, that characterize many real-world graphs. Hyperbolic graph neural networks (HGNNs) address this limitation by embedding graphs into hyperbolic space, which can better capture the hierarchical structures of networks. However, HGNNs often involve complex computations in hyperbolic space or its tangent space during training, which may hinder their efficiency. In this paper, we propose hyperbolic attention graph neural networks (HA-GNN), which can leverage both network structure and node features for graph representation learning in an efficient way. Specifically, we design a structural properties attention mechanism that measures the structural connection between nodes based on their hyperbolic embeddings. We also design a node features attention mechanism that quantifies the feature similarity between nodes. We then combine these two attentions to obtain a hyperbolic attention that weights the relevance between all connected nodes. We conduct extensive experiments on five real-world networks and demonstrate that our model consistently and significantly outperforms other state-of-the-art methods. For example, on the Cora network, our model achieves an accuracy of 83.1 (± 0.4) on node classification tasks, which is 1.6% higher than the best baseline method in Euclidean space.

computer science, artificial intelligence
Scalable and Effective Negative Sample Generation for Hyperedge Prediction

Shilin Qu,Weiqing Wang,Yuan-Fang Li,Quoc Viet Hung Nguyen,Hongzhi Yin

2024-11-19

Abstract:Hyperedge prediction is crucial in hypergraph analysis for understanding complex multi-entity interactions in various web-based applications, including social networks and e-commerce systems. Traditional methods often face difficulties in generating high-quality negative samples due to the imbalance between positive and negative instances. To address this, we present the Scalable and Effective Negative Sample Generation for Hyperedge Prediction (SEHP) framework, which utilizes diffusion models to tackle these challenges. SEHP employs a boundary-aware loss function that iteratively refines negative samples, moving them closer to decision boundaries to improve classification performance. SEHP samples positive instances to form sub-hypergraphs for scalable batch processing. By using structural information from sub-hypergraphs as conditions within the diffusion process, SEHP effectively captures global patterns. To enhance efficiency, our approach operates directly in latent space, avoiding the need for discrete ID generation and resulting in significant speed improvements while preserving accuracy. Extensive experiments show that SEHP outperforms existing methods in accuracy, efficiency, and scalability, representing a substantial advancement in hyperedge prediction techniques. Our code is available here.

Information Retrieval
Hierarchical Contrastive Learning Enhanced Heterogeneous Graph Neural Network

Nian Liu,Xiao Wang,Hui Han,Chuan Shi

DOI: https://doi.org/10.1109/tkde.2023.3264691

IF: 9.235

2023-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Heterogeneous graph neural networks (HGNNs) as an emerging technique have shown superior capacity of dealing with heterogeneous information network (HIN). However, most HGNNs follow a semi-supervised learning manner, which notably limits their wide use in reality since labels are usually scarce in real applications. Recently, contrastive learning, a self-supervised method, becomes one of the most exciting learning paradigms and shows great potential when there are no labels. In this paper, we study the problem of self-supervised HGNNs and propose a novel co-contrastive learning mechanism for HGNNs, named HeCo. Different from traditional contrastive learning which only focuses on contrasting positive and negative samples, HeCo employs cross-view contrastive mechanism. Specifically, two views of a HIN (network schema and meta-path views) are proposed to learn node embeddings, so as to capture both of local and high-order structures simultaneously. Then the cross-view contrastive learning, as well as a view mask mechanism, is proposed, which is able to extract the positive and negative embeddings from two views. This enables the two views to collaboratively supervise each other and finally learn high-level node embeddings. Moreover, to further boost the performance of HeCo, two additional methods are designed to generate harder negative samples with high quality. The essence of HeCo is to make positive samples from different views close to each other by cross-view contrast, and learn the factors invariant to two proposed views. However, besides the invariant factors, view-specific factors complementally provide the diverse structure information between different nodes, which also should be contained into the final embeddings. Therefore, we need to further explore each view independently and propose a modified model, called HeCo++. Specifically, HeCo++ conducts hierarchical contrastive learning, including cross-view and intra-view contrasts, which aims to enhance the mining of respective structures. Extensive experiments conducted on a variety of real-world networks show the superior performance of the proposed methods over the state-of-the-arts.

computer science, information systems, artificial intelligence,engineering, electrical & electronic
Domain-adaptive Graph Attention-supervised Network for Cross-network Edge Classification

Xiao Shen,Mengqiu Shao,Shirui Pan,Laurence T. Yang,Xi Zhou

DOI: https://doi.org/10.48550/arXiv.2309.07380

2023-09-14

Social and Information Networks

Abstract:Graph neural networks (GNNs) have shown great ability in modeling graphs, however, their performance would significantly degrade when there are noisy edges connecting nodes from different classes. To alleviate negative effect of noisy edges on neighborhood aggregation, some recent GNNs propose to predict the label agreement between node pairs within a single network. However, predicting the label agreement of edges across different networks has not been investigated yet. Our work makes the pioneering attempt to study a novel problem of cross-network homophilous and heterophilous edge classification (CNHHEC), and proposes a novel domain-adaptive graph attention-supervised network (DGASN) to effectively tackle the CNHHEC problem. Firstly, DGASN adopts multi-head GAT as the GNN encoder, which jointly trains node embeddings and edge embeddings via the node classification and edge classification losses. As a result, label-discriminative embeddings can be obtained to distinguish homophilous edges from heterophilous edges. In addition, DGASN applies direct supervision on graph attention learning based on the observed edge labels from the source network, thus lowering the negative effects of heterophilous edges while enlarging the positive effects of homophilous edges during neighborhood aggregation. To facilitate knowledge transfer across networks, DGASN employs adversarial domain adaptation to mitigate domain divergence. Extensive experiments on real-world benchmark datasets demonstrate that the proposed DGASN achieves the state-of-the-art performance in CNHHEC.
CAT: A Causally Graph Attention Network for Trimming Heterophilic Graph

Silu He,Qinyao Luo,Xinsha Fu,Ling Zhao,Ronghua Du,Haifeng Li

DOI: https://doi.org/10.1016/j.ins.2024.120916

2024-06-17

Abstract:Local Attention-guided Message Passing Mechanism (LAMP) adopted in Graph Attention Networks (GATs) is designed to adaptively learn the importance of neighboring nodes for better local aggregation on the graph, which can bring the representations of similar neighbors closer effectively, thus showing stronger discrimination ability. However, existing GATs suffer from a significant discrimination ability decline in heterophilic graphs because the high proportion of dissimilar neighbors can weaken the self-attention of the central node, jointly resulting in the deviation of the central node from similar nodes in the representation space. This kind of effect generated by neighboring nodes is called the Distraction Effect (DE) in this paper. To estimate and weaken the DE of neighboring nodes, we propose a Causally graph Attention network for Trimming heterophilic graph (CAT). To estimate the DE, since the DE are generated through two paths (grab the attention assigned to neighbors and reduce the self-attention of the central node), we use Total Effect to model DE, which is a kind of causal estimand and can be estimated from intervened data; To weaken the DE, we identify the neighbors with the highest DE (we call them Distraction Neighbors) and remove them. We adopt three representative GATs as the base model within the proposed CAT framework and conduct experiments on seven heterophilic datasets in three different sizes. Comparative experiments show that CAT can improve the node classification accuracy of all base GAT models. Ablation experiments and visualization further validate the enhancement of discrimination ability brought by CAT. The source code is available at <a class="link-external link-https" href="https://github.com/GeoX-Lab/CAT" rel="external noopener nofollow">this https URL</a>.

Machine Learning,Artificial Intelligence,Social and Information Networks
Enhancing Hyperedge Prediction with Context-Aware Self-Supervised Learning

Yunyong Ko,Hanghang Tong,Sang-Wook Kim

DOI: https://doi.org/10.48550/arXiv.2309.05798

IF: 5.414

2023-09-11

Machine Learning

Abstract:Hypergraphs can naturally model group-wise relations (e.g., a group of users who co-purchase an item) as hyperedges. Hyperedge prediction is to predict future or unobserved hyperedges, which is a fundamental task in many real-world applications (e.g., group recommendation). Despite the recent breakthrough of hyperedge prediction methods, the following challenges have been rarely studied: (C1) How to aggregate the nodes in each hyperedge candidate for accurate hyperedge prediction? and (C2) How to mitigate the inherent data sparsity problem in hyperedge prediction? To tackle both challenges together, in this paper, we propose a novel hyperedge prediction framework (CASH) that employs (1) context-aware node aggregation to precisely capture complex relations among nodes in each hyperedge for (C1) and (2) self-supervised contrastive learning in the context of hyperedge prediction to enhance hypergraph representations for (C2). Furthermore, as for (C2), we propose a hyperedge-aware augmentation method to fully exploit the latent semantics behind the original hypergraph and consider both node-level and group-level contrasts (i.e., dual contrasts) for better node and hyperedge representations. Extensive experiments on six real-world hypergraphs reveal that CASH consistently outperforms all competing methods in terms of the accuracy in hyperedge prediction and each of the proposed strategies is effective in improving the model accuracy of CASH. For the detailed information of CASH, we provide the code and datasets at: https://github.com/yy-ko/cash.
Cluster-guided Contrastive Graph Clustering Network

Xihong Yang,Yue Liu,Sihang Zhou,Siwei Wang,Wenxuan Tu,Qun Zheng,Xinwang Liu,Liming Fang,En Zhu

DOI: https://doi.org/10.48550/arXiv.2301.01098

2023-01-03

Abstract:Benefiting from the intrinsic supervision information exploitation capability, contrastive learning has achieved promising performance in the field of deep graph clustering recently. However, we observe that two drawbacks of the positive and negative sample construction mechanisms limit the performance of existing algorithms from further improvement. 1) The quality of positive samples heavily depends on the carefully designed data augmentations, while inappropriate data augmentations would easily lead to the semantic drift and indiscriminative positive samples. 2) The constructed negative samples are not reliable for ignoring important clustering information. To solve these problems, we propose a Cluster-guided Contrastive deep Graph Clustering network (CCGC) by mining the intrinsic supervision information in the high-confidence clustering results. Specifically, instead of conducting complex node or edge perturbation, we construct two views of the graph by designing special Siamese encoders whose weights are not shared between the sibling sub-networks. Then, guided by the high-confidence clustering information, we carefully select and construct the positive samples from the same high-confidence cluster in two views. Moreover, to construct semantic meaningful negative sample pairs, we regard the centers of different high-confidence clusters as negative samples, thus improving the discriminative capability and reliability of the constructed sample pairs. Lastly, we design an objective function to pull close the samples from the same cluster while pushing away those from other clusters by maximizing and minimizing the cross-view cosine similarity between positive and negative samples. Extensive experimental results on six datasets demonstrate the effectiveness of CCGC compared with the existing state-of-the-art algorithms.

Machine Learning
Generating Counterfactual Hard Negative Samples for Graph Contrastive Learning

Haoran Yang,Hongxu Chen,Sixiao Zhang,Xiangguo Sun,Qian Li,Xiangyu Zhao,Guandong Xu

DOI: https://doi.org/10.1145/3543507.3583499

2022-01-01

Abstract:Graph contrastive learning has emerged as a powerful unsupervised graph representation learning tool. The key to the success of graph contrastive learning is to acquire high-quality positive and negative samples as contrasting pairs to learn the underlying structural semantics of the input graph. Recent works usually sample negative samples from the same training batch with the positive samples or from an external irrelevant graph. However, a significant limitation lies in such strategies: the unavoidable problem of sampling false negative samples. In this paper, we propose a novel method to utilize Counterfactual mechanism to generate artificial hard negative samples for Graph Contrastive learning, namely CGC. We utilize a counterfactual mechanism to produce hard negative samples, ensuring that the generated samples are similar but have labels that differ from the positive sample. The proposed method achieves satisfying results on several datasets. It outperforms some traditional unsupervised graph learning methods and some SOTA graph contrastive learning methods. We also conducted some supplementary experiments to illustrate the proposed method, including the performances of CGC with different hard negative samples and evaluations for hard negative samples generated with different similarity measurements. The implementation code is available online to ease reproducibility1.
Biomedical Interaction Prediction with Adaptive Line Graph Contrastive Learning

Shilin Sun,Hua Tian,Runze Wang,Zehua Zhang

DOI: https://doi.org/10.3390/math11030732

IF: 2.4

2023-02-02

Mathematics

Abstract:Biomedical interaction prediction is essential for the exploration of relationships between biomedical entities. Predicted biomedical interactions can help researchers with drug discovery, disease treatment, and more. In recent years, graph neural networks have taken advantage of their natural structure to achieve great progress in biomedical interaction prediction. However, most of them use node embedding instead of directly using edge embedding, resulting in information loss. Moreover, they predict links based on node similarity correlation assumptions, which have poor generalization. In addition, they do not consider the difference in topological information between negative and positive sample links, which limits their performance. Therefore, in this paper, we propose an adaptive line graph contrastive (ALGC) method to convert negative and positive sample links into two kinds of line graph nodes. By adjusting the number of intra-class line graph edges and inter-class line graph edges, an augmented line graph is generated and, finally, the information of the two views is balanced by contrastive learning. Through experiments on four public datasets, it is proved that the ALGC model outperforms the state-of-the-art methods.

mathematics
Dual-level Hypergraph Contrastive Learning with Adaptive Temperature Enhancement

Yiyue Qian,Tianyi Ma,Chuxu Zhang,Yanfang Ye

DOI: https://doi.org/10.1145/3589335.3651493

2024-01-01

Abstract:Inspired by the success of graph contrastive learning, researchers have begun exploring the benefits of contrastive learning over hypergraphs. However, these works have the following limitations in modeling the high-order relationships over unlabeled data: (i) They primarily focus on maximizing the agreements among individual node embeddings while neglecting the capture of group-wise collective behaviors within hypergraphs; (ii) Most of them disregard the importance of the temperature index in discriminating contrastive pairs during contrast optimization. To address these limitations, we propose a novel dual-level Hy perG raph C ontrastive L earning framework with Ad aptive T emperature (HyGCL-AdT ) to boost contrastive learning over hypergraphs. Specifically, unlike most works that merely maximize the agreement of node embeddings in hypergraphs, we propose a dual-level contrast mechanism that not only captures the individual node behaviors in a local context but also models the group-wise collective behaviors of nodes within hyperedges from a community perspective. Besides, we design an adaptive temperature-enhanced contrastive optimization to improve the discrimination ability between contrastive pairs. Empirical experiments conducted on seven benchmark hypergraphs demonstrate that HyGCL-AdT exhibits excellent effectiveness compared to state-of-the-art baseline models. The source code is available at \hrefhttps://github.com/graphprojects/HyGCL-AdT https://github.com/graphprojects/HyGCL-AdT.
Hyperbolic Heterogeneous Graph Attention Networks

Jongmin Park,Seunghoon Han,Soohwan Jeong,Sungsu Lim

DOI: https://doi.org/10.1145/3589335.3651522

2024-04-15

Abstract:Most previous heterogeneous graph embedding models represent elements in a heterogeneous graph as vector representations in a low-dimensional Euclidean space. However, because heterogeneous graphs inherently possess complex structures, such as hierarchical or power-law structures, distortions can occur when representing them in Euclidean space. To overcome this limitation, we propose Hyperbolic Heterogeneous Graph Attention Networks (HHGAT) that learn vector representations in hyperbolic spaces with meta-path instances. We conducted experiments on three real-world heterogeneous graph datasets, demonstrating that HHGAT outperforms state-of-the-art heterogeneous graph embedding models in node classification and clustering tasks.

Machine Learning
Heterogeneous Data Augmentation in Graph Contrastive Learning for Effective Negative Samples

Adnan Ali,Jinlong Li,Huanhuan Chen

DOI: https://doi.org/10.1016/j.compeleceng.2024.109304

IF: 4.152

2024-01-01

Computers & Electrical Engineering

Abstract:Graph contrastive learning (GCL) aims to contrast positive-negative counterparts, whereas graph data augmentation (GDA) in GCL is employed to generate positive-negative samples. Existing GDA techniques, such as 1 -dimensional (1D) feature masking, suffer from having a high probability of augmenting partially homogeneous views. Homogeneous views encode identical embeddings, induce substandard positive-negative samples, and enforce the performance responsibility on structural augmentation. Thus, previous work requires plenty of negative samples, converges slower, consumes more memory for training, and offers trivial performance improvements on downstream tasks. To overcome these issues, firstly , we introduce a novel 2dimensional (2D) feature masking technique in GCL to mask the feature matrix in 2 -dimensions. Secondly , we introduce heterogeneous augmentation, a combination of 1D -2D feature masking and edge dropping. Thirdly , we present a negative samples -based GCL framework: Heterogeneous D ata A ugmentation in Graph Contrastive Learning for E ffective N egative S amples ( DAENS ). The effectiveness of the DAENS's induced positive-negative samples can be quantified as using only inter -view negative samples improves node classification performance up to 5.84% on 8 benchmark datasets. DAENS converges faster, takes less time per epoch, and is more memory efficient than existing state-of-the-art methods. Lastly , we empirically examine the feature and structural augmentation effect on sparse and dense graphs with DAENS. The implementation of DAENS is available at https://github.com/mhadnanali/DAENS.

The value of carpal compression test (CCT) as an alternative provocative clinical manoeuvre.

ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learning

Debiased Graph Contrastive Learning.

AHP: Learning to Negative Sample for Hyperedge Prediction

Aggregative and Contrastive Dual-View Graph Attention Network for Hyperspectral Image Classification

Negative samples selecting strategy for graph contrastive learning

Negative Samples Mining Matters: Reconsidering Hyperspectral Image Classification with Contrastive Learning

Hard Sample Aware Network for Contrastive Deep Graph Clustering

Ha-gnn: a novel graph neural network based on hyperbolic attention

Scalable and Effective Negative Sample Generation for Hyperedge Prediction

Hierarchical Contrastive Learning Enhanced Heterogeneous Graph Neural Network

Domain-adaptive Graph Attention-supervised Network for Cross-network Edge Classification

CAT: A Causally Graph Attention Network for Trimming Heterophilic Graph

Enhancing Hyperedge Prediction with Context-Aware Self-Supervised Learning

Cluster-guided Contrastive Graph Clustering Network

Generating Counterfactual Hard Negative Samples for Graph Contrastive Learning

Biomedical Interaction Prediction with Adaptive Line Graph Contrastive Learning

Dual-level Hypergraph Contrastive Learning with Adaptive Temperature Enhancement

Hyperbolic Heterogeneous Graph Attention Networks

Heterogeneous Data Augmentation in Graph Contrastive Learning for Effective Negative Samples