Deeper Graph Contrastive Learning with Attention Mechanism for Recommendation

Yicheng Di,Yuan Liu,ZhuoHan Tao,Lipeng Huang,JiaYu Bao
DOI: https://doi.org/10.1109/IJCNN60899.2024.10650966
2024-06-30
Abstract:The Graph Convolutional Network (GCN) is a powerful method for handling graph data in deep learning, which has found extensive application and exhibited outstanding performance in recommendation systems. Graph Contrastive Learning (GCL), on the other hand, is a self-supervised learning approach that learns valuable information about graph structures by contrasting representations of diverse elements within the graph. In the realm of recommendation systems, Graph Contrastive Learning has garnered significant research attention and interest.This paper introduces a novel framework for the Contrastive Learning model, termed Deeper Graph Contrastive Learning with Attention mechanism (ADGCL). To address the issue of excessive smoothing of nodes caused by the stacking of multiple layers of graph convolutional layers, resulting in reduced differences between nodes and subsequently impacting the performance of tasks such as node classification, this paper employs crosslayer connections and representation mapping. These techniques mitigate the oversmoothing phenomenon, enabling the network to delve deeper into learning. Furthermore, the incorporation of a self-attention mechanism for features enhances the efficiency of the network in handling information between different feature graphs, thereby improving model performance. The core idea revolves around enabling the model to adaptively learn the weights of feature graphs, better capturing crucial features to enhance overall performance. Experimental results demonstrate that our model outperforms current state-of-the-art methods, achieving a performance improvement of nearly 5% on the Yelp2018, Douban-Book, and Ml-1M datasets, respectively.
Computer Science
What problem does this paper attempt to address?