Abstract:In recommendation tasks, we model user preferences by learning node representations (i.e., user and item embeddings) based on the observed user-item interaction data, which is a bipartite graph. G raph N eural N etworks ( GNN s) are widely used to refine the representations by exploring the topology of the graph: embeddings of neighbors are propagated to each node to reconstruct its embeddings. However, the propagation strategy in existing GNNs is empirical and defective: (1) a substantial proportion of links are missed in the sparse observed graph, which causes ineffective and biased propagation; and (2) the propagation weights are determined by a coarse pre-defined rule, which only takes the degree of nodes into consideration. In this paper, we propose a dense and data-driven propagation mechanism for GNNs. Considering the graph we use to propagate embeddings in recommendation tasks is extremely sparse, we complement it and use the predicted graph as the new propagation tool. We learn the propagation matrix from the data, and propose a S elf-propagation G raph N eural N etwork ( SGNN ). Since it is very space- and time-consuming to maintain a large and dense propagation matrix, we factorize it for storing and updating. In this paper, we propose three methods to complete the sparse graph and construct the propagation matrix: (1) we complete the graph based on a recommendation model; (2) we measure the node distance based on spectral clustering; (3) we predict missing links of the graph based on predictive embeddings. In SGNN, the embeddings can be propagated to not only the observed neighbors, but also the potential yet unobserved neighbors, and the propagation weights are learned based on the connection strength. Comprehensive experiments on three real-world datasets demonstrate the effectiveness and efficiency of our proposed model: SGNN outperforms recent state-of-the-art GNNs significantly. Codes are available on https://github.com/Wenhui-Yu/LCFN .

Learning Data-Driven Propagation Mechanism for Graph Neural Network

Self-Propagation Graph Neural Network for Recommendation

Optimal Propagation for Graph Neural Networks

Hypergraph Label Propagation Network.

Discovering the Representation Bottleneck of Graph Neural Networks from Multi-order Interactions

Learning How to Propagate Messages in Graph Neural Networks

Unifying Graph Neural Networks with a Generalized Optimization Framework

Prioritized Propagation in Graph Neural Networks

Interpreting and Unifying Graph Neural Networks with an Optimization Framework

Heterogeneous Graph Propagation Network

Propagation Model Search for Graph Neural Networks.

Enhance Information Propagation for Graph Neural Network by Heterogeneous Aggregations

Active Learning for Graph Neural Networks via Node Feature Propagation.

Accelerating Scalable Graph Neural Network Inference with Node-Adaptive Propagation

Forward Learning of Graph Neural Networks

On the Distribution Alignment of Propagation in Graph Neural Networks

AdaProp: Learning Adaptive Propagation for Graph Neural Network based Knowledge Graph Reasoning

Graph Neural Networks Inspired by Classical Iterative Algorithms

Rethinking Node-wise Propagation for Large-scale Graph Learning

Powerful Graph Convolutioal Networks with Adaptive Propagation Mechanism for Homophily and Heterophily

Neural Graph Machines: Learning Neural Networks Using Graphs