Abstract:Graph ranking plays an important role in many applications, such as page ranking on web graphs and entity ranking on social networks. In applications, besides graph structure, rich information on nodes and edges and explicit or implicit human supervision are often available. In contrast, conventional algorithms (e.g., PageRank and HITS) compute ranking scores by only resorting to graph structure information. A natural question arises here, that is, how to effectively and efficiently leverage all the information to more accurately calculate graph ranking scores than the conventional algorithms, assuming that the graph is also very large. Previous work only partially tackled the problem, and the proposed solutions are also not satisfying. This paper addresses the problem and proposes a general framework as well as an efficient algorithm for graph ranking. Specifically, we define a semi-supervised learning framework for ranking of nodes on a very large graph and derive within our proposed framework an efficient algorithm called Semi-Supervised PageRank. In the algorithm, the objective function is defined based upon a Markov random walk on the graph. The transition probability and the reset probability of the Markov model are defined as parametric models based on features on nodes and edges. By minimizing the objective function, subject to a number of constraints derived from supervision information, we simultaneously learn the optimal parameters of the model and the optimal ranking scores of the nodes. Finally, we show that it is possible to make the algorithm efficient to handle a billion-node graph by taking advantage of the sparsity of the graph and implement it in the MapReduce logic. Experiments on real data from a commercial search engine show that the proposed algorithm can outperform previous algorithms on several tasks.

Large-scale Graph Mining and Learning for Information Retrieval.

Ranking on Large-Scale Graphs with Rich Metadata

Semi-supervised Ranking on Very Large Graphs with Rich Metadata

A Ranking Approach on Large-Scale Graph With Multidimensional Heterogeneous Information.

Implementation of large-scale distributed information retrieval system

Task-Oriented Genetic Activation for Large-Scale Complex Heterogeneous Graph Embedding.

Managing and Mining Large Graphs

Learning Better Representations for Neural Information Retrieval with Graph Information

Learning Search Tasks in Queries and Web Pages Via Graph Regularization

A Comprehensive Study on Large-Scale Graph Training: Benchmarking and Rethinking

OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphs

Big Graph Mining: Frameworks and Techniques

From Document to Image: Learning a Scalable Ranking Model for Content Based Image Retrieval

A Parallel Computing Model for Large-Graph Mining with MapReduce.

Learning To Rank Resources with GNN

Graph Learning and Its Advancements on Large Language Models: A Holistic Survey

Pre-trained Graphformer-based Ranking at Web-scale Search (Extended Abstract)

Efficient Subgraph Matching on Billion Node Graphs

Graph Representation Learning: Foundations, Methods, Applications and Systems

Identifying Important Features for Graph Retrieval

Large scale graph processing systems: survey and an experimental evaluation