Abstract:Higher-order Markov chain plays an important role in analyzing a variety of stochastic processes over time in multi-dimensional spaces. One of the important applications is the study of higher-order PageRank problem. The truncated power method proposed recently provides us with another idea to solve this problem, however, its accuracy and efficiency can be poor in practical computations. In this work, we revisit the higher-order PageRank problem and consider how to solve it efficiently. The contribution of this work is as follows. First, we accelerate the truncated power method for higher-order PageRank. In the improved version, it is neither to form and store the vectors arising from the dangling states, nor to store an auxiliary matrix. Second, we propose a truncated power method with partially updating to further release the overhead, in which one only needs to update some important columns of the approximation in each iteration. However, the truncated power method solves a modified higher-order PageRank model for convenience, which is not mathematically equivalent to the original one. Thus, the third contribution of this work is to propose a sparse power method with partially updating for the original higher-order PageRank problem. The convergence of all the proposed methods are discussed. Numerical experiments on large and sparse real-world and synthetic data sets are performed. Numerical results demonstrate the superiority of our new algorithms over some state-of-the-art ones for large and sparse higher-order PageRank problems.

Accelerating Power Methods for Higher-order Markov Chains

The finest level acceleration of multilevel aggregation for markov chains

Truncated and Sparse Power Methods with Partially Updating for Large and Sparse Higher-Order PageRank Problems.

Power Utility Maximization Problem under Rough Stochastic Local Volatility Models with Continuous-Time Markov Chain Approximation

Practical and Fast Momentum-Based Power Methods

Sparse Power Methods for Large-Scale Higher-Order PageRank Problems

Fast Computation of Stationary Joint Probability Distribution of Sparse Markov Chains

A New GMRES(m) Method for Markov Chains

On the fundamental limitations of multiproposal Markov chain Monte Carlo algorithms

Higher-order statistics-based estimation of moments of first passage time for Markov chains in its reverse problem

The Extrapolation-Accelerated Multilevel Aggregation Method in PageRank Computation

On the Convergence of the Minimally Irreducible Markov Chain Method with Applications to PageRank

Extrapolation methods for accelerating PageRank computations

An Extension of Two Conjugate Direction Methods to Markov Chain Problems

Hamiltonian Monte Carlo Acceleration Using Surrogate Functions with Random Bases

Adaptive Penalized Likelihood method for Markov Chains

Block-accelerated Aggregation Multigrid for Markov Chains with Application to PageRank Problems

A Simplified Parsimonious Higher Order Multivariate Markov Chain Model with New Convergence Condition

Enhanced preprocessed multi-step splitting iterations for computing PageRank

A Multi-Index Markov Chain Monte Carlo Method

Some Limit Properties of Markov Chains Induced by Stochastic Recursive Algorithms