Abstract:This work concerns the development of an algebraic multilevel method for computing state vectors of Markov chains. We present an efficient bootstrap algebraic multigrid (AMG) method for this task. In our proposed approach, we employ a multilevel eigensolver, with interpolation built using ideas based on compatible relaxation, algebraic distances, and least squares fitting of test vectors. Our adaptive variational strategy for computation of the state vector of a given Markov chain is then a combination of this multilevel eigensolver and an associated additive multilevel preconditioned correction process. We show that the bootstrap AMG eigensolver by itself can efficiently compute accurate approximations to the steady state vector. An additional benefit of the bootstrap approach is that it yields an accurate interpolation operator for many other eigenmodes. This in turn allows for the use of the resulting multigrid hierarchy as a preconditioner to accelerate the generalized minimal residual (GMRES) iteration for computing an additive correction equation for the approximation to the steady state vector. Unlike other existing multilevel methods for Markov chains, our method does not employ any special processing of the coarse-level systems to ensure that stochastic properties of the fine-level system are maintained there. The proposed approach is applied to a range of test problems involving nonsymmetric M-matrices arising from stochastic matrices and showing promising results.

Adaptive Low-Nonnegative-Rank Approximation for State Aggregation of Markov Chains

Multilevel Adaptive Aggregation for Markov Chains, with Application to Web Ranking

A low-rank spectral method for learning Markov models

Identifying Sparse Low-Dimensional Structures in Markov Chains: A Nonnegative Matrix Factorization Approach

Low-Rank Tensors for Multi-Dimensional Markov Models

Minimum Conditional Information Loss Approach to Discrete Stochastic Model Reduction

A Bootstrap Algebraic Multilevel Method for Markov Chains

Individualized rank aggregation using nuclear norm regularization

Efficient Low-rank Identification via Accelerated Iteratively Reweighted Nuclear Norm Minimization

Formal Error Bounds for the State Space Reduction of Markov Chains

Estimating Matching Affinity Matrix under Low-Rank Constraints

Supervised rank aggregation

Information-Preserving Markov Aggregation

State ordering and classification for analyzing non-sparse large Markov models

Adaptive Penalized Likelihood method for Markov Chains

Fast Computation of Stationary Joint Probability Distribution of Sparse Markov Chains

Approximate and Dynamic Rank Aggregation

Nonnegative Low Rank Matrix Approximation for Nonnegative Matrices

Optimal Ricci curvature Markov chain Monte Carlo methods on finite states

Multigrid methods combined with low-rank approximation for tensor structured Markov chains

Efficient State Estimation for Gas Pipeline Networks via Low-Rank Approximations