Abstract:Recent work by Kilmer et al. (A third-order generalization of the matrix SVD as a product of third-order tensors, Department of Computer Science, Tufts University, Medford, MA, 2008; Linear Algebra Appl 435(3):641–658, 2011; SIAM J Matrix Anal Appl 34(1):148–172, 2013), and Braman (Linear Algebra Appl 433(7):1241–1253, 2010) on tensor–tensor multiplication opens up a new avenue to study third-order tensors. Based on this new tensor–tensor multiplication and related concepts, some familiar tools of linear algebra can be extended to study third-order tensors. Motivated by this process, in this paper, we consider the multi-rank of a tensor as a sparsity measure and propose a new model, called third-order tensor multi-rank minimization, as an extension of matrix rank minimization. The operator splitting technique and the convex relaxation technique are used to tackle this problem. Based on these two powerful techniques, we propose a simple first-order and easy-to-implement algorithm to solve this problem. The proposed algorithm is shown to be globally convergent under some assumptions. The continuation technique is also applied to improve the numerical performance of the algorithm. Some preliminary numerical results demonstrate the efficiency of the proposed algorithm, and the potential value and applications of the multi-rank and the tensor multi-rank minimization model.

Relaxation Methods for Solving the Tensor Equation Arising from the Higher-Order Markov Chains.

A C-eigenvalue Problem for Tensors with Applications to Higher-Order Multivariate Markov Chains.

On Greedy Randomized Kaczmarz-type Methods for Solving the System of Tensor Equations

A New Relaxative Algorithm for Coupled Riccati Matrix Equations

A New Surrogate for Tensor Multirank and Applications in Image and Video Completion

Cyclic stationary probability distribution of second order markov chains and its applications

Low-Rank Tensors for Multi-Dimensional Markov Models

Practical Approximation Algorithms for ℓ_1-Regularized Sparse Rank-1 Approximation to Higher-Order Tensors

Fast Computation of Stationary Joint Probability Distribution of Sparse Markov Chains

Convergence of Parallel Multisplitting Block Relaxation TOR Iterative Algorthms

The Tensor Splitting with Application to Solve Multi-Linear Systems

Rank-1 Tensor Properties with Applications to A Class of Tensor Optimization Problems

Restarted Nonnegativity Preserving Tensor Splitting Methods via Relaxed Anderson Acceleration for Solving Multi-linear Systems

Markov Chain Monte Carlo in Tensor Network Representation

Multigrid methods combined with low-rank approximation for tensor structured Markov chains

Solving the system of nonsingular tensor equations via randomized Kaczmarz-like method

An Iterative Algorithm for Third-Order Tensor Multi-Rank Minimization

Semidefinite Relaxation Methods for Tensor Absolute Value Equations.

Triangular and Skew-Symmetric Splitting Method for Numerical Solutions of Markov Chains

Markov chains for tensor network states

Multilinear PageRank: Uniqueness, Error Bound and Perturbation Analysis