Abstract:Fully-connected tensor network (FCTN) decomposition is a generalization of the popular tensor train and tensor ring decompositions and has been applied to various fields with great success. The standard method for computing this decomposition is the well-known alternating least squares (ALS). However, it is very expensive, especially for large-scale tensors. To reduce the cost, we propose an ALS-based randomized algorithm. Specifically, by defining a new tensor product called subnetwork product and adjusting the sizes of FCTN factors suitably, the structure of the coefficient matrices of the ALS subproblems from FCTN decomposition is first figured out. Then, with the structure and the properties of subnetwork product, we devise the randomized algorithm based on leverage sampling. This algorithm enables sampling on FCTN factors and hence avoids the formation of full coefficient matrices of ALS subproblems. The computational complexity and numerical performance of our algorithm are presented. Experimental results show that it requires much less computation time to achieve similar accuracy compared with the deterministic ALS method. Further, we apply our algorithm to four famous problems, i.e., tensor-on-vector regression, multi-view subspace clustering, nonnegative tensor approximation and tensor completion, and the performances are quite decent.

Practical sketching‐based randomized tensor ring decomposition

Low-rank Tensor Train Decomposition Using TensorSketch

Randomized algorithms for Kroncecker tensor decomposition and applications

Randomized sketched TT-GMRES for linear systems with tensor structure

A Randomized Block Krylov Method for Tensor Train Approximation

Parallel Randomized Tucker Decomposition Algorithms

Towards Efficient and Accurate Approximation: Tensor Decomposition Based on Randomized Block Krylov Iteration

An Efficient Two-Sided Sketching Method for Large-Scale Tensor Decomposition Based on Transformed Domains

A random sampling algorithm for fully-connected tensor network decomposition with applications

Fast and Accurate Randomized Algorithms for Low-rank Tensor Decompositions

Tensor LU and QR Decompositions and Their Randomized Algorithms

Randomized Average Kaczmarz Algorithm for Tensor Linear Systems

The trouble with tensor ring decompositions

Efficient Tensor Contraction via Fast Count Sketch

A block-randomized stochastic method with importance sampling for CP tensor decomposition

Random Tensor Theory for Tensor Decomposition

Randomized algorithms for computing the tensor train approximation and their applications

An Efficient Randomized Algorithm for Computing the Approximate Tucker Decomposition

Randomized Algorithms for the Approximations of Tucker and the Tensor Train Decompositions.

Fast Exact Leverage Score Sampling from Khatri-Rao Products with Applications to Tensor Decomposition

Distributed-Memory Randomized Algorithms for Sparse Tensor CP Decomposition