Abstract:Tensor train decomposition is one of the most powerful approaches for processing high-dimensional data. For low-rank tensor train decomposition of large tensors, the alternating least squares (ALS) algorithm is widely used by updating each core tensor alternatively. However, it may suffer from the curse of dimensionality due to the large scale of subproblems. In this paper, a novel randomized proximal ALS algorithm is proposed for low-rank tensor train decomposition by using TensorSketch, which allows for efficient implementation via fast Fourier transform. The theoretical lower bounds of sketch size are estimated for approximating the optimal value of subproblems. Numerical experiments on synthetic and real-world data also demonstrate the effectiveness and efficiency of the proposed algorithm.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the curse of dimensionality encountered when dealing with Low - Rank Tensor Train Decomposition (LR - TTD) of large - scale tensors. The traditional Alternating Least Squares (ALS) algorithm may encounter the problem that the computational cost increases exponentially with the tensor order when updating each core tensor, which makes this method impractical for large - scale problems. To overcome this challenge, the authors propose a new algorithm based on randomization techniques - the Randomized Proximal ALS Algorithm Using TensorSketch, aiming to efficiently approximate the solution of large - scale sub - problems while ensuring sufficient accuracy. Specifically, the main contributions of the paper include: 1. **Proposing a new algorithm**: Based on regularized ALS and combined with TensorSketch technology, a new randomized algorithm is proposed to efficiently perform low - rank tensor train decomposition. 2. **Efficient implementation**: The efficient computation of TensorSketch is achieved through the Fast Fourier Transform (FFT). 3. **Theoretical analysis**: The theoretical lower bound of the sketch size used to approximate the optimal value of the sub - problem is estimated. 4. **Experimental verification**: Through numerical experiments on synthetic data and real - world data, the effectiveness and efficiency of the proposed algorithm are demonstrated. By introducing TensorSketch technology, the paper not only solves the computational bottleneck of the traditional ALS algorithm in high - dimensional data processing, but also avoids the swamp effect in the classical ALS algorithm through the regularization term, thereby improving the stability and accuracy of the algorithm.

Low-rank Tensor Train Decomposition Using TensorSketch

Fast and Accurate Randomized Algorithms for Low-rank Tensor Decompositions

An Efficient Two-Sided Sketching Method for Large-Scale Tensor Decomposition Based on Transformed Domains

Practical Sketching Algorithms for Low-Rank Tucker Approximation of Large Tensors

Tensor Denoising Using Low-Rank Tensor Train Decomposition

Faster Tensor Train Decomposition for Sparse Data

Efficient Leverage Score Sampling for Tensor Train Decomposition

Practical sketching‐based randomized tensor ring decomposition

A fast sketching-based algorithm for rank- ( L , L , 1 ) block term decomposition

Tensor-structured sketching for constrained least squares

Tensor-Based Sketching Method for the Low-Rank Approximation of Data Streams

A Randomized Block Krylov Method for Tensor Train Approximation

Tensor Train Decomposition for Solving Large-Scale Linear Equations.

A random sampling algorithm for fully-connected tensor network decomposition with applications

Efficient Tensor Contraction via Fast Count Sketch

Efficient Alternating Least Squares Algorithms for Low Multilinear Rank Approximation of Tensors

Robust recovery of low-rank matrices and low-tubal-rank tensors from noisy sketches

Support Vector Machine Based On Low-Rank Tensor Train Decomposition For Big Data Applications

Decomposition of Big Tensors With Low Multilinear Rank

Sampling-Based Decomposition Algorithms for Arbitrary Tensor Networks

A Fast Algorithm for Rank-(L, M, N) Block Term Decomposition of Multi-Dimensional Data