Abstract:In this paper we propose efficient randomized fixed-precision techniques for low tubal rank approximation of tensors. The proposed methods are faster and more efficient than the existing fixed-precision algorithms for approximating the truncated tensor SVD (T-SVD). Besides, there are a few works on randomized single-pass algorithms for computing low tubal rank approximation of tensors, none of them experimentally reports the robustness of such algorithms for low-rank approximation of real-world data tensors e.g., images and videos. The current single-pass algorithms for tensors are generalizations of those developed for matrices to tensors. However, the single-pass randomized algorithms for matrices have been recently improved and stabilized. Motivated by this progress, in this paper, we also generalize them to the tensor case based on the tubal product (T-product). We conduct extensive simulations to study the robustness of them compared with the existing single-pass randomized algorithms. In particular, we experimentally found that single-pass algorithms with the sketching parameters of equal sizes usually lead to ill-conditioned tensor least-squares problems and inaccurate results. It is experimentally shown that our proposed single-pass algorithms are robust in this sense. Numerical results demonstrate that under the same conditions (setting the same hyper-parameters), our proposed algorithms provide better performance. Three applications to image compression, super-resolution problem and deep learning are also presented.

Fast and Accurate Randomized Algorithms for Low-rank Tensor Decompositions

Low-rank Tensor Train Decomposition Using TensorSketch

Practical Sketching Algorithms for Low-Rank Tucker Approximation of Large Tensors

Distributed-Memory Randomized Algorithms for Sparse Tensor CP Decomposition

Efficient Alternating Least Squares Algorithms for Low Multilinear Rank Approximation of Tensors

Parallel Randomized Tucker Decomposition Algorithms

Randomized Alternating Least Squares for Canonical Tensor Decompositions: Application to a PDE with Random Data

An Iterative Reweighted Method for Tucker Decomposition of Incomplete Multiway Tensors

Faster TKD: Towards Lightweight Decomposition for Large-Scale Tensors with Randomized Block Sampling

RTSMS: Randomized Tucker with single-mode sketching

Low-Rank Tucker Approximation of a Tensor from Streaming Data

Efficient Algorithms for Low Tubal Rank Tensor Approximation with Applications to Image Compression, Super-Resolution and Deep Learning

An Iterative Reweighted Method for Tucker Decomposition of Incomplete Tensors

Efficient Alternating Least Squares Algorithms for Truncated HOSVD of Higher-Order Tensors.

Towards Efficient and Accurate Approximation: Tensor Decomposition Based on Randomized Block Krylov Iteration

Randomized sketched TT-GMRES for linear systems with tensor structure

Efficient algorithms for Tucker decomposition via approximate matrix multiplication

Efficient Leverage Score Sampling for Tensor Train Decomposition

Decomposition of Big Tensors With Low Multilinear Rank

A random sampling algorithm for fully-connected tensor network decomposition with applications

A multilinear Nyström algorithm for low-rank approximation of tensors in Tucker format