Abstract:In this paper we propose efficient randomized fixed-precision techniques for low tubal rank approximation of tensors. The proposed methods are faster and more efficient than the existing fixed-precision algorithms for approximating the truncated tensor SVD (T-SVD). Besides, there are a few works on randomized single-pass algorithms for computing low tubal rank approximation of tensors, none of them experimentally reports the robustness of such algorithms for low-rank approximation of real-world data tensors e.g., images and videos. The current single-pass algorithms for tensors are generalizations of those developed for matrices to tensors. However, the single-pass randomized algorithms for matrices have been recently improved and stabilized. Motivated by this progress, in this paper, we also generalize them to the tensor case based on the tubal product (T-product). We conduct extensive simulations to study the robustness of them compared with the existing single-pass randomized algorithms. In particular, we experimentally found that single-pass algorithms with the sketching parameters of equal sizes usually lead to ill-conditioned tensor least-squares problems and inaccurate results. It is experimentally shown that our proposed single-pass algorithms are robust in this sense. Numerical results demonstrate that under the same conditions (setting the same hyper-parameters), our proposed algorithms provide better performance. Three applications to image compression, super-resolution problem and deep learning are also presented.

Randomized Algorithms for the Low Multilinear Rank Approximations of Tensors

The Computation of Low Multilinear Rank Approximations of Tensors Via Power Scheme and Random Projection

Randomized Algorithms for the Computation of Multilinear Rank-$$(\Mu _1,\mu _2,\mu _3)$$ Approximations

Randomized Algorithms for the Approximations of Tucker and the Tensor Train Decompositions.

Randomized algorithms for computing the tensor train approximation and their applications

Efficient algorithms for Tucker decomposition via approximate matrix multiplication

A Random Matrix Approach to Low-Multilinear-Rank Tensor Approximation

An Efficient Randomized Algorithm for Computing the Approximate Tucker Decomposition

Fast Randomized Tensor Singular Value Thresholding for Low‐rank Tensor Optimization

Nonconvex Robust High-Order Tensor Completion Using Randomized Low-Rank Approximation

Efficient Alternating Least Squares Algorithms for Low Multilinear Rank Approximation of Tensors

Efficient Algorithms for Low Tubal Rank Tensor Approximation with Applications to Image Compression, Super-Resolution and Deep Learning

An Efficient Randomized Fixed-Precision Algorithm for Tensor Singular Value Decomposition

Practical Approximation Algorithms for ℓ_1-Regularized Sparse Rank-1 Approximation to Higher-Order Tensors

Several Approximation Algorithms for Sparse Best Rank-1 Approximation to Higher-Order Tensors

A Randomized Block Krylov Method for Tensor Train Approximation

Practical Sketching Algorithms for Low-Rank Tucker Approximation of Large Tensors

Efficient randomized tensor-based algorithms for function approximation and low-rank kernel interactions

On Approximation Algorithm for Orthogonal Low-Rank Tensor Approximation

Randomized low-rank approximations beyond Gaussian random matrices

Robust Multilinear Decomposition of Low Rank Tensors.