Abstract:We propose new algorithms for singular value decomposition (SVD) of very large-scale matrices based on a low-rank tensor approximation technique called the tensor train (TT) format. The proposed algorithms can compute several dominant singular values and corresponding singular vectors for large-scale structured matrices given in a TT format. The computational complexity of the proposed methods scales logarithmically with the matrix size under the assumption that both the matrix and the singular vectors admit low-rank TT decompositions. The proposed methods, which are called the alternating least squares for SVD (ALS-SVD) and modified alternating least squares for SVD (MALS-SVD), compute the left and right singular vectors approximately through block TT decompositions. The very large-scale optimization problem is reduced to sequential small-scale optimization problems, and each core tensor of the block TT decompositions can be updated by applying any standard optimization methods. The optimal ranks of the block TT decompositions are determined adaptively during iteration process, so that we can achieve high approximation accuracy. Extensive numerical simulations are conducted for several types of TT-structured matrices such as Hilbert matrix, Toeplitz matrix, random matrix with prescribed singular values, and tridiagonal matrix. The simulation results demonstrate the effectiveness of the proposed methods compared with standard SVD algorithms and TT-based algorithms developed for symmetric eigenvalue decomposition.

Singular Value Decomposition For Unitary Symmetric Matrix

Singular Value Decomposition for Extended Matrix

SVD Row or Column Symmetric Matrix

The Singular Value Decomposition, Applications and Beyond.

On Properties and Structure of the Analytic Singular Value Decomposition

On the Structures of the Nonsingular Matrices of QQ-SVD

Limited Memory Block Krylov Subspace Optimization for Computing Dominant Singular Value Decompositions.

A note on the hyperbolic singular value decomposition without hyperexchange matrices

A Power Method for Computing Singular Value Decomposition

Singular value decomposition for complex matrices using two-sided Jacobi method

Randomized dual singular value decomposition

Singular value decomposition of complexes

Dual complex structure-preserving algorithm of dual quaternion singular value decomposition and its applications

A Novel Fully Hardware-Implemented SVD Solver Based on Ultra-Parallel BCV Jacobi Algorithm

A Parallelizable Method for Computing the Singular Subspaces of a General Matrix

Very Large-Scale Singular Value Decomposition Using Tensor Train Networks

High Order Numerical Methods To Approximate The Singular Value Decomposition

A Krylov space approach to Singular Value Decomposition in non-Hermitian systems

A novel structure-preserving algorithm for the singular value decomposition of biquaternion matrices

An Extended Ulm-like Method for Inverse Singular Value Problems with Multiple And/or Zero Singular Values

A New Complex Structure-Preserving Method for QSVD