Abstract:The problem of finding the best rank-one approximation to higher-order tensors has extensive engineering and statistical applications. It is well-known that this problem is equivalent to a homogeneous polynomial optimization problem. In this paper, we study theoretical results and numerical methods of this problem, particularly focusing on the 4-th order symmetric tensor case. First, we reformulate the polynomial optimization problem to a matrix programming, and show the equivalence between these two problems. Then, we prove that there is no duality gap between the reformulation and its Lagrangian dual problem. Concerning the approaches to deal with the problem, we propose two relaxed models. The first one is a convex quadratic matrix optimization problem regularized by the nuclear norm, while the second one is a quadratic matrix programming regularized by a truncated nuclear norm, which is a D.C. function and therefore is nonconvex. To overcome the difficulty of solving this nonconvex problem, we approximate the nonconvex penalty by a convex term. We propose to use the proximal augmented Lagrangian method to solve these two relaxed models. In order to obtain a global solution, we propose an alternating least eigenvalue method after solving the relaxed models and prove its convergence. Numerical results presented in the last demonstrate, especially for nonpositive tensors, the effectiveness and efficiency of our proposed methods.

Symmetric Rank-1 Approximation of Symmetric High-Order Tensors.

A sparse rank-1 approximation algorithm for high-order tensors

Low Rank Symmetric Tensor Approximations

On the Global Convergence of the Alternating Least Squares Method for Rank-One Approximation to Generic Tensors

Properties and methods for finding the best rank-one approximation to higher-order tensors

Rank-one approximation of a higher-order tensor by a Riemannian trust-region method

On the rank and the approximation of symmetric tensors

Successive Partial-Symmetric Rank-One Algorithms for Almost Unitarily Decomposable Conjugate Partial-Symmetric Tensors

Tensor Methods for Solving Symmetric ℳ -tensor Systems

Structure-preserving low multilinear rank approximation of antisymmetric tensors

On The Tensor Svd And The Optimal Low Rank Orthogonal Approximation Of Tensors

Tensor Methods for Solving Symmetric \({\mathcal {M}}\)-tensor Systems

Low-rank approximate inverse for preconditioning tensor-structured linear systems

On the Uniqueness and Perturbation to the Best Rank-One Approximation of a Tensor

Efficient Alternating Least Squares Algorithms for Low Multilinear Rank Approximation of Tensors

The Low-Rank Approximation of Fourth-Order Partial-Symmetric and Conjugate Partial-Symmetric Tensor

Approximate Real Symmetric Tensor Rank

The bounds for the best rank-1 approximation ratio of a finite dimensional tensor space

Randomized Algorithms for the Low Multilinear Rank Approximations of Tensors

Uniqueness of Nonnegative Tensor Approximations

A tensor approximation method based on ideal minimal residual formulations for the solution of high-dimensional problems