Abstract:We consider the problem of finding the smallest or largest entry of a tensor of order N that is specified via its rank decomposition. Stated in a different way, we are given N sets of R-dimensional vectors and we wish to select one vector from each set such that the sum of the Hadamard product of the selected vectors is minimized or maximized. We show that this fundamental tensor problem is NP-hard for any tensor rank higher than one, and polynomial-time solvable in the rank-one case. We also propose a continuous relaxation and prove that it is tight for any rank. For low-enough ranks, the proposed continuous reformulation is amenable to low-complexity gradient-based optimization, and we propose a suite of gradient-based optimization algorithms drawing from projected gradient descent, Frank-Wolfe, or explicit parametrization of the relaxed constraints. We also show that our core results remain valid no matter what kind of polyadic tensor model is used to represent the tensor of interest, including Tucker, HOSVD/MLSVD, tensor train, or tensor ring. Next, we consider the class of problems that can be posed as special instances of the problem of interest. We show that this class includes the partition problem (and thus all NP-complete problems via polynomial-time transformation), integer least squares, integer linear programming, integer quadratic programming, sign retrieval (a special kind of mixed integer programming / restricted version of phase retrieval), and maximum likelihood decoding of parity check codes. We demonstrate promising experimental results on a number of hard problems, including state-of-art performance in decoding low density parity check codes and general parity check codes.

On the equivalence between low rank matrix completion and tensor rank

Low-Rank Tensor Completion Based on Log-Det Rank Approximation and Matrix Factorization

Robust Approximations of Low-Rank Minimization for Tensor Completion

Minimizing low-rank models of high-order tensors: Hardness, span, tight relaxation, and applications

Hybrid Singular Value Thresholding For Tensor Completion

Quasi-Hankel low-rank matrix completion: a convex relaxation

Optimal Low-Rank Matrix Completion: Semidefinite Relaxations and Eigenvector Disjunctions

Iterative Tensor Eigen Rank Minimization for Low-Rank Tensor Completion.

Two heuristics solving low tensor train rank tensor completion

The Rank-1 Completion Problem for Cubic Tensors

Rank Minimization on Tensor Ring: A New Paradigm in Scalable Tensor Decomposition and Completion

Tensor completion via nonconvex tensor ring rank minimization with guaranteed convergence

Tensor Completion Via Tensor Train Based Low-Rank Quotient Geometry under a Preconditioned Metric

Tensor Completion Via a Multi-Linear Low-N-rank Factorization Model

A Non-Convex Tensor Rank Approximation for Tensor Completion

Uniqueness of Low-Rank Matrix Completion by Rigidity Theory

Low rank tensor completion with sparse regularization in a transformed domain

Imbalanced low-rank tensor completion via latent matrix factorization

A Scale-Invariant Relaxation in Low-Rank Tensor Recovery with an Application to Tensor Completion

T-product factorization based method for matrix and tensor completion problems

A Note on the Rank of the Optimal Matrix in Symmetric Toeplitz Matrix Completion Problem