Abstract:This work studies the problem of high-dimensional data (referred to as tensors) completion from partially observed samplings. We consider that a tensor is a superposition of multiple low-rank components. In particular, each component can be represented as multilinear connections over several latent factors and naturally mapped to a specific tensor network (TN) topology. In this paper, we propose a fundamental tensor decomposition (TD) framework: Multi-Tensor Network Representation (MTNR), which can be regarded as a linear combination of a range of TD models, e.g., CANDECOMP/PARAFAC (CP) decomposition, Tensor Train (TT), and Tensor Ring (TR). Specifically, MTNR represents a high-order tensor as the addition of multiple TN models, and the topology of each TN is automatically generated instead of manually pre-designed. For the optimization phase, an adaptive topology learning (ATL) algorithm is presented to obtain latent factors of each TN based on a rank incremental strategy and a projection error measurement strategy. In addition, we theoretically establish the fundamental multilinear operations for the tensors with TN representation, and reveal the structural transformation of MTNR to a single TN. Finally, MTNR is applied to a typical task, tensor completion, and two effective algorithms are proposed for the exact recovery of incomplete data based on the Alternating Least Squares (ALS) scheme and Alternating Direction Method of Multiplier (ADMM) framework. Extensive numerical experiments on synthetic data and real-world datasets demonstrate the effectiveness of MTNR compared with the start-of-the-art methods.

Enhanced Nonconvex Low-Rank Approximation of Tensor Multi-Modes for Tensor Completion.

Mixed norm regularized models for low-rank tensor completion

Beyond Low Rank: A Data-Adaptive Tensor Completion Method

Low-Rank Tensor Completion Based on Log-Det Rank Approximation and Matrix Factorization

Robust Approximations of Low-Rank Minimization for Tensor Completion

Imbalanced low-rank tensor completion via latent matrix factorization

Low Multilinear Rank Tensor Completion with Missing Data

Tensor Completion Via a Multi-Linear Low-N-rank Factorization Model

Tensor completion via multi-directional partial tensor nuclear norm with total variation regularization

Tensor Completion Via Collaborative Sparse and Low-Rank Transforms

Low-rank tensor completion via tensor joint rank with logarithmic composite norm

Two New Low Rank Tensor Completion Methods Based on Sum Nuclear Norm

Multi-Dimensional Visual Data Completion via Low-Rank Tensor Representation Under Coupled Transform

Multi-Tensor Network Representation for High-Order Tensor Completion

Adaptive total variation and second-order total variation-based model for low-rank tensor completion

Auto-weighted robust low-rank tensor completion via tensor-train

Accurate Tensor Completion via Adaptive Low-Rank Representation

Low-Rank Tensor Completion Using Matrix Factorization Based on Tensor Train Rank and Total Variation

Asymmetry Total Variation and Framelet Regularized Nonconvex Low-Rank Tensor Completion

An Efficient Tensor Completion Method Via New Latent Nuclear Norm

Low rank tensor completion with sparse regularization in a transformed domain