Abstract:The nuclear norm and Schatten-$p$ quasi-norm are popular rank proxies in low-rank matrix recovery. However, computing the nuclear norm or Schatten-$p$ quasi-norm of a tensor is hard in both theory and practice, hindering their application to low-rank tensor completion (LRTC) and tensor robust principal component analysis (TRPCA). In this paper, we propose a new class of tensor rank regularizers based on the Euclidean norms of the CP component vectors of a tensor and show that these regularizers are monotonic transformations of tensor Schatten-$p$ quasi-norm. This connection enables us to minimize the Schatten-$p$ quasi-norm in LRTC and TRPCA implicitly via the component vectors. The method scales to big tensors and provides an arbitrarily sharper rank proxy for low-rank tensor recovery compared to the nuclear norm. On the other hand, we study the generalization abilities of LRTC with the Schatten-$p$ quasi-norm regularizer and LRTC with the proposed regularizers. The theorems show that a relatively sharper regularizer leads to a tighter error bound, which is consistent with our numerical results. Particularly, we prove that for LRTC with Schatten-$p$ quasi-norm regularizer on $d$-order tensors, $p=1/d$ is always better than any $p>1/d$ in terms of the generalization ability. We also provide a recovery error bound to verify the usefulness of small $p$ in the Schatten-$p$ quasi-norm for TRPCA. Numerical results on synthetic data and real data demonstrate the effectiveness of the regularization methods and theorems.

Sparse Reconstruction by Means of the Standard Tikhonov Regularization

Sparsity reconstruction by the standard Tikhonov method

Sparse Recovery by the Standard Tikhonov Method

Multi-parameter Tikhonov Regularization with the ℓ 0 Sparsity Constraint

Tikhonov Regularization with L^0-Term Complementing a Convex Penalty: L^1 Convergence under Sparsity Constraints

Beyond convergence rates: Exact recovery with Tikhonov regularization with sparsity constraints

Sparse Norm-Regularized Reconstructive Coefficients Learning

On the Generalized Discrepancy Principle for Tikhonov Regularization in Hilbert Scales

A regularized eigenmatrix method for unstructured sparse recovery

Sparsity reconstruction using nonconvex TGpV-shearlet regularization and constrained projection

Multi-parameter Regularization and Its Numerical Realization

Sparse Recovery: The Square of $\ell_1/\ell_2$ Norms

Multi-parameter Tikhonov regularization with the ` sparsity constraint: ` convergence

An Analysis of Tikhonov Regularization for Nonlinear Ill-Posed Problems under a General Smoothness Assumption

Sparse Recovery Via Nonconvex Regularized M-estimators over ℓ_q-Balls

Irregularly Sampled 3D Seismic Data Reconstruction with L1/2 Norm Regularization

The Efficient Norm Regularization Method Applying on the ISAR Image with Sparse Data

Euclidean-Norm-Induced Schatten-p Quasi-Norm Regularization for Low-Rank Tensor Completion and Tensor Robust Principal Component Analysis

Regularized Total Least Squares: Computational Aspects and Error Bounds.

On partial sparse recovery

An Approach of Regularization Parameter Estimation for Sparse Signal Recovery