Abstract:Recovering a large matrix from a small subset of its entries is a challenging problem arising in many real applications, such as image inpainting and recommender systems. Many existing approaches formulate this problem as a general low-rank matrix approximation problem. Since the rank operator is nonconvex and discontinuous, most of the recent theoretical studies use the nuclear norm as a convex relaxation. One major limitation of the existing approaches based on nuclear norm minimization is that all the singular values are simultaneously minimized, and thus the rank may not be well approximated in practice. In this paper, we propose to achieve a better approximation to the rank of matrix by truncated nuclear norm, which is given by the nuclear norm subtracted by the sum of the largest few singular values. In addition, we develop a novel matrix completion algorithm by minimizing the Truncated Nuclear Norm. We further develop three efficient iterative procedures, TNNR-ADMM, TNNR-APGL, and TNNR-ADMMAP, to solve the optimization problem. TNNR-ADMM utilizes the alternating direction method of multipliers (ADMM), while TNNR-AGPL applies the accelerated proximal gradient line search method (APGL) for the final optimization. For TNNR-ADMMAP, we make use of an adaptive penalty according to a novel update rule for ADMM to achieve a faster convergence rate. Our empirical study shows encouraging results of the proposed algorithms in comparison to the state-of-the-art matrix completion algorithms on both synthetic and real visual datasets.

Algorithms of Matrix Recovery Based on Truncated Schatten P-Norm

Fast and Accurate Matrix Completion Via Truncated Nuclear Norm Regularization

Recovery of Low-Rank Matrices Based on the Rank Null Space Properties.

On the Schatten P-Quasi-norm Minimization for Low-Rank Matrix Recovery

Convergence Analysis of Projected Gradient Descent for Schatten-p Nonconvex Matrix Recovery

Matrix completion by Truncated Nuclear Norm Regularization

A robust low-rank matrix completion based on truncated nuclear norm and Lp-norm

Low Rank Matrix Recovery with Adversarial Sparse Noise

Truncated Nuclear Norm Minimization for Image Restoration Based On Iterative Support Detection

Double Weighted Truncated Nuclear Norm Regularization for Low-Rank Matrix Completion.

Truncated quadratic norm minimization for bilinear factorization based matrix completion

Guaranteed matrix recovery using weighted nuclear norm plus weighted total variation minimization

Max-norm optimization for robust matrix recovery

On The Synergy Between Nonconvex Extensions of The Tensor Nuclear Norm for Tensor Recovery

Solving Low-Rank Matrix Completion Problems Efficiently

Weighted hybrid truncated norm regularization method for low-rank matrix completion

Truncated nuclear norm regularization for low-rank tensor completion

A Scalable, Adaptive and Sound Nonconvex Regularizer for Low-rank Matrix Learning

Euclidean-Norm-Induced Schatten-p Quasi-Norm Regularization for Low-Rank Tensor Completion and Tensor Robust Principal Component Analysis

T-Schatten-$p$ Norm for Low-Rank Tensor Recovery

Low-Rank Tensor Completion by Truncated Nuclear Norm Regularization