Abstract:Recovering a large matrix from a small subset of its entries is a challenging problem arising in many real applications, such as image inpainting and recommender systems. Many existing approaches formulate this problem as a general low-rank matrix approximation problem. Since the rank operator is nonconvex and discontinuous, most of the recent theoretical studies use the nuclear norm as a convex relaxation. One major limitation of the existing approaches based on nuclear norm minimization is that all the singular values are simultaneously minimized, and thus the rank may not be well approximated in practice. In this paper, we propose to achieve a better approximation to the rank of matrix by truncated nuclear norm, which is given by the nuclear norm subtracted by the sum of the largest few singular values. In addition, we develop a novel matrix completion algorithm by minimizing the Truncated Nuclear Norm. We further develop three efficient iterative procedures, TNNR-ADMM, TNNR-APGL, and TNNR-ADMMAP, to solve the optimization problem. TNNR-ADMM utilizes the alternating direction method of multipliers (ADMM), while TNNR-AGPL applies the accelerated proximal gradient line search method (APGL) for the final optimization. For TNNR-ADMMAP, we make use of an adaptive penalty according to a novel update rule for ADMM to achieve a faster convergence rate. Our empirical study shows encouraging results of the proposed algorithms in comparison to the state-of-the-art matrix completion algorithms on both synthetic and real visual datasets.

Matrix completion based on non-convex low rank approximation

Matrix completion by Truncated Nuclear Norm Regularization

Fast and Accurate Matrix Completion Via Truncated Nuclear Norm Regularization

A Nearly Unbiased Matrix Completion Approach.

Efficient Completion for Corrupted Low-Rank Images Via Alternating Direction Method

Non-Local Image Inpainting Using Low-Rank Matrix Completion: Non-Local Image Inpainting Using Low-Rank Matrix Completion

A Novel Nonconvex Relaxation Approach to Low-Rank Matrix Completion of Inexact Observed Data

A robust low-rank matrix completion based on truncated nuclear norm and Lp-norm

Matrix Completion via Non-Convex Relaxation and Adaptive Correlation Learning

Feature and Nuclear Norm Minimization for Matrix Completion

Locally Linear Approximation Approach for Incomplete Data.

Solving Low-Rank Matrix Completion Problems Efficiently

Truncated quadratic norm minimization for bilinear factorization based matrix completion

Robust Approximations of Low-Rank Minimization for Tensor Completion

Adaptive Rank-One Matrix Completion using Sum of Outer Products

Low rank matrix completion by alternating steepest descent methods

Matrix completion via an alternating direction method

Matrix Completion Based on Low-Rank and Local Features Applied to Images Recovery and Recommendation Systems.

Matrix Completion via Nonsmooth Regularization of Fully Connected Neural Networks

Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm

Exact Error in Matrix Completion: Approximately Low-Rank Structures and Missing Blocks