Abstract:Recovering a large matrix from a small subset of its entries is a challenging problem arising in many real applications, such as image inpainting and recommender systems. Many existing approaches formulate this problem as a general low-rank matrix approximation problem. Since the rank operator is nonconvex and discontinuous, most of the recent theoretical studies use the nuclear norm as a convex relaxation. One major limitation of the existing approaches based on nuclear norm minimization is that all the singular values are simultaneously minimized, and thus the rank may not be well approximated in practice. In this paper, we propose to achieve a better approximation to the rank of matrix by truncated nuclear norm, which is given by the nuclear norm subtracted by the sum of the largest few singular values. In addition, we develop a novel matrix completion algorithm by minimizing the Truncated Nuclear Norm. We further develop three efficient iterative procedures, TNNR-ADMM, TNNR-APGL, and TNNR-ADMMAP, to solve the optimization problem. TNNR-ADMM utilizes the alternating direction method of multipliers (ADMM), while TNNR-AGPL applies the accelerated proximal gradient line search method (APGL) for the final optimization. For TNNR-ADMMAP, we make use of an adaptive penalty according to a novel update rule for ADMM to achieve a faster convergence rate. Our empirical study shows encouraging results of the proposed algorithms in comparison to the state-of-the-art matrix completion algorithms on both synthetic and real visual datasets.

Connections Between Nuclear-Norm and Frobenius-Norm-Based Representations

Data representation using robust nonnegative matrix factorization for edge computing

FlRR: fast low-rank representation using Frobenius-norm

Fast and Accurate Matrix Completion Via Truncated Nuclear Norm Regularization

Matrix completion by Truncated Nuclear Norm Regularization

Convergence Analysis of Graph Regularized Non-Negative Matrix Factorization

Robust Orthogonal Nonnegative Matrix Tri-Factorization for Data Representation

Nuclear Norm Minus Frobenius Norm Minimization with Rank Residual Constraint for Image Denoising

A Comparative Study for the Nuclear Norms Minimization Methods.

Tree-Structured Nuclear Norm Approximation with Applications to Robust Face Recognition.

Analyzing the Weighted Nuclear Norm Minimization and Nuclear Norm Minimization based on Group Sparse Representation.

Feature and Nuclear Norm Minimization for Matrix Completion

A Nuclear Norm Based Matrix Regression Based Projections Method for Feature Extraction.

Projective Robust Nonnegative Factorization.

Robust Sparse Nonnegative Matrix Factorization Based on Maximum Correntropy Criterion

Robust Capped Norm Nonnegative Matrix Factorization: Capped Norm NMF.

Non-negative Local Coordinate Factorization for Image Representation.

Nuclear Norm Regularized Sparse Coding

Factorization for Projective and Metric Reconstruction Via Truncated Nuclear Norm.

Learning Parts-Based and Global Representation for Image Classification.

Norm retrieval algorithms: A new frame theory approach