Abstract:The low rank matrix completion problem which aims to recover a matrix from that having missing entries has received much attention in many fields such as image processing and machine learning. The rank of a matrix may be measured by the [Formula: see text] norm of the vector of its singular values. Due to the nonconvexity and discontinuity of the [Formula: see text] norm, solving the low rank matrix completion problem which is clearly NP hard suffers from computational challenges. In this paper, we propose a constrained matrix completion model in which a novel nonconvex continuous rank surrogate is used to approximate the rank function of a matrix, promote low rank of the recovered matrix and address the computational challenges. The proposed rank surrogate differs from the convex nuclear norm and other existing state-of-the-art nonconvex surrogates in a way that it alleviates the discontinuity and nonconvexity of the rank function through a local [Formula: see text]-relaxation of the [Formula: see text] norm so that it possesses several desirable properties. These properties ensure that it accurately approximates the rank function by choosing an appropriate relaxation parameter. We moreover develop an efficient iterative algorithm to solve the resulting model. We also propose strategies of automatically updating the relaxation parameter to practically ensure the global convergence and speed up the algorithm. We establish theoretical convergence results for the proposed algorithm. Experimental results are presented to demonstrate significant performance improvements of the proposed model and the associated algorithm as compared to state-of-the-art methods in both recoverability and computational efficiency.

A NONCONVEX ALGORITHM FOR SIMULTANEOUSLY SPARSE AND LOW-RANK MATRIX RECONSTRUCTION

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

CONVERGENCE AND STABILITY OF ITERATIVELY REWEIGHTED LEAST SQUARES FOR LOW-RANK MATRIXRECOVERY

A non-convex approach to low-rank and sparse matrix decomposition.

Convex Relaxation Algorithm for a Structured Simultaneous Low-Rank and Sparse Recovery Problem

Robust Recovery of Low-Rank Matrices Via Non-Convex Optimization

A Fast Convex Conjugated Algorithm for Sparse Recovery

Fast Convex Optimization Algorithms for the Recovery of a Corrupted Low-Rank Matrix

Fast Convex Optimization Algorithms for Exact Recovery of a Corrupted Low-Rank Matrix

A Unified Computational and Statistical Framework for Nonconvex Low-rank Matrix Estimation

Fast Sparse Recovery Via Non-Convex Optimization

Nonconvex relaxation approaches to robust matrix recovery

Low-Rank Matrix Recovery with Composite Optimization: Good Conditioning and Rapid Convergence

Fast Low-Rank Matrix Learning with Nonconvex Regularization

A Non-convex Approach for Sparse Recovery with Convergence Guarantee

Matrix Completion Via Minimizing an Approximate Rank

Leveraging subspace information for low-rank matrix reconstruction

A Measurement-Efficient Low-Rank Matrix Recovery Approach

The Convergence Guarantees of a Non-Convex Approach for Sparse Recovery.

Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview

Fast Algorithms for Recovering a Corrupted Low-Rank Matrix