Abstract:Recently, there is a rapidly increasing attraction for the efficient recovery of low-rank matrix in computer vision and machine learning. The popular convex solution of rank minimization is nuclear norm-based minimization (NNM), which usually leads to a biased solution since NNM tends to overshrink the rank components and treats each rank component equally. To address this issue, some nonconvex nonsmooth rank (NNR) relaxations have been exploited widely. Different from these convex and nonconvex rank substitutes, this paper first introduces a general and flexible rank relaxation function named weighted NNR relaxation function, which is actually derived from the initial double NNR (DNNR) relaxations, i.e., DNNR relaxation function acts on the nonconvex singular values function (SVF). An iteratively reweighted SVF optimization algorithm with continuation technology through computing the supergradient values to define the weighting vector is devised to solve the DNNR minimization problem, and the closed-form solution of the subproblem can be efficiently obtained by a general proximal operator, in which each element of the desired weighting vector usually satisfies the nondecreasing order. We next prove that the objective function values decrease monotonically, and any limit point of the generated subsequence is a critical point. Combining the Kurdyka-Łojasiewicz property with some milder assumptions, we further give its global convergence guarantee. As an application in the matrix completion problem, experimental results on both synthetic data and real-world data can show that our methods are competitive with several state-of-the-art convex and nonconvex matrix completion methods.

Robust Recovery of Low-Rank Matrices Via Non-Convex Optimization

Nonconvex relaxation approaches to robust matrix recovery

Robust Sparse Recovery Via Non-Convex Optimization

Efficient Recovery of Low-Rank Matrix Via Double Nonconvex Nonsmooth Rank Minimization.

Low-rank matrix recovery via nonconvex optimization methods with application to errors-in-variables matrix regression

Generalized Nonconvex Nonsmooth Low-Rank Minimization

Fast Convex Optimization Algorithms for the Recovery of a Corrupted Low-Rank Matrix

Nonconvex Robust Low-rank Matrix Recovery

Improved Nonconvex Optimization Model for Low-Rank Matrix Recovery

Fast Convex Optimization Algorithms for Exact Recovery of a Corrupted Low-Rank Matrix

A multi-stage convex relaxation approach to noisy structured low-rank matrix recovery

Low-rank matrix recovery with non-quadratic loss: projected gradient method and regularity projection oracle

Low-Rank Matrix Recovery with Composite Optimization: Good Conditioning and Rapid Convergence

A Non-convex Approach for Sparse Recovery with Convergence Guarantee

Recovery of corrupted low-rank matrices via half-quadratic based nonconvex minimization

A Scalable, Adaptive and Sound Nonconvex Regularizer for Low-rank Matrix Learning

Fast Low-Rank Matrix Learning with Nonconvex Regularization

A non-convex approach to low-rank and sparse matrix decomposition.

The Convergence Guarantees of a Non-Convex Approach for Sparse Recovery.

Tensor Recovery via Nonconvex Low-Rank Approximation

Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview