Abstract:Rank regularized minimization problem is an ideal model for the low-rank matrix completion/recovery problem. The matrix factorization approach can transform the high-dimensional rank regularized problem to a low-dimensional factorized column-sparse regularized problem. The latter can greatly facilitate fast computations in applicable algorithms, but needs to overcome the simultaneous non-convexity of the loss and regularization functions. In this paper, we consider the factorized column-sparse regularized model. Firstly, we optimize this model with bound constraints, and establish a certain equivalence between the optimized factorization problem and rank regularized problem. Further, we strengthen the optimality condition for stationary points of the factorization problem and define the notion of strong stationary point. Moreover, we establish the equivalence between the factorization problem and its a nonconvex relaxation in the sense of global minimizers and strong stationary points. To solve the factorization problem, we design two types of algorithms and give an adaptive method to reduce their computation. The first algorithm is from the relaxation point of view and its iterates own some properties from global minimizers of the factorization problem after finite iterations. We give some analysis on the convergence of its iterates to the strong stationary point. The second algorithm is designed for directly solving the factorization problem. We improve the PALM algorithm introduced by Bolte et al. (Math Program Ser A 146:459-494, 2014) for the factorization problem and give its improved convergence results. Finally, we conduct numerical experiments to show the promising performance of the proposed model and algorithms for low-rank matrix completion.

A Smoothing Majorization Method for Matrix Minimization

Convergence Analysis of Projected Gradient Descent for Schatten-p Nonconvex Matrix Recovery

On the Schatten P-Quasi-norm Minimization for Low-Rank Matrix Recovery

Robust Matrix Factorization by Majorization Minimization

Relaxed Majorization-Minimization for Non-Smooth and Non-Convex Optimization

Smoothed Low Rank and Sparse Matrix Recovery by Iteratively Reweighted Least Squares Minimization

The appeals of quadratic majorization–minimization

An approximation theory of matrix rank minimization and its application to quadratic equations

On solving a rank regularized minimization problem via equivalent factorized column-sparse regularized models

Nonconvex Mixed Matrix Minimization

A Majorization-Minimization Gauss-Newton Method for 1-Bit Matrix Completion

A majorized PAM method with subspace correction for low-rank composite factorization model

Exploring Algorithmic Limits of Matrix Rank Minimization under Affine Constraints

Efficient Low-rank Identification via Accelerated Iteratively Reweighted Nuclear Norm Minimization

Large-Scale Convex Minimization with a Low-Rank Constraint

Smoothed sparse recovery via locally competitive algorithm and forward Euler discretization method.

A Proximal-Proximal Majorization-Minimization Algorithm for Nonconvex Rank Regression Problems.

On Partial Smoothness, Activity Identification and Faster Algorithms of L1 over L2 Minimization

Incremental Majorization-Minimization Optimization with Application to Large-Scale Machine Learning

RIP-based Performance Guarantee for Low Rank Matrix Recovery via $L_{*-F}$ Minimization

On Partly Smoothness, Activity Identification and Faster Algorithms of L 1 over L 2 Minimization