Abstract:Rank regularized minimization problem is an ideal model for the low-rank matrix completion/recovery problem. The matrix factorization approach can transform the high-dimensional rank regularized problem to a low-dimensional factorized column-sparse regularized problem. The latter can greatly facilitate fast computations in applicable algorithms, but needs to overcome the simultaneous non-convexity of the loss and regularization functions. In this paper, we consider the factorized column-sparse regularized model. Firstly, we optimize this model with bound constraints, and establish a certain equivalence between the optimized factorization problem and rank regularized problem. Further, we strengthen the optimality condition for stationary points of the factorization problem and define the notion of strong stationary point. Moreover, we establish the equivalence between the factorization problem and its a nonconvex relaxation in the sense of global minimizers and strong stationary points. To solve the factorization problem, we design two types of algorithms and give an adaptive method to reduce their computation. The first algorithm is from the relaxation point of view and its iterates own some properties from global minimizers of the factorization problem after finite iterations. We give some analysis on the convergence of its iterates to the strong stationary point. The second algorithm is designed for directly solving the factorization problem. We improve the PALM algorithm introduced by Bolte et al. (Math Program Ser A 146:459-494, 2014) for the factorization problem and give its improved convergence results. Finally, we conduct numerical experiments to show the promising performance of the proposed model and algorithms for low-rank matrix completion.

Several Classes of Stationary Points for Rank Regularized Minimization Problems

Exact Penalization for Cardinality and Rank-Constrained Optimization Problems Via Partial Regularization

Multistage Convex Relaxation Approach to Rank Regularized Minimization Problems Based on Equivalent Mathematical Program with a Generalized Complementarity Constraint

Generalized Stationary Points and an Interior Point Method for MPEC

Exact Penalization at D-Stationary Points of Cardinality- or Rank-Constrained Problem

Local Optimality for Stationary Points of Group Zero-Norm Regularized Problems and Equivalent Surrogates

Globally Convergent Algorithm for Solving Stationary Points for Mathematical Programs with Complementarity Constraints Via Nonsmooth Reformulations

Exact penalty method for D-stationary point of nonlinear optimization

Equivalent Lipschitz Surrogates for Zero-Norm and Rank Optimization Problems

Partial Exact Penalty for Mathematical Programs with Equilibrium Constraints

On solving a rank regularized minimization problem via equivalent factorized column-sparse regularized models

The Minimization of Piecewise Functions: Pseudo Stationarity

Optimality and Complexity for Constrained Optimization Problems with Nonconvex Regularization.

A note on stationarity in constrained optimization

Nonsmooth convex-concave saddle point problems with cardinality penalties

Mordukhovich Stationarity for Mathematical Programs with Switching Constraints under Weak Constraint Qualifications

Zero-norm Regularized Problems: Equivalent Surrogates, Proximal MM Method and Statistical Error Bound.

Low-rank optimization methods based on projected-projected gradient descent that accumulate at Bouligand stationary points

Promoting low rank non-convex fraction function penalty for affine matrix rank minimization

Exact Penalty Decomposition Method for Zero-Norm Minimization Based on Mpec Formulation

Hybrid Algorithms for Finding a D-Stationary Point of a Class of Structured Nonsmooth DC Minimization