Abstract:Rank regularized minimization problem is an ideal model for the low-rank matrix completion/recovery problem. The matrix factorization approach can transform the high-dimensional rank regularized problem to a low-dimensional factorized column-sparse regularized problem. The latter can greatly facilitate fast computations in applicable algorithms, but needs to overcome the simultaneous non-convexity of the loss and regularization functions. In this paper, we consider the factorized column-sparse regularized model. Firstly, we optimize this model with bound constraints, and establish a certain equivalence between the optimized factorization problem and rank regularized problem. Further, we strengthen the optimality condition for stationary points of the factorization problem and define the notion of strong stationary point. Moreover, we establish the equivalence between the factorization problem and its a nonconvex relaxation in the sense of global minimizers and strong stationary points. To solve the factorization problem, we design two types of algorithms and give an adaptive method to reduce their computation. The first algorithm is from the relaxation point of view and its iterates own some properties from global minimizers of the factorization problem after finite iterations. We give some analysis on the convergence of its iterates to the strong stationary point. The second algorithm is designed for directly solving the factorization problem. We improve the PALM algorithm introduced by Bolte et al. (Math Program Ser A 146:459-494, 2014) for the factorization problem and give its improved convergence results. Finally, we conduct numerical experiments to show the promising performance of the proposed model and algorithms for low-rank matrix completion.

Successively Alternate Least Square for Low-Rank Matrix Factorization with Bounded Missing Data

Regularization Methods for Low-Rank Factorization of Matrices with Missing Data

Robust Matrix Factorization by Majorization Minimization

Fast Matrix Factorization with Non-Uniform Weights on Missing Data.

Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm

Low-rank matrix estimation via nonconvex spectral regularized methods in errors-in-variables matrix regression

An algorithm for low-rank matrix factorization and its applications

Subspace-Constrained Quadratic Matrix Factorization: Algorithm and Applications

Beyond Procrustes: Balancing-Free Gradient Descent for Asymmetric Low-Rank Matrix Sensing

On solving a rank regularized minimization problem via equivalent factorized column-sparse regularized models

Sparse Linear Regression With Missing Data

A NONCONVEX ALGORITHM FOR SIMULTANEOUSLY SPARSE AND LOW-RANK MATRIX RECONSTRUCTION

Generalized Least Squares Kernelized Tensor Factorization

Absence of spurious solutions far from ground truth: A low-rank analysis with high-order losses

Low Multilinear Rank Tensor Completion with Missing Data

Imputation and low-rank estimation with Missing Not At Random data

Generalized Low-Rank Matrix Completion Model with Overlapping Group Error Representation

Smoothed Low Rank and Sparse Matrix Recovery by Iteratively Reweighted Least Squares Minimization

Matrix Completion and Low-Rank SVD via Fast Alternating Least Squares

Post-surgical Complication Prediction in the Presence of Low-Rank Missing Data.

Alternating Iteratively Reweighted Minimization Algorithms for Low-Rank Matrix Factorization