Abstract:Low-rank matrix factorization (LRMF) is a powerful approach that can recover useful information with low-rank features from corrupted data and has been broadly applied in various scenarios such as computer vision and statistics. Existing convex relaxation-based LRMF models' performance and solutions are often limited by unsatisfied recovery accuracy and prolonged execution time due to excessive relaxation bias and heavy computational burden. In this paper, we first explore one class of parameterized non-convex penalty function and generalize it as a non-convex relaxation substitution term for the original rank function in the LRMF, which can effectively enhance the recovery capability for low-rank data. In order to reduce the computational burden of the nuclear-norm-based optimization scheme and make LRMF applicable to large-scale data. We propose to perform bilinear decomposition on the low-rank matrix and derive the bilinear factorization formula under the parameterized non-convex alternative. With the above considering, a low-rank matrix recovery model via bilinear decomposition and non-convex regularization, denoted as NCBF, is formulated. Further, the optimal solution algorithm for the NCBF model is developed in the framework of the block coordinate descent, combining simultaneously three strategies of decoupling, proximal gradient descent, and block prox-linear. Also, the convergence condition for the proposed algorithm has been given. We perform extensive experiments using synthetic data and real-world image datasets. The synthetic data test results demonstrate the dual superiority of the bilinear decomposition scheme in terms of operation time and estimation accuracy. Application of denoising to both generic and CT image datasets, experimental results show that NCBF outperforms several existing methods under both subjective and objective metrics evaluations.

$L_{1}$ -Norm Low-Rank Matrix Decomposition by Neural Networks and Mollifiers

Low-rank matrix decomposition in L1-norm by dynamic systems

Fast and Accurate Matrix Completion Via Truncated Nuclear Norm Regularization

Sine Activated Low-Rank Matrices for Parameter Efficient Learning

The linearized alternating direction method of multipliers for low-rank and fused LASSO matrix regression model

Matrix completion by Truncated Nuclear Norm Regularization

Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations

Divide-and-Conquer Method for L1 Norm Matrix Factorization in the Presence of Outliers and Missing Data

Low-rank matrix factorization with nonconvex regularization and bilinear decomposition

A Scalable, Adaptive and Sound Nonconvex Regularizer for Low-rank Matrix Learning

A Cyclic Weighted Median Method for L1 Low-Rank Matrix Factorization with Missing Entries

Fast Low-Rank Matrix Learning with Nonconvex Regularization

Alternating Iteratively Reweighted Minimization Algorithms for Low-Rank Matrix Factorization

A non-convex approach to low-rank and sparse matrix decomposition.

Learnable Graph-Regularization for Matrix Decomposition

Low-Rank Approximation via Generalized Reweighted Iterative Nuclear and Frobenius Norms

Online Optimization for Large-Scale Max-Norm Regularization

A continuous-time neurodynamic approach in matrix form for rank minimization

Orthogonal Weight Normalization: Solution to Optimization over Multiple Dependent Stiefel Manifolds in Deep Neural Networks

Beyond Low Rank + Sparse: Multiscale Low Rank Matrix Decomposition

Accelerating nuclear-norm regularized low-rank matrix optimization through Burer-Monteiro decomposition