Abstract:Low-rank matrix factorization (LRMF) is a powerful approach that can recover useful information with low-rank features from corrupted data and has been broadly applied in various scenarios such as computer vision and statistics. Existing convex relaxation-based LRMF models' performance and solutions are often limited by unsatisfied recovery accuracy and prolonged execution time due to excessive relaxation bias and heavy computational burden. In this paper, we first explore one class of parameterized non-convex penalty function and generalize it as a non-convex relaxation substitution term for the original rank function in the LRMF, which can effectively enhance the recovery capability for low-rank data. In order to reduce the computational burden of the nuclear-norm-based optimization scheme and make LRMF applicable to large-scale data. We propose to perform bilinear decomposition on the low-rank matrix and derive the bilinear factorization formula under the parameterized non-convex alternative. With the above considering, a low-rank matrix recovery model via bilinear decomposition and non-convex regularization, denoted as NCBF, is formulated. Further, the optimal solution algorithm for the NCBF model is developed in the framework of the block coordinate descent, combining simultaneously three strategies of decoupling, proximal gradient descent, and block prox-linear. Also, the convergence condition for the proposed algorithm has been given. We perform extensive experiments using synthetic data and real-world image datasets. The synthetic data test results demonstrate the dual superiority of the bilinear decomposition scheme in terms of operation time and estimation accuracy. Application of denoising to both generic and CT image datasets, experimental results show that NCBF outperforms several existing methods under both subjective and objective metrics evaluations.

Adaptive and Implicit Regularization for Matrix Completion

Fast and Accurate Matrix Completion Via Truncated Nuclear Norm Regularization

Implicit Regularization in Deep Matrix Factorization

Connectivity Shapes Implicit Regularization in Matrix Factorization Models for Matrix Completion

A regularized deep matrix factorized model of matrix completion for image restoration

Bayesian Inference for Adaptive Low Rank and Sparse Matrix Estimation

Efficiency Calibration of Implicit Regularization in Deep Networks Via Self-paced Curriculum-Driven Singular Value Selection

A Regularised Deep Matrix Factorised Model of Matrix Completion for Image Restoration

A Scalable, Adaptive and Sound Nonconvex Regularizer for Low-rank Matrix Learning

Modified Correlated Total Variation Regularization for Low-Rank Matrix Recovery

Large-Scale Affine Matrix Rank Minimization with a Novel Nonconvex Regularizer.

Matrix completion by Truncated Nuclear Norm Regularization

Simultaneously Sparse and Low-Rank Matrix Reconstruction Via Nonconvex and Nonseparable Regularization

A Dynamics Theory of Implicit Regularization in Deep Low-Rank Matrix Factorization

Low-rank matrix factorization with nonconvex regularization and bilinear decomposition

Regularized Matrix Regression

Scalable iterative data-adaptive RKHS regularization

A Hybrid Truncated Norm Regularization Method for Matrix Completion.

3-D Array Image Data Completion by Tensor Decomposition and Nonconvex Regularization Approach

Bayesian Matrix Completion Via Adaptive Relaxed Spectral Regularization

Combining Explicit and Implicit Regularization for Efficient Learning in Deep Networks