Abstract:Low-rank matrix recovery is a major challenge in machine learning and computer vision, particularly for large-scale data matrices, as popular methods involving nuclear norm and singular value decomposition (SVD) are associated with high computational costs and biased estimators. To overcome this challenge, we propose a novel approach to learning low-rank matrices based on the matrix volume and a nonconvex logarithmic function. The matrix volume is the product of all the nonzero singular values of a matrix and has unique geometric properties and connections with other convex and nonconvex functions. We establish a generalized nonconvex regularization problem using the penalty function strategy and introduce an accelerated proximal alternating linearized minimization (AccPALM) algorithm with double acceleration, which combines Nesterov's acceleration and power strategy. The algorithm reduces computational costs and has provable convergence results under the Kurdyka-Łojasiewicz (KŁ) inequality with mild conditions. Our approach shows superior accuracy, efficiency, and convergence behavior compared to other low-rank matrix learning methods on robust matrix completion (RMC) and low-rank representation (LRR) tasks. We analyze the impact of algorithm parameters on convergence and performance and present visually appealing results to further demonstrate the effectiveness of our approach. The proposed methodology represents a promising advance in the field of low-rank matrix recovery, and its effectiveness has been validated via extensive numerical experiments. The source code for the proposed algorithms is accessible at https://github.com/ZhangHengMin/AccPALMcodes.

Riemannian Pursuit for Big Matrix Recovery.

Convergence of projected Landweber iteration for matrix rank minimization

A Preconditioned Riemannian Gradient Descent Algorithm for Low-Rank Matrix Recovery

Matrix Recovery with Implicitly Low-Rank Data.

Riemannian Submanifold Tracking on Low-Rank Algebraic Variety.

Guarantees of Riemannian Optimization for Low Rank Matrix Recovery

RAP: Scalable RPCA for Low-rank Matrix Recovery

Low-rank matrix recovery with non-quadratic loss: projected gradient method and regularity projection oracle

Pathwise Component Descent Method with MC+ Penalty for Low Rank Matrix Recovery

Generalized Nonconvex Nonsmooth Low-Rank Matrix Recovery Framework with Feasible Algorithm Designs and Convergence Analysis.

Proximal Riemannian Pursuit for Large-Scale Trace-Norm Minimization.

Accelerated PALM for Nonconvex Low-Rank Matrix Recovery with Theoretical Analysis

Approximation Conjugate Gradient Method for Low-Rank Matrix Recovery

Fast Hybrid Algorithm for Big Matrix Recovery

Online Robust Low Rank Matrix Recovery

Riemannian Optimization with Subspace Tracking for Low-Rank Recovery.

Low Rank Matrix Recovery via Robust Outlier Estimation

Exploiting the Structure Effectively and Efficiently in Low Rank Matrix Recovery.

Robust Low-Rank Matrix Recovery As Mixed Integer Programming Via $\ell _{0}$-Norm Optimization.

Nonconvex relaxation approaches to robust matrix recovery