Abstract:Low-rank minimization aims to recover a matrix of minimum rank subject to linear system constraint. It can be found in various data analysis and machine learning areas, such as recommender systems, video denoising, and signal processing. Nuclear norm minimization is a dominating approach to handle it. However, such a method ignores the difference among singular values of target matrix. To address this issue, nonconvex low-rank regularizers have been widely used. Unfortunately, existing methods suffer from different drawbacks, such as inefficiency and inaccuracy. To alleviate such problems, this article proposes a flexible model with a novel nonconvex regularizer. Such a model not only promotes low rankness but also can be solved much faster and more accurate. With it, the original low-rank problem can be equivalently transformed into the resulting optimization problem under the rank restricted isometry property (rank-RIP) condition. Subsequently, Nesterov's rule and inexact proximal strategies are adopted to achieve a novel algorithm highly efficient in solving this problem at a convergence rate of O(1/K) , with K being the iterate count. Besides, the asymptotic convergence rate is also analyzed rigorously by adopting the Kurdyka- ojasiewicz (KL) inequality. Furthermore, we apply the proposed optimization model to typical low-rank problems, including matrix completion, robust principal component analysis (RPCA), and tensor completion. Exhaustively empirical studies regarding data analysis tasks, i.e., synthetic data analysis, image recovery, personalized recommendation, and background subtraction, indicate that the proposed model outperforms state-of-the-art models in both accuracy and efficiency.

Learned Turbo-type Affine Rank Minimization

Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis

TARM: A Turbo-Type Algorithm for Affine Rank Minimization

Tarm: A Turbo-Type Algorithm for Low-Rank Matrix Recovery.

A New Nonconvex Strategy to Affine Matrix Rank Minimization Problem

Large-Scale Affine Matrix Rank Minimization with a Novel Nonconvex Regularizer.

Asymptotic Log-Det Sum-of-Ranks Minimization via Tensor (Alternating) Iteratively Reweighted Least Squares

Promoting low rank non-convex fraction function penalty for affine matrix rank minimization

Adaptive Metric Learning with the Low Rank Constraint

Augmented Lagrangian Alternating Direction Method for Low-Rank Minimization Via Non-Convex Approximation.

A Stochastic Alternating Minimization Approach for Large Scale Low Rank Matrix Factorization.

Sine Activated Low-Rank Matrices for Parameter Efficient Learning

Alternating Direction and Taylor Expansion Minimization Algorithms for Unconstrained Nuclear Norm Optimization.

Accelerated PALM for Nonconvex Low-Rank Matrix Recovery with Theoretical Analysis

RIP-based Performance Guarantee for Low Rank Matrix Recovery via $L_{*-F}$ Minimization

$L_0$-ARM: Network Sparsification via Stochastic Binary Optimization

Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation

Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation.

Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation

Greedy Learning of Generalized Low-Rank Models.

Efficient Rank Minimization via Solving Non-convexPenalties by Iterative Shrinkage-Thresholding Algorithm