Abstract:Low-rank minimization aims to recover a matrix of minimum rank subject to linear system constraint. It can be found in various data analysis and machine learning areas, such as recommender systems, video denoising, and signal processing. Nuclear norm minimization is a dominating approach to handle it. However, such a method ignores the difference among singular values of target matrix. To address this issue, nonconvex low-rank regularizers have been widely used. Unfortunately, existing methods suffer from different drawbacks, such as inefficiency and inaccuracy. To alleviate such problems, this article proposes a flexible model with a novel nonconvex regularizer. Such a model not only promotes low rankness but also can be solved much faster and more accurate. With it, the original low-rank problem can be equivalently transformed into the resulting optimization problem under the rank restricted isometry property (rank-RIP) condition. Subsequently, Nesterov's rule and inexact proximal strategies are adopted to achieve a novel algorithm highly efficient in solving this problem at a convergence rate of O(1/K) , with K being the iterate count. Besides, the asymptotic convergence rate is also analyzed rigorously by adopting the Kurdyka- ojasiewicz (KL) inequality. Furthermore, we apply the proposed optimization model to typical low-rank problems, including matrix completion, robust principal component analysis (RPCA), and tensor completion. Exhaustively empirical studies regarding data analysis tasks, i.e., synthetic data analysis, image recovery, personalized recommendation, and background subtraction, indicate that the proposed model outperforms state-of-the-art models in both accuracy and efficiency.

Research Progress of Low-Rank Matrix Approximation and Optimization Problem

From Compressed Sensing to Low-rank Matrix Recovery: Theory and Applications

Low-Rank Modeling and Its Applications in Image Analysis

Exploiting the Structure Effectively and Efficiently in Low Rank Matrix Recovery.

Large-Scale Affine Matrix Rank Minimization with a Novel Nonconvex Regularizer.

Low-Rank Matrix Approximation with Stability.

Low-Rank Matrix Recovery Via Modified Schatten-$p$ Norm Minimization with Convergence Guarantees

Generalized Nonconvex Nonsmooth Low-Rank Matrix Recovery Framework with Feasible Algorithm Designs and Convergence Analysis.

Sparse and Low-Rank Matrix Decompositions

A review on low-rank models in data analysis

Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview

Improved Nonconvex Optimization Model for Low-Rank Matrix Recovery

Low-Rank Matrix Recovery with Composite Optimization: Good Conditioning and Rapid Convergence

Low-Rank Matrix Recovery Via Efficient Schatten P-Norm Minimization

Efficient Recovery of Low-Rank Matrix Via Double Nonconvex Nonsmooth Rank Minimization.

Low-Rank Approximations with Sparse Factors I: Basic Algorithms and Error Analysis

Leveraging subspace information for low-rank matrix reconstruction

Low Rank Optimization for Efficient Deep Learning: Making A Balance between Compact Architecture and Fast Training

A Unified Computational and Statistical Framework for Nonconvex Low-rank Matrix Estimation

An algorithm for low-rank matrix factorization and its applications

Low-rank matrix estimation via nonconvex spectral regularized methods in errors-in-variables matrix regression