Abstract:This paper considers the problem of minimizing the sum of a smooth function and the Schatten-$p$ norm of the matrix. Our contribution involves proposing accelerated iteratively reweighted nuclear norm methods designed for solving the nonconvex low-rank minimization problem. Two major novelties characterize our approach. Firstly, the proposed method possesses a rank identification property, enabling the provable identification of the "correct" rank of the stationary point within a finite number of iterations. Secondly, we introduce an adaptive updating strategy for smoothing parameters. This strategy automatically fixes parameters associated with zero singular values as constants upon detecting the "correct" rank while quickly driving the rest of the parameters to zero. This adaptive behavior transforms the algorithm into one that effectively solves smooth problems after a few iterations, setting our work apart from existing iteratively reweighted methods for low-rank optimization. We prove the global convergence of the proposed algorithm, guaranteeing that every limit point of the iterates is a critical point. Furthermore, a local convergence rate analysis is provided under the Kurdyka-Łojasiewicz property. We conduct numerical experiments using both synthetic and real data to showcase our algorithm's efficiency and superiority over existing methods.

Continuous-time Laguerre-based Subspace Identification Utilising Nuclear Norm Minimisation.

Subspace-based Continuous-time Model Identification Using Nuclear Norm Minimization

A LMI Approach to Robust H/sub ∞/ Filtering for Discrete-Time Systems

Closed-loop continuous-time Laguerre-based subspace identification via orthogonal projection approach

Nuclear Norm Subspace Identification (N2SID) for short data batches

Identification of Nonlinear System with Irregularly and Slowly Sampled Output Using Lpv Model

A lagrange programming neural network approach for nuclear norm optimization

Subspace based direct closed-loop identification via output over-sampling scheme

Subspace Identification for Continuous-Time Errors-in-variables Model from Sampled Data

Hierarchical Least-Squares Based Iterative Identification for Multivariable Systems with Moving Average Noises

Modulating Function-Based Subspace Identification for Continuous-Time Fractional Order Systems

l0 Norm Constraint LMS Algorithm for Sparse System Identification.

$L_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification

A Novel RSMI Based on Regression and Natural Power Method

Closed-loop Subspace Identification for Continuous-time Models

Subspace-Based Fractional Order Systems Identification in Presence of Outliers

Efficient Low-rank Identification via Accelerated Iteratively Reweighted Nuclear Norm Minimization

l 0-norm penalised shrinkage linear and widely linear LMS algorithms for sparse system identification.

Subspace-based continuous-time identification of fractional order systems from non-uniformly sampled data

Linearized augmented Lagrangian and alternating direction methods for nuclear norm minimization.

Kernel Least-Mean Mixed-Norm Algorithm