Abstract:In this paper, we study the theoretical properties of iteratively reweighted least squares algorithm for recovering a matrix (IRLS-M for short) from noisy linear measurements. The IRLS-M was proposed by Fornasier et al. (2011) [ 17 ] for solving nuclear norm minimization and by Mohan et al. (2012) [ 31 ] for solving Schatten- \begin{document}$p$\end{document} (quasi) norm minimization ( \begin{document}$0 ) in noiseless case, based on the iteratively reweighted least squares algorithm for sparse signal recovery (IRLS for short) (Daubechies et al., 2010) [ 15 ], and numerical experiments have been given to show its efficiency (Fornasier et al. and Mohan et al.) [ 17 ], [ 31 ]. In this paper, we focus on providing convergence and stability analysis of iteratively reweighted least squares algorithm for low-rank matrix recovery in the presence of noise. The convergence of IRLS-M is proved strictly for all \begin{document}$0 . Furthermore, when the measurement map \begin{document}$\mathcal{A}$\end{document} satisfies the matrix restricted isometry property (M-RIP for short), we show that the IRLS-M is stable for \begin{document}$0 . Specially, when \begin{document}$p=1$\end{document} , we prove that the M-RIP constant \begin{document}$δ_{2r} is sufficient for IRLS-M to recover an unknown (approximately) low rank matrix with an error that is proportional to the noise level. The simplicity of IRLS-M, along with the theoretical guarantees provided in this paper, make a compelling case for its adoption as a standard tool for low rank matrix recovery.

Performance Analysis of $l_0$ Norm Constraint Least Mean Square Algorithm

Performance Analysis of L-0-Lms with Gaussian Input Signal

$L_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification

l0 Norm Constraint LMS Algorithm for Sparse System Identification.

Average case analysis of Lasso under ultra-sparse conditions

l 0-norm penalised shrinkage linear and widely linear LMS algorithms for sparse system identification.

A Robust Zero-point Attraction LMS Algorithm on Near Sparse System Identification

Gradient Compared Lp-LMS Algorithms for Sparse System Identification

Robust Zero-Point Attraction Least Mean Square Algorithm on Near Sparse System Identification

Transient performance analysis of zero-attracting LMS

The Steady-State Mean-Square Error Analysis for Least Mean $P$-Order Algorithm

Performance Analysis of the Gradient Comparator LMS Algorithm

CONVERGENCE AND STABILITY OF ITERATIVELY REWEIGHTED LEAST SQUARES FOR LOW-RANK MATRIXRECOVERY

Regularized Least-Mean-Square Algorithms

Adaptive Algorithm for Sparse System Identification:Zero-Attracting LMS

Sparse LMS for System Identification

On the Mean-Square Performance of the Constrained LMS Algorithm

Variable p norm constrained LMS algorithm based on gradient of root relative deviation.pdf

L0-norm constraint normalized subband adaptive filtering algorithm: Performance development and AEC application

Error bounds of constant gain least-mean-squares algorithms

Reweighted l1-norm Penalized LMS for Sparse Channel Estimation and Its Analysis