Abstract:In this paper, we study the theoretical properties of iteratively reweighted least squares algorithm for recovering a matrix (IRLS-M for short) from noisy linear measurements. The IRLS-M was proposed by Fornasier et al. (2011) [ 17 ] for solving nuclear norm minimization and by Mohan et al. (2012) [ 31 ] for solving Schatten- \begin{document}$p$\end{document} (quasi) norm minimization ( \begin{document}$0 ) in noiseless case, based on the iteratively reweighted least squares algorithm for sparse signal recovery (IRLS for short) (Daubechies et al., 2010) [ 15 ], and numerical experiments have been given to show its efficiency (Fornasier et al. and Mohan et al.) [ 17 ], [ 31 ]. In this paper, we focus on providing convergence and stability analysis of iteratively reweighted least squares algorithm for low-rank matrix recovery in the presence of noise. The convergence of IRLS-M is proved strictly for all \begin{document}$0 . Furthermore, when the measurement map \begin{document}$\mathcal{A}$\end{document} satisfies the matrix restricted isometry property (M-RIP for short), we show that the IRLS-M is stable for \begin{document}$0 . Specially, when \begin{document}$p=1$\end{document} , we prove that the M-RIP constant \begin{document}$δ_{2r} is sufficient for IRLS-M to recover an unknown (approximately) low rank matrix with an error that is proportional to the noise level. The simplicity of IRLS-M, along with the theoretical guarantees provided in this paper, make a compelling case for its adoption as a standard tool for low rank matrix recovery.

The Analysis of Completely Perturbed Model Based on RIP Via Orthogonal Least Squares

Analysis Non-Sparse Recovery for Relaxed ALASSO

Average case analysis of Lasso under ultra-sparse conditions

Sparse Signals Recovery from Noisy Measurements by Orthogonal Matching Pursuit

Optimal RIP Bounds for Sparse Signals Recovery Via ℓ Minimization

Sparse Recovery with Coherent Tight Frame via Analysis Dantzig Selector and Analysis LASSO

Recovery Conditions of Sparse Signals Using Orthogonal Least Squares-Type Algorithms

I T ] 8 S ep 2 01 3 Sparse Recovery with Coherent Tight Frames via Analysis Dantzig Selector and Analysis LASSO ∗

Block Sparse Recovery Via Mixed L 2 / L 1 Minimization

Recovery of Sparse Signals Using Multiple Orthogonal Least Squares

Nonuniform Support Recovery from Noisy Random Measurements by Orthogonal Matching Pursuit.

CONVERGENCE AND STABILITY OF ITERATIVELY REWEIGHTED LEAST SQUARES FOR LOW-RANK MATRIXRECOVERY

Perturbation Analysis of Orthogonal Matching Pursuit.

Analysis of Block OMP using Block RIP

Recovery of sparse signals using OMP and its variants: convergence analysis based on RIP

An improved greedy algorithm for signal recovery from random measurements

Theoretical analysis of GOMP based on RIP and ROC

Note on RIP-based Co-sparse Analysis

Analysis Of T-Orthogonal Greedy Algorithm in Noisy Measurement

Support Recovery with Orthogonal Matching Pursuit in the Presence of Noise: A New Analysis

Online Recovery Guarantees and Analytical Results for OMP