Local Linear Convergence of ISTA and FISTA on the LASSO Problem

Shaozhe Tao,Daniel Boley,Shuzhong Zhang
DOI: https://doi.org/10.48550/arXiv.1501.02888
2015-01-13
Abstract:We establish local linear convergence bounds for the ISTA and FISTA iterations on the model LASSO problem. We show that FISTA can be viewed as an accelerated ISTA process. Using a spectral analysis, we show that, when close enough to the solution, both iterations converge linearly, but FISTA slows down compared to ISTA, making it advantageous to switch to ISTA toward the end of the iteration processs. We illustrate the results with some synthetic numerical examples.
Optimization and Control
What problem does this paper attempt to address?