Abstract:Iterative sketching and sketch-and-precondition are well-established randomized algorithms for solving large-scale, over-determined linear least-squares problems. In this paper, we introduce a new perspective that interprets Iterative Sketching and Sketching-and-Precondition as forms of Iterative Refinement. We also examine the numerical stability of two distinct refinement strategies, iterative refinement and recursive refinement, which progressively improve the accuracy of a sketched linear solver. Building on this insight, we propose a novel algorithm, Sketched Iterative and Recursive Refinement (SIRR), which combines both refinement methods. SIRR demonstrates a \emph{four order of magnitude improvement} in backward error compared to iterative sketching, achieved simply by reorganizing the computational order, ensuring that the computed solution exactly solves a modified least-squares system where the coefficient matrix deviates only slightly from the original matrix. To the best of our knowledge, \emph{SIRR is the first asymptotically fast, single-stage randomized least-squares solver that achieves both forward and backward stability}.

A New Iterative Refinement with Roundoff Error Analysis.

Extended version with the analysis of dynamic system for iterative refinement of solution

A Note on Wilkinson's Iterative Refinement of Solution with Automatic Step-Size Control

Wilkinson’s Iterative Refinement of Solution with Automatic Step-Size Control for Linear System of Equations

Stable iterative refinement algorithms for solving linear systems

New Iterative Improvement of a Solution for an Ill-conditioned System of Linear Equations Based on a Linear Dynamic System

Iterative Refinement of Solution with Biparameter for Solving Ill-Conditioned Systems of Linear Algebraic Equations

Iterative Refinement of Computing Inverse Matrix

Randomized Iterative Solver as Iterative Refinement: A Simple Fix Towards Backward Stability

Note on the Improvement of Newton’s Method for System of Nonlinear Equations

A Significant Improvement On Newton'S Iterative Method

A semi-local convergence theorem for a robust revised Newton's method

A Note on Improving Iterative Algorithm for Saddle Point System

A Study of the Robustness of Iterative Methods for Linear Systems

Mixed precision iterative refinement for linear inverse problems

Some Substantial Modifications and Improvements for Derivative-Free Iterative Methods and Derivative-Free Transformation for Multiple Zeros

A feasible adaptive refinement algorithm for linear semi-infinite optimization

New high-order convergence iteration methods without employing derivatives for solving nonlinear equations

A posteriori error analysis of round-off errors in the numerical solution of ordinary differential equations

A significant improvement on Newton's interative method

An Efficient Numerical Method for Solving a Class of Nonlinear Fractional Differential Equations and Error Estimates