Abstract:Anderson acceleration (AA) is widely used for accelerating the convergence of nonlinear fixed-point methods $x_{k+1}=q(x_{k})$, $x_k \in \mathbb{R}^n$, but little is known about how to quantify the convergence acceleration provided by AA. As a roadway towards gaining more understanding of convergence acceleration by AA, we study AA($m$), i.e., Anderson acceleration with finite window size $m$, applied to the case of linear fixed-point iterations $x_{k+1}=M x_{k}+b$. We write AA($m$) as a Krylov method with polynomial residual update formulas, and derive recurrence relations for the AA($m$) polynomials. Writing AA($m$) as a Krylov method immediately implies that $k$ iterations of AA($m$) cannot produce a smaller residual than $k$ iterations of GMRES without restart (but without implying anything about the relative convergence speed of (windowed) AA($m$) versus restarted GMRES($m$)). We find that the AA($m$) residual polynomials observe a periodic memory effect where increasing powers of the error iteration matrix $M$ act on the initial residual as the iteration number increases. We derive several further results based on these polynomial residual update formulas, including orthogonality relations, a lower bound on the AA(1) acceleration coefficient $\beta_k$, and explicit nonlinear recursions for the AA(1) residuals and residual polynomials that do not include the acceleration coefficient $\beta_k$. Using these recurrence relations we also derive new residual convergence bounds for AA(1) in the linear case, demonstrating how the per-iteration residual reduction $||r_{k+1}||/||r_{k}||$ depends strongly on the residual reduction in the previous iteration and on the angle between the prior residual vectors $r_k$ and $r_{k-1}$. We apply these results to study the influence of the initial guess on the asymptotic convergence factor of AA(1), and to study AA(1) residual convergence patterns.

Practical considerations for the adoption of Anderson acceleration in nonlinear diffusion accelerated transport

Anderson acceleration for PWR whole-core pin-by-pin Nu-TH coupling calculation in NECP-Bamboo2.0

Towards the Use of Anderson Acceleration in Coupled Transport-Gyrokinetic Turbulence Simulations

A Computational Strategy for Nonlinear Coupled Constitutive Relations of Rarefied Nonequilibrium Flows on Unstructured Grids

Anderson acceleration. Convergence analysis and applications to equilibrium chemistry

Non-stationary Anderson acceleration with optimized damping

A New Coupled Computational Method in Conjunction with Three-Dimensional Finite Volume Schemes for Nonlinear Coupled Constitutive Relations

Anderson Acceleration as a Krylov Method with Application to Asymptotic Convergence Analysis

A Parametric Study for Convergence Improvement of the Ronen Method Through the DAAREM Algorithm

Anderson acceleration with approximate calculations: applications to scientific computing

Fine Mesh Finite Difference Acceleration Method Based on the Generalized Equivalence Theory for the 2-D MOC Transport Calculation

On the Convergence of CROP-Anderson Acceleration Method

Analysis of an Adaptive Safeguarded Newton-Anderson Algorithm of Depth One with Applications to Fluid Problems

A short report on preconditioned Anderson acceleration method

Optimizations of the Accelerated Axial Polynomial Method of Characteristics of the APOLLO3® Deterministic Neutron Transport Code

Anderson Acceleration with Truncated Gram-Schmidt

Anderson Acceleration with Truncated Gram–Schmidt

Anderson Accelerated PMHSS for Complex-Symmetric Linear Systems

Convergence Analysis of the Alternating Anderson-Picard Method for Nonlinear Fixed-point Problems

On the Use of the Jacobian-Free Newton Krylov Method to Generate One-Group Discontinuity and Super Homogenization Factors for Full-Core Neutron Diffusion Simulations

Asymptotic convergence of restarted Anderson acceleration for certain normal linear systems