Abstract:\bfA \bfb \bfs \bft \bfr \bfa \bfc \bft .We prove convergence of Anderson acceleration for a class of nonsmooth fixed-point problems for which the nonlinearities can be split into a smooth contractive part and a nonsmooth part which has a small Lipschitz constant.These problems arise from compositions of completely continuous integral operators and pointwise nonsmooth functions.We illustrate the results with two examples.\bfK \bfe \bfy \bfw \bfo \bfr \bfd \bfs .nonsmooth equatioins, Anderson acceleration, integral equations, nonlinear equations, fixed-point problems \bfA \bfM \bfS \bfs \bfu \bfb \bfj \bfe \bfc \bft \bfc \bfl \bfa \bfs \bfs \bfi fi\bfc \bfa \bft \bfi \bfo \bfn \bfs .65H10, 45G10 \bfD \bfO \bfI .10.1137/20M132938X 1. Introduction.In this paper we prove convergence of Anderson acceleration [1] for a class of nonsmooth fixed-point problems.Anderson acceleration was originally designed for integral equations and is now very common in electronic structure computations (see [6] and many references since then).Anderson acceleration is essentially the same as direct inversion on the iterative subspace (DIIS) [18,19,26,27], nonlinear GMRES [2,21,23,32], and interface quasi-Newton [7,13,20].It is also closely related to Pulay mixing [25], also known as Commutator DIIS [10,15,16,26].Convergence analysis has been reported in the literature only recently, and most of that work assumes at least continuous differentiability of the fixed-point map.There are convergence results for the linear case [30,31], the continuously differentiable case [3], the Lipschitz continuously differentiable case [29,30], and even smoother cases [8,24].In this paper we assume that nonlinearities can be split into a smooth part and a nonsmooth part with a small Lipschitz constant.The splittings we use in this paper are similar to ones used in nonsmooth nonlinear equations [5,14,17].In those papers the norm of the nonsmooth part was small enough so that using the derivative of the smooth part led to a rapidly convergent Newton-like iteration.In this paper the splitting is only used in the analysis, and the algorithm does not change.However, the classes of problems to which the methods apply are very similar.

Anderson Acceleration with Truncated Gram–Schmidt

Anderson Acceleration with Truncated Gram-Schmidt

Anderson Acceleration as a Krylov Method with Application to Asymptotic Convergence Analysis

Asymptotic convergence of restarted Anderson acceleration for certain normal linear systems

Anderson acceleration with approximate calculations: applications to scientific computing

A short report on preconditioned Anderson acceleration method

Descent Properties of an Anderson Accelerated Gradient Method With Restarting

A Fast Anderson-Chebyshev Acceleration for Nonlinear Optimization.

Anderson Acceleration in Nonsmooth Problems: Local Convergence via Active Manifold Identification

Convergence Analysis of the Alternating Anderson-Picard Method for Nonlinear Fixed-point Problems

Accelerating ADMM for Efficient Simulation and Optimization

Accelerated Stochastic ADMM with Variance Reduction

Improved Convergence Rates of Windowed Anderson Acceleration for Symmetric Fixed-Point Iterations

A Class of Short-term Recurrence Anderson Mixing Methods and Their Applications

Efficient Acceleration Framework for Complex‐Valued Linear Systems: Alternating Anderson Accelerating Preconditioned Richardson Approach

Globally Convergent Type-I Anderson Acceleration for Nonsmooth Fixed-Point Iterations

Anderson Acceleration for Geometry Optimization and Physics Simulation

Anderson acceleration of derivative-free projection methods for constrained monotone nonlinear equations

On the Convergence of CROP-Anderson Acceleration Method

Anderson Acceleration For Bioinformatics-Based Machine Learning

Anderson Acceleration for a Class of Nonsmooth Fixed-Point Problems