Abstract:\bfA \bfb \bfs \bft \bfr \bfa \bfc \bft .We prove convergence of Anderson acceleration for a class of nonsmooth fixed-point problems for which the nonlinearities can be split into a smooth contractive part and a nonsmooth part which has a small Lipschitz constant.These problems arise from compositions of completely continuous integral operators and pointwise nonsmooth functions.We illustrate the results with two examples.\bfK \bfe \bfy \bfw \bfo \bfr \bfd \bfs .nonsmooth equatioins, Anderson acceleration, integral equations, nonlinear equations, fixed-point problems \bfA \bfM \bfS \bfs \bfu \bfb \bfj \bfe \bfc \bft \bfc \bfl \bfa \bfs \bfs \bfi fi\bfc \bfa \bft \bfi \bfo \bfn \bfs .65H10, 45G10 \bfD \bfO \bfI .10.1137/20M132938X 1. Introduction.In this paper we prove convergence of Anderson acceleration [1] for a class of nonsmooth fixed-point problems.Anderson acceleration was originally designed for integral equations and is now very common in electronic structure computations (see [6] and many references since then).Anderson acceleration is essentially the same as direct inversion on the iterative subspace (DIIS) [18,19,26,27], nonlinear GMRES [2,21,23,32], and interface quasi-Newton [7,13,20].It is also closely related to Pulay mixing [25], also known as Commutator DIIS [10,15,16,26].Convergence analysis has been reported in the literature only recently, and most of that work assumes at least continuous differentiability of the fixed-point map.There are convergence results for the linear case [30,31], the continuously differentiable case [3], the Lipschitz continuously differentiable case [29,30], and even smoother cases [8,24].In this paper we assume that nonlinearities can be split into a smooth part and a nonsmooth part with a small Lipschitz constant.The splittings we use in this paper are similar to ones used in nonsmooth nonlinear equations [5,14,17].In those papers the norm of the nonsmooth part was small enough so that using the derivative of the smooth part led to a rapidly convergent Newton-like iteration.In this paper the splitting is only used in the analysis, and the algorithm does not change.However, the classes of problems to which the methods apply are very similar.

Safeguarded Anderson acceleration for parametric nonexpansive operators

Globally Convergent Type-I Anderson Acceleration for Nonsmooth Fixed-Point Iterations

Anderson Acceleration for Geometry Optimization and Physics Simulation

Analysis of an Adaptive Safeguarded Newton-Anderson Algorithm of Depth One with Applications to Fluid Problems

Non-linear Stochastic Optimal Control of Acceleration Parametrically Excited Systems

A Fast Anderson-Chebyshev Acceleration for Nonlinear Optimization.

Accelerating ADMM for Efficient Simulation and Optimization

Anderson Acceleration for a Class of Nonsmooth Fixed-Point Problems

Anderson Acceleration in Nonsmooth Problems: Local Convergence via Active Manifold Identification

Anderson acceleration with adaptive relaxation for convergent fixed-point iterations

A short report on preconditioned Anderson acceleration method

Anderson Acceleration Without Restart: A Novel Method with $n$-Step Super Quadratic Convergence Rate

Anderson Acceleration with Truncated Gram-Schmidt

Anderson acceleration for partially observable Markov decision processes: A maximum entropy approach

Anderson Acceleration with Truncated Gram–Schmidt

Anderson Acceleration for Nonsmooth Fixed Point Problems

Anderson Acceleration for Nonconvex ADMM Based on Douglas-Rachford Splitting

Stochastic Momentum Method with Double Acceleration for Regularized Empirical Risk Minimization

Damped Anderson acceleration with restarts and monotonicity control for accelerating EM and EM-like algorithms

Anderson acceleration of derivative-free projection methods for constrained monotone nonlinear equations

Non-stationary Anderson acceleration with optimized damping