Abstract:The proximal Galerkin finite element method is a high-order, low iteration complexity, nonlinear numerical method that preserves the geometric and algebraic structure of pointwise bound constraints in infinite-dimensional function spaces. This paper introduces the proximal Galerkin method and applies it to solve free boundary problems, enforce discrete maximum principles, and develop a scalable, mesh-independent algorithm for optimal design problems with pointwise bound constraints. This paper also provides a derivation of the latent variable proximal point (LVPP) algorithm, an unconditionally stable alternative to the interior point method. LVPP is an infinite-dimensional optimization algorithm that may be viewed as having an adaptive barrier function that is updated with a new informative prior at each (outer loop) optimization iteration. One of its main benefits is witnessed when analyzing the classical obstacle problem. Therein, we find that the original variational inequality can be replaced by a sequence of partial differential equations (PDEs) that are readily discretized and solved with, e.g., high-order finite elements. Throughout this work, we arrive at several unexpected contributions that may be of independent interest. These include (1) a semilinear PDE we refer to as the entropic Poisson equation; (2) an algebraic/geometric connection between high-order positivity-preserving discretizations and certain infinite-dimensional Lie groups; and (3) a gradient-based, bound-preserving algorithm for two-field density-based topology optimization. The complete latent variable proximal Galerkin methodology combines ideas from nonlinear programming, functional analysis, tropical algebra, and differential geometry and can potentially lead to new synergies among these areas as well as within variational and numerical analysis.

On growth error bound conditions with an application to heavy ball method

Error bounds, PL condition, and quadratic growth for weakly convex functions, and linear convergences of proximal point methods

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Accelerated Over-Relaxation Heavy-Ball Methods with Provable Acceleration and Global Convergence

A Robust Control Approach to Asymptotic Optimality of the Heavy Ball Method for Optimization of Quadratic Functions

Heavy Ball Momentum for Non-Strongly Convex Optimization

A Unified Analysis on the Subgradient Upper Bounds for the Subgradient Methods Minimizing Composite Nonconvex, Nonsmooth and Non-Lipschitz Functions

Convergence analysis of a stochastic heavy-ball method for linear ill-posed problems

Primitive Heavy-ball Dynamics Achieves $O(\varepsilon^{-7/4})$ Convergence for Nonconvex Optimization

On the growth of nonconvex functionals at strict local minimizers

Growth of nonconvex functionals at strict local minimizers

Sharper Bounds for Proximal Gradient Algorithms with Errors

Accelerated Convex Optimization with Stochastic Gradients: Generalizing the Strong-Growth Condition

Nonsmooth Nonconvex Stochastic Heavy Ball

On Generalization Error Bounds of Noisy Gradient Methods for Non-Convex Learning

On Lower Complexity Bounds for Large-Scale Smooth Convex Optimization

An adaptive proximal point algorithm framework and application to large-scale optimization

An adaptive heavy ball method for ill-posed inverse problems

Proximal Galerkin: A structure-preserving finite element method for pointwise bound constraints

Relaxed-Inertial Proximal Point Algorithms for Nonconvex Equilibrium Problems with Applications

Polyak's Heavy Ball Method Achieves Accelerated Local Rate of Convergence under Polyak-Lojasiewicz Inequality