Abstract:This work concerns the zeroth-order global minimization of continuous nonconvex functions with a unique global minimizer and possibly multiple local minimizers. We formulate a theoretical framework for inexact proximal point (IPP) methods for global optimization, establishing convergence guarantees under mild assumptions when either deterministic or stochastic estimates of proximal operators are <a class="link-external link-http" href="http://used.The" rel="external noopener nofollow">this http URL</a> quadratic regularization in the proximal operator and the scaling effect of a parameter $\delta>0$ create a concentrated landscape of an associated Gibbs measure that is practically effective for sampling. The convergence of the expectation under the Gibbs measure as $\delta\to 0^+$ is established, and the convergence rate of $\bigO(\delta)$ is derived under additional assumptions. These results provide a theoretical foundation for evaluating proximal operators inexactly using sampling-based methods such as Monte Carlo (MC) integration. In addition, we propose a new approach based on tensor train (TT) approximation. This approach employs a randomized TT cross algorithm to efficiently construct a low-rank TT approximation of a discretized function using a small number of function evaluations, and we provide an error analysis for the TT-based estimation. We then propose two practical IPP algorithms, TT-IPP and MC-IPP. The TT-IPP algorithm leverages TT estimates of the proximal operators, while the MC-IPP algorithm employs MC integration to estimate the proximal operators. Both algorithms are designed to adaptively balance efficiency and accuracy in inexact evaluations of proximal operators. The effectiveness of the two algorithms is demonstrated through experiments on diverse benchmark functions and various applications.

Pointwise Lipschitz Continuous Graph Algorithms via Proximal Gradient Analysis

Lipschitz Continuous Algorithms for Graph Problems

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

Lipschitz Continuous Algorithms for Covering Problems

A Symplectic Discretization Based Proximal Point Algorithm for Convex Minimization

Proximal Point Methods for Optimization with Nonconvex Functional Constraints

Convergence rate of inexact proximal point algorithms for operator with holder metric subregularity

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Solving a class of nonsmooth resource allocation problems with directed graphs through distributed Lipschitz continuous multi-proximal algorithms

A UNIFIED AND TIGHT LINEAR CONVERGENCE ANALYSIS OF THE RELAXED PROXIMAL POINT ALGORITHM

Adaptive proximal algorithms for convex optimization under local Lipschitz continuity of the gradient

Inexact Proximal Point Algorithms for Zeroth-Order Global Optimization

An adaptive proximal point algorithm framework and application to large-scale optimization

Error bounds, PL condition, and quadratic growth for weakly convex functions, and linear convergences of proximal point methods

A family of multi-parameterized proximal point algorithms

A Unified Analysis for the Subgradient Methods Minimizing Composite Nonconvex, Nonsmooth and Non-Lipschitz Functions.

Discrete-time gradient flows in Gromov hyperbolic spaces

New nonasymptotic convergence rates of stochastic proximal pointalgorithm for convex optimization problems

Continuous-Time Distributed Proximal Gradient Algorithms for Nonsmooth Resource Allocation over General Digraphs.

Distributed Proximal Point Algorithm For Constrained Optimization Over Unbalanced Graphs