Abstract:This work concerns the zeroth-order global minimization of continuous nonconvex functions with a unique global minimizer and possibly multiple local minimizers. We formulate a theoretical framework for inexact proximal point (IPP) methods for global optimization, establishing convergence guarantees under mild assumptions when either deterministic or stochastic estimates of proximal operators are <a class="link-external link-http" href="http://used.The" rel="external noopener nofollow">this http URL</a> quadratic regularization in the proximal operator and the scaling effect of a parameter $\delta>0$ create a concentrated landscape of an associated Gibbs measure that is practically effective for sampling. The convergence of the expectation under the Gibbs measure as $\delta\to 0^+$ is established, and the convergence rate of $\bigO(\delta)$ is derived under additional assumptions. These results provide a theoretical foundation for evaluating proximal operators inexactly using sampling-based methods such as Monte Carlo (MC) integration. In addition, we propose a new approach based on tensor train (TT) approximation. This approach employs a randomized TT cross algorithm to efficiently construct a low-rank TT approximation of a discretized function using a small number of function evaluations, and we provide an error analysis for the TT-based estimation. We then propose two practical IPP algorithms, TT-IPP and MC-IPP. The TT-IPP algorithm leverages TT estimates of the proximal operators, while the MC-IPP algorithm employs MC integration to estimate the proximal operators. Both algorithms are designed to adaptively balance efficiency and accuracy in inexact evaluations of proximal operators. The effectiveness of the two algorithms is demonstrated through experiments on diverse benchmark functions and various applications.

The Developments of Proximal Point Algorithms

The Indefinite Proximal Point Algorithms for Maximal Monotone Operators

Proximal Point Algorithms for Zero Points of Nonlinear Operators

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

On the proximal point algorithms for solving the monotone inclusion problem

A Proximal Point Method for the Sum of Maximal Monotone Operators

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

A UNIFIED AND TIGHT LINEAR CONVERGENCE ANALYSIS OF THE RELAXED PROXIMAL POINT ALGORITHM

On the optimal linear convergence factor of the relaxed proximal point algorithm for monotone inclusion problems.

Finite Termination of Inexact Proximal Point Algorithms in Hilbert Spaces

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

A Class of Nonlinear Proximal Point Algorithms for Variational Inequality Problems

Convergence rate of inexact proximal point algorithms for operator with holder metric subregularity

An adaptive proximal point algorithm framework and application to large-scale optimization

Inexact Proximal Point Algorithms for Zeroth-Order Global Optimization

Error Sensitivity for Strongly Convergent Modifications of the Proximal Point Algorithm

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

high-order proximal point algorithm for the monotone variational inequality problem and its application

A Symplectic Discretization Based Proximal Point Algorithm for Convex Minimization

A Regularization Method for the Proximal Point Algorithm

Tight Sublinear Convergence Rate of the Proximal Point Algorithm for Maximal Monotone Inclusion Problems