Abstract:This work concerns the zeroth-order global minimization of continuous nonconvex functions with a unique global minimizer and possibly multiple local minimizers. We formulate a theoretical framework for inexact proximal point (IPP) methods for global optimization, establishing convergence guarantees under mild assumptions when either deterministic or stochastic estimates of proximal operators are <a class="link-external link-http" href="http://used.The" rel="external noopener nofollow">this http URL</a> quadratic regularization in the proximal operator and the scaling effect of a parameter $\delta>0$ create a concentrated landscape of an associated Gibbs measure that is practically effective for sampling. The convergence of the expectation under the Gibbs measure as $\delta\to 0^+$ is established, and the convergence rate of $\bigO(\delta)$ is derived under additional assumptions. These results provide a theoretical foundation for evaluating proximal operators inexactly using sampling-based methods such as Monte Carlo (MC) integration. In addition, we propose a new approach based on tensor train (TT) approximation. This approach employs a randomized TT cross algorithm to efficiently construct a low-rank TT approximation of a discretized function using a small number of function evaluations, and we provide an error analysis for the TT-based estimation. We then propose two practical IPP algorithms, TT-IPP and MC-IPP. The TT-IPP algorithm leverages TT estimates of the proximal operators, while the MC-IPP algorithm employs MC integration to estimate the proximal operators. Both algorithms are designed to adaptively balance efficiency and accuracy in inexact evaluations of proximal operators. The effectiveness of the two algorithms is demonstrated through experiments on diverse benchmark functions and various applications.

Convergence rate of inexact proximal point algorithms for operator with holder metric subregularity

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

Local Convergence of Inexact Methods under the Hölder Condition

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Finite Termination of Inexact Proximal Point Algorithms in Hilbert Spaces

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

CONVERGENCE CRITERION OF INEXACT METHODS FOR OPERATORS WITH H¨OLDER CONTINUOUS DERIVATIVES

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Local convergence of an inexact proximal algorithm for weakly convex functions

Error Sensitivity for Strongly Convergent Modifications of the Proximal Point Algorithm

Convergence results for proximal point algorithm with inertial and correction terms

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

A Strongly Convergent Modification of the Proximal Point Algorithm in Nonsmooth Banach Spaces

On the Convergence Rates of Proximal Splitting Algorithms

Convergence of Generalized Proximal Point Algorithms

Convergence Rate of the Relaxed CQ Algorithm under Hölderian Type Error Bound Property

Iterative Algorithms for Nonlinear Operators

Inexact Proximal Point Algorithms for Zeroth-Order Global Optimization

The Indefinite Proximal Point Algorithms for Maximal Monotone Operators

The Rate of Convergence of Proximal Method of Multipliers for Equality Constrained Optimization Problems.

A Convergence Framework for Inexact Nonconvex and Nonsmooth Algorithms and Its Applications to Several Iterations