Abstract:This work concerns the zeroth-order global minimization of continuous nonconvex functions with a unique global minimizer and possibly multiple local minimizers. We formulate a theoretical framework for inexact proximal point (IPP) methods for global optimization, establishing convergence guarantees under mild assumptions when either deterministic or stochastic estimates of proximal operators are <a class="link-external link-http" href="http://used.The" rel="external noopener nofollow">this http URL</a> quadratic regularization in the proximal operator and the scaling effect of a parameter $\delta>0$ create a concentrated landscape of an associated Gibbs measure that is practically effective for sampling. The convergence of the expectation under the Gibbs measure as $\delta\to 0^+$ is established, and the convergence rate of $\bigO(\delta)$ is derived under additional assumptions. These results provide a theoretical foundation for evaluating proximal operators inexactly using sampling-based methods such as Monte Carlo (MC) integration. In addition, we propose a new approach based on tensor train (TT) approximation. This approach employs a randomized TT cross algorithm to efficiently construct a low-rank TT approximation of a discretized function using a small number of function evaluations, and we provide an error analysis for the TT-based estimation. We then propose two practical IPP algorithms, TT-IPP and MC-IPP. The TT-IPP algorithm leverages TT estimates of the proximal operators, while the MC-IPP algorithm employs MC integration to estimate the proximal operators. Both algorithms are designed to adaptively balance efficiency and accuracy in inexact evaluations of proximal operators. The effectiveness of the two algorithms is demonstrated through experiments on diverse benchmark functions and various applications.

Finite Termination of Inexact Proximal Point Algorithms in Hilbert Spaces

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Convergence rate of inexact proximal point algorithms for operator with holder metric subregularity

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

An Approximate Proximal Point Algorithm for Maximal Monotone Inclusion Problems

Weak Sharp Minima and Finite Termination of the Proximal Point Method for Convex Functions on Hadamard Manifolds

Local Convergence of Inexact Methods under the Hölder Condition

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Monotone vector fields and the proximal point algorithm on Hadamard manifolds

Error Sensitivity for Strongly Convergent Modifications of the Proximal Point Algorithm

Proximal Point Algorithms for Zero Points of Nonlinear Operators

Convergence results for proximal point algorithm with inertial and correction terms

A Regularization Method for the Proximal Point Algorithm

On finite convergence of proximal point algorithms for variational inequalities

Inexact Proximal Point Algorithms for Zeroth-Order Global Optimization

The Developments of Proximal Point Algorithms

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Proximal Point Algorithms for Nonsmooth Convex Optimization with Fixed Point Constraints

Proximal Point Algorithms Involving Fixed Point of Nonspreading-Type Multivalued Mappings in Hilbert Spaces

The Indefinite Proximal Point Algorithms for Maximal Monotone Operators

Finite Convergence of a Projected Proximal Point Algorithm for the Generalized Variational Inequalities.