Abstract:In this paper we provide a rigorous convergence analysis for the renowned particle swarm optimization method by using tools from stochastic calculus and the analysis of partial differential equations. Based on a continuous-time formulation of the particle dynamics as a system of stochastic differential equations, we establish convergence to a global minimizer of a possibly nonconvex and nonsmooth objective function in two steps. First, we prove consensus formation of an associated mean-field dynamics by analyzing the time-evolution of the variance of the particle distribution, which acts as Lyapunov function of the dynamics. We then show that this consensus is close to a global minimizer by employing the asymptotic Laplace principle and a tractability condition on the energy landscape of the objective function. These results allow for the usage of memory mechanisms, and hold for a rich class of objectives provided certain conditions of well-preparation of the hyperparameters and the initial datum. In a second step, at least for the case without memory effects, we provide a quantitative result about the mean-field approximation of particle swarm optimization, which specifies the convergence of the interacting particle system to the associated mean-field limit. Combining these two results allows for global convergence guarantees of the numerical particle swarm optimization method with provable polynomial complexity. To demonstrate the applicability of the method we propose an efficient and parallelizable implementation, which is tested in particular on a competitive and well-understood high-dimensional benchmark problem in machine learning.

Stopping Rules for the Stochastic Nested Partitions Method

Stopping Criterion for a Simulation-Based Optimization Method

Nested Partitions Method for Stochastic Optimization

Nested Partitions Method for Global Optimization

Simulation Optimization: A New Approach

Stopping Rules for Randomized Greedy Triangulation Schemes

Solving Nonsmooth Nonconvex Compound Stochastic Programs with Applications to Risk Measure Minimization

A Note on the Stochastic Ruler Method for Discrete Simulation Optimization

Optimally Stopped Optimization

A New Partition-Based Random Search Method For Deterministic Optimization Problems

A Stochastic Record-Value Approach to Global Simulation Optimization

MCMC stopping rules in latent variable modelling

Sequential Design for Optimal Stopping Problems

Ordinal Comparison via the Nested Partitions Method

On the Global Convergence of Particle Swarm Optimization Methods

A New Algorithm for Stochastic Discrete Resource Allocation Optimization

Randomized Optimal Stopping Problem in Continuous Time and Reinforcement Learning Algorithm

On the rates of convergence of simulation based optimization algorithms for optimal stopping problems

Statistical properties of an early stopping rule for resampling-based multiple testing.

Sum the Probabilities to $m$ and Stop

Stopping Bayesian Optimization with Probabilistic Regret Bounds