Disconvergence of Cauchy Annealing

HT Fang,MP Qian,GL Gong

1996-01-01

Abstract:In rather general cases, the Cauchy annealing does not converge to global minima in probability.

What problem does this paper attempt to address?

General limit to thermodynamic annealing performance

Yutong Luo,Yi-Zheng Zhen,Xiangjing Liu,Daniel Ebler,Oscar Dahlsten

DOI: https://doi.org/10.1103/PhysRevE.108.L052105

2023-11-17

Abstract:Annealing has proven highly successful in finding minima in a cost landscape. Yet, depending on the landscape, systems often converge towards local minima rather than global ones. In this Letter, we analyse the conditions for which annealing is approximately successful in finite time. We connect annealing to stochastic thermodynamics to derive a general bound on the distance between the system state at the end of the annealing and the ground state of the landscape. This distance depends on the amount of state updates of the system and the accumulation of non-equilibrium energy, two protocol and energy landscape dependent quantities which we show are in a trade-off relation. We describe how to bound the two quantities both analytically and physically. This offers a general approach to assess the performance of annealing from accessible parameters, both for simulated and physical implementations.

Statistical Mechanics,Quantum Physics
Annealing of Iterative Stochastic Schemes

Haitao Fang,Guanglu Gong,Minping Qian

DOI: https://doi.org/10.1137/S0363012995293670

IF: 2.2

1997-01-01

SIAM Journal on Control and Optimization

Abstract:Annealing of general iterative stochastic schemes is studied by using Wentzell's large deviation theory. The convergence of this algorithm is shown under some conditions. The closed form of the critical constant is specified in terms of its potential function of the mean model.
An Improved Annealing Method and Its Large-Time Behavior

HT Fang,MP Qian,GL Gong

DOI: https://doi.org/10.1016/s0304-4149(97)00069-0

IF: 1.43

1997-01-01

Stochastic Processes and their Applications

Abstract:In this paper, a new algorithm of simulated annealing is suggested. It is shown that this algorithm gives more rapid convergence than the usual algorithm. A logarithmic Sobolev inequality is also established.
Quantum and classical annealing in a continuous space with multiple local minima

Yang Wei Koh,Hidetoshi Nishimori

DOI: https://doi.org/10.1103/PhysRevA.105.062435

2022-03-22

Abstract:The protocol of quantum annealing is applied to an optimization problem with a one-dimensional continuous degree of freedom, a variant of the problem proposed by Shinomoto and Kabashima. The energy landscape has a number of local minima, and the classical approach of simulated annealing is predicted to have a logarithmically slow convergence to the global minimum. We show by extensive numerical analyses that quantum annealing yields a power law convergence, thus an exponential improvement over simulated annealing. The power is larger, and thus the convergence is faster, than a prediction by an existing phenomenological theory for this problem. Performance of simulated annealing is shown to be enhanced by introducing quasi-global searches across energy barriers, leading to a power-law convergence but with a smaller power than in the quantum case and thus a slower convergence classically even with quasi-global search processes. We also reveal how diabatic quantum dynamics, quantum tunneling in particular, steers the systems toward the global minimum by a meticulous choice of annealing schedule. This latter result explicitly contrasts the role of tunneling in quantum annealing against the classical counterpart of stochastic optimization by simulated annealing.

Quantum Physics
Global Annealing Genetic Algorithm and Its Convergence Analysis

Jiangshe Zhang,Zongben Xu,Yee Leung

DOI: https://doi.org/10.1007/bf02919428

1997-01-01

Abstract:A new selection mechanism termed global annealing selection (GAnS) is proposed for the genetic algorithm. It is proved that the GAnS genetic algorithm converges to the global optimums if and only if the parents are allowed to compete for reproduction, and that the variance of population's fitness can be used as a natural stopping criterion. Numerical simulations show that the new algorithm has stronger ability to escape from local maximum and converges more rapidly than canonical genetic algorithm.
Chaotic Annealing with Hypothesis Test for Function Optimization in Noisy Environments

Hui Pan,Ling Wang,Bo Liu

DOI: https://doi.org/10.1016/j.chaos.2006.05.070

IF: 9.922

2008-01-01

Chaos Solitons & Fractals

Abstract:As a special mechanism to avoid being trapped in local minimum, the ergodicity property of chaos has been used as a novel searching technique for optimization problems, but there is no research work on chaos for optimization in noisy environments. In this paper, the performance of chaotic annealing (CA) for uncertain function optimization is investigated, and a new hybrid approach (namely CAHT) that combines CA and hypothesis test (HT) is proposed. In CAHT, the merits of CA are applied for well exploration and exploitation in searching space, and solution quality can be identified reliably by hypothesis test to reduce the repeated search to some extent and to reasonably estimate performance for solution. Simulation results and comparisons show that, chaos is helpful to improve the performance of SA for uncertain function optimization, and CAHT can further improve the searching efficiency, quality and robustness.
Convergence analysis of the Gauss–Newton method for convex inclusion and convex-composite optimization problems

C. Li,K.F. Ng

DOI: https://doi.org/10.1016/j.jmaa.2011.11.062

IF: 1.417

2012-01-01

Journal of Mathematical Analysis and Applications

Abstract:Using the convex process theory we study the convergence issues of the iterative sequences generated by the Gauss–Newton method for the convex inclusion problem defined by a cone C and a smooth function F (the derivative is denoted by F′). The restriction in our consideration is minimal and, even in the classical case (the initial point x0 is assumed to satisfy the following two conditions: F′ is Lipschitz around x0 and the convex process Tx0, defined by Tx0⋅=F′(x0)⋅−C, is surjective), our results are new in giving sufficient conditions (which are weaker than the known ones and have a remarkable property being affine-invariant) ensuring the convergence of the iterative sequence with initial point x0. The same study is also made for the so-called convex-composite optimization problem (with objective function given as the composite of a convex function with a smooth map).
On Convergence of the Gauss-Newton Method for Convex Composite Optimization

Chong Li,Xinghua Wang

DOI: https://doi.org/10.1007/s101070100249

IF: 2.7

2002-01-01

Mathematical Programming

Abstract:The local quadratic convergence of the Gauss-Newton method for convex composite optimization f=h∘F is established for any convex function h with the minima set C, extending Burke and Ferris’ results in the case when C is a set of weak sharp minima for h.
Convergence of Langevin-simulated annealing algorithms with multiplicative noise

Pierre Bras,Gilles Pagès

DOI: https://doi.org/10.1090/mcom/3899

IF: 2.118

2024-03-16

Mathematics of Computation

Abstract:We study the convergence of Langevin-Simulated Annealing type algorithms with multiplicative noise, i.e. for V : R d → R V : \mathbb {R}^d o \mathbb {R} a potential function to minimize, we consider the stochastic differential equation d Y t = − σ σ ⊤ ∇ V ( Y t ) dY_t = - \sigma \sigma ^ op abla V(Y_t) d t + a ( t ) σ ( Y t ) d W t + a ( t ) 2 Υ ( Y t ) d t dt + a(t)\sigma (Y_t)dW_t + a(t)^2\Upsilon (Y_t)dt , where ( W t ) (W_t) is a Brownian motion, where σ : R d → M d ( R ) \sigma : \mathbb {R}^d o \mathcal {M}_d(\mathbb {R}) is an adaptive (multiplicative) noise, where a : R + → R + a : \mathbb {R}^+ o \mathbb {R}^+ is a function decreasing to 0 0 and where Υ \Upsilon is a correction term. This setting can be applied to optimization problems arising in Machine Learning; allowing σ \sigma to depend on the position brings faster convergence in comparison with the classical Langevin equation d Y t = − ∇ V ( Y t ) d t + σ d W t dY_t = - abla V(Y_t)dt + \sigma dW_t . The case where σ \sigma is a constant matrix has been extensively studied; however little attention has been paid to the general case. We prove the convergence for the L 1 L^1 -Wasserstein distance of Y t Y_t and of the associated Euler scheme Y ̄ t \bar {Y}_t to some measure ν ⋆ u ^\star which is supported by argmin ⁡ ( V ) \operatorname {argmin}(V) and give rates of convergence to the instantaneous Gibbs measure ν a ( t ) u _{a(t)} of density ∝ exp ⁡ ( − 2 V ( x ) / a ( t ) 2 ) \propto \exp (-2V(x)/a(t)^2) . To do so, we first consider the case where a a is a piecewise constant function. We find again the classical schedule a ( t ) = A log − 1 / 2 ⁡ ( t ) a(t) = A\log ^{-1/2}(t) . We then prove the convergence for the general case by giving bounds for the Wasserstein distance to the stepwise constant case using ergodicity properties.

mathematics, applied
Simulated annealing with a potential function with discontinuous gradient on ℝd

Guanglu Gong,Yong Liu,Minping Qian

2001-01-01

Abstract:In this paper, we have proven that the simulated annealing process dXt = - β(t) ∇U(Xt) + √2 dWt with a potential function on ℝd, of which the gradient is discontinuous, converges in probability to a neighborhood of the global minima of the potential function.
Global warming: Temperature estimation in annealers

Jack Raymond,Sheir Yarkoni,Evgeny Andriyash

DOI: https://doi.org/10.3389/fict.2016.00023

2017-08-25

Abstract:Sampling from a Boltzmann distribution is NP-hard and so requires heuristic approaches. Quantum annealing is one promising candidate. The failure of annealing dynamics to equilibrate on practical time scales is a well understood limitation, but does not always prevent a heuristically useful distribution from being generated. In this paper we evaluate several methods for determining a useful operational temperature range for annealers. We show that, even where distributions deviate from the Boltzmann distribution due to ergodicity breaking, these estimates can be useful. We introduce the concepts of local and global temperatures that are captured by different estimation methods. We argue that for practical application it often makes sense to analyze annealers that are subject to post-processing in order to isolate the macroscopic distribution deviations that are a practical barrier to their application.

Quantum Physics,Statistical Mechanics,Applications
Simulated Annealing with the State Generator Based on Cauchy and Gaussian Distributions

WANGLing,ZHENGDazhong

DOI: https://doi.org/10.3321/j.issn:1000-0054.2000.09.028

2000-01-01

Abstract:Simulated annealing is a probabilistic global optimization algorithm, whose searching behavior and performance are very sensitive to the input parameters, especially to the state generator. The performances of state generators based on Cauchy distribution (SGC) and Gaussian distribution (SGG) for numerical optimization were compared in this paper. The distribution mechanism was analyzed, and it has been found that SGC is good at search in solution spaces while SGG is better at search in small local neighborhoods. Simulation results on benchmark problems show that SGC is more efficient than SGG for simple unimodal functions and that the optimization quality and robustness of SGC are superior to those of SGG for complex multimodal functions with many local minima and for simple functions with plateaus. An improved SGC was proposed using the annealing strategy to control the scale parameter which has better quality and robustness have been achieved.
Bound on annealing performance from stochastic thermodynamics, with application to simulated annealing

Yutong Luo,Yi-Zheng Zhen,Xiangjing Liu,Daniel Ebler,Oscar Dahlsten

DOI: https://doi.org/10.1103/PhysRevE.108.054119

2023-11-17

Abstract:Annealing is the process of gradually lowering the temperature of a system to guide it towards its lowest energy states. In an accompanying paper [Luo et al. Phys. Rev. E 108, L052105 (2023)], we derived a general bound on annealing performance by connecting annealing with stochastic thermodynamics tools, including a speed-limit on state transformation from entropy production. We here describe the derivation of the general bound in detail. In addition, we analyze the case of simulated annealing with Glauber dynamics in depth. We show how to bound the two case-specific quantities appearing in the bound, namely the activity, a measure of the number of microstate jumps, and the change in relative entropy between the state and the instantaneous thermal state, which is due to temperature variation. We exemplify the arguments by numerical simulations on the SK model of spin-glasses.

Statistical Mechanics,Quantum Physics
Improved Metropolis-Hastings algorithms via landscape modifcation with applications to simulated annealing and the Curie-Weiss model

Michael C.H. Choi

DOI: https://doi.org/10.1017/apr.2023.35

2023-07-19

Abstract:In this paper, we propose new Metropolis-Hastings and simulated annealing algorithms on finite state space via modifying the energy landscape. The core idea of landscape modification rests on introducing a parameter $c$, in which the landscape is modified once the algorithm is above this threshold parameter to encourage exploration, while the original landscape is utilized when the algorithm is below the threshold for exploitation purpose. We illustrate the power and benefits of landscape modification by investigating its effect on the classical Curie-Weiss model with Glauber dynamics and external magnetic field in the subcritical regime. This leads to a landscape-modified mean-field equation, and with appropriate choice of $c$ the free energy landscape can be transformed from a double-well into a single-well, while the location of the global minimum is preserved on the modified landscape. Consequently, running algorithms on the modified landscape can improve the convergence to the ground-state in the Curie-Weiss model. In the setting of simulated annealing, we demonstrate that landscape modification can yield improved or even subexponential mean tunneling time between global minima in the low-temperature regime by appropriate choice of $c$, and give convergence guarantee using an improved logarithmic cooling schedule with reduced critical height. We also discuss connections between landscape modification and other acceleration techniques such as Catoni's energy transformation algorithm, preconditioning, importance sampling and quantum annealing. The technique developed in this paper is not only limited to simulated annealing and is broadly applicable to any difference-based discrete optimization algorithm by a change of landscape.

Mathematical Physics,Optimization and Control,Probability,Computation
Random optimization problems at fixed temperatures

Partha S. Dey,Grigory Terlov

2024-02-13

Abstract:This article considers a class of disordered mean-field combinatorial optimization problems. We focus on the Gibbs measure, where the inverse temperature does not vary with the size of the graph and the edge weights are sampled from a general distribution under mild assumptions. Our results consist of the Law of Large Numbers and Central Limit Theorems for the log-partition function, the weight of a typical configuration, and the Gibbs average in both quenched and annealed forms. We also derive quenched Poisson convergence for the size of the intersection of two independent samples, yielding replica symmetry of the model. Applications cover popular models from the literature, such as the Minimal Matching Problem, Traveling Salesman Problem, and Minimal Spanning Tree Problem, on a sequence of deterministic and random dense block graphs of increasing size.

Probability,Combinatorics
Convergence condition of simulated quantum annealing for closed and open systems

Yusuke Kimura,Hidetoshi Nishimori

DOI: https://doi.org/10.1103/PhysRevA.106.062614

2022-12-20

Abstract:Simulated quantum annealing is a generic classical protocol to simulate some aspects of quantum annealing and is sometimes regarded as a classical alternative to quantum annealing in finding the ground state of a classical Ising model. We derive a generic condition for simulated quantum annealing to converge to thermal equilibrium at a given, typically low, temperature. Both closed and open systems are treated. We rewrite the classical master equation for simulated quantum annealing into an imaginary-time Schrödinger equation, to which we apply the imaginary-time variant of asymptotic adiabatic condition to deduce the convergence condition. The result agrees qualitatively with a rigorous convergence condition of simulated quantum annealing for closed systems, which was derived from the theory of inhomogeneous Markov process. Also observed is qualitative agreement with a rigorous convergence condition of quantum annealing for closed systems under the real-time Schrödinger dynamics. This coincidence of convergence conditions for classical stochastic processes for simulated quantum annealing and the real-time quantum dynamics for quantum annealing is highly non-trivial and calls for further scrutiny.

Quantum Physics
An Algebraically Converging Stochastic Gradient Descent Algorithm for Global Optimization

Björn Engquist,Kui Ren,Yunan Yang

2023-10-05

Abstract:We propose a new gradient descent algorithm with added stochastic terms for finding the global optimizers of nonconvex optimization problems. A key component in the algorithm is the adaptive tuning of the randomness based on the value of the objective function. In the language of simulated annealing, the temperature is state-dependent. With this, we prove the global convergence of the algorithm with an algebraic rate both in probability and in the parameter space. This is a significant improvement over the classical rate from using a more straightforward control of the noise term. The convergence proof is based on the actual discrete setup of the algorithm, not just its continuous limit as often done in the literature. We also present several numerical examples to demonstrate the efficiency and robustness of the algorithm for reasonably complex objective functions.

Optimization and Control,Machine Learning
A deterministic annealing algorithm for approximating a solution of the min-bisection problem

Chuangyin Dang,Wei Ma,Jiye Liang

DOI: https://doi.org/10.1016/j.neunet.2008.09.008

Abstract:The min-bisection problem is an NP-hard combinatorial optimization problem. In this paper an equivalent linearly constrained continuous optimization problem is formulated and an algorithm is proposed for approximating its solution. The algorithm is derived from the introduction of a logarithmic-cosine barrier function, where the barrier parameter behaves as temperature in an annealing procedure and decreases from a sufficiently large positive number to zero. The algorithm searches for a better solution in a feasible descent direction, which has a desired property that lower and upper bounds are always satisfied automatically if the step length is a number between zero and one. We prove that the algorithm converges to at least a local minimum point of the problem if a local minimum point of the barrier problem is generated for a sequence of descending values of the barrier parameter with a limit of zero. Numerical results show that the algorithm is much more efficient than two of the best existing heuristic methods for the min-bisection problem, Kernighan-Lin method with multiple starting points (MSKL) and multilevel graph partitioning scheme (MLGP).
Convergence of adaptive stochastic collocation with finite elements

Michael Feischl,Andrea Scaglioni

DOI: https://doi.org/10.1016/j.camwa.2021.07.001

2021-09-01

Abstract:We consider an elliptic partial differential equation with a random diffusion parameter discretized by a stochastic collocation method in the parameter domain and a finite element method in the spatial domain. We prove for the first time convergence of a stochastic collocation algorithm which adaptively enriches the parameter space as well as refines the finite element meshes.

mathematics, applied
Annealed central limit theorem for a class of contractive random dynamical systems

Cesar Maldonado,Hugo Nieto Loredo

DOI: https://doi.org/10.1080/10236198.2024.2405645

2024-09-25

The Journal of Difference Equations and Applications

Abstract:In this paper, we use the Nagaev-Guivarc'h method to prove an annealed Central Limit Theorem for a class of contractive random dynamical systems. For this purpose, we build on the quasicompactness of the operator associated to these contracting fibre systems, and show that it also holds on a normed vector space of complex measures in which the operator has suitable spectral gap properties. We also obtain a Berry-Esseen inequality which gives us an optimal bound for the speed of convergence for the Central Limit Theorem. A simple, contractive random dynamical system on the unit interval and an Iterated Function System are used as examples to illustrate the application of our result.

mathematics, applied

Disconvergence of Cauchy Annealing

General limit to thermodynamic annealing performance

Annealing of Iterative Stochastic Schemes

An Improved Annealing Method and Its Large-Time Behavior

Quantum and classical annealing in a continuous space with multiple local minima

Global Annealing Genetic Algorithm and Its Convergence Analysis

Chaotic Annealing with Hypothesis Test for Function Optimization in Noisy Environments

Convergence analysis of the Gauss–Newton method for convex inclusion and convex-composite optimization problems

On Convergence of the Gauss-Newton Method for Convex Composite Optimization

Convergence of Langevin-simulated annealing algorithms with multiplicative noise

Simulated annealing with a potential function with discontinuous gradient on ℝd

Global warming: Temperature estimation in annealers

Simulated Annealing with the State Generator Based on Cauchy and Gaussian Distributions

Bound on annealing performance from stochastic thermodynamics, with application to simulated annealing

Improved Metropolis-Hastings algorithms via landscape modifcation with applications to simulated annealing and the Curie-Weiss model

Random optimization problems at fixed temperatures

Convergence condition of simulated quantum annealing for closed and open systems

An Algebraically Converging Stochastic Gradient Descent Algorithm for Global Optimization

A deterministic annealing algorithm for approximating a solution of the min-bisection problem

Convergence of adaptive stochastic collocation with finite elements

Annealed central limit theorem for a class of contractive random dynamical systems