Abstract:``Extended Ensemble Monte Carlo''is a generic term that indicates a set of algorithms which are now popular in a variety of fields in physics and statistical information processing. Exchange Monte Carlo (Metropolis-Coupled Chain, Parallel Tempering), Simulated Tempering (Expanded Ensemble Monte Carlo), and Multicanonical Monte Carlo (Adaptive Umbrella Sampling) are typical members of this family. Here we give a cross-disciplinary survey of these algorithms with special emphasis on the great flexibility of the underlying idea. In Sec.2, we discuss the background of Extended Ensemble Monte Carlo. In Sec.3, 4 and 5, three types of the algorithms, i.e., Exchange Monte Carlo, Simulated Tempering, Multicanonical Monte Carlo are introduced. In Sec.6, we give an introduction to Replica Monte Carlo algorithm by Swendsen and Wang. Strategies for the construction of special-purpose extended ensembles are discussed in Sec.7. We stress that an extension is not necessary restricted to the space of energy or temperature. Even unphysical (unrealizable) configurations can be included in the ensemble, if the resultant fast mixing of the Markov chain offsets the increasing cost of the sampling procedure. Multivariate (multi-component) extensions are also useful in many examples. In Sec.8, we give a survey on extended ensembles with a state space whose dimensionality is dynamically varying. In the appendix, we discuss advantages and disadvantages of three types of extended ensemble algorithms.

Exploration of Order in Chaos with Replica Exchange Monte Carlo

Replica exchange light transport on relaxed distributions.

Finding the effective dynamics to make rare events typical in chaotic maps

Extended Ensemble Monte Carlo

Chaotic Monte Carlo Computation: A Dynamical Effect of Random-Number Generations

Exploring Transition from Stability to Chaos through Random Matrices

Order Patterns of Spatiotemporal Chaos

Deterministic replica-exchange method without pseudo random numbers for simulations of complex systems

Symmetry Decomposition of Chaotic Dynamics

Study Of Evolution Of Global Structure Into Chaotic Itinerancy By Point Mapping Under Cell Reference Method

Mapping Chaos: Bifurcation Patterns and Shrimp Structures in the Ikeda Map

Multicanonical MCMC for Sampling Rare Events

Asymmetry and Symmetry in New Three-Dimensional Chaotic Map with Commensurate and Incommensurate Fractional Orders

Non-equilibrium quantum Monte Carlo algorithm for stabilizer Renyi entropy in spin systems

Constrained Exploration via Reflected Replica Exchange Stochastic Gradient Langevin Dynamics

Spontaneous versus explicit replica symmetry breaking in the theory of disordered systems

Reliability and robustness of oscillations in some slow-fast chaotic systems

Replica-exchange Wang-Landau sampling: Pushing the limits of Monte Carlo simulations in materials sciences

A novel delayed exponent coupled chaotic map with countering dynamical degradation

Exchange Monte Carlo Method and Application to Spin Glass Simulations

Superposition Enhanced Nested Sampling