Rejoinder to "Equi-energy sampler with applications in statistical inference and statistical mechanics"

S. C. Kou,Qing Zhou,Wing H. Wong

DOI: https://doi.org/10.48550/arXiv.math/0611224

2006-11-08

Statistics Theory

Abstract:Rejoinder to ``Equi-energy sampler with applications in statistical inference and statistical mechanics'' by Kou, Zhou and Wong [math.ST/0507080]

What problem does this paper attempt to address?

A note on convergence of the equi-energy sampler

Christophe Andrieu,Ajay Jasra,Arnaud Doucet,Pierre Del Moral

DOI: https://doi.org/10.48550/arXiv.0711.0164

2007-11-02

Abstract:In a recent paper `The equi-energy sampler with applications statistical inference and statistical mechanics' [Ann. Stat. 34 (2006) 1581--1619], Kou, Zhou & Wong have presented a new stochastic simulation method called the equi-energy (EE) sampler. This technique is designed to simulate from a probability measure $\pi$, perhaps only known up to a normalizing constant. The authors demonstrate that the sampler performs well in quite challenging problems but their convergence results (Theorem 2) appear incomplete. This was pointed out, in the discussion of the paper, by Atchadé & Liu (2006) who proposed an alternative convergence proof. However, this alternative proof, whilst theoretically correct, does not correspond to the algorithm that is implemented. In this note we provide a new proof of convergence of the equi-energy sampler based on the Poisson equation and on the theory developed in Andrieu et al. (2007) for \emph{Non-Linear} Markov chain Monte Carlo (MCMC). The objective of this note is to provide a proof of correctness of the EE sampler when there is only one feeding chain; the general case requires a much more technical approach than is suitable for a short note. In addition, we also seek to highlight the difficulties associated with the analysis of this type of algorithm and present the main techniques that may be adopted to prove the convergence of it.

Computation,Statistics Theory
Thermodynamics of Markov Processes with Non-extensive Entropy and Free Energy

Liangrong Peng,Hong Qian,Liu Hong

DOI: https://doi.org/10.1103/PhysRevE.101.022114

2020-03-31

Abstract:Statistical thermodynamics of small systems shows dramatic differences from normal systems. Parallel to the recently presented steady-state thermodynamic formalism for master equation and Fokker-Planck equation, we show that a ``thermodynamic'' theory can also be developed based on Tsallis' generalized entropy $S^{(q)}=\sum_{i=1}^N(p_i-p_i^q)/[q(q-1)]$ and Shiino's generalized free energy $F^{(q)}=[\sum_{i=1}^Np_i(p_i/\pi_i)^{q-1}-1]/[q(q-1)]$, where $\pi_i$ is the stationary distribution. $dF^{(q)}/dt=-f_d^{(q)}\le 0$ and it is zero iff the system is in its stationary state. $dS^{(q)}/dt-Q_{ex}^{(q)} = f_d^{(q)}$ where $Q_{ex}^{(q)}$ characterizes the heat exchange. For systems approaching equilibrium with detailed balance, $f_d^{(q)}$ is the product of Onsager's thermodynamic flux and force. However, it is discovered that the Onsager's force is non-local. This is a consequence of the particular transformation invariance for zero energy of Tsallis' statistics.

Mathematical Physics
Some Applications of Stochastic Averaging Method for Quasi Hamiltonian Systems in Physics

MaoLin Deng,WeiQiu Zhu

DOI: https://doi.org/10.1007/s11433-009-0166-2

2009-01-01

Abstract:Many physical systems can be modeled as quasi-Hamiltonian systems and the stochastic averaging method for quasi-Hamiltonian systems can be applied to yield reasonable approximate response statistics. In the present paper, the basic idea and procedure of the stochastic averaging method for quasi Hamiltonian systems are briefly introduced. The applications of the stochastic averaging method in studying the dynamics of active Brownian particles, the reaction rate theory, the dynamics of breathing and denaturation of DNA, and the Fermi resonance and its effect on the mean transition time are reviewed.
Adaptive Equi-Energy Sampler : Convergence and Illustration

Amandine Schreck,Gersende Fort,Eric Moulines

DOI: https://doi.org/10.48550/arXiv.1207.0662

2012-07-03

Statistics Theory

Abstract:Markov chain Monte Carlo (MCMC) methods allow to sample a distribution known up to a multiplicative constant. Classical MCMC samplers are known to have very poor mixing properties when sampling multimodal distributions. The Equi-Energy sampler is an interacting MCMC sampler proposed by Kou, Zhou and Wong in 2006 to sample difficult multimodal distributions. This algorithm runs several chains at different temperatures in parallel, and allow lower-tempered chains to jump to a state from a higher-tempered chain having an energy 'close' to that of the current state. A major drawback of this algorithm is that it depends on many design parameters and thus, requires a significant effort to tune these parameters. In this paper, we introduce an Adaptive Equi-Energy (AEE) sampler which automates the choice of the selection mecanism when jumping onto a state of the higher-temperature chain. We prove the ergodicity and a strong law of large numbers for AEE, and for the original Equi-Energy sampler as well. Finally, we apply our algorithm to motif sampling in DNA sequences.
Qin Et Al. Reply

Nan Qin,Emmanuelle Le Chatelier,Jing Guo,Edi Prifti,Lanjuan Li,S. Dusko Ehrlich

DOI: https://doi.org/10.1038/nature14852

IF: 64.8

2015-01-01

Nature

Abstract:A Reply to the Comment by J. H. Chen and H. Y. Fan.Received 22 May 2013DOI:https://doi.org/10.1103/PhysRevLett.110.269502© 2013 American Physical Society
Towards accurate thermodynamics from random energy sampling

Thomas Schuler,Maylise Nastar,Kangming Li,Chu-Chun Fu

DOI: https://doi.org/10.1016/j.actamat.2024.120074

IF: 9.4

2024-06-13

Acta Materialia

Abstract:Special Quasi-random Structures (SQSs) are often used to model disordered alloys in small simulation cells. Yet, SQS-based sampling yields chemical potentials (and other thermodynamic properties) that do not match the equilibrium values at some finite temperature, which can for instance be measured in atomic Monte Carlo simulations. This is due to the lack of chemical short-range order in random samples. In this paper, we present a probabilistic analysis of chemical potential calculations based on the distribution of substitution energies and the Widom technique. Performing the analysis by sampling either equilibrium configurations or SQSs, we show that they both yield different results, but that it is possible to correct the results from the random sampling in order to get a result which is much closer to the equilibrium values. The correction is very simple to apply and does not require additional total energy calculations.

materials science, multidisciplinary,metallurgy & metallurgical engineering
Comments on the paper "Foundation of statistical mechanics from symmetries of entanglement" by S. Deffner and W. Zurek

Robert Alicki

DOI: https://doi.org/10.48550/arXiv.1504.06572

2015-04-23

Quantum Physics

Abstract:The authors of the recent paper [1] boldly claim to discover a new fully quantum approach to foundation of statistical mechanics: "Our conceptually novel approach is free of mathematically ambiguous notions such as probability, ensemble, randomness, etc." The aim of this note is to show that this approach is neither specific for quantum systems nor really conceptually different from the standard textbook arguments supporting microcanonical or canonical ensembles in statistical mechanics.
Rejoinder to the Response <a class="link-https" data-arxiv-id="0812.2330" href="https://arxiv.org/abs/0812.2330">arXiv:0812.2330</a> to 'Comment on a recent conjectured solution of the three-dimensional Ising model'

F. Y. Wu,B. M. McCoy,M. E. Fisher,L. Chayes

DOI: https://doi.org/10.1080/14786430802537779

2008-12-16

Abstract:We comment on Z. D. Zhang's Response [<a class="link-https" data-arxiv-id="0812.2330" href="https://arxiv.org/abs/0812.2330">arXiv:0812.2330</a>] to our recent Comment [<a class="link-https" data-arxiv-id="0811.3876" href="https://arxiv.org/abs/0811.3876">arXiv:0811.3876</a>] addressing the conjectured solution of the three-dimensional Ising model reported in [<a class="link-https" data-arxiv-id="0705.1045" href="https://arxiv.org/abs/0705.1045">arXiv:0705.1045</a>].

Statistical Mechanics
Reply to "Comment on `Extending the laws of thermodynamics for arbitrary autonomous quantum systems'"

Cyril Elouard,Camille Lombard Latune

2023-09-15

Abstract:In his Comment [1], Philip Strasberg (PS) argues from the analysis of different examples that the framework we have presented in [2] does not recover known results of macroscopic textbook thermodynamics. Here, we show that such apparent contradictions disappear when the necessary assumptions the aforementioned known results pre-suppose are applied. Those assumptions concern the control ability of the observer, the nature of the described degree of freedom, or the scale of the systems. The ability to relax those assumptions is precisely a motivation of our framework, which can explore the capacity of quantum systems to exchange work and heat even at scales not captured by textbook thermodynamics. We take the opportunity of this reply to further expand on the use of our framework and its connections with traditional thermodynamics.

Quantum Physics
An integral algorithm of exponential observables for interacting fermions in quantum Monte Carlo simulation

Xu Zhang,Gaopei Pan,Bin-Bin Chen,Kai Sun,Zi Yang Meng

DOI: https://doi.org/10.1103/PhysRevB.109.205147

2024-05-27

Abstract:Exponential observables, formulated as $\log \langle e^{\hat{X}}\rangle$ where $\hat{X}$ is an extensive quantity, play a critical role in study of quantum many-body systems, examples of which include the free-energy and entanglement entropy. Given that $e^{X}$ becomes exponentially large (or small) in the thermodynamic limit, accurately computing the expectation value of this exponential quantity presents a significant challenge. In this Letter, we propose a comprehensive algorithm for quantifying these observables in interacting fermion systems, utilizing the determinant quantum Monte Carlo (DQMC) method. We have applied this novel algorithm to the 2D half-filled Hubbard model. At the strong coupling limit, our method showcases a significant accuracy improvement compared to conventional methods that are derived from the internal energy. We also illustrate that this novel approach delivers highly efficient and precise measurements of the nth Rényi entanglement entropy. Even more noteworthy is that this improvement comes without incurring increases in computational complexity. This algorithm effectively suppresses exponential fluctuations and can be easily generalized to other models.

Strongly Correlated Electrons,Statistical Mechanics,Quantum Physics
Resummation-based Quantum Monte Carlo for Entanglement Entropy Computation

Menghan Song,Ting-Tung Wang,Zi Yang Meng

2024-09-02

Abstract:Based on the recently developed resummation-based quantum Monte Carlo method for the SU($N$) spin and loop-gas models, we develop a new algorithm, dubbed ResumEE, to compute the entanglement entropy (EE) with greatly enhanced efficiency. Our ResumEE exponentially speeds up the computation of the exponentially small value of the $\langle e^{-S^{(2)}}\rangle$, where $S^{(2)}$ is the 2nd order Rényi EE, such that the $S^{(2)}$ for a generic 2D quantum SU($N$) spin models can be readily computed with high accuracy. We benchmark our algorithm with the previously proposed estimators of $S^{(2)}$ on 1D and 2D SU($2$) Heisenberg spin systems to reveal its superior performance and then use it to detect the entanglement scaling data of the Néel-to-VBS transition on 2D SU($N$) Heisenberg model with continuously varying $N$. Our ResumEE algorithm is efficient for precisely evaluating the entanglement entropy of SU($N$) spin models with continuous $N$ and reliable access to the conformal field theory data for the highly entangled quantum matter.

Strongly Correlated Electrons,Quantum Gases,Quantum Physics
Reply to 'Comment on Universal out-of-equilibrium transport in Kondo-correlated quantum dots'

Enrique Muñoz,C. J. Bolech,Stefan Kirchner

DOI: https://doi.org/10.48550/arXiv.1308.0638

2013-08-03

Abstract:A recent comment on our work (Phys. Rev. Lett., vol. 110, 016601 (2013)) by <a class="link-external link-http" href="http://A.A.Aligia" rel="external noopener nofollow">this http URL</a> claims that we "made mistakes in the evaluation of the lesser quantities". It is further claimed that the distribution function of the single-particle selfenergy of the interacting region in the Fermi liquid regime, e.g. at small bias voltage, low temperature, and small frequency, is continuous. These claims are based on a comparison of the particle-hole symmetric case with results obtained from the approach of <a class="link-external link-http" href="http://A.A.Aligia" rel="external noopener nofollow">this http URL</a>. We disagree with these claims and show that the discrepancies that the comment alludes to originate from a violation of Ward identities by the method employed in the comment. A comparison of our approach with the numerical renormalization group shows perfect agreement for the symmetric case.

Strongly Correlated Electrons
Reply to the Comment by T. Dauxois, F. Bouchet, S. Ruffo on the paper by A. Rapisarda and A. Pluchino, Europhysics News, 36 (2005) 202

Andrea Rapisarda,Alessandro Pluchino

DOI: https://doi.org/10.48550/arXiv.cond-mat/0605502

2006-05-20

Abstract:In the comment by <a class="link-external link-http" href="http://T.Dauxois" rel="external noopener nofollow">this http URL</a> et al.,(<a class="link-https" data-arxiv-id="cond-mat/0605445" href="https://arxiv.org/abs/cond-mat/0605445">cond-mat/0605445</a>), the authors question our application of the nonextensive statistical mechanics proposed by Tsallis, to explain the anomalous dynamics of the Hamiltonian Mean Field (HMF) model. More specifically they claim that the explanation of the metastability found in the out-of-equilibrium dynamics is only a fitting procedure and is also in contrast with a previous application. This criticism mostly relies on recent studies based on the Vlasov approach, where the authors claim to explain the anomalous behaviour of the HMF model in terms of a standard formalism. In order to reply to this comment we want to stress a few numerical facts and conclude with some final considerations. A recent paper by P-H. Chavanis (<a class="link-https" data-arxiv-id="cond-mat/0604234" href="https://arxiv.org/abs/cond-mat/0604234">cond-mat/0604234</a>) is also important to clarify the question here debated.

Statistical Mechanics
The $s$-Energy and Its Applications

Bernard Chazelle,Kritkorn Karntikoon

2024-10-12

Abstract:Averaging dynamics drives countless processes in physics, biology, engineering, and the social sciences. In recent years, the $s$-energy has emerged as a useful tool for bounding the convergence rates of time-varying averaging systems. We derive new bounds on the $s$-energy, which we use to resolve a number of open questions in the areas of bird flocking, opinion dynamics, and distributed motion coordination. We also use our results to provide a theoretical validation for the idea of the "Overton Window" as an attracting manifold of viable group opinions. Our new bounds on the $s$-energy highlight its dependency on the connectivity of the underlying networks. In this vein, we use the $s$-energy to explain the exponential gap in the convergence rates of stationary and time-varying consensus systems.

Optimization and Control,Multiagent Systems
Efficient quantum Gibbs samplers with Kubo--Martin--Schwinger detailed balance condition

Zhiyan Ding,Bowen Li,Lin Lin

2024-10-29

Abstract:Lindblad dynamics and other open-system dynamics provide a promising path towards efficient Gibbs sampling on quantum computers. In these proposals, the Lindbladian is obtained via an algorithmic construction akin to designing an artificial thermostat in classical Monte Carlo or molecular dynamics methods, rather than treated as an approximation to weakly coupled system-bath unitary dynamics. Recently, Chen, Kastoryano, and Gilyén (<a class="link-https" data-arxiv-id="2311.09207" href="https://arxiv.org/abs/2311.09207">arXiv:2311.09207</a>) introduced the first efficiently implementable Lindbladian satisfying the Kubo--Martin--Schwinger (KMS) detailed balance condition, which ensures that the Gibbs state is a fixed point of the dynamics and is applicable to non-commuting Hamiltonians. This Gibbs sampler uses a continuously parameterized set of jump operators, and the energy resolution required for implementing each jump operator depends only logarithmically on the precision and the mixing time. In this work, we build upon the structural characterization of KMS detailed balanced Lindbladians by Fagnola and Umanità, and develop a family of efficient quantum Gibbs samplers using a finite set of jump operators (the number can be as few as one), \re{akin to the classical Markov chain-based sampling algorithm. Compared to the existing works, our quantum Gibbs samplers have a comparable quantum simulation cost but with greater design flexibility and a much simpler implementation and error analysis.} Moreover, it encompasses the construction of Chen, Kastoryano, and Gilyén as a special instance.

Quantum Physics
Tracking the variation of entanglement Rényi negativity: an efficient quantum Monte Carlo method

Yi-Ming Ding,Yin Tang,Zhe Wang,Zhiyan Wang,Bin-Bin Mao,Zheng Yan

2024-09-16

Abstract:Although the entanglement entropy probing novel phases and phase transitions numerically via quantum Monte Carlo (QMC) has achieved huge success in pure ground states of quantum many-body systems, numerical explorations on mixed states remain limited, despite the fact that most real-world systems are non-isolated. Meanwhile, entanglement negativity, as a rarely computable entanglement monotone for mixed states, is significant in characterizing mixed-state entanglement, such as in systems with two disconnected regions, dissipation or at finite temperature. However, efficient numerical approaches are scarce to calculate this quantity in large-scale and high-dimensional systems, especially when we need to access how it varies with certain parameters to study critical behaviors. Within the reweight-annealing frame, we present an accessible and efficient QMC algorithm, which is able to achieve the values as well as tracking the variation of the Rényi version of entanglement negativity on some specified parameter path. Our algorithm makes it feasible to directly study the role that entanglement plays at the critical point and in different phases for mixed states in high dimensions numerically. In addition, this method is accessible and easy to parallelize on computers. Through this method, different intrinsic mechanisms in quantum and thermal criticalities with the same universal class have been revealed clearly through the numerical calculations on Rényi negativity.

Strongly Correlated Electrons,Statistical Mechanics,Quantum Physics
Numerical results on Quantum Energy Inequalities in Integrable Models at the Two-Particle level

Jan Mandrysch

2023-12-14

Abstract:In this article, we introduce a novel numerical method for determining optimal Quantum Energy Inequality (QEI) bounds in one- and two-particle states, extending previous work focused on the one-particle case. Our method, applicable to integrable models constructed via the inverse scattering approach, overcomes challenges associated with the numerical treatment of kinematical singularities and the increased complexity in the two-particle scenario. Applying the method to the sinh-Gordon model provides explicit insights into optimal QEI bounds. Notably, QEIs persist at the two-particle level, though, allowing for significantly more negative energy to be sustained over longer times compared with the one-particle case. Our findings confirm self-interaction as the source of negative energy, with stronger interactions yielding more pronounced negativities. Importantly, evidence supports the finite sustainability of negative energies over time, implying the validity of the averaged weak energy condition (AWEC) at both one- and two-particle levels. Last but not least, we identify a one-parameter class of nonminimal stress tensor expressions satisfying QEIs at both levels, with more stringent constraints arising from the QEI bounds at two-particle level.

High Energy Physics - Theory,General Relativity and Quantum Cosmology
Efficient Spectral Methods for Quasi-Equilibrium Closure Approximations of Symmetric Problems on Unit Circle and Sphere

Shan Jiang,Haijun Yu

DOI: https://doi.org/10.1007/s10915-021-01646-1

2021-04-29

Abstract:Quasi-equilibrium approximation is a widely used closure approximation approach for model reduction with applications in complex fluids, materials science, etc. It is based on the maximum entropy principle and leads to thermodynamically consistent coarse-grain models. However, its high computational cost is a known barrier for fast and accurate applications. Despite its good mathematical properties, there are very few works on the fast and efficient implementations of quasi-equilibrium approximations. In this paper, we give efficient implementations of quasi-equilibrium approximations for antipodally symmetric problems on unit circle and unit sphere using polynomial and piecewise polynomial approximations. Comparing to the existing methods using linear or cubic interpolations, our approach achieves high accuracy (double precision) with much less storage cost. The methods proposed in this paper can be directly extended to handle other moment closure approximation problems.

Numerical Analysis
Sampling and statistical physics via symmetry

Steve Huntsman

DOI: https://doi.org/10.1007/978-3-030-77957-3_20

2021-04-02

Abstract:We formulate both Markov chain Monte Carlo (MCMC) sampling algorithms and basic statistical physics in terms of elementary symmetries. This perspective on sampling yields derivations of well-known MCMC algorithms and a new parallel algorithm that appears to converge more quickly than current state of the art methods. The symmetry perspective also yields a parsimonious framework for statistical physics and a practical approach to constructing meaningful notions of effective temperature and energy directly from time series data. We apply these latter ideas to Anosov systems.

Statistical Mechanics,Mathematical Physics,Dynamical Systems,Statistics Theory
Statistical Quasi-Particle Theory for Open Quantum Systems

Hou-Dao Zhang,Rui-Xue Xu,Xiao Zheng,YiJing Yan

DOI: https://doi.org/10.1080/00268976.2018.1431407

2018-01-01

Molecular Physics

Abstract:This paper presents a comprehensive account on the recently developed dissipaton-equation-of-motion (DEOM) theory. This is a statistical quasi-particle theory for quantum dissipative dynamics. It accurately describes the influence of bulk environments, with a few number of quasi-particles, the dissipatons. The novel dissipaton algebra is then followed, which readily bridges the Schrodinger equation to the DEOM theory. As a fundamental theory of quantum mechanics in open systems, DEOM characterizes both the stationary and dynamic properties of system-and-bath interferences. It treats not only the quantum dissipative systems of primary interest, but also the hybrid environment dynamics that could be experimentally measurable. Examples are the linear or nonlinear Fano interferences and the Herzberg-Teller vibronic couplings in optical spectroscopies. This review covers the DEOM construction, the underlying dissipaton algebra and theorems, the physical meanings of dynamical variables, the possible identifications of dissipatons, and some recent advancements in efficient DEOM evaluations on various problems. The relations of the present theory to other nonperturbative methods are also critically presented.

Rejoinder to "Equi-energy sampler with applications in statistical inference and statistical mechanics"

A note on convergence of the equi-energy sampler

Thermodynamics of Markov Processes with Non-extensive Entropy and Free Energy

Some Applications of Stochastic Averaging Method for Quasi Hamiltonian Systems in Physics

Adaptive Equi-Energy Sampler : Convergence and Illustration

Qin Et Al. Reply

Towards accurate thermodynamics from random energy sampling

Comments on the paper "Foundation of statistical mechanics from symmetries of entanglement" by S. Deffner and W. Zurek

Rejoinder to the Response <a class="link-https" data-arxiv-id="0812.2330" href="https://arxiv.org/abs/0812.2330">arXiv:0812.2330</a> to 'Comment on a recent conjectured solution of the three-dimensional Ising model'

Reply to "Comment on `Extending the laws of thermodynamics for arbitrary autonomous quantum systems'"

An integral algorithm of exponential observables for interacting fermions in quantum Monte Carlo simulation

Resummation-based Quantum Monte Carlo for Entanglement Entropy Computation

Reply to 'Comment on Universal out-of-equilibrium transport in Kondo-correlated quantum dots'

Reply to the Comment by T. Dauxois, F. Bouchet, S. Ruffo on the paper by A. Rapisarda and A. Pluchino, Europhysics News, 36 (2005) 202

The $s$-Energy and Its Applications

Efficient quantum Gibbs samplers with Kubo--Martin--Schwinger detailed balance condition

Tracking the variation of entanglement Rényi negativity: an efficient quantum Monte Carlo method

Numerical results on Quantum Energy Inequalities in Integrable Models at the Two-Particle level

Efficient Spectral Methods for Quasi-Equilibrium Closure Approximations of Symmetric Problems on Unit Circle and Sphere

Sampling and statistical physics via symmetry

Statistical Quasi-Particle Theory for Open Quantum Systems