Fractal entropies from the Second Inverse Maximum Entropy Principle

Marcelo R. Ubriaco

2023-03-25

Abstract:With use of the Second Inverse Maximum Entropy Principle we find entropy functions for systems with fractal distribution functions with order parameter $q$. We compare these entropy functions with those given by the Bose-Einstein and Fermi-Dirac cases.

Statistical Mechanics

What problem does this paper attempt to address?

Entropy and the uncertainty principle

Rupert L. Frank,Elliott H. Lieb

DOI: https://doi.org/10.1007/s00023-012-0175-y

2011-09-06

Abstract:We generalize, improve and unify theorems of Rumin, and Maassen--Uffink about classical entropies associated to quantum density matrices. These theorems refer to the classical entropies of the diagonals of a density matrix in two different bases. Thus they provide a kind of uncertainty principle. Our inequalities are sharp because they are exact in the high-temperature or semi-classical limit.

Mathematical Physics,Functional Analysis
Infinite Statistics and Holographic Principle

Yi-Xin Chen,Yong Xiao

2008-01-01

Abstract:It is known that the entropy bound for non-gravitational collapsing bosonic and fermionic fields is $A^{3/4}/l_{p}^{3/2}$, where $A$ is the boundary area of the corresponding system, $l_{p}=1.616\times10^{-35}m$ is the Planck length. In this paper, we shall show that the entropy bound for quantum Boltzmannian fields obeying infinite statistics is rightly the holographic entropy $A/l_{p}^{2}$, and in general cases it comes back to the Bekenstein bound $El/(\hbar c) $, where $E$ and $l$ are respectively the energy and size of the system. Our results shed light on the understanding of the gap between the $A^{3/4}/l_{p}^{3/2}$ entropy bound for local quantum field theory and the holographic entropy $A/l_{p}^{2}$, the corresponding degrees of freedom of which are very obscure before. This suggests a close relationship between infinite statistics and quantum gravity.
Testing the Quantum of Entropy

Uwe Hohm,Christoph Schiller

DOI: https://doi.org/10.3390/e25111511

2023-07-19

Abstract:Experimental and theoretical results about entropy limits for macroscopic and single-particle systems are reviewed. It is clarified when it is possible to speak about a quantum of entropy, given by the Boltzmann constant k, and about a lower entropy limit $S \geq k \ln 2$. Conceptual tensions with the third law of thermodynamics and the additivity of entropy are resolved. Black hole entropy is also surveyed. Further claims for vanishing entropy values are shown to contradict the requirement of observability, which, as possibly argued for the first time, also implies $S \geq k \ln 2$. The uncertainty relations involving the Boltzmann constant and the possibility of deriving thermodynamics from the existence of a quantum of entropy enable one to speak about a principle of the entropy limit that is valid across nature.

Quantum Physics,Chemical Physics
The Exact Entropy Formula of the Ideal Gas and its Information-Theoretic Interpretation

Arnaldo Spalvieri

2023-05-17

Abstract:The paper analyzes the entropy of a system composed by non-interacting and indistinguishable particles whose quantum state numbers are modelled as independent and identically distributed classical random variables. The crucial observation is that, under this assumption, whichever is the number of particles that constitute the system, the occupancy numbers of system's quantum (micro)states are multinomially distributed. This observation leads to an entropy formula for the physical system, which is nothing else than the entropy formula of the multinomial distribution, for which we claim novelty, in the sense that it is proposed here for the first time that the entropy of the multinomial distribution is the entropy of the physical system. The entropy formula of the multinomial distribution unveils yet unexplored connections between information theory and statistical mechanics, among which we mention the connection between conditional entropy of the random microstate given the random occupancy numbers and the Boltzmann-Planck entropy $\log(W)$ and between these two and the Gibbs correction term $\log(N!)$, thermalization and communication-theoretic preparation of a thermal state, accessible information of the thermal state and physical entropy of the thermalized system. A noticeable specific result that descends from our approach is the exact quantum correction to the textbook Sackur-Tetrode formula for the entropy of an ideal gas at the thermal equilibrium in a container.

Statistical Mechanics
Maximum entropy principle for Renyi's and Tsallis' entropies

A. G. Bashkirov,A.G.Bashkirov

DOI: https://doi.org/10.48550/arXiv.cond-mat/0310211

2003-10-09

Statistical Mechanics

Abstract:The equilibrium distributions of probabilities providing maximality of Renyi and Tsallis entropies are rederived. New S-forms of them are found which are normalised with corresponding entropies in contrast to the usual Z-forms normalised with partition functions.
Maximum Geometric Quantum Entropy

Fabio Anza,James P. Crutchfield

2024-03-13

Abstract:Any given density matrix can be represented as an infinite number of ensembles of pure states. This leads to the natural question of how to uniquely select one out of the many, apparently equally suitable, possibilities. Following Jaynes' information-theoretic perspective, this can be framed as an inference problem. We propose the Maximum Geometric Quantum Entropy Principle to exploit the notions of Quantum Information Dimension and Geometric Quantum Entropy. These allow us to quantify the entropy of fully arbitrary ensembles and select the one that maximizes it. After formulating the principle mathematically, we give the analytical solution to the maximization problem in a number of cases and discuss the physical mechanism behind the emergence of such maximum entropy ensembles.

Quantum Physics,Statistical Mechanics,Dynamical Systems
On the foundations of the maximum entropy principle using Fenchel duality for Shannon and Tsallis entropies

Pierre Maréchal,Yasmín Navarrete,Sergio Davis

DOI: https://doi.org/10.1088/1402-4896/ad55b8

2024-06-08

Physica Scripta

Abstract:In this work, we address two main objectives. The first one is to provide a rigorous foundation to the maximum entropy principle in statistical physics, by making use of the Fenchel-Rockafellar duality. The second objective is to discuss the well-foundedness of the so-called escort distributions in the context of non-extensive entropy maximization. The duality treatment of maximum entropy confirms the non-rigorous results obtained via the usual variational calculus, however, the use of escort distributions yields undefined behavior when used consistently, and only leads to the desired results when used in an ad-hoc manner.

physics, multidisciplinary
Entropy, geometry, and the quantum potential

Robert Carroll

DOI: https://doi.org/10.48550/arXiv.physics/0511176

2005-11-21

Abstract:We sketch and emphasize the automatic emergence of a quantum potential Q in e.g. classical WDW type equations upon inserting a (Bohmian) complex wave function. The interpretation of Q in terms of momentum fluctuations via Fisher information and entropy ideas is discussed along with the essentially forced role of the amplitude squared as a probability density. We also review the constructions of Padmanabhan connecting entropy and the Einstein equations.

Classical Physics,General Physics
Emergence of a second law of thermodynamics in isolated quantum systems

Florian Meier,Tom Rivlin,Tiago Debarba,Jake Xuereb,Marcus Huber,Maximilian P. E. Lock

2024-08-02

Abstract:The second law of thermodynamics states that the entropy of an isolated system can only increase over time. This appears to conflict with the reversible evolution of isolated quantum systems under the Schrödinger equation, which preserves the von Neumann entropy. Nonetheless, one finds that with respect to many observables, expectation values approach a fixed value -- their equilibrium value. This ultimately raises the question: in what sense does the entropy of an isolated quantum system increase over time? For classical systems, one introduces the assumption of a low entropy initial state along with the concept of ignorance about the microscopic details of the physical system, leading to a statistical interpretation of the second law. By considering the observables through which we examine quantum systems, both these assumptions can be incorporated, building upon recent studies of the equilibration on average of observables. While the statistical behavior of observable expectation values is well-established, a quantitative connection to entropy increase has been lacking so far. In deriving novel bounds for the equilibration of observables, and considering the entropy of the system relative to observables, we recover a variant of the second law: the entropy with respect to a given observable tends towards its equilibrium value in the course of the system's unitary evolution. These results also support recent findings which question the necessity of non-integrability for equilibration in quantum systems. We further illustrate our bounds using numerical results from the paradigmatic example of a quantum Ising model on a chain of spins. There, we observe entropy increasing up to equilibrium values, as well as fluctuations which expose the underlying reversible evolution in accordance with the derived bounds.

Quantum Physics,Statistical Mechanics
Signed Rényi Entropy and Quantum Second Laws

Adam Brandenburger,Pierfrancesco La Mura

2024-10-21

Abstract:We modify the Rényi (1961) axioms for entropy to apply to negative (``signed") measures as arise, for example, in phase-space representations of quantum mechanics. We obtain two new measures of (lack of) information about a system -- which we propose as signed analogs to classical Shannon entropy and classical Rényi entropy, respectively. We show that signed Rényi entropy witnesses non-classicality of a system. Specifically, a measure has at least one negative component if and only if signed Rényi $\alpha$-entropy is negative for some $\alpha > 1$. The corresponding non-classicality test does not work with signed Shannon entropy. We next show that signed Rényi $2k$-entropy, when $k$ is a positive integer, is Schur-concave. (An example shows that signed Shannon entropy is not Schur-concave.) We then establish an abstract quantum H-theorem for signed measures. We prove that signed Rényi $2k$-entropy is non-decreasing under classical (``decohering") evolution of a signed measure, where the latter could be a Wigner function or other phase-space representation of a quantum system. (An example shows that signed Shannon entropy may be non-monotonic.) We also provide a characterization of the Second Law for signed Rényi $2$-entropy in terms of what we call eventual classicalization of evolution of a system. We conclude with an argument that signed Rényi $2$-entropy of the Wigner function is constant under Moyal bracket evolution.

Quantum Physics,Mathematical Physics
Numerical analysis of second law of thermodynamics and irreversibility in exemplary quantum systems

G.B. Lesovik,I.A. Sadovskyy

DOI: https://doi.org/10.48550/arXiv.1212.2576

2015-02-12

Abstract:We test Boltzmann's H-theorem for several models of particle random walk. We study the influence of interaction between the particle and reservoir/detectors on entropy and find entropy increasing in time for some models and behaving non-monotonically for others. The key mechanism affecting the entropy growth is the quantum entanglement between the system and the reservoir. We discuss the details of the system-reservoir interaction, such as presence of the interference in the system and number of interactions with detector parts, and their impact on the monotonicity of entropy.

Quantum Physics,Mesoscale and Nanoscale Physics,Statistical Mechanics
On Entropy Growth in Perturbative Scattering

Clifford Cheung,Temple He,Allic Sivaramakrishnan

DOI: https://doi.org/10.1103/PhysRevD.108.045013

2023-08-19

Abstract:Inspired by the second law of thermodynamics, we study the change in subsystem entropy generated by dynamical unitary evolution of a product state in a bipartite system. Working at leading order in perturbative interactions, we prove that the quantum $n$-Tsallis entropy of a subsystem never decreases, $\Delta S_n \geq 0$, provided that subsystem is initialized as a statistical mixture of states of equal probability. This is true for any choice of interactions and any initialization of the complementary subsystem. When this condition on the initial state is violated, it is always possible to explicitly construct a "Maxwell's demon" process that decreases the subsystem entropy, $\Delta S_n < 0$. Remarkably, for the case of particle scattering, the circuit diagrams corresponding to $n$-Tsallis entropy are the same as the on-shell diagrams that have appeared in the modern scattering amplitudes program, and $\Delta S_n \geq 0$ is intimately related to the nonnegativity of cross-sections.

High Energy Physics - Theory,High Energy Physics - Phenomenology,Quantum Physics
Quantifying quantum chaos through microcanonical distributions of entanglement

Joaquin F. Rodriguez-Nieva,Cheryne Jonay,Vedika Khemani

2023-05-20

Abstract:A characteristic feature of "quantum chaotic" systems is that their eigenspectra and eigenstates display universal statistical properties described by random matrix theory (RMT). However, eigenstates of local systems also encode structure beyond RMT. To capture this, we introduce a quantitative metric for quantum chaos which utilizes the Kullback-Leibler divergence to compare the microcanonical distribution of entanglement entropy (EE) of midspectrum eigenstates with a reference RMT distribution generated by pure random states (with appropriate constraints). The metric compares not just the averages of the distributions, but also higher moments. The differences in moments are compared on a highly-resolved scale set by the standard deviation of the RMT distribution, which is exponentially small in system size. This distinguishes between chaotic and integrable behavior, and also quantifies the degree of chaos in systems assumed to be chaotic. We study this metric in local minimally structured Floquet random circuits, as well as a canonical family of many-body Hamiltonians, the mixed field Ising model (MFIM). For Hamiltonian systems, the reference random distribution must be constrained to incorporate the effect of energy conservation. The metric captures deviations from RMT across all models and parameters, including those that have been previously identified as strongly chaotic, and for which other diagnostics of chaos such as level spacing statistics look strongly thermal. In Floquet circuits, the dominant source of deviations is the second moment of the distribution, and this persists for all system sizes. For the MFIM, we find significant variation of the KL divergence in parameter space. Notably, we find a small region where deviations from RMT are minimized, suggesting that "maximally chaotic" Hamiltonians may exist in fine-tuned pockets of parameter space.

Statistical Mechanics,High Energy Physics - Theory,Quantum Physics
Entropy computing via integration over fractal measures

Wojciech Slomczynski,Jaroslaw Kwapien,Karol Zyczkowski

DOI: https://doi.org/10.1063/1.166492

1999-09-02

Abstract:We discuss the properties of invariant measures corresponding to iterated function systems (IFSs) with place-dependent probabilities and compute their Renyi entropies, generalized dimensions, and multifractal spectra. It is shown that with certain dynamical systems one can associate the corresponding IFSs in such a way that their generalized entropies are equal. This provides a new method of computing entropy for some classical and quantum dynamical systems. Numerical techniques are based on integration over the fractal measures.

Chaotic Dynamics
Entropic Fluctuations in Statistical Mechanics II. Quantum Dynamical Systems

T. Benoist,L. Bruneau,V. Jakšić,A. Panati,C.-A. Pillet

2024-09-24

Abstract:The celebrated Evans-Searles, respectively Gallavotti-Cohen, fluctuation theorem concerns certain universal statistical features of the entropy production rate of a classical system in a transient, respectively steady, state. In this paper, we consider and compare several possible extensions of these fluctuation theorems to quantum systems. In addition to the direct two-time measurement approach whose discussion is based on (LMP 114:32 (2024)), we discuss a variant where measurements are performed indirectly on an auxiliary system called ancilla, and which allows to retrieve non-trivial statistical information using ancilla state tomography. We also show that modular theory provides a way to extend the classical notion of phase space contraction rate to the quantum domain, which leads to a third extension of the fluctuation theorems. We further discuss the quantum version of the principle of regular entropic fluctuations, introduced in the classical context in (Nonlinearity 24, 699 (2011)). Finally, we relate the statistical properties of these various notions of entropy production to spectral resonances of quantum transfer operators. The obtained results shed a new light on the nature of entropic fluctuations in quantum statistical mechanics.

Mathematical Physics,Quantum Physics
Entanglement Theory and the Second Law of Thermodynamics

Fernando G.S.L. Brandao,Martin B. Plenio

DOI: https://doi.org/10.1038/nphys1100

2008-10-14

Abstract:Entanglement is central both to the foundations of quantum theory and, as a novel resource, to quantum information science. The theory of entanglement establishes basic laws, such as the non-increase of entanglement under local operations, that govern its manipulation and aims to draw from them formal analogies to the second law of thermodynamics. However, while in the second law the entropy uniquely determines whether a state is adiabatically accessible from another, the manipulation of entanglement under local operations exhibits a fundamental irreversibility which prevents the existence of such an order. Here we show that a reversible theory of entanglement and a rigorous relationship with thermodynamics may be established when one considers all non-entangling transformations. The role of the entropy in the second law is taken by the asymptotic relative entropy of entanglement in the basic law of entanglement. We show the usefulness of this new approach to general resource theories and to quantum information theory.

Quantum Physics
From Classical to Quantum: Uniform Continuity Bounds on Entropies in Infinite Dimensions

Simon Becker,Nilanjana Datta,Michael G. Jabbour

2023-07-18

Abstract:We prove a variety of new and refined uniform continuity bounds for entropies of both classical random variables on an infinite state space and of quantum states of infinite-dimensional systems. We obtain the first tight continuity estimate on the Shannon entropy of random variables with a countably infinite alphabet. The proof relies on a new mean-constrained Fano-type inequality and the notion of maximal coupling of random variables. We then employ this classical result to derive the first tight energy-constrained continuity bound for the von Neumann entropy of states of infinite-dimensional quantum systems, when the Hamiltonian is the number operator, which is arguably the most relevant Hamiltonian in the study of infinite-dimensional quantum systems in the context of quantum information theory. The above scheme works only for Shannon- and von Neumann entropies. Hence, to deal with more general entropies, e.g. $\alpha$-Rényi and $\alpha$-Tsallis entropies, with $\alpha \in (0,1)$, for which continuity bounds are known only for finite-dimensional systems, we develop a novel approximation scheme which relies on recent results on operator Hölder continuous functions and the equivalence of all Schatten norms in special spectral subspaces of the Hamiltonian. This approach is, as we show, motivated by continuity bounds for $\alpha$-Rényi and $\alpha$-Tsallis entropies of random variables that follow from the Hölder continuity of the entropy functionals. Bounds for $\alpha>1$ are provided, too. Finally, we settle an open problem on related approximation questions posed in the recent works by Shirokov on the so-called Finite-dimensional Approximation (FA) property.

Quantum Physics,Information Theory,Mathematical Physics
On entropy production of repeated quantum measurements II. Examples

Tristan Benoist,Noé Cuneo,Vojkan Jakšić,Claude-Alain Pillet

DOI: https://doi.org/10.1007/s10955-021-02725-1

2021-02-08

Abstract:We illustrate the mathematical theory of entropy production in repeated quantum measurement processes developed in a previous work by studying examples of quantum instruments displaying various interesting phenomena and singularities. We emphasize the role of the thermodynamic formalism, and give many examples of quantum instruments whose resulting probability measures on the space of infinite sequences of outcomes (shift space) do not have the (weak) Gibbs property. We also discuss physically relevant examples where the entropy production rate satisfies a large deviation principle but fails to obey the central limit theorem and the fluctuation-dissipation theorem. Throughout the analysis, we explore the connections with other, a priori unrelated topics like functions of Markov chains, hidden Markov models, matrix products and number theory.

Dynamical Systems,Probability,Quantum Physics
Logical Entropy and Negative Probabilities in Quantum Mechanics

Giovanni Manfredi

DOI: https://doi.org/10.1051/fopen/2022004

2022-03-25

Abstract:The concept of Logical Entropy, $S_L = 1- \sum_{i=1}^n p_i^2$, where the $p_i$ are normalized probabilities, was introduced by David Ellerman in a series of recent papers. Although the mathematical formula itself is not new, Ellerman provided a sound probabilistic interpretation of $S_L$ as a measure of the distinctions of a partition on a given set. The same formula comes across as a useful definition of entropy in quantum mechanics, where it is linked to the notion of purity of a quantum state. The quadratic form of the logical entropy lends itself to a generalization of the probabilities that include negative values, an idea that goes back to Feynman and Wigner. Here, we analyze and reinterpret negative probabilities in the light of the concept of logical entropy. Several intriguing quantum-like properties of the logical entropy are derived and discussed in finite dimensional spaces. For infinite-dimensional spaces (continuum), we show that, under the sole hypothesis that the logical entropy and the total probability are preserved in time, one obtains an evolution equation for the probability density that is basically identical to the quantum evolution of the Wigner function in phase space, at least when one considers only the momentum variable. This result suggest that the logical entropy plays a profound role in establishing the peculiar rules of quantum physics.

Quantum Physics,Mathematical Physics

Fractal entropies from the Second Inverse Maximum Entropy Principle

Entropy and the uncertainty principle

Infinite Statistics and Holographic Principle

Testing the Quantum of Entropy

The Exact Entropy Formula of the Ideal Gas and its Information-Theoretic Interpretation

Maximum entropy principle for Renyi's and Tsallis' entropies

Maximum Geometric Quantum Entropy

On the foundations of the maximum entropy principle using Fenchel duality for Shannon and Tsallis entropies

Entropy, geometry, and the quantum potential

Emergence of a second law of thermodynamics in isolated quantum systems

Signed Rényi Entropy and Quantum Second Laws

Numerical analysis of second law of thermodynamics and irreversibility in exemplary quantum systems

On Entropy Growth in Perturbative Scattering

Quantifying quantum chaos through microcanonical distributions of entanglement

Entropy computing via integration over fractal measures

Entropic Fluctuations in Statistical Mechanics II. Quantum Dynamical Systems

Entanglement Theory and the Second Law of Thermodynamics

From Classical to Quantum: Uniform Continuity Bounds on Entropies in Infinite Dimensions

On entropy production of repeated quantum measurements II. Examples

Logical Entropy and Negative Probabilities in Quantum Mechanics