Microscopic Legendre Transform, Canonical Ensemble and Jaynes' Maximum Entropy Principle

Ramandeep S. Johal
2024-01-29
Abstract:Legendre transform between thermodynamic quantities such as the Helmholtz free energy and entropy plays a key role in the formulation of the canonical ensemble. The transform helps to exchange the independent variable from the system's internal energy to its conjugate variable -- the inverse temperature of the reservoir. In this article, we study the Legendre transform between the free energy and Shannon entropy, denoted as the microscopic Legendre transform ($\mathscr{L}_{\!\mathscr{M}}^{}$), where the conjugate variables are the microstate probabilities and the energies (scaled by the inverse temperature). We formulate the exact differential property of the Shannon entropy and utilize it to derive central relations within canonical ensemble. Thermodynamics of a system in contact with a heat reservoir is discussed from this perspective. Other approaches, in particular, Jaynes' maximum entropy principle is compared with the present approach.
Statistical Mechanics,Quantum Physics
What problem does this paper attempt to address?
The paper primarily explores the application of the microscopic Legendre transformation (LM) in statistical mechanics and attempts to establish a direct connection between thermodynamic entropy and Shannon entropy. Specifically: 1. **Research Background**: The paper first introduces the importance of the Legendre transformation in physics, particularly in thermodynamics, where it is used to define the relationships between different thermodynamic quantities. Through the Legendre transformation, one can convert from one thermodynamic quantity (such as free energy) to another (such as entropy), thereby describing the system under different experimental conditions. 2. **Main Contributions**: The authors propose a new method of microscopic Legendre transformation that directly links free energy with Shannon entropy. This method not only provides an alternative derivation for the canonical ensemble but also further emphasizes the exact differential nature of entropy. Additionally, this method establishes a connection with Jaynes' principle of maximum entropy. 3. **Theoretical Framework**: The paper discusses in detail how to define the microscopic Legendre transformation through an optimization process and demonstrates how this transformation can derive the thermodynamic properties of the system from probability distributions. By introducing Lagrange multipliers to handle the constraints of the probability distribution, the exact differential of entropy can be defined. 4. **Comparison with Existing Methods**: Finally, the paper compares the proposed microscopic Legendre transformation method with other methods such as Jaynes' principle of maximum entropy. Although these methods differ in form, they can all derive the same canonical distribution under specific conditions. In summary, this paper provides a new perspective for understanding and deriving the properties of thermodynamic systems by introducing a new method of microscopic Legendre transformation and establishes a connection with existing information theory methods.