A short derivation of Boltzmann distribution and Gibbs entropy formula from the fundamental postulate

Didier Lairez

DOI: https://doi.org/10.48550/arXiv.2211.02455

2023-02-02

Abstract:Introducing the Boltzmann distribution very early in a statistical thermodynamics course (in the spirit of Feynmann) has many didactic advantages, in particular that of easily deriving the Gibbs entropy formula. In this note, a short derivation is proposed from the fundamental postulate of statistical mechanics and basics calculations accessible to undergraduate students.

Statistical Mechanics,Chemical Physics

What problem does this paper attempt to address?

This paper aims to solve a key problem in the teaching of statistical thermodynamics, that is, how to derive the Boltzmann distribution and the Gibbs entropy formula in a simple way that is easy for undergraduates to understand, starting from the basic assumptions of statistical mechanics. The author points out that in most textbooks and university courses, the introduction of these two concepts often seems abrupt and lacks an intuitive explanation, which may confuse students. Specifically, the paper attempts to solve the following problems:

1. **Educational challenges**: Traditional teaching methods usually introduce these concepts in one of two extreme ways:
- Directly define the statistical entropy formula (such as the equation \( S = -\sum_i p_i \ln(p_i) \)), and then derive all the contents of classical thermodynamics through the principle of maximum entropy.
- First derive the Boltzmann probability distribution (or canonical distribution), then calculate some statistics, and finally obtain the statistical entropy formula by comparing with the classical thermodynamics equations.

2. **Complexity of the method**: The classical method of deriving the Boltzmann distribution involves the Lagrange multiplier method and Stirling's approximation, which are relatively complex and difficult for undergraduates to understand.

3. **Natural logical transition**: The author hopes to find a method that can naturally derive the Boltzmann distribution and the Gibbs entropy formula from the basic assumptions of statistical mechanics without introducing complex mathematical tools.

To achieve this goal, the paper proposes a short derivation method. The main steps are as follows:

- **Free energy**: First introduce the concept of free energy, defined as \( F = U - TS \), where \( U \) is the internal energy, \( S \) is the entropy, and \( T \) is the temperature.
- **Basic assumptions**: Consider an isolated system whose total energy \( E \) remains constant and the system is divided into multiple sub - parts. According to the basic assumptions of statistical mechanics, all possible microscopic states have the same probability.
- **Boltzmann distribution**: By analyzing the energy fluctuations of the subsystem and the properties of independent random variables, derive the Boltzmann distribution \( p_i \propto e^{-\beta \epsilon_i} \), where \( \beta \) is a constant, and finally determined as \( \beta=\frac{1}{T} \).
- **Gibbs entropy**: Use the Boltzmann distribution to calculate the internal energy \( U \) and free energy \( F \) of the system, and derive the Gibbs entropy formula \( S = -\sum_i p_i \ln(p_i) \) through thermodynamic relations.

Through this method, the author hopes to provide a more intuitive and understandable teaching path, so that students can have a deep understanding of the Boltzmann distribution and Gibbs entropy when they first come into contact with statistical thermodynamics.