Abstract:Information (I) is defined as the amount of the data after data compression. The first law of information theory: the total amount of data L (the sum of entropy S and information I) of an isolated system remains unchanged. The second law of information theory: Information I of an isolated system decreases to a minimum at equilibrium. The third law of information theory: For a solid structure of perfect symmetry (e.g., a perfect crystal), the information I is zero and the (information theory) entropy (called by me as static entropy for solid state) S is at the maximum. Gibbs Paradox has been resolved. Spontaneously mixed substances at gaseous state can be spontaneously separated at condensed phases (solid or liquid states), driving only by information loss or by the increase in (information theory) entropy. None of the typical pure mixing or separation processes are driving by free energy minimization and the free energy (or total amount of chemical potential) has no change during the processes of ideal mixture formation or ideal mixture separation. The thermodynamic entropy change for the formation of ideal mixtures of gases, liquids or solids is always zero.
What problem does this paper attempt to address?
The problems that this paper attempts to solve mainly revolve around the **Gibbs Paradox** and its relationship with concepts such as information, symmetry, and similarity. Specifically:
1. **Defining information**: The author proposes a new definition of information, that is, information \(I\) is the total amount after data compression. In information theory, entropy \(S\) is defined as information loss, that is, \(S = L - I\), where \(L\) is the total amount of data.
2. **Three laws of information theory**:
- First law: The total amount of data \(L\) (that is, the sum of entropy and information) in an isolated system remains unchanged.
- Second law: The information \(I\) in an isolated system decreases to a minimum in an equilibrium state.
- Third law: For a perfectly symmetric solid structure (such as a perfect crystal), the information \(I\) is zero, and the entropy \(S\) reaches a maximum.
3. **Discussion of the Gibbs Paradox**: The Gibbs Paradox involves the problem of entropy change during the mixing process. The author reviews the research in this area by Gibbs, von Neumann, and himself, and presents his own views. He believes that the entropy change during the mixing process should be understood from the perspective of information theory, rather than from the perspective of thermodynamic energy. Specifically, the mixing process can be regarded as a process of information loss, rather than a process of energy change.
4. **Experimental verification**: The author points out that it is difficult to detect changes in heat and work during the mixing process of ideal gases experimentally, which supports the view that the entropy change during the mixing process is independent of energy. Therefore, the author believes that the entropy change during the mixing process should be explained by information theory.
5. **Symmetry and spontaneous processes**: The author further explores the relationship between symmetry and spontaneous processes, and points out that more similar substances are more likely to mix spontaneously, which is different from the traditional thermodynamic view. For example, the spontaneous coalescence of oil droplets in water and the spontaneous formation of crystals are both processes with high symmetry, and the spontaneity of these processes can be explained by information theory.
In summary, this paper aims to re - interpret the Gibbs Paradox through information theory and propose a new perspective to understand the entropy change and spontaneous processes during the mixing process.