Abstract:When at equilibrium, large-scale systems obey conventional thermodynamics because they belong to microscopic configurations (or states) that are typical. Crucially, the typical states usually represent only a small fraction of the total number of possible states, and yet the characterization of the set of typical states -- the typical set -- alone is sufficient to describe the macroscopic behavior of a given system. Consequently, the concept of typicality, and the associated Asymptotic Equipartition Property allow for a drastic reduction of the degrees of freedom needed for system's statistical description. The mathematical rationale for such a simplification in the description is due to the phenomenon of concentration of measure. The later emerges for equilibrium configurations thanks to very strict constraints on the underlying dynamics, such as weekly interacting and (almost) independent system constituents. The question naturally arises as to whether the concentration of measure and related typicality considerations can be extended and applied to more general complex systems, and if so, what mathematical structure can be expected in the ensuing generalized thermodynamics. In this paper we illustrate the relevance of the concept of typicality in the toy model context of the "thermalized" coin and show how this leads naturally to Shannon entropy. We also show an intriguing connection: The characterization of typical sets in terms of Renyi and Tsallis entropies naturally leads to the free energy and partition function, respectively, and makes their relationship explicit. Finally, we propose potential ways to generalize the concept of typicality to systems where the standard microscopic assumptions do not hold.

A Pilot Experiment with Reactor Neutrinos in Taiwan

Statistical Physics of Non Equilibrium Quantum Phenomena

Lectures on Statistical Mechanics

A First Exposure to Statistical Mechanics for Life Scientists

The Fundamental Concepts of Classical Equilibrium Statistical Mechanics

On the foundations of statistical mechanics

Statistical Mechanics of Thermodynamic Processes

Stochastic Processes and Statistical Mechanics

A Basic Problem in the Correlations Between Statistics and Thermodynamics

Física Estadística: teoría, ejemplos trabajados, modelos y simulaciones

Nonextensive Statistical Mechanics: Some Links with Astronomical Phenomena

Typicality, entropy and the generalization of statistical mechanics

Microscopic description of a nonequilibrium system

Entropy, concentration, and learning: a statistical mechanics primer

Coconuts and Islanders: A Statistics-First Guide to the Boltzmann Distribution

Phenomenological thermodynamics in a nutshell

Lecture Notes on the Statistical Mechanics of Disordered Systems

Teaching the principles of statistical dynamics

Observable Statistical Mechanics

Many Faces of Entropy or Bayesian Statistical Mechanics