Abstract:The paper analyzes the entropy of a system composed by non-interacting and indistinguishable particles whose quantum state numbers are modelled as independent and identically distributed classical random variables. The crucial observation is that, under this assumption, whichever is the number of particles that constitute the system, the occupancy numbers of system's quantum (micro)states are multinomially distributed. This observation leads to an entropy formula for the physical system, which is nothing else than the entropy formula of the multinomial distribution, for which we claim novelty, in the sense that it is proposed here for the first time that the entropy of the multinomial distribution is the entropy of the physical system. The entropy formula of the multinomial distribution unveils yet unexplored connections between information theory and statistical mechanics, among which we mention the connection between conditional entropy of the random microstate given the random occupancy numbers and the Boltzmann-Planck entropy $\log(W)$ and between these two and the Gibbs correction term $\log(N!)$, thermalization and communication-theoretic preparation of a thermal state, accessible information of the thermal state and physical entropy of the thermalized system. A noticeable specific result that descends from our approach is the exact quantum correction to the textbook Sackur-Tetrode formula for the entropy of an ideal gas at the thermal equilibrium in a container.

A pathway to multivariate Gaussian density

Optimal Reduction of Multivariate Dirac Mixture Densities

Pathwise Derivatives for Multivariate Distributions

Non-central limit of densities of some functionals of Gaussian processes

Pathway Model, Superstatistics, Tsallis Statistics, and a Generalized Measure of Entropy

Gaussian concentration bound and Ensemble equivalence in generic quantum many-body systems including long-range interaction

Entropy-Maximising Diffusions Satisfy a Parallel Transport Law

A simple probabilistic construction yielding generalized entropies and divergences, escort distributions and q-Gaussians

A mixture of ellipsoidal densities for 3D data modelling

Average spectral density of multiparametric Gaussian ensembles of complex matrices

A Stochastic Approach to Maxwell Velocity Distribution via Central Limit Theorem and Boltzmann's Entropy Formula

A discrete probabilistic model yielding multidimensional Gaussians in the thermodynamic limit for specific parameter values

Geometric Insights into the Multivariate Gaussian Distribution and Its Entropy and Mutual Information

Entropic Density Functional Theory

Approximate maximum entropy principles via Goemans-Williamson with applications to provable variational methods

Mittag-Leffler Probability Density for Nonextensive Statistics and Superstatistics

Gaussian Process Regression for Maximum Entropy Distribution

An Entropic Approach To Classical Density Functional Theory

The Exact Entropy Formula of the Ideal Gas and its Information-Theoretic Interpretation

Maximum Entropy Principle, Equal Probability a Priori and Gibbs Paradox