Entropic Central Limit Theorem for Order Statistics
Martina Cardone,Alex Dytso,Cynthia Rush
DOI: https://doi.org/10.1109/tit.2022.3219344
IF: 2.5
2023-03-18
IEEE Transactions on Information Theory
Abstract:It is well known that central order statistics exhibit a central limit behavior and converge to a Gaussian distribution as the sample size grows. This paper strengthens this known result by establishing an entropic version of the central limit theorem that ensures a stronger mode of convergence using the relative entropy. This upgrade in convergence is shown at the expense of extra regularity conditions, which can be considered as mild. To prove this result, ancillary results on order statistics are derived, which might be of independent interest. For instance, a rather general bound on the moments of order statistics, and an upper bound on the mean squared error of estimating the -th quantile of an unknown cumulative distribution function, are derived. Finally, a discussion on the necessity of the derived conditions for convergence and on the rate of convergence and monotonicity of the relative entropy is provided.
computer science, information systems,engineering, electrical & electronic