Abstract:This monograph presents a unified treatment of single- and multi-user problems in Shannon’s information theory where we depart from the requirement that the error probability decays asymptotically in the blocklength. Instead, the error probabilities for various problems are bounded above by a non-vanishing constant and the spotlight is shone on achievable coding rates as functions of the growing blocklengths. This represents the study of asymptotic estimates with non-vanishing error probabilities. In Part I, after reviewing the fundamentals of information theory, we discuss Strassen’s seminal result for binary hypothesis testing where the type-I error probability is non-vanishing and the rate of decay of the type-II error probability with growing number of independent observations is characterized. In Part II, we use this basic hypothesis testing result to develop second- and sometimes, even third-order asymptotic expansions for point-to-point communication. Finally in Part III, we consider network information theory problems for which the second order asymptotics are known. These problems include some classes of channels with random state, the multiple-encoder distributed lossless source coding (Slepian-Wolf) problem and special cases of the Gaussian interference and multiple-access channels. Finally, we discuss avenues for further research.

The asymptotic spectrum distance, graph limits, and the Shannon capacity

On conjectures of network distance measures by using graph spectra

On Upper Bounding Shannon Capacity of Graph Through Generalized Conic Programming

Shannon capacity, Chess, DNA and Umbrellas

Shannon capacity, Lovász theta number and the Mycielski construction

Exponentially many graphs are determined by their spectrum

Bounding the Graph Capacity with Quantum Mechanics and Finite Automata

Asymptotic Capacity Bounds for Wireless Networks with Non-Uniform Traffic

Towards a theory of eigenvalue asymptotics on infinite metric graphs: the case of diagonal combs

Capacity bounds on integral flows and the Kostant partition function

On Distance Spectral Radius and Distance Energy of Graphs

Asymptotic Estimates in Information Theory with Non-Vanishing Error Probabilities

One-shot and asymptotic classical capacity in general physical theories

Towards a System Theoretic Approach to Wireless Network Capacity in Finite Time and Space

Capacity Analysis of Maximal Flow in Ad Hoc Networks

Spectral Distances on Graphs.

Graph Limits and Spectral Extremal Problems for Graphs

The spectrum of asymptotic Cayley trees

Boundary Conditions Matter: On The Spectrum Of Infinite Quantum Graphs

New Tight Upper Bounds on the Capacity for General Deterministic Dissemination in Wireless Ad Hoc Networks