On the Minimum of the Expansion Factor for Universal Coding of Integers

Wei Yan,Sian-Jheng Lin
DOI: https://doi.org/10.1109/tcomm.2021.3100497
IF: 6.166
2021-01-01
IEEE Transactions on Communications
Abstract:Universal coding of integers (UCI) is a prefix coding suitable for probability distributions without prior knowledge. UCI has the property that the expected codeword length is no more than constant K-C times max{1, H(P)}, where K-C is called the expansion factor and H(P) is the entropy of source P. A class of UCI C with a smaller K-C is preferred, but the minimum value of K-C (as well as its code construction) is still unknown. Thus, this paper provides a range of the minimum values of K-C. First, we show that K-C >= 2 for each UCI C. Then, for the upper bound, we provide a class of UCIs, termed eta code, to achieve K-C = 2.75. This approach improves the prior result K-C = 3 achieved by Elias gamma coding. Next, we propose an asymptotically optimal UCI, termed theta code, to achieve K-C = 3.5. Finally, we compare the range of the minimum value of K-C of eta code, theta code and some other UCIs.
What problem does this paper attempt to address?