A Characterization of Optimal Prefix Codes

Spencer Congero,Kenneth Zeger

2024-04-10

Abstract:A property of prefix codes called strong monotonicity is introduced, and it is proven that for a given source, a prefix code is optimal if and only if it is complete and strongly monotone.

Information Theory

What problem does this paper attempt to address?

Competitive Advantage of Huffman and Shannon-Fano Codes

Spencer Congero,Kenneth Zeger

2024-04-10

Abstract:For any finite discrete source, the competitive advantage of prefix code $C_1$ over prefix code $C_2$ is the probability $C_1$ produces a shorter codeword than $C_2$, minus the probability $C_2$ produces a shorter codeword than $C_1$. For any source, a prefix code is competitively optimal if it has a nonnegative competitive advantage over all other prefix codes. In 1991, Cover proved that Huffman codes are competitively optimal for all dyadic sources, namely sources whose symbol probabilities are negative integer powers of $2$. We prove the following asymptotic converse: As the source size grows, the probability a Huffman code for a randomly chosen non-dyadic source is competitively optimal converges to zero. We also prove: (i) For any non-dyadic source, a Huffman code has a positive competitive advantage over a Shannon-Fano code; (ii) For any source, the competitive advantage of any prefix code over a Huffman code is strictly less than $\frac{1}{3}$; (iii) For each integer $n>3$, there exists a source of size $n$ and some prefix code whose competitive advantage over a Huffman code is arbitrarily close to $\frac{1}{3}$; and (iv) For each positive integer $n$, there exists a source of size $n$ and some prefix code whose competitive advantage over a Shannon-Fano code becomes arbitrarily close to $1$ as $n\to\infty$.

Information Theory
Multichannel Optimal Tree-Decodable Codes are Not Always Optimal Prefix Codes

Hoover H. F. Yin,Harry W. H. Wong,Mehrdad Tahernia,Russell W. F. Lai

DOI: https://doi.org/10.48550/arXiv.2205.05122

2022-05-10

Information Theory

Abstract:The theory of multichannel prefix codes aims to generalize the classical theory of prefix codes. Although single- and two-channel prefix codes always have decoding trees, the same cannot be said when there are more than two channels. One question is of theoretical interest: Do there exist optimal tree-decodable codes that are not optimal prefix codes? Existing literature, which focused on generalizing single-channel results, covered little about non-tree-decodable prefix codes since they have no single-channel counterparts. In this work, we study the fundamental reason behind the non-tree-decodability of prefix codes. By investigating the simplest non-tree-decodable structure, we obtain a general sufficient condition on the channel alphabets for the existence of optimal tree-decodable codes that are not optimal prefix codes.
Fast and Compact Prefix Codes

Travis Gagie,Gonzalo Navarro,Yakov Nekrich

DOI: https://doi.org/10.48550/arXiv.0905.3107

2009-05-19

Abstract:It is well-known that, given a probability distribution over $n$ characters, in the worst case it takes (\Theta (n \log n)) bits to store a prefix code with minimum expected codeword length. However, in this paper we first show that, for any $0<\epsilon<1/2$ with (1 / \epsilon = \Oh{\polylog{n}}), it takes $\Oh{n \log \log (1 / \epsilon)}$ bits to store a prefix code with expected codeword length within $\epsilon$ of the minimum. We then show that, for any constant (c > 1), it takes $\Oh{n^{1 / c} \log n}$ bits to store a prefix code with expected codeword length at most $c$ times the minimum. In both cases, our data structures allow us to encode and decode any character in $\Oh{1}$ time.

Data Structures and Algorithms
A characterization of optimal constacyclic locally repairable codes

Wei Zhao,Kenneth W. Shum,Shenghao Yang

DOI: https://doi.org/10.1016/j.disc.2024.113901

IF: 0.961

2024-01-28

Discrete Mathematics

Abstract:A locally repairable code (LRC) with locality r allows for the recovery of any erased codeword symbol using at most r other codeword symbols. The Singleton-type bound dictates a best possible tradeoff between the dimension, the minimum distance and the locality of LRCs. An LRC attaining this tradeoff is said to be optimal. A constacyclic LRC is an LRC with constacyclic structure which can be encoded efficiently using any encoding algorithm for cyclic codes in general. In this paper we consider the optimal constacyclic LRCs of length ηps over finite fields, where p is the characteristic of the finite fields, s is a positive integer and η is a positive integer coprime to p . We obtain several infinite classes of optimal constacyclic LRCs with new parameters. Furthermore, under a further assumption that the ambient space Fpm[x]/〈xηps−λ〉 of the repeated-root constacyclic codes is a chain ring, we characterize all the possible optimal constacyclic LRCs in Fpm[x]/〈xηps−λ〉 .

mathematics
A Direct Construction of Optimal Symmetrical Z-Complementary Code Sets of Prime Power Lengths

Praveen Kumar,Sudhan Majhi,Subhabrata Paul

2023-05-02

Abstract:This paper presents a direct construction of an optimal symmetrical Z-complementary code set (SZCCS) of prime power lengths using a multi-variable function (MVF). SZCCS is a natural extension of the Z-complementary code set (ZCCS), which has only front-end zero correlation zone (ZCZ) width. SZCCS has both front-end and tail-end ZCZ width. SZCCSs are used in developing optimal training sequences for broadband generalized spatial modulation systems over frequency-selective channels because they have ZCZ width on both the front and tail ends. The construction of optimal SZCCS with large set sizes and prime power lengths is presented for the first time in this paper. Furthermore, it is worth noting that several existing works on ZCCS and SZCCS can be viewed as special cases of the proposed construction.

Information Theory
In search of maximum non-overlapping codes

Lidija Stanovnik,Miha Moškon,Miha Mraz

DOI: https://doi.org/10.1007/s10623-023-01344-z

IF: 1.4

2024-01-09

Designs Codes and Cryptography

Abstract:Non-overlapping codes are block codes that have arisen in diverse contexts of computer science and biology. Applications typically require finding non-overlapping codes with large cardinalities, but the maximum size of non-overlapping codes has been determined only for cases where the codeword length divides the size of the alphabet, and for codes with codewords of length two or three. For all other alphabet sizes and codeword lengths no computationally feasible way to identify non-overlapping codes that attain the maximum size has been found to date. Herein we characterize maximal non-overlapping codes. We formulate the maximum non-overlapping code problem as an integer optimization problem and determine necessary conditions for optimality of a non-overlapping code. Moreover, we solve several instances of the optimization problem to show that the hitherto known constructions do not generate the optimal codes for many alphabet sizes and codeword lengths. We also evaluate the number of distinct maximum non-overlapping codes.

mathematics, applied,computer science, theory & methods
Optimal Locally Repairable Codes: An Improved Bound and Constructions

Han Cai,Cuiling Fan,Ying Miao,Moshe Schwartz,Xiaohu Tang

DOI: https://doi.org/10.48550/arXiv.2011.04966

2020-11-10

Abstract:We study the Singleton-type bound that provides an upper limit on the minimum distance of locally repairable codes. We present an improved bound by carefully analyzing the combinatorial structure of the repair sets. Thus, we show the previous bound is unachievable for certain parameters. We then also provide explicit constructions of optimal codes that show that for certain parameters the new bound is sharp. Additionally, as a byproduct, some previously known codes are shown to attain the new bound and are thus proved to be optimal.

Information Theory
The characterization of binary constant weight codes meeting the bound of Fu and Shen

Fang-Wei Fu,Shu-Tao Xia

DOI: https://doi.org/10.1007/s10623-007-9049-6

2007-01-01

Abstract:Fu and Shen gave an upper bound on binary constant weight codes. In this paper, we present a new proof for the bound of Fu and Shen and characterize binary constant weight codes meeting this bound. It is shown that binary constant weight codes meet the bound of Fu and Shen if and only if they are generated from certain symmetric designs and quasi-symmetric designs in combinatorial design theory. In particular, it turns out that the existence of binary codes with even length meeting the Grey–Rankin bound is equivalent to the existence of certain binary constant weight codes meeting the bound of Fu and Shen. Furthermore, some examples are listed to illustrate these results. Finally, we obtain a new upper bound on binary constant weight codes which improves on the bound of Fu and Shen in certain case.
Entropic Bounds on the Average Length of Codes with a Space

Roberto Bruno,Ugo Vaccaro

DOI: https://doi.org/10.3390/e26040283

2024-05-10

Abstract:We consider the problem of constructing prefix-free codes in which a designated symbol, a space, can only appear at the end of codewords. We provide a linear-time algorithm to construct almost-optimal codes with this property, meaning that their average length differs from the minimum possible by at most one. We obtain our results by uncovering a relation between our class of codes and the class of one-to-one codes. Additionally, we derive upper and lower bounds to the average length of optimal prefix-free codes with a space in terms of the source entropy.

Information Theory
Optimal linear codes with few weights from simplicial complexes

Bing Chen,Yunge Xu,Zhao Hu,Nian Li,Xiangyong Zeng

2024-07-14

Abstract:Recently, constructions of optimal linear codes from simplicial complexes have attracted much attention and some related nice works were presented. Let $q$ be a prime power. In this paper, by using the simplicial complexes of ${\mathbb F}_{q}^m$ with one single maximal element, we construct four families of linear codes over the ring ${\mathbb F}_{q}+u{\mathbb F}_{q}$ ($u^2=0$), which generalizes the results of [IEEE Trans. Inf. Theory 66(6):3657-3663, 2020]. The parameters and Lee weight distributions of these four families of codes are completely determined. Most notably, via the Gray map, we obtain several classes of optimal linear codes over ${\mathbb F}_{q}$, including (near) Griesmer codes and distance-optimal codes.

Information Theory
Lossless Coding with Generalised Criteria

Charalambos D. Charalambous,Themistoklis Charalambous,Farzad Rezaei

DOI: https://doi.org/10.48550/arXiv.1102.2207

2011-02-11

Abstract:This paper presents prefix codes which minimize various criteria constructed as a convex combination of maximum codeword length and average codeword length or maximum redundancy and average redundancy, including a convex combination of the average of an exponential function of the codeword length and the average redundancy. This framework encompasses as a special case several criteria previously investigated in the literature, while relations to universal coding is discussed. The coding algorithm derived is parametric resulting in re-adjusting the initial source probabilities via a weighted probability vector according to a merging rule. The level of desirable merging has implication in applications where the maximum codeword length is bounded.

Information Theory
Infinite families of optimal and minimal codes over rings using simplicial complexes

Yanan Wu,Tingting Pang,Nian Li,Yanbin Pan,Xiangyong Zeng

2024-07-13

Abstract:In this paper, several infinite families of codes over the extension of non-unital non-commutative rings are constructed utilizing general simplicial complexes. Thanks to the special structure of the defining sets, the principal parameters of these codes are characterized. Specially, when the employed simplicial complexes are generated by a single maximal element, we determine their Lee weight distributions completely. Furthermore, by considering the Gray image codes and the corresponding subfield-like codes, numerous of linear codes over $\mathbb{F}_q$ are also obtained, where $q$ is a prime power. Certain conditions are given to ensure the above linear codes are (Hermitian) self-orthogonal in the case of $q=2,3,4$. It is noteworthy that most of the derived codes over $\mathbb{F}_q$ satisfy the Ashikhmin-Barg's condition for minimality. Besides, we obtain two infinite families of distance-optimal codes over $\mathbb{F}_q$ with respect to the Griesmer bound.

Information Theory
Generalized asymptotically optimal codebooks

Gang Wang,Min-Yao Niu,You Gao

DOI: https://doi.org/10.1016/j.amc.2020.125230

IF: 4.397

2020-08-01

Applied Mathematics and Computation

Abstract:<p>Recently, Luo et al. proposed two new codebooks based on the operations of some given sets, which are asymptotically optimal. In the paper, we present new construction of codebooks. We determine maximal cross-correlation amplitude of the constructed codebooks. The constructed codebooks are near optimal to the Welch bound. This new codebooks in the paper generalize Luo et al.′s constructions. The parameters of constructed codebooks are nimble and new under some circumstances.</p>

mathematics, applied
Approximate generalized Steiner systems and near-optimal constant weight codes

Miao Liu,Chong Shangguan

2024-01-21

Abstract:Constant weight codes (CWCs) and constant composition codes (CCCs) are two important classes of codes that have been studied extensively in both combinatorics and coding theory for nearly sixty years. In this paper we show that for {\it all} fixed odd distances, there exist near-optimal CWCs and CCCs asymptotically achieving the classic Johnson-type upper bounds.

Combinatorics,Information Theory
Quasi-Perfect and Distance-Optimal Codes Sum-Rank Codes

Hao Chen

2024-02-14

Abstract:Constructions of distance-optimal codes and quasi-perfect codes are challenging problems and have attracted many attentions. In this paper, we give the following three results.

Information Theory
A New Construction of Optimal Symmetrical ZCCS

Rajen Kumar,Prashant Kumar Srivastava,Sudhan Majhi

2024-05-25

Abstract:We propose new constructions for a two-dimensional ($2$D) perfect array, complete complementary code (CCC), and multiple CCCs as an optimal symmetrical $Z$-complementary code set (ZCCS). We propose a method to generate a two-dimensional perfect array and CCC. By utilising mutually orthogonal sequences, we developed a method to extend the length of a CCC without affecting the set or code size. Additionally, this concept is extended to include the development of multiple CCCs, and the correlation characteristics of these multiple CCCs are identical with the characteristics of optimal symmetrical ZCCS.

Information Theory
Optimal codes in the Stiefel manifold

John Jasper,Nathan Mankovich,Dustin G. Mixon

2024-07-02

Abstract:We consider the coding problem in the Stiefel manifold with chordal distance. After considering various low-dimensional instances of this problem, we use Rankin's bounds on spherical codes to prove upper bounds on the minimum distance of a Stiefel code, and then we construct several examples of codes that achieve equality in these bounds.

Metric Geometry,Information Theory,Combinatorics
On optimal constant weight codes derived from -circulant balanced generalized weighing matrices

Hadi Kharaghani,Thomas Pender,Vladimir Tonchev

DOI: https://doi.org/10.1007/s10623-024-01414-w

IF: 1.4

2024-05-16

Designs Codes and Cryptography

Abstract:Balanced generalized weight matrices are used to construct optimal constant weight codes that are monomially inequivalent to codes derived from the classical simplex codes. What's more, these codes can be assumed to be generated entirely by -shifts of a single codeword where is a primitive element of a Galois field. Additional constant weight codes are derived by projecting onto subgroups of the alphabet sets. These too are shown to be optimal.

mathematics, applied,computer science, theory & methods

A Characterization of Optimal Prefix Codes

Competitive Advantage of Huffman and Shannon-Fano Codes

Multichannel Optimal Tree-Decodable Codes are Not Always Optimal Prefix Codes

Fast and Compact Prefix Codes

A characterization of optimal constacyclic locally repairable codes

A Direct Construction of Optimal Symmetrical Z-Complementary Code Sets of Prime Power Lengths

In search of maximum non-overlapping codes

Optimal Locally Repairable Codes: An Improved Bound and Constructions

The characterization of binary constant weight codes meeting the bound of Fu and Shen

Entropic Bounds on the Average Length of Codes with a Space

Optimal linear codes with few weights from simplicial complexes

Lossless Coding with Generalised Criteria

Infinite families of optimal and minimal codes over rings using simplicial complexes

Generalized asymptotically optimal codebooks

Approximate generalized Steiner systems and near-optimal constant weight codes

Quasi-Perfect and Distance-Optimal Codes Sum-Rank Codes

A New Construction of Optimal Symmetrical ZCCS

Optimal codes in the Stiefel manifold

On optimal constant weight codes derived from -circulant balanced generalized weighing matrices