Constituent automorphism decoding of Reed-Muller codes

Yicheng Qu,Amir Tasbihi,Frank R. Kschischang

2024-09-06

Abstract:Automorphism-ensemble decoding is applied to the Plotkin constituents of Reed-Muller codes, resulting in a new soft-decision decoding algorithm with state-of-the-art performance versus complexity trade-offs.

Information Theory

What problem does this paper attempt to address?

Soft Decision Decoding of Recursive Plotkin Constructions Based on Hidden Code Words

Martin Bossert

2024-08-23

Abstract:The Plotkin construction combines two codes to a code of doubled length. It can be applied recursively. The class of Reed-Muller (RM) codes is a particular example. Also, a special class of generalized concatenated codes (GCC) can be described as recursive Plotkin construction. Exploiting a property of the code words constructed by the recursive Plotkin construction, we present novel soft-decision decoders. These are based on the decoding of hidden code words which are inherent contained in the constructed code words and can be uncovered by adding particular parts of the overall code word. The main idea is to use more than one decoding variant where each variant starts with the decoding of a different hidden code word. The final decoding decision selects the best of the decisions of the used variants. The more variants are used the closer the performance gets to the maximum-likelihood (ML) decoding performance. This is verified by an ML-bound for the cases where the ML performance is not known. The decoding algorithms use only additions, comparisons, and sign operations. Further, due to the recursive structure, only relatively short codes have to be decoded, thus, the decoding complexity is very low. In addition, we introduce two novel classes of half-rate codes based on recursive Plotkin constructions with RM codes.

Information Theory
A Hybrid Decoding of Reed–Muller Codes

Shuang Li,Shicheng Zhang,Zhenxing Chen,Seog Geun Kang

DOI: https://doi.org/10.1177/1550147716683406

IF: 1.938

2017-01-01

International Journal of Distributed Sensor Networks

Abstract:In this article, a hybrid decoding algorithm for Reed–Muller codes is presented. Unlike the conventional algorithm, the presented algorithm ends recursive decomposition when [Formula: see text] and [Formula: see text] appeared. A simplified maximum-likelihood algorithm based on fast Hadamard transform is also exploited to decode the systematic code through its special structure. As a result, the presented hybrid decoding algorithm reduces the number of floating-point multiplications significantly as compared with the conventional algorithms. In addition, the new algorithm has better error performance than the conventional ones.
On automorphism groups of polar codes

Jicheng Ma,Guiying Yan

2024-06-14

Abstract:Over the past years, Polar codes have arisen as a highly effective class of linear codes, equipped with a decoding algorithm of low computational complexity. This family of codes share a common algebraic formalism with the well-known Reed-Muller codes, which involves monomial evaluations. As useful algebraic codes, more specifically known as decreasing monomial codes, a lot of decoding work has been done on Reed-Muller codes based on their rich code automorphisms. In 2021, a new permutation group decoder, referred to as the automorphism ensemble (AE) decoder, was introduced. This decoder can be applied to Polar codes and has been shown to produce similar decoding effects. However, identifying the right set of code automorphisms that enhance decoding performance for Polar codes remains a challenging task. This paper aims to characterize the full automorphism group of Polar codes. We will prove a reduction theorem that effectively reduces the problem of determining the full automorphism group of arbitrary random Polar codes to that of a specified class of Polar codes. Besides, we give exact classification of the full automorphism groups of families of Polar codes that are constructed using the Reed-Muller codes.

Combinatorics,Information Theory
The Re-Encoding Transformation in Algebraic List-Decoding of Reed-Solomon Codes

Ralf Koetter,Jun Ma,Alexander Vardy

DOI: https://doi.org/10.48550/arXiv.1005.5734

2010-06-01

Abstract:The main computational steps in algebraic soft-decoding, as well as Sudan-type list-decoding, of Reed-Solomon codes are bivariate polynomial interpolation and factorization. We introduce a computational technique, based upon re-encoding and coordinate transformation, that significantly reduces the complexity of the bivariate interpolation procedure. This re-encoding and coordinate transformation converts the original interpolation problem into another reduced interpolation problem, which is orders of magnitude smaller than the original one. A rigorous proof is presented to show that the two interpolation problems are indeed equivalent. An efficient factorization procedure that applies directly to the reduced interpolation problem is also given.

Information Theory
Machine Learning-Aided Efficient Decoding of Reed-Muller Subcodes

Mohammad Vahid Jamali,Xiyang Liu,Ashok Vardhan Makkuva,Hessam Mahdavifar,Sewoong Oh,Pramod Viswanath

2023-08-01

Abstract:Reed-Muller (RM) codes achieve the capacity of general binary-input memoryless symmetric channels and are conjectured to have a comparable performance to that of random codes in terms of scaling laws. However, such results are established assuming maximum-likelihood decoders for general code parameters. Also, RM codes only admit limited sets of rates. Efficient decoders such as successive cancellation list (SCL) decoder and recently-introduced recursive projection-aggregation (RPA) decoders are available for RM codes at finite lengths. In this paper, we focus on subcodes of RM codes with flexible rates. We first extend the RPA decoding algorithm to RM subcodes. To lower the complexity of our decoding algorithm, referred to as subRPA, we investigate different approaches to prune the projections. Next, we derive the soft-decision based version of our algorithm, called soft-subRPA, that not only improves upon the performance of subRPA but also enables a differentiable decoding algorithm. Building upon the soft-subRPA algorithm, we then provide a framework for training a machine learning (ML) model to search for \textit{good} sets of projections that minimize the decoding error rate. Training our ML model enables achieving very close to the performance of full-projection decoding with a significantly smaller number of projections. We also show that the choice of the projections in decoding RM subcodes matters significantly, and our ML-aided projection pruning scheme is able to find a \textit{good} selection, i.e., with negligible performance degradation compared to the full-projection case, given a reasonable number of projections.

Information Theory,Artificial Intelligence,Machine Learning
On a Group Under Which Symmetric Reed-Muller Codes are Invariant

Sibel Kurt Toplu,Talha Arikan,Pinar AydoğDu,OğUz Yayla

2024-01-21

Abstract:The Reed-Muller codes are a family of error-correcting codes that have been widely studied in coding theory. In 2020, Wei Yan and Sian-Jheng Lin introduced a variant of Reed-Muller codes so called symmetric Reed-Muller codes. We investigate linear maps of the automorphism group of symmetric Reed-Muller codes and show that the set of these linear maps forms a subgroup of the general linear group, which is the automorphism group of punctured Reed-Muller codes. We provide a method to determine all the automorphisms in this subgroup explicitly for some special cases.

Information Theory
Generalized Automorphisms of Channel Codes: Properties, Code Design, and a Decoder

Jonathan Mandelbaum,Holger Jäkel,Laurent Schmalen

2023-07-27

Abstract:Low-density parity-check codes together with belief propagation (BP) decoding are known to be well-performing for large block lengths. However, for short block lengths there is still a considerable gap between the performance of the BP decoder and the maximum likelihood decoder. Different ensemble decoding schemes such as, e.g., the automorphism ensemble decoder (AED), can reduce this gap in short block length regime. We propose a generalized AED (GAED) that uses automorphisms according to the definition in linear algebra. Here, an automorphism of a vector space is defined as a linear, bijective self-mapping, whereas in coding theory self-mappings that are scaled permutations are commonly used. We show that the more general definition leads to an explicit joint construction of codes and automorphisms, and significantly enlarges the search space for automorphisms of existing linear codes. Furthermore, we prove the concept that generalized automorphisms can indeed be used to improve decoding. Additionally, we propose a code construction of parity check codes enabling the construction of codes with suitably designed automorphisms. Finally, we analyze the decoding performances of the GAED for some of our constructed codes.

Information Theory
Dynamic Frozen-Function Design for Reed-Muller Codes With Automorphism-Based Decoding

Samet Gelincik,Charles Pillet,Pascal Giard

DOI: https://doi.org/10.1109/LCOMM.2022.3230202

2023-03-20

Abstract:In this letter, we propose to add dynamic frozen bits to underlying polar codes with a Reed-Muller information set with the aim of maintaining the same sub-decoding structure in Automorphism Ensemble (AE) and lowering the Maximum Likelihood (ML) bound by reducing the number of minimum weight codewords. We provide the dynamic freezing constraint matrix that remains identical after applying a permutation linear transformation. This feature also permits to drastically reduce the memory requirements of an AE decoder with polar-like codes having dynamic frozen bits. We show that, under AE decoding, the proposed dynamic freezing constraints lead to a gain of up to 0.25dB compared to the ML bound of the R(3,7) Reed-Muller code, at the cost of small increase in memory requirements.

Information Theory
Information sets from defining sets for Reed-Muller codes of first and second order

José Joaquín Bernal,Juan Jacobo Simón

DOI: https://doi.org/10.1109/TIT.2018.2817539

2024-01-19

Abstract:Reed-Muller codes belong to the family of affine-invariant codes. As such codes they have a defining set that determines them uniquely, and they are extensions of cyclic group codes. In this paper we identify those cyclic codes with multidimensional abelian codes and we use the techniques introduced in \cite{BS} to construct information sets for them from their defining set. For first and second order Reed-Muller codes, we describe a direct method to construct information sets in terms of their basic parameters.

Information Theory
A proof that Reed-Muller codes achieve Shannon capacity on symmetric channels

Emmanuel Abbe,Colin Sandon

2023-04-05

Abstract:Reed-Muller codes were introduced in 1954, with a simple explicit construction based on polynomial evaluations, and have long been conjectured to achieve Shannon capacity on symmetric channels. Major progress was made towards a proof over the last decades; using combinatorial weight enumerator bounds, a breakthrough on the erasure channel from sharp thresholds, hypercontractivity arguments, and polarization theory. Another major progress recently established that the bit error probability vanishes slowly below capacity. However, when channels allow for errors, the results of Bourgain-Kalai do not apply for converting a vanishing bit to a vanishing block error probability, neither do the known weight enumerator bounds. The conjecture that RM codes achieve Shannon capacity on symmetric channels, with high probability of recovering the codewords, has thus remained open. This paper closes the conjecture's proof. It uses a new recursive boosting framework, which aggregates the decoding of codeword restrictions on `subspace-sunflowers', handling their dependencies via an $L_p$ Boolean Fourier analysis, and using a list-decoding argument with a weight enumerator bound from Sberlo-Shpilka. The proof does not require a vanishing bit error probability for the base case, but only a non-trivial probability, obtained here for general symmetric codes. This gives in particular a shortened and tightened argument for the vanishing bit error probability result of Reeves-Pfister, and with prior works, it implies the strong wire-tap secrecy of RM codes on pure-state classical-quantum channels.

Information Theory,Discrete Mathematics
Symbol-level Soft-Decision Decoding of Reed-Solomon Codes

DING Su-quan,YANG Zhi-xing,PAN Chang-yong,WANG Jun

DOI: https://doi.org/10.3321/j.issn:1001-506x.2007.06.036

2007-01-01

Abstract:To achieve good tradeoffs between error performance and decoding complexity,two types of symbol-level soft-decision decoding algorithms for Reed-Solomon codes are proposed.The first algorithm integrates order statistic decoding into Chase decoding while the second algorithm employs Chase-2 algorithm in a step-by-step version.Both algorithms make good use of the received soft-decision information.Simulation results show that the first algorithm performs well when the decoding complexity is low while the second algorithm provides good flexibility and performs well when the decoding complexity is affordable.Both algorithms outperform some popular symbol-level SDD algorithms in some cases.
Syndrome decoding of Reed-Muller codes and tensor decomposition over finite fields

Swastik Kopparty,Aditya Potukuchi

DOI: https://doi.org/10.48550/arXiv.1712.06039

2017-12-17

Abstract:Reed-Muller codes are some of the oldest and most widely studied error-correcting codes, of interest for both their algebraic structure as well as their many algorithmic properties. A recent beautiful result of Saptharishi, Shpilka and Volk showed that for binary Reed-Muller codes of length $n$ and distance $d = O(1)$, one can correct $\operatorname{polylog}(n)$ random errors in $\operatorname{poly}(n)$ time (which is well beyond the worst-case error tolerance of $O(1)$). In this paper, we consider the problem of `syndrome decoding' Reed-Muller codes from random errors. More specifically, given the $\operatorname{polylog}(n)$-bit long syndrome vector of a codeword corrupted in $\operatorname{polylog}(n)$ random coordinates, we would like to compute the locations of the codeword corruptions. This problem turns out to be equivalent to a basic question about computing tensor decomposition of random low-rank tensors over finite fields. Our main result is that syndrome decoding of Reed-Muller codes (and the equivalent tensor decomposition problem) can be solved efficiently, i.e., in $\operatorname{polylog}(n)$ time. We give two algorithms for this problem: 1. The first algorithm is a finite field variant of a classical algorithm for tensor decomposition over real numbers due to Jennrich. This also gives an alternate proof for the main result of Saptharishi et al. 2. The second algorithm is obtained by implementing the steps of the Berlekamp-Welch-style decoding algorithm of Saptharishi et al. in sublinear-time. The main new ingredient is an algorithm for solving certain kinds of systems of polynomial equations.

Information Theory,Data Structures and Algorithms
Reed-Muller Identification

Mattia Spandri,Roberto Ferrara,Christian Deppe

DOI: https://doi.org/10.3929/ethz-b-000535285

2023-10-12

Abstract:Ahlswede and Dueck identification has the potential of exponentially reducing traffic or exponentially increasing rates in applications where a full decoding of the message is not necessary and, instead, a simple verification of the message of interest suffices. However, the proposed constructions can suffer from exponential increase in the computational load at the sender and receiver, rendering these advantages unusable. This has been shown in particular to be the case for a construction achieving identification capacity based on concatenated Reed-Solomon codes. Here, we consider the natural generalization of identification based on Reed-Muller codes and we show that, although without achieving identification capacity, they allow to achieve the exponentially large rates mentioned above without the computational penalty increasing too much the latency with respect to transmission.

Information Theory
Geometric structure and transversal logic of quantum Reed-Muller codes

Alexander Barg,Nolan J. Coble,Dominik Hangleiter,Christopher Kang

2024-10-10

Abstract:Designing efficient and noise-tolerant quantum computation protocols generally begins with an understanding of quantum error-correcting codes and their native logical operations. The simplest class of native operations are transversal gates, which are naturally fault-tolerant. In this paper, we aim to characterize the transversal gates of quantum Reed-Muller (RM) codes by exploiting the well-studied properties of their classical counterparts. We start our work by establishing a new geometric characterization of quantum RM codes via the Boolean hypercube and its associated subcube complex. More specifically, a set of stabilizer generators for a quantum RM code can be described via transversal $X$ and $Z$ operators acting on subcubes of particular dimensions. This characterization leads us to define subcube operators composed of single-qubit $\pi/2^k$ $Z$-rotations that act on subcubes of given dimensions. We first characterize the action of subcube operators on the code space: depending on the dimension of the subcube, these operators either (1) act as a logical identity on the code space, (2) implement non-trivial logic, or (3) rotate a state away from the code space. Second, and more remarkably, we uncover that the logic implemented by these operators corresponds to circuits of multi-controlled-$Z$ gates that have an explicit and simple combinatorial description. Overall, this suite of results yields a comprehensive understanding of a class of natural transversal operators for quantum RM codes.

Quantum Physics,Information Theory,Combinatorics
Computation with quantum Reed-Muller codes and their mapping onto 2D atom arrays

Anqi Gong,Joseph M. Renes

2024-10-31

Abstract:We give a fault tolerant construction for error correction and computation using two punctured quantum Reed-Muller (PQRM) codes. In particular, we consider the $[[127,1,15]]$ self-dual doubly-even code that has transversal Clifford gates (CNOT, H, S) and the triply-even $[[127,1,7]]$ code that has transversal T and CNOT gates. We show that code switching between these codes can be accomplished using Steane error correction. For fault-tolerant ancilla preparation we utilize the low-depth hypercube encoding circuit along with different code automorphism permutations in different ancilla blocks, while decoding is handled by the high-performance classical successive cancellation list decoder. In this way, every logical operation in this universal gate set is amenable to extended rectangle analysis. The CNOT exRec has a failure rate approaching $10^{-9}$ at $10^{-3}$ circuit-level depolarizing noise. Furthermore, we map the PQRM codes to a 2D layout suitable for implementation in arrays of trapped atoms and try to reduce the circuit depth of parallel atom movements in state preparation. The resulting protocol is strictly fault-tolerant for the $[[127,1,7]]$ code and practically fault-tolerant for the $[[127,1,15]]$ code. Moreover, each patch requires a permutation consisting of $7$ sub-hypercube swaps only. These are swaps of rectangular grids in our 2D hypercube layout and can be naturally created with acousto-optic deflectors (AODs). Lastly, we show for the family of $[[2^{2r},{2r\choose r},2^r]]$ QRM codes that the entire logical Clifford group can be achieved using only permutations, transversal gates, and fold-transversal gates.

Quantum Physics
Projective Systematic Authentication via Reed-Muller Codes

Hsuan-Po Liu,Hessam Mahdavifar

2024-04-14

Abstract:In this paper, we study the problem of constructing projective systematic authentication schemes based on binary linear codes. In systematic authentication, a tag for authentication is generated and then appended to the information, also referred to as the source, to be sent from the sender. Existing approaches to leverage projective constructions focus primarily on codes over large alphabets, and the projection is simply into one single symbol of the codeword. In this work, we extend the projective construction and propose a general projection process in which the source, which is mapped to a higher dimensional codeword in a given code, is first projected to a lower dimensional vector. The resulting vector is then masked to generate the tag. To showcase the new method, we focus on leveraging binary linear codes and, in particular, Reed-Muller (RM) codes for the proposed projective construction. More specifically, we propose systematic authentication schemes based on RM codes, referred to as RM-Acodes. We provide analytical results for probabilities of deception, widely considered as the main metrics to evaluate the performance of authentication systems. Through our analysis, we discover and discuss explicit connections between the probabilities of deception and various properties of RM codes.

Cryptography and Security
Improved Generalized Automorphism Belief Propagation Decoding

Jonathan Mandelbaum,Sisi Miao,Nils Albert Schwendemann,Holger Jäkel,Laurent Schmalen

2024-06-05

Abstract:With the increasing demands on future wireless systems, new design objectives become eminent. Low-density parity-check codes together with belief propagation (BP) decoding have outstanding performance for large block lengths. Yet, for future wireless systems, good decoding performance for short block lengths is mandatory, a regime in which BP decoding typically shows a significant gap to maximum likelihood decoding. Automorphism ensemble decoding (AED) is known to reduce this gap effectively and, in addition, enables an easy trade-off between latency, throughput, and complexity. Recently, generalized AED (GAED) was proposed to increase the set of feasible automorphisms suitable for ensemble decoding. By construction, GAED requires a preprocessing step within its constituent paths that results in information loss and potentially limits the gains of GAED. In this work, we show that the preprocessing step can be merged with the Tanner graph of BP decoding, thereby improving the performance of the constituent paths. Finally, we show that the improvement of the individual paths also enhances the overall performance of the ensemble.

Information Theory
A recursive construction for projective Reed-Muller codes

Rodrigo San-José

2024-07-15

Abstract:We give a recursive construction for projective Reed-Muller codes in terms of affine Reed-Muller codes and projective Reed-Muller codes in fewer variables. From this construction, we obtain the dimension of the subfield subcodes of projective Reed-Muller codes for some particular degrees that give codes with good parameters. Moreover, from this recursive construction we derive a lower bound for the generalized Hamming weights of projective Reed-Muller codes which is sharp in most of the cases we have checked.

Information Theory,Commutative Algebra
Polynomial Freiman-Ruzsa, Reed-Muller codes and Shannon capacity

Emmanuel Abbe,Colin Sandon,Vladyslav Shashkov,Maryna Viazovska

2024-11-21

Abstract:In 1948, Shannon used a probabilistic argument to show the existence of codes achieving a maximal rate defined by the channel capacity. In 1954, Muller and Reed introduced a simple deterministic code construction, based on polynomial evaluations, conjectured shortly after to achieve capacity. The conjecture led to decades of activity involving various areas of mathematics and the recent settlement by [AS23] using flower set boosting. In this paper, we provide an alternative proof of the weak form of the capacity result, i.e., that RM codes have a vanishing local error at any rate below capacity. Our proof relies on the recent Polynomial Freiman-Ruzsa conjecture's proof [GGMT23] and an entropy extraction approach similar to [AY19]. Further, a new additive combinatorics conjecture is put forward which would imply the stronger result with vanishing global error. We expect the latter conjecture to be more directly relevant to coding applications.

Information Theory,Combinatorics,Number Theory
The Re-encoding Transform in Algebraic List Decoding of Algebraic Geometric Codes.

Yunqi Wan,Jiongyue Xing,Yuliang Huang,Ting-Yi Wu,Bo Bai,Gong Zhang

DOI: https://doi.org/10.1109/isit54713.2023.10206845

2023-01-01

Abstract:This paper proposes the re-encoding transformed (ReT) based list decoding using the module basis reduction (BR) interpolation for algebraic geometric (AG) codes on C ab curves. The two ReT approaches are introduced to facilitate the BR interpolation. One is realized by the bivariate Lagrange polynomial. The other is conducted by the ReT of Reed-Solomon (RS) codes based on the mathematical structure of AG codes. The ReT based BR interpolation (ReT-BR) algorithm for decoding the AG codes is further introduced. Finally, complexity of the proposed algorithm is analyzed and validated by the simulation results, demonstrating its complexity advantage over the non-ReT counterpart.

Constituent automorphism decoding of Reed-Muller codes

Soft Decision Decoding of Recursive Plotkin Constructions Based on Hidden Code Words

A Hybrid Decoding of Reed–Muller Codes

On automorphism groups of polar codes

The Re-Encoding Transformation in Algebraic List-Decoding of Reed-Solomon Codes

Machine Learning-Aided Efficient Decoding of Reed-Muller Subcodes

On a Group Under Which Symmetric Reed-Muller Codes are Invariant

Generalized Automorphisms of Channel Codes: Properties, Code Design, and a Decoder

Dynamic Frozen-Function Design for Reed-Muller Codes With Automorphism-Based Decoding

Information sets from defining sets for Reed-Muller codes of first and second order

A proof that Reed-Muller codes achieve Shannon capacity on symmetric channels

Symbol-level Soft-Decision Decoding of Reed-Solomon Codes

Syndrome decoding of Reed-Muller codes and tensor decomposition over finite fields

Reed-Muller Identification

Geometric structure and transversal logic of quantum Reed-Muller codes

Computation with quantum Reed-Muller codes and their mapping onto 2D atom arrays

Projective Systematic Authentication via Reed-Muller Codes

Improved Generalized Automorphism Belief Propagation Decoding

A recursive construction for projective Reed-Muller codes

Polynomial Freiman-Ruzsa, Reed-Muller codes and Shannon capacity

The Re-encoding Transform in Algebraic List Decoding of Algebraic Geometric Codes.