Finding the minimum distance and decoding linear codes with Gaussian Elimination Method

Tianshuo Yang

2023-03-13

Abstract:We propose an algorithm using the Gaussian elimination method to find the minimal Hamming distance and decode received messages of linear codes. This algorithm is easy to implement as it requires no Gröbner bases to compute solutions for systems of polynomial equations

Information Theory,Cryptography and Security

What problem does this paper attempt to address?

Minimum distance computation of linear codes via genetic algorithms with permutation encoding

José Gómez-Torrecillas,F. J. Lobillo,Gabriel Navarro

DOI: https://doi.org/10.48550/arXiv.1807.07151

2018-07-19

Abstract:We design a heuristic method, a genetic algorithm, for the computation of an upper bound of the minimum distance of a linear code over a finite field. By the use of the row reduced echelon form, we obtain a permutation encoding of the problem, so that its space of solutions does not depend on the size of the base field or the dimension of the code. Actually, the efficiency of our method only grows non-polynomially with respect to the length of the code.

Information Theory
Generalized Gaussian Approximation and Its Application in Polar Decoding.

Zhihuan Zhu,Zhaoyang Zhang,Kangjian Qin,Xiong Wang

DOI: https://doi.org/10.1109/wcsp.2018.8555618

2018-01-01

Abstract:How to analyse the block error rate (BLER) of stateof-the-art successive cancellation list (SC-list) decoders has been the most appealing and challenging problem in polar coding theory. In this paper, by investigating the distributions of path metrics for each path at each decoding stage, a generalized Gaussian approximation method is proposed to obtain the distributions of log-likelihood ratio (LLR) messages calculated in a SC-list decoder. Moreover, we also adopt Monte Carlo method to validate the proposed method, based on which a framework to analyze the BLER performance of SC-list decoding is developed. Finally, numerical results show that the proposed generalized Gaussian approximation method approaches the real distribution of LLR messages in practical SC-list decoding.
On the Computing of the Minimum Distance of Linear Block Codes by Heuristic Methods

Mohamed Askali,Ahmed Azouaoui,Saïd Nouh,Mostafa Belkasmi

DOI: https://doi.org/10.48550/arXiv.1303.4375

2013-03-18

Information Theory

Abstract:The evaluation of the minimum distance of linear block codes remains an open problem in coding theory, and it is not easy to determine its true value by classical methods, for this reason the problem has been solved in the literature with heuristic techniques such as genetic algorithms and local search algorithms. In this paper we propose two approaches to attack the hardness of this problem. The first approach is based on genetic algorithms and it yield to good results comparing to another work based also on genetic algorithms. The second approach is based on a new randomized algorithm which we call Multiple Impulse Method MIM, where the principle is to search codewords locally around the all-zero codeword perturbed by a minimum level of noise, anticipating that the resultant nearest nonzero codewords will most likely contain the minimum Hamming-weight codeword whose Hamming weight is equal to the minimum distance of the linear code.
The Euclidean Algorithm for Generalized Minimum Distance Decoding of Reed-Solomon Codes

Sabine Kampf,Martin Bossert

DOI: https://doi.org/10.1109/CIG.2010.5592677

2010-06-15

Abstract:This paper presents a method to merge Generalized Minimum Distance decoding of Reed-Solomon codes with the extended Euclidean algorithm. By merge, we mean that the steps taken to perform the Generalized Minimum Distance decoding are similar to those performed by the extended Euclidean algorithm. The resulting algorithm has a complexity of O(n^2).

Information Theory
On the minimum distance of elliptic curve codes

Jiyou Li,Daqing Wan,Jun Zhang

DOI: https://doi.org/10.1109/isit.2015.7282884

2015-06-01

Abstract:Computing the minimum distance of a linear code is one of the fundamental problems in algorithmic coding theory. Vardy [1] showed that it is an NP-hard problem for general linear codes. In practice, one often uses codes with additional mathematical structure, such as cyclic codes and algebraic geometry (AG) codes, etc. In this paper, we study the minimum distance of a family of AG codes. For AG codes of genus 0 (generalized Reed-Solomon codes), the minimum distance has a simple explicit formula. An interesting result of Cheng [2] says that the minimum distance problem is already NP-hard (under RP-reduction) for general elliptic curve codes (ECAG codes, or AG codes of genus 1). In this paper, we show that the minimum distance of ECAG codes also has a simple explicit formula if the evaluation set is suitably large (at least 2/3 of the group order). Our method is purely combinatorial and based on a new sieving technique from Li-Wan [3].
A Low-Complexity Method for Evaluating the Distance Spectrum of Polar Codes

Guo Tai Chen,Lei Cao,Kangjian Qin,Zhaoyang Zhang

DOI: https://doi.org/10.1109/5gwf.2018.8516712

2018-01-01

Abstract:Different from linear block codes that may use one single generator matrix for different channel conditions, polar codes have different generator matrices for different channel conditions. Few papers investigated polar codes from the view of different distance spectrum associated with different generator matrices. Successive cancellation list (SCL) decoding was proposed to evaluate the distance spectrum of polar codes. However, the large memory requirement of SCL decoding using a large number of survival paths can be beyond the memory constraint of normal computers. One practical method to evaluate the distance spectrum of polar codes with SCL decoding was implemented with the aid of hard disk to store the immediately generated data. In this paper, we modify the algorithm of SCL decoding proposed by Tal and Vardy to largely reduce the time complexity and the required space in hard disk. With this method, we further investigate the distance spectrum of polar codes with length N = 128 and N = 256, respectively.
Fast Reliability-based Algorithm of Finding Minimum-weight Codewords for LDPC Codes

Guangwen Li,Guangzeng Feng

DOI: https://doi.org/10.48550/arXiv.0710.1589

2007-10-09

Abstract:Despite the NP hardness of acquiring minimum distance $d_m$ for linear codes theoretically, in this paper we propose one experimental method of finding minimum-weight codewords, the weight of which is equal to $d_m$ for LDPC codes. One existing syndrome decoding method, called serial belief propagation (BP) with ordered statistic decoding (OSD), is adapted to serve our purpose. We hold the conjecture that among many candidate error patterns in OSD reprocessing, modulo 2 addition of the lightest error pattern with one of the left error patterns may generate a light codeword. When the decoding syndrome changes to all-zero state, the lightest error pattern reduces to all-zero, the lightest non-zero error pattern is a valid codeword to update lightest codeword list. Given sufficient codewords sending, the survived lightest codewords are likely to be the target. Compared with existing techniques, our method demonstrates its efficiency in the simulation of several interested LDPC codes.

Information Theory
Computation and Reformation of the Minimum Distance and Check Array of QC LDPC Codes

LI Yun-jiao,YE Fan,REN Jun-yan

DOI: https://doi.org/10.19304/j.cnki.issn1000-7180.2010.06.031

2010-01-01

Abstract:Based on the principles of linear algebra and linear block codes,a method is proposed to calculate the minimum distance of a group of QC LDPC codes as well as other kinds of linear block codes.A estimation of time complexity is stated too.A method of generating larger minimum distance by reforming the check array is given for QC LDPC codes based on its special structure.
A Hypergraph Filtering Based Iterative Decoding Approach for Linear Channel Codes

Jiaqi He,Ruyuan Qu,Chongbin Xu,Hui Feng,Xin Wang

DOI: https://doi.org/10.1109/access.2021.3079283

IF: 3.9

2021-01-01

IEEE Access

Abstract:Efficient decoding for general linear channel codes has been a long standing problem. Message passing type algorithms can achieve near-optimal performance for channel codes with sparse check matrices and long code-lengths, but they may suffer from obvious performance loss when the aforementioned two conditions are not satisfied. In this paper, we propose an alternative hypergraph filtering based decoding scheme based on recently developed hypergraph signal processing (HGSP) frameworks. Specifically, we model the coded sequence as a hypergraph signal by regarding each coded bit as a vertex and representing each check constraint by a hyperedge. We then map the message passing in iterative decoding algorithms to the signal shifting in HGSP, based on which a hypergraph filtering (HF) based decoding scheme is developed. By further combining the modified random redundant iterative decoding (mRRD) technique, we finally develop a novel HF-mRRD scheme to approach the near-optimal decoding performance. Simulation results on both Hamming codes and BCH codes show that the proposed scheme obtains significant performance gains over standard message passing type algorithms, and achieve comparable or even better performance than the state-of-the-art deep learning based schemes.
A Decoding Algorithm Based on Layered Decoding and Min-max for Nonbinary LDPC Codes

Yang Wei,Zhang Wei

DOI: https://doi.org/10.3724/sp.j.1146.2012.01634

2013-01-01

Abstract:Based on decoding algorithms available nowadays, a high efficiency decoding algorithm for nonbinary low-density parity-check codes is proposed. The algorithm takes advantage of both the layered decoding algorithm and the Min-max algorithm, which not only achieves the low complexity and the low memory requirement, but also speeds up the decoding by two times. Simulations for a (620,509) code over GF(25) show that with the same bit error rate, the maximum iteration times of the proposed algorithm required is just 45%of Zhang’s algorithm presented in 2011.
Solving Ecdlp Via List Decoding

Fangguo Zhang,Shengli Liu

DOI: https://doi.org/10.1007/978-3-030-31919-9_13

2019-01-01

Abstract:We provide a new approach to the elliptic curve discrete logarithm problem (ECDLP). First, we construct Elliptic Codes (EC codes) from the ECDLP. Then we propose an algorithm of finding the minimum weight codewords for algebraic geometry codes, especially for the elliptic code, via list decoding. Finally, with the minimum weight codewords, we show how to solve ECDLP. This work may provide a potential approach to speeding up the computation of ECDLP.
An Investigation on LP Decoding of Short Binary Linear Codes with the Subgradient Method

Haiyang Liu,Xiaopeng Jiao,Lianrong Ma

DOI: https://doi.org/10.1587/transfun.2023eal2045

2023-01-01

IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences

Abstract:In this letter, we investigate the application of the subgradient method to design efficient algorithm for linear programming (LP) decoding of binary linear codes. A major drawback of the original formulation of LP decoding is that the description complexity of the feasible region is exponential in the check node degrees of the code. In order to tackle the problem, we propose a processing technique for LP decoding with the subgradient method, whose complexity is linear in the check node degrees. Consequently, a message-passing type decoding algorithm can be obtained, whose per-iteration complexity is extremely low. Moreover, if the algorithm converges to a valid codeword, it is guaranteed to be a maximum likelihood codeword. Simulation results on several binary linear codes with short lengths suggest that the performances of LP decoding based on the subgradient method and the state-of-art LP decoding implementation approach are comparable.
A simple coding-decoding algorithm for the Hamming code

Omar Khadir

DOI: https://doi.org/10.48550/arXiv.2201.02066

2022-01-06

Information Theory

Abstract:In this work, we present a new simple way to encode/decode messages transmitted via a noisy channel and protected against errors by the Hamming method. We also propose a fast and efficient algorithm for the encoding and the decoding process which do not use neither the generator matrix nor the parity-check matrix of the Hamming code.
Fast Decoding of Low Density Lattice Codes

Shuiyin Liu,Yi Hong,Emanuele Viterbo,Alessia Marelli,Rino Micheloni

DOI: https://doi.org/10.48550/arXiv.1806.05524

2018-06-14

Information Theory

Abstract:Low density lattice codes (LDLC) are a family of lattice codes that can be decoded efficiently using a message-passing algorithm. In the original LDLC decoder, the message exchanged between variable nodes and check nodes are continuous functions, which must be approximated in practice. A promising method is Gaussian approximation (GA), where the messages are approximated by Gaussian functions. However, current GA-based decoders share two weaknesses: firstly, the convergence of these approximate decoders is unproven; secondly, the best known decoder requires $O(2^d)$ operations at each variable node, where $d$ is the degree of LDLC. It means that existing decoders are very slow for long codes with large $d$. The contribution of this paper is twofold: firstly, we prove that all GA-based LDLC decoders converge sublinearly (or faster) in the high signal-to-noise ratio (SNR) region; secondly, we propose a novel GA-based LDLC decoder which requires only $O(d)$ operations at each variable node. Simulation results confirm that the error correcting performance of proposed decoder is the same as the best known decoder, but with a much lower decoding complexity.
A PDD Decoder for Binary Linear Codes With Neural Check Polytope Projection

Yi Wei,Ming-Min Zhao,Min-Jian Zhao,Ming Lei

DOI: https://doi.org/10.48550/arXiv.2006.06240

2020-06-11

Abstract:Linear Programming (LP) is an important decoding technique for binary linear codes. However, the advantages of LP decoding, such as low error floor and strong theoretical guarantee, etc., come at the cost of high computational complexity and poor performance at the low signal-to-noise ratio (SNR) region. In this letter, we adopt the penalty dual decomposition (PDD) framework and propose a PDD algorithm to address the fundamental polytope based maximum likelihood (ML) decoding problem. Furthermore, we propose to integrate machine learning techniques into the most time-consuming part of the PDD decoding algorithm, i.e., check polytope projection (CPP). Inspired by the fact that a multi-layer perception (MLP) can theoretically approximate any nonlinear mapping function, we present a specially designed neural CPP (NCPP) algorithm to decrease the decoding latency. Simulation results demonstrate the effectiveness of the proposed algorithms.

Signal Processing,Information Theory,Machine Learning
Two Efficient Algorithms Based on Majority-Logic and Min-Sum Algorithms for Ldpc Codes

Zuotao Zhang,Yibo Fang,Guanghui Liu

DOI: https://doi.org/10.1109/wicom.2012.6478732

2012-01-01

Abstract:Recently, an iterative soft information reliability-based majority-logic (ISRB-MLG) decoding algorithm was proposed for Euclidean geometry LDPC (EG-LDPC) and Projective geometry LDPC (PG-LDPC) codes. This paper first presents an iterative soft information reliability-based min-sum (ISRB-MS) decoding algorithm based on ISRB-MLG and traditional min-sum decoding algorithm. The performance of ISRB-MS algorithm is greatly improved with a little more complexity than ISRB-MLG algorithm, it mainly needs integer additions and logical operations. Different from traditional min-sum decoding algorithm, the extrinsic information transfer of ISRB-MS algorithm is simplified, we use the full information that all check nodes pass rather than the extrinsic information to update the bit nodes information. Then a modified iterative soft information reliability-based min-sum (MISRB-MS) decoding algorithm is proposed. Compared to (ISRB-MS) algorithm, MISRB-MS algorithm multiplies a scaling factor, so it needs some extra multiplication, but it achieves better performance. Simulation results show that the two algorithms achieve excellent performance and fast convergence rate, they only needs about 10 iterations, if an appropriate scaling factor is chosen, the performance of MISRB-MS algorithm very closes to that of sum-product algorithm (SPA).
Proving Information Inequalities by Gaussian Elimination

Laigang Guo,Raymond W. Yeung,Xiao-Shan Gao

2024-01-26

Abstract:The proof of information inequalities and identities under linear constraints on the information measures is an important problem in information theory. For this purpose, ITIP and other variant algorithms have been developed and implemented, which are all based on solving a linear program (LP). In this paper, we develop a method with symbolic computation. Compared with the known methods, our approach can completely avoids the use of linear programming which may cause numerical errors. Our procedures are also more efficient computationally.

Information Theory
Computer classification of linear codes based on lattice point enumeration and integer linear programming

Sascha Kurz

2024-03-26

Abstract:Linear codes play a central role in coding theory and have applications in several branches of mathematics. For error correction purposes the minimum Hamming distance should be as large as possible. Linear codes related to applications in Galois Geometry often require a certain divisibility of the occurring weights. In this paper we present an algorithmic framework for the classification of linear codes over finite fields with restricted sets of weights. The underlying algorithms are based on lattice point enumeration and integer linear programming. We present new enumeration and non-existence results for projective two-weight codes, divisible codes, and additive $\mathbb{F}_4$-codes.

Information Theory,Combinatorics
Capacity-Approaching Polar Codes with Long Codewords and Successive Cancellation Decoding Based on Improved Gaussian Approximation

Hideki Ochiai,Patrick Mitran,H. Vincent Poor

DOI: https://doi.org/10.48550/arXiv.1912.00098

2020-10-07

Abstract:This paper focuses on an improved Gaussian approximation (GA) based construction of polar codes with successive cancellation (SC) decoding over an additive white Gaussian noise (AWGN) channel. Arikan has proven that polar codes with low-complexity SC decoder can approach the channel capacity of an arbitrary symmetric binary-input discrete memoryless channel, provided that the code length is chosen large enough. Nevertheless, how to construct such codes over an AWGN channel with low computational effort has been an open problem. Compared to density evolution, the GA is known as a low complexity yet powerful technique that traces the evolution of the mean log likelihood ratio (LLR) value by iterating a nonlinear function. Therefore, its high-precision numerical evaluation is critical as the code length increases. In this work, by analyzing the asymptotic behavior of this nonlinear function, we propose an improved GA approach that makes an accurate trace of mean LLR evolution feasible. With this improved GA, through numerical analysis and simulations with code lengths up to $N=2^{18}$, we explicitly demonstrate that various code-rate polar codes with long codeword and capacity approaching behavior can be easily designed.

Information Theory
Construction and Fast Decoding of Binary Linear Sum-Rank-Metric Codes

Hao Chen,Yanfeng Qi,Zhiqiang Cheng

2024-04-04

Abstract:Sum-rank-metric codes have wide applications in the multishot network coding and the distributed storage. Linearized Reed-Solomon codes, sum-rank BCH codes and their Welch-Berlekamp type decoding algorithms were proposed and studied. They are sum-rank versions of Reed-Solomon codes and BCH codes in the Hamming metric. In this paper, we construct binary linear sum-rank-metric codes of the matrix size $2 \times 2$, from BCH, Goppa and additive quaternary Hamming metric codes. Larger sum-rank-metric codes than these sum-rank BCH codes of the same minimum sum-rank distances are obtained. Then a reduction of the decoding in the sum-rank-metric to the decoding in the Hamming metric is given. Fast decoding algorithms of BCH and Goppa type binary linear sum-rank-metric codes of the block length $t$ and the matrix size $2 \times 2$, which are better than these sum-rank BCH codes, are presented. These fast decoding algorithms for BCH and Goppa type binary linear sum-rank-metric codes of the matrix size $2 \times 2$ need at most $O(t^2)$ operations in the field ${\bf F}_4$. Asymptotically good sequences of quadratic-time encodable and decodable binary linear sum-rank-metric codes of the matrix size $2 \times 2$ satisfying $$R_{sr}(\delta_{sr}) \geq 1-\frac{1}{2}(H_4(\frac{4}{3}\delta_{sr})+H_4(2\delta_{sr})),$$ can be constructed from Goppa codes.

Information Theory

Finding the minimum distance and decoding linear codes with Gaussian Elimination Method

Minimum distance computation of linear codes via genetic algorithms with permutation encoding

Generalized Gaussian Approximation and Its Application in Polar Decoding.

On the Computing of the Minimum Distance of Linear Block Codes by Heuristic Methods

The Euclidean Algorithm for Generalized Minimum Distance Decoding of Reed-Solomon Codes

On the minimum distance of elliptic curve codes

A Low-Complexity Method for Evaluating the Distance Spectrum of Polar Codes

Fast Reliability-based Algorithm of Finding Minimum-weight Codewords for LDPC Codes

Computation and Reformation of the Minimum Distance and Check Array of QC LDPC Codes

A Hypergraph Filtering Based Iterative Decoding Approach for Linear Channel Codes

A Decoding Algorithm Based on Layered Decoding and Min-max for Nonbinary LDPC Codes

Solving Ecdlp Via List Decoding

An Investigation on LP Decoding of Short Binary Linear Codes with the Subgradient Method

A simple coding-decoding algorithm for the Hamming code

Fast Decoding of Low Density Lattice Codes

A PDD Decoder for Binary Linear Codes With Neural Check Polytope Projection

Two Efficient Algorithms Based on Majority-Logic and Min-Sum Algorithms for Ldpc Codes

Proving Information Inequalities by Gaussian Elimination

Computer classification of linear codes based on lattice point enumeration and integer linear programming

Capacity-Approaching Polar Codes with Long Codewords and Successive Cancellation Decoding Based on Improved Gaussian Approximation

Construction and Fast Decoding of Binary Linear Sum-Rank-Metric Codes