On the Design and Performance of Machine Learning Based Error Correcting Decoders

Yuncheng Yuan,Péter Scheepers,Lydia Tasiou,Yunus Can Gültekin,Federico Corradi,Alex Alvarado
2024-10-23
Abstract:This paper analyzes the design and competitiveness of four neural network (NN) architectures recently proposed as decoders for forward error correction (FEC) codes. We first consider the so-called single-label neural network (SLNN) and the multi-label neural network (MLNN) decoders which have been reported to achieve near maximum likelihood (ML) performance. Here, we show analytically that SLNN and MLNN decoders can always achieve ML performance, regardless of the code dimensions -- although at the cost of computational complexity -- and no training is in fact required. We then turn our attention to two transformer-based decoders: the error correction code transformer (ECCT) and the cross-attention message passing transformer (CrossMPT). We compare their performance against traditional decoders, and show that ordered statistics decoding outperforms these transformer-based decoders. The results in this paper cast serious doubts on the application of NN-based FEC decoders in the short and medium block length regime.
Signal Processing,Machine Learning
What problem does this paper attempt to address?
### What problems does this paper attempt to solve? This paper mainly explores the design and performance of four neural network (NN) - based forward error correction (FEC) decoders, aiming to evaluate their competitiveness in different scenarios. Specifically, the paper focuses on the following issues: 1. **Achievement of approximate maximum - likelihood (ML) performance**: - Investigate whether single - label neural network (SLNN) and multi - label neural network (MLNN) decoders can achieve maximum - likelihood (ML) performance without training. - Analyze the computational complexity of these decoders under different code lengths. 2. **Performance evaluation of Transformer - architecture decoders**: - Compare the performance of two Transformer - based decoders: error - correction - code Transformer (ECCT) and cross - attention message - passing Transformer (CrossMPT), with that of traditional decoders (such as the ordered - statistical decoder OSD). - Explore the practical application potential of these new decoders for short and medium - length codes. 3. **Limitations of existing NN - based FEC decoders**: - Reveal the performance bottlenecks of existing neural - network - based FEC decoders in short and medium - length codes. - Propose suggestions for future research directions, especially regarding the complexity comparison between neural - network decoders and traditional decoders. ### Main conclusions - **SLNN and MLNN decoders**: - The paper proves that SLNN and MLNN decoders can achieve ML performance without training under specific conditions, but at the cost of high computational complexity and are only applicable to short codes. - **Transformer - based decoders (ECCT and CrossMPT)**: - These decoders do not show better performance than the traditional ordered - statistical decoder (OSD) for short and medium - length codes. - For BCH(31,16) and BCH(63,51) codes, the simple OSD decoder (q = 1) outperforms ECCT and CrossMPT. - For the longer BCH(127,64) code, the performance of ECCT and CrossMPT is even worse than that of hard - decision decoding. ### Summary The paper shows through detailed analysis that in the application scenarios of short and medium - length codes, neural - network - based FEC decoders (including SLNN, MLNN, ECCT, and CrossMPT) have not yet shown an advantage over traditional decoders. Future research needs to further explore the potential of these decoders in other application scenarios and conduct accurate complexity comparisons.