Abstract:Since the work of Polyanskiy, Poor and Verdú on the finite blocklength performance of capacity-achieving codes for discrete memoryless channels, many papers have attempted to find further results for more practically relevant channels. However, it seems that the complexity of computing capacity-achieving codes has not been investigated until now. We study this question for the simplest non-trivial Gaussian channels, i.e., the additive colored Gaussian noise channel. To assess the computational complexity, we consider the classes $\mathrm{FP}_1$ and $\#\mathrm{P}_1$. $\mathrm{FP}_1$ includes functions computable by a deterministic Turing machine in polynomial time, whereas $\#\mathrm{P}_1$ encompasses functions that count the number of solutions verifiable in polynomial time. It is widely assumed that $\mathrm{FP}_1\neq\#\mathrm{P}_1$. It is of interest to determine the conditions under which, for a given $M \in \mathbb{N}$, where $M$ describes the precision of the deviation of $C(P,N)$, for a certain blocklength $n_M$ and a decoding error $\epsilon > 0$ with $\epsilon\in\mathbb{Q}$, the following holds: $R_{n_M}(\epsilon)>C(P,N)-\frac{1}{2^M}$. It is shown that there is a polynomial-time computable $N_*$ such that for sufficiently large $P_*\in\mathbb{Q}$, the sequences $\{R_{n_M}(\epsilon)\}_{{n_M}\in\mathbb{N}}$, where each $R_{n_M}(\epsilon)$ satisfies the previous condition, cannot be computed in polynomial time if $\mathrm{FP}_1\neq\#\mathrm{P}_1$. Hence, the complexity of computing the sequence $\{R_{n_M}(\epsilon)\}_{n_M\in\mathbb{N}}$ grows faster than any polynomial as $M$ increases. Consequently, it is shown that either the sequence of achievable rates $\{R_{n_M}(\epsilon)\}_{n_M\in\mathbb{N}}$ as a function of the blocklength, or the sequence of blocklengths $\{n_M\}_{M\in\mathbb{N}}$ corresponding to the achievable rates, is not a polynomial-time computable sequence.

Systematic Transmission With Fountain Parity Checks for Erasure Channels With Stop Feedback

Variable-Length Codes with Bursty Feedback

Variable-Length Feedback Codes over Known and Unknown Channels with Non-vanishing Error Probabilities

Sequential Transmission Over Binary Asymmetric Channels With Feedback

Variable-Length Sparse Feedback Codes for Point-to-Point, Multiple Access, and Random Access Channels

The capacity of low-density parity-check codes under message-passing decoding

Unequal Error Protection Achieves Threshold Gains on BEC and BSC via Higher Fidelity Messages

An Achievability Bound for Variable-Length Stop-Feedback Coding over the Gaussian Channel

Learning Channel Codes from Data: Performance Guarantees in the Finite Blocklength Regime

A Unified Expression for Upper Bounds on the BLER of Spinal Codes over Fading Channels

Balancing forward and feedback error correction for erasure channels with unreliable feedback

Fountain Uncorrectable Sets and Finite-Length Analysis

On the Throughput of Channels That Wear Out

A proof that Reed-Muller codes achieve Shannon capacity on symmetric channels

Streaming Codes for Channels with Burst and Isolated Erasures

Multiplexed Streaming Codes for Messages with Different Decoding Delays in Channel with Burst and Random Erasures

Variable Length Coding over the Two-User Multiple-Access Channel

Linear Network Code for Erasure Broadcast Channel with Feedback: Complexity and Algorithms

Erasure Codes with a Banded Structure for Hybrid Iterative-ML Decoding

Finite Blocklength Performance of Capacity-achieving Codes in the Light of Complexity Theory

Design of Convergence-Optimized Non-Binary LDPC Codes over Binary Erasure Channel