Abstract:In this paper, we present a general method for determining the capacity of low-density parity-check (LDPC) codes under message-passing decoding when used over any binary-input memoryless channel with discrete or continuous output alphabets. Transmitting at rates below this capacity, a randomly chosen element of the given ensemble will achieve an arbitrarily small target probability of error with a probability that approaches one exponentially fast in the length of the code. (By concatenating with an appropriate outer code one can achieve a probability of error that approaches zero exponentially fast in the length of the code with arbitrarily small loss in rate.) Conversely, transmitting at rates above this capacity the probability of error is bounded away from zero by a strictly positive constant which is independent of the length of the code and of the number of iterations performed. Our results are based on the observation that the concentration of the performance of the decoder around its average performance, as observed by Luby [1] in the case of a binary-symmetric channel and a binary message-passing algorithm, is a general phenomenon. For the particularly important case of belief-propagation decoders, we provide an effective algorithm to determine the corresponding capacity to any desired degree of accuracy. The ideas presented in this paper are broadly applicable and extensions of the general method to low-density parity-check codes over larger alphabets, turbo codes, and other concatenated coding schemes are outlined.

On Decoder Ties for the Binary Symmetric Channel with Arbitrarily Distributed Input

Improved decoding algorithm of bit-interleaved coded modulationfor LDPC code

Bounds on the Decoding Error Probability of Binary Block Codes over Noncoherent Block Awgn and Fading Channels

Reed-Muller Codes on BMS Channels Achieve Vanishing Bit-Error Probability for All Rates Below Capacity

Channel MismatchEffect on Performance Oflowdensity Parity CheckCodes

Performance of Spatially-Coupled LDPC Codes and Threshold Saturation over BICM Channels

Duality of Channel Encoding and Decoding - Part I: Rate-1 Binary Convolutional Codes

Channel Mismatch Effect on Performance of Low Density Parity Check Codes

The capacity of low-density parity-check codes under message-passing decoding

New Upper Bounds on the Error Probability under ML Decoding for Spinal Codes and the Joint Transmission-Decoding System Design

LDPC Decoders Prefer More Reliable Parity Bits: Unequal Data Protection Over BSC

Tight Upper Bounds on the Error Probability of Spinal Codes over Fading Channels

Duality of Channel Encoding and Decoding - Part II: Rate-1 Non-binary Convolutional Codes

&Lt;title>map Decoding of Variable Length Codes over Noisy Channels</title>

Mismatched Multi-Letter Successive Decoding for the Multiple-Access Channel

MAP decoding of variable length codes over noisy channels

Generalized Automorphisms of Channel Codes: Properties, Code Design, and a Decoder

Sequential Transmission Over Binary Asymmetric Channels With Feedback

Joint source and channel decoding with symbol re-alignment

Mismatched Decoding: Error Exponents, Second-Order Rates and Saddlepoint Approximations

Variations on a Theme by Schalkwijk and Kailath