Abstract:In this paper, we present a general method for determining the capacity of low-density parity-check (LDPC) codes under message-passing decoding when used over any binary-input memoryless channel with discrete or continuous output alphabets. Transmitting at rates below this capacity, a randomly chosen element of the given ensemble will achieve an arbitrarily small target probability of error with a probability that approaches one exponentially fast in the length of the code. (By concatenating with an appropriate outer code one can achieve a probability of error that approaches zero exponentially fast in the length of the code with arbitrarily small loss in rate.) Conversely, transmitting at rates above this capacity the probability of error is bounded away from zero by a strictly positive constant which is independent of the length of the code and of the number of iterations performed. Our results are based on the observation that the concentration of the performance of the decoder around its average performance, as observed by Luby [1] in the case of a binary-symmetric channel and a binary message-passing algorithm, is a general phenomenon. For the particularly important case of belief-propagation decoders, we provide an effective algorithm to determine the corresponding capacity to any desired degree of accuracy. The ideas presented in this paper are broadly applicable and extensions of the general method to low-density parity-check codes over larger alphabets, turbo codes, and other concatenated coding schemes are outlined.

Graph-Cover Decoding and Finite-Length Analysis of Message-Passing Iterative Decoding of LDPC Codes

VLSI Decoding Design of Low-Density Parity-Check Codes Based on Circulant Matrices

Improved Decoding Approach of Low-Density Parity-Check Codes with Finite Precision

Locally-Optimized Reweighted Belief Propagation for Decoding LDPC Codes with Finite-Length

Deriving Good LDPC Convolutional Codes from LDPC Block Codes

The capacity of low-density parity-check codes under message-passing decoding

On the Total-Power Capacity of Regular-LDPC Codes with Iterative Message-Passing Decoders

Linear Time Encoding of LDPC Codes

Performance analysis of finite-length LDPC codes

An Improved Decoding Algorithm for Finite-Geometry LDPC Codes.

Multistep Linear Programming Approaches for Decoding Low-Density Parity-Check Codes

On the minimum pseudo-codewords of LDPC codes

LDPC Codes Achieve List Decoding Capacity

On the Stopping Sets of Finite Plane LDPC Codes

Improved Linear Programming Decoding of LDPC Codes and Bounds on the Minimum and Fractional Distance

Minimum Pseudo-Weight and Minimum Pseudo-Codewords of LDPC Codes

Finite-Length Analysis for Spatially Coupled LDPC Codes Based on Base Matrix

On Pseudocodewords and Decision Regions of Linear Programming Decoding of HDPC Codes

A Separation Algorithm for Improved LP-Decoding of Linear Block Codes

On the Decomposition Method for Linear Programming Decoding of LDPC Codes

Sparse Decoding of Low Density Parity Check Codes Using Margin Propagation