435 research outputs found
On Universal Properties of Capacity-Approaching LDPC Ensembles
This paper is focused on the derivation of some universal properties of
capacity-approaching low-density parity-check (LDPC) code ensembles whose
transmission takes place over memoryless binary-input output-symmetric (MBIOS)
channels. Properties of the degree distributions, graphical complexity and the
number of fundamental cycles in the bipartite graphs are considered via the
derivation of information-theoretic bounds. These bounds are expressed in terms
of the target block/ bit error probability and the gap (in rate) to capacity.
Most of the bounds are general for any decoding algorithm, and some others are
proved under belief propagation (BP) decoding. Proving these bounds under a
certain decoding algorithm, validates them automatically also under any
sub-optimal decoding algorithm. A proper modification of these bounds makes
them universal for the set of all MBIOS channels which exhibit a given
capacity. Bounds on the degree distributions and graphical complexity apply to
finite-length LDPC codes and to the asymptotic case of an infinite block
length. The bounds are compared with capacity-approaching LDPC code ensembles
under BP decoding, and they are shown to be informative and are easy to
calculate. Finally, some interesting open problems are considered.Comment: Published in the IEEE Trans. on Information Theory, vol. 55, no. 7,
pp. 2956 - 2990, July 200
Finite Length Analysis of LDPC Codes
In this paper, we study the performance of finite-length LDPC codes in the
waterfall region. We propose an algorithm to predict the error performance of
finite-length LDPC codes over various binary memoryless channels. Through
numerical results, we find that our technique gives better performance
prediction compared to existing techniques.Comment: Submitted to WCNC 201
Capacity-Achieving Codes with Bounded Graphical Complexity on Noisy Channels
We introduce a new family of concatenated codes with an outer low-density
parity-check (LDPC) code and an inner low-density generator matrix (LDGM) code,
and prove that these codes can achieve capacity under any memoryless
binary-input output-symmetric (MBIOS) channel using maximum-likelihood (ML)
decoding with bounded graphical complexity, i.e., the number of edges per
information bit in their graphical representation is bounded. In particular, we
also show that these codes can achieve capacity on the binary erasure channel
(BEC) under belief propagation (BP) decoding with bounded decoding complexity
per information bit per iteration for all erasure probabilities in (0, 1). By
deriving and analyzing the average weight distribution (AWD) and the
corresponding asymptotic growth rate of these codes with a rate-1 inner LDGM
code, we also show that these codes achieve the Gilbert-Varshamov bound with
asymptotically high probability. This result can be attributed to the presence
of the inner rate-1 LDGM code, which is demonstrated to help eliminate high
weight codewords in the LDPC code while maintaining a vanishingly small amount
of low weight codewords.Comment: 17 pages, 2 figures. This paper is to be presented in the 43rd Annual
Allerton Conference on Communication, Control and Computing, Monticello, IL,
USA, Sept. 28-30, 200
Effects of Single-Cycle Structure on Iterative Decoding for Low-Density Parity-Check Codes
We consider communication over the binary erasure channel (BEC) using
low-density parity-check (LDPC) codes and belief propagation (BP) decoding. For
fixed numbers of BP iterations, the bit error probability approaches a limit as
blocklength tends to infinity, and the limit is obtained via density evolution.
On the other hand, the difference between the bit error probability of codes
with blocklength and that in the large blocklength limit is asymptotically
where denotes a
specific constant determined by the code ensemble considered, the number of
iterations, and the erasure probability of the BEC. In this paper,
we derive a set of recursive formulas which allows evaluation of the constant
for standard irregular ensembles. The dominant difference
can be considered as effects of cycle-free and
single-cycle structures of local graphs. Furthermore, it is confirmed via
numerical simulations that estimation of the bit error probability using
is accurate even for small blocklengths.Comment: 16 pages, 7 figures, submitted to IEEE Transactions on Information
Theor
- …