706 research outputs found
Coding for Parallel Channels: Gallager Bounds for Binary Linear Codes with Applications to Repeat-Accumulate Codes and Variations
This paper is focused on the performance analysis of binary linear block
codes (or ensembles) whose transmission takes place over independent and
memoryless parallel channels. New upper bounds on the maximum-likelihood (ML)
decoding error probability are derived. These bounds are applied to various
ensembles of turbo-like codes, focusing especially on repeat-accumulate codes
and their recent variations which possess low encoding and decoding complexity
and exhibit remarkable performance under iterative decoding. The framework of
the second version of the Duman and Salehi (DS2) bounds is generalized to the
case of parallel channels, along with the derivation of their optimized tilting
measures. The connection between the generalized DS2 and the 1961 Gallager
bounds, addressed by Divsalar and by Sason and Shamai for a single channel, is
explored in the case of an arbitrary number of independent parallel channels.
The generalization of the DS2 bound for parallel channels enables to re-derive
specific bounds which were originally derived by Liu et al. as special cases of
the Gallager bound. In the asymptotic case where we let the block length tend
to infinity, the new bounds are used to obtain improved inner bounds on the
attainable channel regions under ML decoding. The tightness of the new bounds
for independent parallel channels is exemplified for structured ensembles of
turbo-like codes. The improved bounds with their optimized tilting measures
show, irrespectively of the block length of the codes, an improvement over the
union bound and other previously reported bounds for independent parallel
channels; this improvement is especially pronounced for moderate to large block
lengths.Comment: Submitted to IEEE Trans. on Information Theory, June 2006 (57 pages,
9 figures
Refinement of the random coding bound
An improved pre-factor for the random coding bound is proved. Specifically,
for channels with critical rate not equal to capacity, if a regularity
condition is satisfied (resp. not satisfied), then for any a
pre-factor of (resp. ) is achievable for rates above the
critical rate, where and is the blocklength and rate, respectively. The
extra term is related to the slope of the random coding
exponent. Further, the relation of these bounds with the authors' recent
refinement of the sphere-packing bound, as well as the pre-factor for the
random coding bound below the critical rate, is discussed.Comment: Submitted to IEEE Trans. Inform. Theor
Tight bounds for LDPC and LDGM codes under MAP decoding
A new method for analyzing low density parity check (LDPC) codes and low
density generator matrix (LDGM) codes under bit maximum a posteriori
probability (MAP) decoding is introduced. The method is based on a rigorous
approach to spin glasses developed by Francesco Guerra. It allows to construct
lower bounds on the entropy of the transmitted message conditional to the
received one. Based on heuristic statistical mechanics calculations, we
conjecture such bounds to be tight. The result holds for standard irregular
ensembles when used over binary input output symmetric channels. The method is
first developed for Tanner graph ensembles with Poisson left degree
distribution. It is then generalized to `multi-Poisson' graphs, and, by a
completion procedure, to arbitrary degree distribution.Comment: 28 pages, 9 eps figures; Second version contains a generalization of
the previous resul
Spatially Coupled LDPC Codes Constructed from Protographs
In this paper, we construct protograph-based spatially coupled low-density
parity-check (SC-LDPC) codes by coupling together a series of L disjoint, or
uncoupled, LDPC code Tanner graphs into a single coupled chain. By varying L,
we obtain a flexible family of code ensembles with varying rates and frame
lengths that can share the same encoding and decoding architecture for
arbitrary L. We demonstrate that the resulting codes combine the best features
of optimized irregular and regular codes in one design: capacity approaching
iterative belief propagation (BP) decoding thresholds and linear growth of
minimum distance with block length. In particular, we show that, for
sufficiently large L, the BP thresholds on both the binary erasure channel
(BEC) and the binary-input additive white Gaussian noise channel (AWGNC)
saturate to a particular value significantly better than the BP decoding
threshold and numerically indistinguishable from the optimal maximum
a-posteriori (MAP) decoding threshold of the uncoupled LDPC code. When all
variable nodes in the coupled chain have degree greater than two,
asymptotically the error probability converges at least doubly exponentially
with decoding iterations and we obtain sequences of asymptotically good LDPC
codes with fast convergence rates and BP thresholds close to the Shannon limit.
Further, the gap to capacity decreases as the density of the graph increases,
opening up a new way to construct capacity achieving codes on memoryless
binary-input symmetric-output (MBS) channels with low-complexity BP decoding.Comment: Submitted to the IEEE Transactions on Information Theor
Improved error bounds for the erasure/list scheme: the binary and spherical cases
We derive improved bounds on the error and erasure rate for spherical codes
and for binary linear codes under Forney's erasure/list decoding scheme and
prove some related results.Comment: 18 pages, 3 figures. Submitted to IEEE Transactions on Informatin
Theory in May 2001, will appear in Oct. 2004 (tentative
- β¦