172 research outputs found
Nonbinary Spatially-Coupled LDPC Codes on the Binary Erasure Channel
We analyze the asymptotic performance of nonbinary spatially-coupled
low-density parity-check (SC-LDPC) codes built on the general linear group,
when the transmission takes place over the binary erasure channel. We propose
an efficient method to derive an upper bound to the maximum a posteriori
probability (MAP) threshold for nonbinary LDPC codes, and observe that the MAP
performance of regular LDPC codes improves with the alphabet size. We then
consider nonbinary SC-LDPC codes. We show that the same threshold saturation
effect experienced by binary SC-LDPC codes occurs for the nonbinary codes,
hence we conjecture that the BP threshold for large termination length
approaches the MAP threshold of the underlying regular ensemble.Comment: Submitted to IEEE International Conference on Communications 201
New Codes on Graphs Constructed by Connecting Spatially Coupled Chains
A novel code construction based on spatially coupled low-density parity-check
(SC-LDPC) codes is presented. The proposed code ensembles are described by
protographs, comprised of several protograph-based chains characterizing
individual SC-LDPC codes. We demonstrate that code ensembles obtained by
connecting appropriately chosen SC-LDPC code chains at specific points have
improved iterative decoding thresholds compared to those of single SC-LDPC
coupled chains. In addition, it is shown that the improved decoding properties
of the connected ensembles result in reduced decoding complexity required to
achieve a specific bit error probability. The constructed ensembles are also
asymptotically good, in the sense that the minimum distance grows linearly with
the block length. Finally, we show that the improved asymptotic properties of
the connected chain ensembles also translate into improved finite length
performance.Comment: Submitted to IEEE Transactions on Information Theor
Capacity-achieving ensembles for the binary erasure channel with bounded complexity
We present two sequences of ensembles of non-systematic irregular
repeat-accumulate codes which asymptotically (as their block length tends to
infinity) achieve capacity on the binary erasure channel (BEC) with bounded
complexity per information bit. This is in contrast to all previous
constructions of capacity-achieving sequences of ensembles whose complexity
grows at least like the log of the inverse of the gap (in rate) to capacity.
The new bounded complexity result is achieved by puncturing bits, and allowing
in this way a sufficient number of state nodes in the Tanner graph representing
the codes. We also derive an information-theoretic lower bound on the decoding
complexity of randomly punctured codes on graphs. The bound holds for every
memoryless binary-input output-symmetric channel and is refined for the BEC.Comment: 47 pages, 9 figures. Submitted to IEEE Transactions on Information
Theor
Spatially Coupled LDPC Codes Constructed from Protographs
In this paper, we construct protograph-based spatially coupled low-density
parity-check (SC-LDPC) codes by coupling together a series of L disjoint, or
uncoupled, LDPC code Tanner graphs into a single coupled chain. By varying L,
we obtain a flexible family of code ensembles with varying rates and frame
lengths that can share the same encoding and decoding architecture for
arbitrary L. We demonstrate that the resulting codes combine the best features
of optimized irregular and regular codes in one design: capacity approaching
iterative belief propagation (BP) decoding thresholds and linear growth of
minimum distance with block length. In particular, we show that, for
sufficiently large L, the BP thresholds on both the binary erasure channel
(BEC) and the binary-input additive white Gaussian noise channel (AWGNC)
saturate to a particular value significantly better than the BP decoding
threshold and numerically indistinguishable from the optimal maximum
a-posteriori (MAP) decoding threshold of the uncoupled LDPC code. When all
variable nodes in the coupled chain have degree greater than two,
asymptotically the error probability converges at least doubly exponentially
with decoding iterations and we obtain sequences of asymptotically good LDPC
codes with fast convergence rates and BP thresholds close to the Shannon limit.
Further, the gap to capacity decreases as the density of the graph increases,
opening up a new way to construct capacity achieving codes on memoryless
binary-input symmetric-output (MBS) channels with low-complexity BP decoding.Comment: Submitted to the IEEE Transactions on Information Theor
On Universal Properties of Capacity-Approaching LDPC Ensembles
This paper is focused on the derivation of some universal properties of
capacity-approaching low-density parity-check (LDPC) code ensembles whose
transmission takes place over memoryless binary-input output-symmetric (MBIOS)
channels. Properties of the degree distributions, graphical complexity and the
number of fundamental cycles in the bipartite graphs are considered via the
derivation of information-theoretic bounds. These bounds are expressed in terms
of the target block/ bit error probability and the gap (in rate) to capacity.
Most of the bounds are general for any decoding algorithm, and some others are
proved under belief propagation (BP) decoding. Proving these bounds under a
certain decoding algorithm, validates them automatically also under any
sub-optimal decoding algorithm. A proper modification of these bounds makes
them universal for the set of all MBIOS channels which exhibit a given
capacity. Bounds on the degree distributions and graphical complexity apply to
finite-length LDPC codes and to the asymptotic case of an infinite block
length. The bounds are compared with capacity-approaching LDPC code ensembles
under BP decoding, and they are shown to be informative and are easy to
calculate. Finally, some interesting open problems are considered.Comment: Published in the IEEE Trans. on Information Theory, vol. 55, no. 7,
pp. 2956 - 2990, July 200
Capacity-Achieving Ensembles of Accumulate-Repeat-Accumulate Codes for the Erasure Channel with Bounded Complexity
The paper introduces ensembles of accumulate-repeat-accumulate (ARA) codes
which asymptotically achieve capacity on the binary erasure channel (BEC) with
{\em bounded complexity}, per information bit, of encoding and decoding. It
also introduces symmetry properties which play a central role in the
construction of capacity-achieving ensembles for the BEC with bounded
complexity. The results here improve on the tradeoff between performance and
complexity provided by previous constructions of capacity-achieving ensembles
of codes defined on graphs. The superiority of ARA codes with moderate to large
block length is exemplified by computer simulations which compare their
performance with those of previously reported capacity-achieving ensembles of
LDPC and IRA codes. The ARA codes also have the advantage of being systematic.Comment: Submitted to IEEE Trans. on Information Theory, December 1st, 2005.
Includes 50 pages and 13 figure
Rate-Equivocation Optimal Spatially Coupled LDPC Codes for the BEC Wiretap Channel
We consider transmission over a wiretap channel where both the main channel
and the wiretapper's channel are Binary Erasure Channels (BEC). We use
convolutional LDPC ensembles based on the coset encoding scheme. More
precisely, we consider regular two edge type convolutional LDPC ensembles. We
show that such a construction achieves the whole rate-equivocation region of
the BEC wiretap channel.
Convolutional LDPC ensemble were introduced by Felstr\"om and Zigangirov and
are known to have excellent thresholds. Recently, Kudekar, Richardson, and
Urbanke proved that the phenomenon of "Spatial Coupling" converts MAP threshold
into BP threshold for transmission over the BEC.
The phenomenon of spatial coupling has been observed to hold for general
binary memoryless symmetric channels. Hence, we conjecture that our
construction is a universal rate-equivocation achieving construction when the
main channel and wiretapper's channel are binary memoryless symmetric channels,
and the wiretapper's channel is degraded with respect to the main channel.Comment: Working pape
The Generalized Area Theorem and Some of its Consequences
There is a fundamental relationship between belief propagation and maximum a
posteriori decoding. The case of transmission over the binary erasure channel
was investigated in detail in a companion paper. This paper investigates the
extension to general memoryless channels (paying special attention to the
binary case). An area theorem for transmission over general memoryless channels
is introduced and some of its many consequences are discussed. We show that
this area theorem gives rise to an upper-bound on the maximum a posteriori
threshold for sparse graph codes. In situations where this bound is tight, the
extrinsic soft bit estimates delivered by the belief propagation decoder
coincide with the correct a posteriori probabilities above the maximum a
posteriori threshold. More generally, it is conjectured that the fundamental
relationship between the maximum a posteriori and the belief propagation
decoder which was observed for transmission over the binary erasure channel
carries over to the general case. We finally demonstrate that in order for the
design rate of an ensemble to approach the capacity under belief propagation
decoding the component codes have to be perfectly matched, a statement which is
well known for the special case of transmission over the binary erasure
channel.Comment: 27 pages, 46 ps figure
- …