464 research outputs found
Replica Analysis and Approximate Message Passing Decoder for Superposition Codes
Superposition codes are efficient for the Additive White Gaussian Noise
channel. We provide here a replica analysis of the performances of these codes
for large signals. We also consider a Bayesian Approximate Message Passing
decoder based on a belief-propagation approach, and discuss its performance
using the density evolution technic. Our main findings are 1) for the sizes we
can access, the message-passing decoder outperforms other decoders studied in
the literature 2) its performance is limited by a sharp phase transition and 3)
while these codes reach capacity as (a crucial parameter in the code)
increases, the performance of the message passing decoder worsen as the phase
transition goes to lower rates.Comment: 5 pages, 5 figures, To be presented at the 2014 IEEE International
Symposium on Information Theor
A Simple Proof of Maxwell Saturation for Coupled Scalar Recursions
Low-density parity-check (LDPC) convolutional codes (or spatially-coupled
codes) were recently shown to approach capacity on the binary erasure channel
(BEC) and binary-input memoryless symmetric channels. The mechanism behind this
spectacular performance is now called threshold saturation via spatial
coupling. This new phenomenon is characterized by the belief-propagation
threshold of the spatially-coupled ensemble increasing to an intrinsic noise
threshold defined by the uncoupled system. In this paper, we present a simple
proof of threshold saturation that applies to a wide class of coupled scalar
recursions. Our approach is based on constructing potential functions for both
the coupled and uncoupled recursions. Our results actually show that the fixed
point of the coupled recursion is essentially determined by the minimum of the
uncoupled potential function and we refer to this phenomenon as Maxwell
saturation. A variety of examples are considered including the
density-evolution equations for: irregular LDPC codes on the BEC, irregular
low-density generator matrix codes on the BEC, a class of generalized LDPC
codes with BCH component codes, the joint iterative decoding of LDPC codes on
intersymbol-interference channels with erasure noise, and the compressed
sensing of random vectors with i.i.d. components.Comment: This article is an extended journal version of arXiv:1204.5703 and
has now been accepted to the IEEE Transactions on Information Theory. This
version adds additional explanation for some details and also corrects a
number of small typo
Compressed sensing using sparse binary measurements: a rateless coding perspective
Compressed Sensing (CS) methods using sparse binary measurement matrices and iterative message-passing re- covery procedures have been recently investigated due to their low computational complexity and excellent performance. Drawing much of inspiration from sparse-graph codes such as Low-Density Parity-Check (LDPC) codes, these studies use analytical tools from modern coding theory to analyze CS solutions. In this paper, we consider and systematically analyze the CS setup inspired by a class of efficient, popular and flexible sparse-graph codes called rateless codes. The proposed rateless CS setup is asymptotically analyzed using tools such as Density Evolution and EXIT charts and fine-tuned using degree distribution optimization techniques
- …