Exponential bounds on error probability with Feedback

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2011.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Cataloged from student submitted PDF version of thesis.Includes bibliographical references (p. 95-97).Feedback is useful in memoryless channels for decreasing complexity and increasing reliability; the capacity of the memoryless channels, however, can not be increased by feedback. For fixed length block codes even the decay rate of error probability with block length does not increase with feedback for most channel models. Consequently for making the physical layer more reliable for higher layers one needs go beyond the framework of fixed length block codes and consider relaxations like variable-length coding, error- erasure decoding. We strengthen and quantify this observation by investigating three problems. 1. Error-Erasure Decoding for Fixed-Length Block Codes with Feedback: Error-erasure codes with communication and control phases, introduced by Yamamoto and Itoh, are building blocks for optimal variable-length block codes. We improve their performance by changing the decoding scheme and tuning the durations of the phases, and establish inner bounds to the tradeoff between error exponent, erasure exponent and rate. We bound the loss of performance due to the encoding scheme of Yamamoto-Itoh from above by deriving outer bounds to the tradeoff between error exponent, erasure exponent and rate both with and without feedback. We also consider the zero error codes with erasures and establish inner and outer bounds to the optimal erasure exponent of zero error codes. In addition we present a proof of the long known fact that, the error exponent tradeoff between two messages is not improved with feedback. 2. Unequal Error Protection for Variable-Length Block Codes with Feedback: We use Kudrayashov's idea of implicit confirmations and explicit rejections in the framework of unequal error protection to establish inner bounds to the achievable pairs of rate vectors and error exponent vectors. Then we derive an outer bound that matches the inner bound using a new bounding technique. As a result we characterize the region of achievable rate vector and error exponent vector pairs for bit-wise unequal error protection problem for variable-length block codes with feedback. Furthermore we consider the single message message-wise unequal error protection problem and determine an analytical expression for the missed detection exponent in terms of rate and error exponent, for variable-length block codes with feedback. 3. Feedback Encoding Schemes for Fixed-Length Block Codes: We modify the analysis technique of Gallager to bound the error probability of feedback encoding schemes. Using the encoding schemes suggested by Zigangirov, D'yachkov and Burnashev we recover or improve all previously known lower bounds on the error exponents of fixedlength block codes.by Bariş Nakiboḡlu.Ph.D

Error-and-Erasure Decoding for Block Codes with Feedback

Inner and outer bounds are derived on the optimal performance of fixed length block codes on discrete memoryless channels with feedback and errors-and-erasures decoding. First an inner bound is derived using a two phase encoding scheme with communication and control phases together with the optimal decoding rule for the given encoding scheme, among decoding rules that can be represented in terms of pairwise comparisons between the messages. Then an outer bound is derived using a generalization of the straight-line bound to errors-and-erasures decoders and the optimal error exponent trade off of a feedback encoder with two messages. In addition upper and lower bounds are derived, for the optimal erasure exponent of error free block codes in terms of the rate. Finally we present a proof of the fact that the optimal trade off between error exponents of a two message code does not increase with feedback on DMCs.Comment: 33 pages, 1 figure

Error Correcting Codes for Distributed Control

The problem of stabilizing an unstable plant over a noisy communication link is an increasingly important one that arises in applications of networked control systems. Although the work of Schulman and Sahai over the past two decades, and their development of the notions of "tree codes"\phantom{} and "anytime capacity", provides the theoretical framework for studying such problems, there has been scant practical progress in this area because explicit constructions of tree codes with efficient encoding and decoding did not exist. To stabilize an unstable plant driven by bounded noise over a noisy channel one needs real-time encoding and real-time decoding and a reliability which increases exponentially with decoding delay, which is what tree codes guarantee. We prove that linear tree codes occur with high probability and, for erasure channels, give an explicit construction with an expected decoding complexity that is constant per time instant. We give novel sufficient conditions on the rate and reliability required of the tree codes to stabilize vector plants and argue that they are asymptotically tight. This work takes an important step towards controlling plants over noisy channels, and we demonstrate the efficacy of the method through several examples.Comment: 39 page

Spatially-Coupled Random Access on Graphs

In this paper we investigate the effect of spatial coupling applied to the recently-proposed coded slotted ALOHA (CSA) random access protocol. Thanks to the bridge between the graphical model describing the iterative interference cancelation process of CSA over the random access frame and the erasure recovery process of low-density parity-check (LDPC) codes over the binary erasure channel (BEC), we propose an access protocol which is inspired by the convolutional LDPC code construction. The proposed protocol exploits the terminations of its graphical model to achieve the spatial coupling effect, attaining performance close to the theoretical limits of CSA. As for the convolutional LDPC code case, large iterative decoding thresholds are obtained by simply increasing the density of the graph. We show that the threshold saturation effect takes place by defining a suitable counterpart of the maximum-a-posteriori decoding threshold of spatially-coupled LDPC code ensembles. In the asymptotic setting, the proposed scheme allows sustaining a traffic close to 1 [packets/slot].Comment: To be presented at IEEE ISIT 2012, Bosto

First-Passage Time and Large-Deviation Analysis for Erasure Channels with Memory

This article considers the performance of digital communication systems transmitting messages over finite-state erasure channels with memory. Information bits are protected from channel erasures using error-correcting codes; successful receptions of codewords are acknowledged at the source through instantaneous feedback. The primary focus of this research is on delay-sensitive applications, codes with finite block lengths and, necessarily, non-vanishing probabilities of decoding failure. The contribution of this article is twofold. A methodology to compute the distribution of the time required to empty a buffer is introduced. Based on this distribution, the mean hitting time to an empty queue and delay-violation probabilities for specific thresholds can be computed explicitly. The proposed techniques apply to situations where the transmit buffer contains a predetermined number of information bits at the onset of the data transfer. Furthermore, as additional performance criteria, large deviation principles are obtained for the empirical mean service time and the average packet-transmission time associated with the communication process. This rigorous framework yields a pragmatic methodology to select code rate and block length for the communication unit as functions of the service requirements. Examples motivated by practical systems are provided to further illustrate the applicability of these techniques.Comment: To appear in IEEE Transactions on Information Theor

Error Exponents for Variable-length Block Codes with Feedback and Cost Constraints

Variable-length block-coding schemes are investigated for discrete memoryless channels with ideal feedback under cost constraints. Upper and lower bounds are found for the minimum achievable probability of decoding error $P_{e,\min}$ as a function of constraints R, \AV, and $\bar \tau$ on the transmission rate, average cost, and average block length respectively. For given $R$ and \AV, the lower and upper bounds to the exponent $-(\ln P_{e,\min})/\bar \tau$ are asymptotically equal as $\bar \tau \to \infty$. The resulting reliability function, $\lim_{\bar \tau\to \infty} (-\ln P_{e,\min})/\bar \tau$, as a function of $R$ and \AV, is concave in the pair (R, \AV) and generalizes the linear reliability function of Burnashev to include cost constraints. The results are generalized to a class of discrete-time memoryless channels with arbitrary alphabets, including additive Gaussian noise channels with amplitude and power constraints