Bounds on the Error Probability of Raptor Codes under Maximum Likelihood Decoding

In this paper upper and lower bounds on the probability of decoding failure under maximum likelihood decoding are derived for different (nonbinary) Raptor code constructions. In particular four different constructions are considered; (i) the standard Raptor code construction, (ii) a multi-edge type construction, (iii) a construction where the Raptor code is nonbinary but the generator matrix of the LT code has only binary entries, (iv) a combination of (ii) and (iii). The latter construction resembles the one employed by RaptorQ codes, which at the time of writing this article represents the state of the art in fountain codes. The bounds are shown to be tight, and provide an important aid for the design of Raptor codes.Comment: Submitted for revie

Dynamic Code Selection Method for Content Transfer in Deep Space Network

Space communications feature large round-trip time delays (for example, between 6.5 and 44 minutes for Mars to Earth and return, depending on the actual distance between the two planets) and highly variable data error rates, for example, bit error rate (BER) of 10−5 is very comand even higher BERs on the order of 10−1 is observed in the deep- space environment. We develop a new content transfer protocol based on RaptorQ codes and turbo codes together with a real-time channel prediction model to maximize file transfer from space vehicles to the Earth stations. While turbo codes are used to correct channel errors, RaptorQ codes are applied to eliminate the need for negative-acknowledgment of the loss of any specific packet. To reduce the effect of channel variation, we develop a practical signal-to-noise ratio (SNR) prediction model that is used to periodically adjust the turbo encoder in distant source spacecraft. This new protocol, termed as dynamic code selection method (DCSM), is compared with two other methods: turbo based genie method (upper bound of DCSM performance) assuming that the channel condition is perfectly known in advance and a static method in which a fixed turbo encoder is used throughout a communication pass. Simulation results demonstrate that the genie can increase telemetry channel throughput expressed in terms of the total number of successfully delivered files during a communication pass by about 20.3 % and DCSM achieves more than 99 % of genie, compared to the static approach being used currently

Finite Length Analysis of Rateless Codes and Their Application in Wireless Networks

Mobile communication systems are undergoing revolutionary developments as a result of the rapidly growing demands for high data rates and reliable communication connections. The key features of the next-generation mobile communication systems are provision of high-speed and robust communication links. However, wireless communications still need to address the same challenge–unreliable communication connections, arising from a number of causes including noise, interference, and distortion because of hardware imperfections or physical limitations. Forwarding error correction (FEC) codes are used to protect source information by adding redundancy. With FEC codes, errors among the transmitted message can be corrected by the receiver. Recent work has shown that, by applying rateless codes (a class of FEC codes), wireless transmission efficiency and reliability can be dramatically improved. Unlike traditional codes, rateless codes can adapt to different channel conditions. Rateless codes have been widely used in many multimedia broadcast/multicast applications. Among the known rate- less codes, two types of codes stand out: Luby transform (LT) codes and Raptor codes. However, our understanding of LT codes and Raptor codes is still in- complete due to the lack of complete theoretical analysis on the decoding error performance of these codes. Particularly, this thesis focuses on the decoding error performance of these codes under maximum-likelihood (ML) decoding, which provides a benchmark on the optimum system performance for gauging other decoding schemes. In this thesis, we discuss the effectiveness of rateless codes in terms of the success probability of decoding. It is defined as the probability that all source symbols can be successfully decoded with a given number of success- fully received coded symbols under ML decoding. This thesis provides a detailed mathematical analysis on the rank profile of general LT codes to evaluate the decoding success probability of LT codes under ML decoding. Furthermore, by analyzing the rank of the product of two random coefficient matrices, this thesis derived bounds on the decoding success probability of Raptor codes with a systematic low-density generator matrix (LDGM) code as the pre-code under ML decoding. Additionally, by resorting to stochastic geometry analysis, we develop a rateless codes based broadcast scheme. This scheme allows a base station (BS) to broadcast a given number of symbols to a large number of users, without user acknowledgment, while being able to pro- vide a performance guarantee on the probability of successful delivery. Further, the BS has limited statistical information about the environment including the spatial distribution of users (instead of their exact locations and number) and the wireless propagation model. Based on the analysis of finite length LT codes and Raptor codes, an upper and a lower bound on the number of transmissions required to meet the performance requirement are obtained. The technique and analysis developed in this thesis are useful for designing efficient and reliable wireless broadcast strategies. It is of interest to implement rateless codes into modern communication systems

ERROR CORRECTION CODE-BASED EMBEDDING IN ADAPTIVE RATE WIRELESS COMMUNICATION SYSTEMS

In this dissertation, we investigated the methods for development of embedded channels within error correction mechanisms utilized to support adaptive rate communication systems. We developed an error correction code-based embedding scheme suitable for application in modern wireless data communication standards. We specifically implemented the scheme for both low-density parity check block codes and binary convolutional codes. While error correction code-based information hiding has been previously presented in literature, we sought to take advantage of the fact that these wireless systems have the ability to change their modulation and coding rates in response to changing channel conditions. We utilized this functionality to incorporate knowledge of the channel state into the scheme, which led to an increase in embedding capacity. We conducted extensive simulations to establish the performance of our embedding methodologies. Results from these simulations enabled the development of models to characterize the behavior of the embedded channels and identify sources of distortion in the underlying communication system. Finally, we developed expressions to define limitations on the capacity of these channels subject to a variety of constraints, including the selected modulation type and coding rate of the communication system, the current channel state, and the specific embedding implementation.Commander, United States NavyApproved for public release; distribution is unlimited

Combined Time, Frecuency and Space Diversity in Multimedia Mobile Broadcasting Systems

El uso combinado de diversidad en el dominio temporal, frecuencial y espacial constituye una valiosa herramienta para mejorar la recepción de servicios de difusión móviles. Gracias a la mejora conseguida por las técnicas de diversidad es posible extender la cobertura de los servicios móviles además de reducir la infraestructura de red. La presente tesis investiga el uso de técnicas de diversidad para la provisión de servicios móviles en la familia europea de sistemas de difusión terrestres estandarizada por el prpoyecto DVB (Digital Video Broadcasting). Esto incluye la primera y segunda generación de sistemas DVB-T (Terrestrial), DVB-NGH (Handheld), y DVB-T2 (Terrestrial 2nd generation), así como el sistema de siguiente generación DVB-NGH. No obstante, el estudio llevado a cabo en la tesis es genérico y puede aplicarse a futuras evoluciones de estándares como el japonés ISDB-T o el americano ATSC. Las investigaciones realizadas dentro del contexto de DVB-T, DVB-H y DVBT2 tienen como objetivo la transmisión simultánea de servicios fijos y móviles en redes terrestres. Esta Convergencia puede facilitar la introducción de servicios móviles de TB debido a la reutilización de espectro, contenido e infraestructura. De acuerdo a los resultados, la incorporación de entrelazado temporal en la capa física para diversidad temporal, y de single-input multiple-output (SIMO) para diversidad espacial, son esenciales para el rendimiento de sistemas móviles de difusión. A pesar de que las técnicas upper later FEC (UL-FEC) pueden propocionar diversidad temporal en sistemas de primera generación como DVB-T y DVB-H, requieren la transmisión de paridad adicional y no son útiles para la recepción estática. El análisis en t�ñerminos de link budjget revela que las técnicas de diversidad noson suficientes para facilitar la provision de servicios móviles en redes DVB-T y DVB-T2 planificadas para recepción fija. Sin embargo, el uso de diversidad en redes planificadas para recepción portableGozálvez Serrano, D. (2012). Combined Time, Frecuency and Space Diversity in Multimedia Mobile Broadcasting Systems [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/16273Palanci

Straggler-Resilient Distributed Computing

In reference to IEEE copyrighted material which is used with permission in this thesis, the IEEE does not endorse any of University of Bergen's products or services. Internal or personal use of this material is permitted. If interested in reprinting/republishing IEEE copyrighted material for advertising or promotional purposes or for creating new collective works for resale or redistribution, please go to http://www.ieee.org/publications_standards/publications/rights/rights_link.html to learn how to obtain a License from RightsLink.Utbredelsen av distribuerte datasystemer har økt betydelig de siste årene. Dette skyldes først og fremst at behovet for beregningskraft øker raskere enn hastigheten til en enkelt datamaskin, slik at vi må bruke flere datamaskiner for å møte etterspørselen, og at det blir stadig mer vanlig at systemer er spredt over et stort geografisk område. Dette paradigmeskiftet medfører mange tekniske utfordringer. En av disse er knyttet til "straggler"-problemet, som er forårsaket av forsinkelsesvariasjoner i distribuerte systemer, der en beregning forsinkes av noen få langsomme noder slik at andre noder må vente før de kan fortsette. Straggler-problemet kan svekke effektiviteten til distribuerte systemer betydelig i situasjoner der en enkelt node som opplever en midlertidig overbelastning kan låse et helt system. I denne avhandlingen studerer vi metoder for å gjøre beregninger av forskjellige typer motstandsdyktige mot slike problemer, og dermed gjøre det mulig for et distribuert system å fortsette til tross for at noen noder ikke svarer i tide. Metodene vi foreslår er skreddersydde for spesielle typer beregninger. Vi foreslår metoder tilpasset distribuert matrise-vektor-multiplikasjon (som er en grunnleggende operasjon i mange typer beregninger), distribuert maskinlæring og distribuert sporing av en tilfeldig prosess (for eksempel det å spore plasseringen til kjøretøy for å unngå kollisjon). De foreslåtte metodene utnytter redundans som enten blir introdusert som en del av metoden, eller som naturlig eksisterer i det underliggende problemet, til å kompensere for manglende delberegninger. For en av de foreslåtte metodene utnytter vi redundans for også å øke effektiviteten til kommunikasjonen mellom noder, og dermed redusere mengden data som må kommuniseres over nettverket. I likhet med straggler-problemet kan slik kommunikasjon begrense effektiviteten i distribuerte systemer betydelig. De foreslåtte metodene gir signifikante forbedringer i ventetid og pålitelighet sammenlignet med tidligere metoder.The number and scale of distributed computing systems being built have increased significantly in recent years. Primarily, that is because: i) our computing needs are increasing at a much higher rate than computers are becoming faster, so we need to use more of them to meet demand, and ii) systems that are fundamentally distributed, e.g., because the components that make them up are geographically distributed, are becoming increasingly prevalent. This paradigm shift is the source of many engineering challenges. Among them is the straggler problem, which is a problem caused by latency variations in distributed systems, where faster nodes are held up by slower ones. The straggler problem can significantly impair the effectiveness of distributed systems—a single node experiencing a transient outage (e.g., due to being overloaded) can lock up an entire system. In this thesis, we consider schemes for making a range of computations resilient against such stragglers, thus allowing a distributed system to proceed in spite of some nodes failing to respond on time. The schemes we propose are tailored for particular computations. We propose schemes designed for distributed matrix-vector multiplication, which is a fundamental operation in many computing applications, distributed machine learning—in the form of a straggler-resilient first-order optimization method—and distributed tracking of a time-varying process (e.g., tracking the location of a set of vehicles for a collision avoidance system). The proposed schemes rely on exploiting redundancy that is either introduced as part of the scheme, or exists naturally in the underlying problem, to compensate for missing results, i.e., they are a form of forward error correction for computations. Further, for one of the proposed schemes we exploit redundancy to also improve the effectiveness of multicasting, thus reducing the amount of data that needs to be communicated over the network. Such inter-node communication, like the straggler problem, can significantly limit the effectiveness of distributed systems. For the schemes we propose, we are able to show significant improvements in latency and reliability compared to previous schemes.Doktorgradsavhandlin

Raptor Codes for BIAWGN Channel: SNR Mismatch and the Optimality of the Inner and Outer Rates

Fountain codes are a class of rateless codes with two interesting properties, first, they can generate potentially limitless numbers of encoded symbols given a finite set of source symbols, and second, the source symbols can be recovered from any subset of encoded symbols with cardinality greater than the number of source symbols. Raptor codes are the first implementation of fountain codes with linear complexity and vanishing error floors on noisy channels. Raptor codes are designed by the serial concatenation of an inner Luby trans-form (LT) code, the first practical realization of fountain codes, and an outer low-density parity-check (LDPC) code. Raptor codes were designed to operate on the binary erasure channel (BEC), however, since their invention they received considerable attention in or-der to improve their performance on noisy channels, and especially additive white Gaussiannoise (AWGN) channels. This dissertation considers two issues that face Raptor codes on the binary input additive white Gaussian noise (BIAWGN) channel: inaccurate estimation of signal to noise ratio (SNR) and the optimality of inner and outer rates. First, for codes that use a belief propagation algorithm (BPA) in decoding, such as Raptor codes on the BIAWGN channel, accurate estimation of the channel SNR is crucial to achieving optimal performance by the decoder. A difference between the estimated SNR and the actual channel SNR is known as signal to noise ratio mismatch (SNRM). Using asymptomatic analysis and simulation, we show the degrading effects of SNRM on Raptor codes and observe that if the mismatch is large enough, it can cause the decoding to fail. Using the discretized density evolution (DDE) algorithm with the modifications required to simulate the asymptotic performance in the case of SNRM, we determine the decoding threshold of Raptor codes for different values of SNRM ratio. Determining the threshold under SNRM enables us to quantify its effects which in turn can be used to reach important conclusions about the effects of SNRM on Raptor codes. Also, it can be used to compare Raptor codes with different designs in terms of their tolerance to SNRM. Based on the threshold response to SNRM, we observe that SNR underestimation is slightly less detrimental to Raptor codes than SNR overestimation for lower levels of mismatch ratio, however, as the mismatch increases, underestimation becomes more detrimental. Further, it can help estimate the tolerance of a Raptor code, with certain code parameters when transmitted at some SNR value, to SNRM. Or equivalently, help estimate the SNR needed for a given code to achieve a certain level of tolerance to SNRM. Using our observations about the performance of Raptor codes under SNRM, we propose an optimization method to design output degree distributions of the LT part that can be used to construct Raptor codes with more tolerance to high levels of SNRM. Second, we study the effects of choosing different values of inner and outer code rate pairs on the decoding threshold and performance of Raptor codes on the BIAWGN channel. For concatenated codes such as Raptor codes, given any instance of the overall code rate R, different inner (Ri) and outer (Ro) code rate combinations can be used to share the available redundancy as long asR=RiRo. Determining the optimal inner and outer rate pair can improve the threshold and performance of Raptor codes. Using asymptotic analysis, we show the effect of the rate pair choice on the threshold of Raptor codes on the BIAWGN channel and how the optimal rate pair is decided. We also show that Raptor codes with different output degree distributions can have different optimal rate pairs, therefore, by identifying the optimal rate pair we can further improve the performance and avoid suboptimal use of the code. We make the observation that as the outer rate of Raptor codes increases the potential of achieving better threshold increases, and provide the reason why the optimal outer rate of Raptor codes cannot occur at lower values. Finally, we present an optimization method that considers the optimality of the inner and outer rates in designing the output degree distribution of the inner LT part of Raptor codes. The designed distributions show improvement in both the decoding threshold and performance compared to other code designs that do not consider the optimality of the inner and outer rates