Self-concatenated code design and its application in power-efficient cooperative communications

In this tutorial, we have focused on the design of binary self-concatenated coding schemes with the help of EXtrinsic Information Transfer (EXIT) charts and Union bound analysis. The design methodology of future iteratively decoded self-concatenated aided cooperative communication schemes is presented. In doing so, we will identify the most important milestones in the area of channel coding, concatenated coding schemes and cooperative communication systems till date and suggest future research directions

Doctor of Philosophy

dissertationMultiple-input and multiple-output (MIMO) technique has emerged as a key feature for future generations of wireless communication systems. It increases the channel capacity proportionate to the minimum number of transmit and receive antennas. This dissertation addresses the receiver design for high-rate MIMO communications in at fading environments. The emphasis of the thesis is on the cases where channel state information (CSI) is not available and thus, clever channel estimation algorithms have to be developed to bene t from the maximum available channel capacity. The thesis makes four distinct novel contributions. First, we note that the conventional MCMC-MIMO detector presented in the prior work may deteriorate as SNR increases. We suggest and show through computer simulations that this problem to a great extent can be solved by initializing the MCMC detector with regulated states which are found through linear detectors. We also introduce the novel concept of staged-MCMC in a turbo receiver, where we start the detection process at a lower complexity and increase complexity only if the data could not be correctly detected in the present stage of data detection. Second, we note that in high-rate MIMO communications, joint data detection and channel estimation poses new challenges when a turbo loop is used to improve the quality of the estimated channel and the detected data. Erroneous detected data may propagate in the turbo loop and, thus, degrade the performance of the receiver signi cantly. This is referred to as error propagation. We propose a novel receiver that decorrelates channel estimation and the detected data to avoid the detrimental e ect of error propagation. Third, the dissertation studies joint channel estimation and MIMO detection over a continuously time-varying channel and proposes a new dual-layer channel estimator to overcome the complexity of optimal channel estimators. The proposed dual-layer channel estimator reduces the complexity of the MIMO detector with optimal channel estimator by an order of magnitude at a cost of a negligible performance degradation, on the order of 0.1 to 0.2 dB. The fourth contribution of this dissertation is to note that the Wiener ltering techniques that are discussed in this dissertation and elsewhere in the literature assume that channel (time-varying) statistics are available. We propose a new method that estimates such statistics using the coarse channel estimates obtained through pilot symbols. The dissertation also makes an additional contribution revealing di erences between the MCMC-MIMO and LMMSE-MIMO detectors. We nd that under the realistic condition where CSI has to be estimated, hence the available channel estimate will be noisy, the MCMC-MIMO detector outperforms the LMMSE-MIMO detector with a signi cant margin

On the use of the channel second-order statistics in MMSE receivers for time- and frequency-selective MIMO transmission systems

Equalization of unknown frequency- and time-selective multiple input multiple output (MIMO) channels is often carried out by means of decision feedback receivers. These consist of a channel estimator and a linear filter (for the estimation of the transmitted symbols), interconnected by a feedback loop through a symbol-wise threshold detector. The linear filter is often a minimum mean square error (MMSE) filter, and its mathematical expression involves second-order statistics (SOS) of the channel, which are usually ignored by simply assuming that the channel is a known (deterministic) parameter given by an estimate thereof. This appears to be suboptimal and in this work we investigate the kind of performance gains that can be expected when the MMSE equalizer is obtained using SOS of the channel process. As a result, we demonstrate that improvements of several dBs in the signal-to-noise ratio needed to achieve a prescribed symbol error rate are possible

Reduced Complexity Sequential Monte Carlo Algorithms for Blind Receivers

Monte Carlo algorithms can be used to estimate the state of a system given relative observations. In this dissertation, these algorithms are applied to physical layer communications system models to estimate channel state information, to obtain soft information about transmitted symbols or multiple access interference, or to obtain estimates of all of these by joint estimation. Initially, we develop and analyze a multiple access technique utilizing mutually orthogonal complementary sets (MOCS) of sequences. These codes deliberately introduce inter-chip interference, which is naturally eliminated during processing at the receiver. However, channel impairments can destroy their orthogonality properties and additional processing becomes necessary. We utilize Monte Carlo algorithms to perform joint channel and symbol estimation for systems utilizing MOCS sequences as spreading codes. We apply Rao-Blackwellization to reduce the required number of particles. However, dense signaling constellations, multiuser environments, and the interchannel interference introduced by the spreading codes all increase the dimensionality of the symbol state space significantly. A full maximum likelihood solution is computationally expensive and generally not practical. However, obtaining the optimum solution is critical, and looking at only a part of the symbol space is generally not a good solution. We have sought algorithms that would guarantee that the correct transmitted symbol is considered, while only sampling a portion of the full symbol space. The performance of the proposed method is comparable to the Maximum Likelihood (ML) algorithm. While the computational complexity of ML increases exponentially with the dimensionality of the problem, the complexity of our approach increases only quadratically. Markovian structures such as the one imposed by MOCS spreading sequences can be seen in other physical layer structures as well. We have applied this partitioning approach with some modification to blind equalization of frequency selective fading channel and to multiple-input multiple output receivers that track channel changes. Additionally, we develop a method that obtains a metric for quantifying the convergence rate of Monte Carlo algorithms. Our approach yields an eigenvalue based method that is useful in identifying sources of slow convergence and estimation inaccuracy.Ph.D.Committee Chair: Douglas B. Williams; Committee Member: Brani Vidakovic; Committee Member: G. Tong zhou; Committee Member: Gordon Stuber; Committee Member: James H. McClella

Expectation propagation as a solution for digital communication systems.

In the context of digital communications, a digital receiver is required to provide an estimation of the transmitted symbols. Nowadays channel decoders highly benefit from soft (probabilistic) estimates for each transmitted symbol rather than from hard decisions. For this reason, digital receivers must be designed to provide the probability that each possible symbol was transmitted based on the received corrupted signal. Since exact inference might be unfeasible in terms of complexity for high-order scenarios, it is necessary to resort to approximate inference, such as the linear minimum mean square error (LMMSE) criterion. The LMMSE approximates the discrete prior information of the transmitted symbols with a Gaussian distribution, which causes a degradation in its performance. In this thesis, an alternative approximate statistical technique is applied to the design of a digital probabilistic receiver in digital communications. Specifically, the expectation propagation (EP) algorithm is investigated to find the Gaussian posterior probability density function (pdf) that minimizes the Kullback-Leibler (KL) divergence with respect to the true posterior pdf. Two different communication system scenarios are studied: a single-input singleoutput (SISO) digital communication system with memory channel and a multipleinput multiple-output (MIMO) system with memoryless channel. In the SISO scenario, three different designs of a soft standalone and turbo equalizer based on the EP algorithm are developed: the block or batch approach, the filter-type version that emulates theWiener filter behavior and the smoothing equalizer which proceeds similarly to a Kalman smoother. Finally, the block EP implementation is also adapted to MIMO scenarios with feedback from the decoder. In both scenarios, the EP is applied iteratively, including a damping mechanism and a control to avoid negative values of variances, which would lead to instabilities (specially for high-order constellations). Experimental results included through the thesis show that the EP algorithm applied to communication systems greatly improves the performance of previous approaches found in the literature with a complexity slightly increased but still proportional to that of the LMMSE. These results also show the robustness of the algorithm even for high-order modulations, large memory channels and high number of antennas. Major contributions of this dissertation have been published in four journal (one of them is still under review) and two conference papers. One more paper will be submitted to a journal soon. All these papers are listed below: • Irene Santos, Juan José Murillo-Fuentes, Rafael Boloix-Tortosa, Eva Arias de Reyna and Pablo M. Olmos, "Expectation Propagation as Turbo Equalizer in ISI Channels," IEEE Transactions on Communications, vol. 65, no.1, pp. 360-370, Jan 2017. • Irene Santos, Juan José Murillo-Fuentes, Eva Arias de Reyna and Pablo M. Olmos, "Turbo EP-based Equalization: a Filter-Type Implementation," IEEE Transactions on Communications, Sep 2017, Accepted. [Online] Available: https://ieeexplore.ieee.org/document/8353388/ • Irene Santos, Juan José Murillo-Fuentes, Eva Arias-de-Reyna and Pablo M. Olmos, "Probabilistic Equalization With a Smoothing Expectation Propagation Approach," IEEE Transactions on Wireless Communications, vol. 16, no. 5, pp. 2950-2962, May 2017. • Irene Santos, Juan José Murillo-Fuentes and Eva Arias-de-Reyna, "Equalization with Expectation Propagation at Smoothing Level," To be submitted. [Online] Available: https://arxiv.org/abs/1809.00806 • Irene Santos and Juan José Murillo-Fuentes, "EP-based turbo detection for MIMO receivers and large-scale systems," IEEE Transactions on Vehicular Technology, May 2018, Under review. [Online] Available: https://arxiv.org/abs/1805.05065 • Irene Santos, Juan José Murillo-Fuentes, and Pablo M. Olmos, "Block expectation propagation equalization for ISI channels," 23rd European Signal Processing Conference (EUSIPCO 2015), Nice, 2015, pp. 379-383. • Irene Santos, and Juan José Murillo-Fuentes, "Improved probabilistic EPbased receiver for MIMO systems and high-order modulations," XXXIII Simposium Nacional de la Unión Científica Internacional de Radio (URSI 2018), Granada, 2018.En el ámbito de las comunicaciones digitales, es necesario un receptor digital que proporcione una estimación de los símbolos transmitidos. Los decodificadores de canal actuales se benefician enormemente de estimaciones suaves (probabilísticas) de cada símbolo transmitido, en vez de estimaciones duras. Por este motivo, los receptores digitales deben diseñarse para proporcionar la probabilidad de cada posible símbolo que fue transmitido en base a la señal recibida y corrupta. Dado que la inferencia exacta puede no ser posible en términos de complejidad para escenarios de alto orden, es necesario recurrir a inferencia aproximada, como por ejemplo el criterio de linear minimum-mean-square-error (LMMSE). El LMMSE aproxima la información a priori discreta de los símbolos transmitidos con una distribución Gaussiana, lo cual provoca una degradación en su resultado. En esta tesis, se aplica una técnica alternativa de inferencia estadística para diseñar un receptor digital probabilístico de comunicaciones digitales. En concreto, se investiga el algoritmo expectation propagation (EP) con el objetivo de encontrar la función densidad de probabilidad (pdf) a posteriori Gaussiana que minimiza la divergencia de Kullback-Leibler (KL) con respecto a la pdf a posteriori verdadera. Se estudian dos escenarios de comunicaciones digitales diferentes: un sistema de comunicaciones single-input single-output (SISO) con canales con memoria y un sistema multiple-input multiple-output (MIMO) con canales sin memoria. Para el escenario SISO se proponen tres diseños diferentes para un igualador probabilístico, tanto simple como turbo, que está basado en el algoritmo EP: una versión bloque, una versión filtrada que emula el comportamiento de un filtroWiener y una versión smoothing que funciona de forma similar a un Kalman smoother. Finalmente, la implementación del EP en bloque se adapta también para escenarios MIMO con realimentación desde el decodificador. En ambos escenarios, el EP se aplica de forma iterativa, incluyendo un mecanismo de damping y un control para evitar valores de varianzas negativas, que darían lugar a inestabilidades (especialmente, en constelaciones de alto orden). Los resultados experimentales que se incluyen en la tesis muestran que, cuando el algoritmo EP se aplica a sistemas de comunicaciones, se mejora notablemente el resultado de otras propuestas anteriores que existen en la literatura, con un pequeño incremento de la complejidad que es proporcional a la carga del LMMSE. Estos resultados también demuestran la robustez del algoritmo incluso para modulaciones de alto orden, canales con bastante memoria y un gran número de antenas. Las principales contribuciones de esta tesis se han publicado en cuatro artículos de revista (uno de ellos todavía bajo revisión) y dos artículos de conferencia. Otro artículo adicional se encuentra en preparación y se enviaría próximamente a una revista. Estos se citan a continuación: • Irene Santos, Juan José Murillo-Fuentes, Rafael Boloix-Tortosa, Eva Arias de Reyna and Pablo M. Olmos, "Expectation Propagation as Turbo Equalizer in ISI Channels," IEEE Transactions on Communications, vol. 65, no.1, pp. 360-370, Jan 2017. • Irene Santos, Juan José Murillo-Fuentes, Eva Arias de Reyna and Pablo M. Olmos, "Turbo EP-based Equalization: a Filter-Type Implementation," IEEE Transactions on Communications, Sep 2017, Aceptado. [Online] Disponible: https://ieeexplore.ieee.org/document/8353388/ • Irene Santos, Juan José Murillo-Fuentes, Eva Arias-de-Reyna and Pablo M. Olmos, "Probabilistic Equalization With a Smoothing Expectation Propagation Approach," IEEE Transactions on Wireless Communications, vol. 16, no. 5, pp. 2950-2962, May 2017. • Irene Santos, Juan José Murillo-Fuentes and Eva Arias-de-Reyna, "Equalization with Expectation Propagation at Smoothing Level," En preparación. [Online] Disponible: https://arxiv.org/abs/1809.00806 • Irene Santos and Juan José Murillo-Fuentes, "EP-based turbo detection for MIMO receivers and large-scale systems," IEEE Transactions on Vehicular Technology, May 2018, En revisión. [Online] Disponible: https://arxiv.org/abs/1805.05065 • Irene Santos, Juan José Murillo-Fuentes, and Pablo M. Olmos, "Block expectation propagation equalization for ISI channels," 23rd European Signal Processing Conference (EUSIPCO 2015), Nice, 2015, pp. 379-383. • Irene Santos, and Juan José Murillo-Fuentes, "Improved probabilistic EPbased receiver for MIMO systems and high-order modulations," XXXIII Simposium Nacional de la Unión Científica Internacional de Radio (URSI 2018), Granada, 2018

Self-concatenated coding for wireless communication systems

In this thesis, we have explored self-concatenated coding schemes that are designed for transmission over Additive White Gaussian Noise (AWGN) and uncorrelated Rayleigh fading channels. We designed both the symbol-based Self-ConcatenatedCodes considered using Trellis Coded Modulation (SECTCM) and bit-based Self- Concatenated Convolutional Codes (SECCC) using a Recursive Systematic Convolutional (RSC) encoder as constituent codes, respectively. The design of these codes was carried out with the aid of Extrinsic Information Transfer (EXIT) charts. The EXIT chart based design has been found an efficient tool in finding the decoding convergence threshold of the constituent codes. Additionally, in order to recover the information loss imposed by employing binary rather than non-binary schemes, a soft decision demapper was introduced in order to exchange extrinsic information withthe SECCC decoder. To analyse this information exchange 3D-EXIT chart analysis was invoked for visualizing the extrinsic information exchange between the proposed Iteratively Decoding aided SECCC and soft-decision demapper (SECCC-ID). Some of the proposed SECTCM, SECCC and SECCC-ID schemes perform within about 1 dB from the AWGN and Rayleigh fading channels’ capacity. A union bound analysis of SECCC codes was carried out to find the corresponding Bit Error Ratio (BER) floors. The union bound of SECCCs was derived for communications over both AWGN and uncorrelated Rayleigh fading channels, based on a novel interleaver concept.Application of SECCCs in both UltraWideBand (UWB) and state-of-the-art video-telephone schemes demonstrated its practical benefits.In order to further exploit the benefits of the low complexity design offered by SECCCs we explored their application in a distributed coding scheme designed for cooperative communications, where iterative detection is employed by exchanging extrinsic information between the decoders of SECCC and RSC at the destination. In the first transmission period of cooperation, the relay receives the potentially erroneous data and attempts to recover the information. The recovered information is then re-encoded at the relay using an RSC encoder. In the second transmission period this information is then retransmitted to the destination. The resultant symbols transmitted from the source and relay nodes can be viewed as the coded symbols of a three-component parallel-concatenated encoder. At the destination a Distributed Binary Self-Concatenated Coding scheme using Iterative Decoding (DSECCC-ID) was employed, where the two decoders (SECCC and RSC) exchange their extrinsic information. It was shown that the DSECCC-ID is a low-complexity scheme, yet capable of approaching the Discrete-input Continuous-output Memoryless Channels’s (DCMC) capacity.Finally, we considered coding schemes designed for two nodes communicating with each other with the aid of a relay node, where the relay receives information from the two nodes in the first transmission period. At the relay node we combine a powerful Superposition Coding (SPC) scheme with SECCC. It is assumed that decoding errors may be encountered at the relay node. The relay node then broadcasts this information in the second transmission period after re-encoding it, again, using a SECCC encoder. At the destination, the amalgamated block of Successive Interference Cancellation (SIC) scheme combined with SECCC then detects and decodes the signal either with or without the aid of a priori information. Our simulation results demonstrate that the proposed scheme is capable of reliably operating at a low BER for transmission over both AWGN and uncorrelated Rayleigh fading channels. We compare the proposed scheme’s performance to a direct transmission link between the two sources having the same throughput

An Iterative Receiver for OFDM With Sparsity-Based Parametric Channel Estimation

In this work we design a receiver that iteratively passes soft information between the channel estimation and data decoding stages. The receiver incorporates sparsity-based parametric channel estimation. State-of-the-art sparsity-based iterative receivers simplify the channel estimation problem by restricting the multipath delays to a grid. Our receiver does not impose such a restriction. As a result it does not suffer from the leakage effect, which destroys sparsity. Communication at near capacity rates in high SNR requires a large modulation order. Due to the close proximity of modulation symbols in such systems, the grid-based approximation is of insufficient accuracy. We show numerically that a state-of-the-art iterative receiver with grid-based sparse channel estimation exhibits a bit-error-rate floor in the high SNR regime. On the contrary, our receiver performs very close to the perfect channel state information bound for all SNR values. We also demonstrate both theoretically and numerically that parametric channel estimation works well in dense channels, i.e., when the number of multipath components is large and each individual component cannot be resolved.Comment: Major revision, accepted for IEEE Transactions on Signal Processin