Iterative receiver design for the estimation of Gaussian samples in impulsive noise

Impulsive noise is the main limiting factor for transmission over channels affected by elec-tromagnetic interference. We study the estimation of (correlated) Gaussian signals in an impulsive noise scenario. In this work, we analyze some of the existing, as well as some novel estimation algorithms. Their performance is compared, for the first time, for different channel conditions, including the Markov–Middleton scenario, where the impulsive noise switches between different noise states. Following a modern approach in digital communications, the receiver design is based on a factor graph model and implements a message passing algorithm. The correlation among signal samples, as well as among noise states brings about a loopy factor graph, where an iterative message passing scheme should be employed. As is well known, approximate variational inference techniques are necessary in these cases. We propose and analyze different algorithms and provide a complete performance comparison among them, showing that the expectation propagation, transparent propa-gation, and parallel iterative schedule approaches reach a performance close to optimal, at different channel conditions

Robust wireless sensor network for smart grid communication : modeling and performance evaluation

Our planet is gradually heading towards an energy famine due to growing population and industrialization. Hence, increasing electricity consumption and prices, diminishing fossil fuels and lack significantly in environment-friendliness due to their emission of greenhouse gasses, and inefficient usage of existing energy supplies have caused serious network congestion problems in many countries in recent years. In addition to this overstressed situation, nowadays, the electric power system is facing many challenges, such as high maintenance cost, aging equipment, lack of effective fault diagnostics, power supply reliability, etc., which further increase the possibility of system breakdown. Furthermore, the adaptation of the new renewable energy sources with the existing power plants to provide an alternative way for electricity production transformed it in a very large and complex scale, which increases new issues. To address these challenges, a new concept of next generation electric power system, called the "smart grid", has emerged in which Information and Communication Technologies (ICTs) are playing the key role. For a reliable smart grid, monitoring and control of power system parameters in the transmission and distribution segments are crucial. This necessitates the deployment of a robust communication network within the power grid. Traditionally, power grid communications are realized through wired communications, including power line communication (PLC). However, the cost of its installation might be expensive especially for remote control and monitoring applications. More recently, plenty of research interests have been drawn to the wireless communications for smart grid applications. In this regard, the most promising methods of smart grid monitoring explored in the literature is based on wireless sensor network (WSN). Indeed, the collaborative nature of WSN brings significant advantages over the traditional wireless networks, including low-cost, wider coverage, self-organization, and rapid deployment. Unfortunately, harsh and hostile electric power system environments pose great challenges in the reliability of sensor node communications because of strong RF interference and noise called impulsive noise. On account of the fundamental of WSN-based smart grid communications and the possible impacts of impulsive noise on the reliability of sensor node communications, this dissertation is supposed to further fill the lacking of the existing research outcomes. To be specific, the contributions of this dissertation can be summarized as three fold: (i) investigation and performance analysis of impulsive noise mitigation techniques for point-to-point single-carrier communication systems impaired by bursty impulsive noise; (ii) design and performance analysis of collaborative WSN for smart grid communication by considering the RF noise model in the designing process, a particular intension is given to how the time-correlation among the noise samples can be taken into account; (iii) optimal minimum mean square error (MMSE)estimation of physical phenomenon like temperature, current, voltage, etc., typically modeled by a Gaussian source in the presence of impulsive noise. In the first part, we compare and analyze the widely used non-linear methods such as clipping, blanking, and combined clipping-blanking to mitigate the noxious effects of bursty impulsive noise for point-to-point communication systems with low-density parity-check (LDPC) coded single-carrier transmission. While, the performance of these mitigation techniques are widely investigated for multi-carrier communication systems using orthogonal frequency division multiplexing (OFDM) transmission under the effect of memoryless impulsive noise, we note that OFDM is outperformed by its single-carrier counterpart when the impulses are very strong and/or they occur frequently, which likely exists in contemporary communication systems including smart grid communications. Likewise, the assumption of memoryless noise model is not valid for many communication scenarios. Moreover, we propose log-likelihood ratio (LLR)-based impulsive noise mitigation for the considered scenario. We show that the memory property of the noise can be exploited in the LLR calculation through maximum a posteriori (MAP) detection. In this context, provided simulation results highlight the superiority of the LLR-based mitigation scheme over the simple clipping/blanking schemes. The second contribution can be divided into two aspects: (i) we consider the performance analysis of a single-relay decode-and-forward (DF) cooperative relaying scheme over channels impaired by bursty impulsive noise. For this channel, the bit error rate (BER) performances of direct transmission and a DF relaying scheme using M-PSK modulation in the presence of Rayleigh fading with a MAP receiver are derived; (ii) as a continuation of single-relay collaborative WSN scheme, we propose a novel relay selection protocol for a multi-relay DF collaborative WSN taking into account the bursty impulsive noise. The proposed protocol chooses the N’th best relay considering both the channel gains and the states of the impulsive noise of the source-relay and relay-destination links. To analyze the performance of the proposed protocol, we first derive closed-form expressions for the probability density function (PDF) of the received SNR. Then, these PDFs are used to derive closed-form expressions for the BER and the outage probability. Finally, we also derive the asymptotic BER and outage expressions to quantify the diversity benefits. From the obtained results, it is seen that the proposed receivers based on the MAP detection criterion is the most suitable one for bursty impulsive noise environments as it has been designed according to the statistical behavior of the noise. Different from the aforementioned contributions, talked about the reliable detection of finite alphabets in the presence of bursty impulsive noise, in the thrid part, we investigate the optimal MMSE estimation for a scalar Gaussian source impaired by impulsive noise. In Chapter 5, the MMSE optimal Bayesian estimation for a scalar Gaussian source, in the presence of bursty impulsive noise is considered. On the other hand, in Chapter 6, we investigate the distributed estimation of a scalar Gaussian source in WSNs in the presence of Middleton class-A noise. From the obtained results we conclude that the proposed optimal MMSE estimator outperforms the linear MMSE estimator developed for Gaussian channel

Fifty Years of Noise Modeling and Mitigation in Power-Line Communications.

Building on the ubiquity of electric power infrastructure, power line communications (PLC) has been successfully used in diverse application scenarios, including the smart grid and in-home broadband communications systems as well as industrial and home automation. However, the power line channel exhibits deleterious properties, one of which is its hostile noise environment. This article aims for providing a review of noise modeling and mitigation techniques in PLC. Specifically, a comprehensive review of representative noise models developed over the past fifty years is presented, including both the empirical models based on measurement campaigns and simplified mathematical models. Following this, we provide an extensive survey of the suite of noise mitigation schemes, categorizing them into mitigation at the transmitter as well as parametric and non-parametric techniques employed at the receiver. Furthermore, since the accuracy of channel estimation in PLC is affected by noise, we review the literature of joint noise mitigation and channel estimation solutions. Finally, a number of directions are outlined for future research on both noise modeling and mitigation in PLC

Applications of artificial intelligence in powerline communications in terms of noise detection and reduction : a review

Abstract: The technology which utilizes the power line as a medium for transferring information known as powerline communication (PLC) has been in existence for over a hundred years. It is beneficial because it avoids new installation since it uses the present installation for electrical power to transmit data. However, transmission of data signals through a power line channel usually experience some challenges which include impulsive noise, frequency selectivity, high channel attenuation, low line impedance etc. The impulsive noise exhibits a power spectral density within the range of 10-15 dB higher than the background noise, which could cause a severe problem in a communication system. For better outcome of the PLC system, these noises must be detected and suppressed. This paper reviews various techniques used in detecting and mitigating the impulsive noise in PLC and suggests the application of machine learning algorithms for the detection and removal of impulsive noise in power line communication systems

Impulsive noise cancellation and channel estimation in power line communication systems

Power line communication (PLC) is considered as the most viable enabler of the smart grid. PLC exploits the power line infrastructure for data transmission and provides an economical communication backbone to support the requirements of smart grid applications. Though PLC brings a lot of benefits to the smart grid implementation, impairments such as frequency selective attenuation of the high-frequency communication signal, the presence of impulsive noise (IN) and the narrowband interference (NBI) from closely operating wireless communication systems, make the power line a hostile environament for reliable data transmission. Hence, the main objective of this dissertation is to design signal processing algorithms that are specifically tailored to overcome the inevitable impairments in the power line environment. First, we propose a novel IN mitigation scheme for PLC systems. The proposed scheme actively estimates the locations of IN samples and eliminates the effect of IN only from the contaminated samples of the received signal. By doing so, the typical problem encountered while mitigating the IN is avoided by using passive IN power suppression algorithms, where samples besides the ones containing the IN are also affected creating additional distortion in the received signal. Apart from the IN, the PLC transmission is also impaired by NBI. Exploiting the duality of the problem where the IN is impulsive in the time domain and the NBI is impulsive in the frequency domain, an extended IN mitigation algorithm is proposed in order to accurately estimate and effectively cancel both impairments from the received signal. The numerical validation of the proposed schemes shows improved BER performance of PLC systems in the presence of IN and NBI. Secondly, we pay attention to the problem of channel estimation in the power line environment. The presence of IN makes channel estimation challenging for PLC systems. To accurately estimate the channel, two maximumlikelihood (ML) channel estimators for PLC systems are proposed in this thesis. Both ML estimators exploit the estimated IN samples to determine the channel coefficients. Among the proposed channel estimators, one treats the estimated IN as a deterministic quantity, and the other assumes that the estimated IN is a random quantity. The performance of both estimators is analyzed and numerically evaluated to show the superiority of the proposed estimators in comparison to conventional channel estimation strategies in the presence of IN. Furthermore, between the two proposed estimators, the one that is based on the random approach outperforms the deterministic one in all typical PLC scenarios. However, the deterministic approach based estimator can perform consistent channel estimation regardless of the IN behavior with less computational effort and becomes an efficient channel estimation strategy in situations where high computational complexity cannot be afforded. Finally, we propose two ML algorithms to perform a precise IN support detection. The proposed algorithms perform a greedy search of the samples in the received signal that are contaminated by IN. To design such algorithms, statistics defined for deterministic and random ML channel estimators are exploited and two multiple hypothesis tests are built according to Bonferroni and Benjamini and Hochberg design criteria. Among the proposed estimators, the random ML-based approach outperforms the deterministic ML-based approach while detecting the IN support in typical power line environment. Hence, this thesis studies the power line environment for reliable data transmission to support smart grid. The proposed signal processing schemes are robust and allow PLC systems to effectively overcome the major impairments in an active electrical network.The efficient mitigation of IN and NBI and accurate estimation of channel enhances the applicability of PLC to support critical applications that are envisioned for the future electrical power grid.La comunicación a través de líneas de transmisión eléctricas (PLC) se considera uno de los habilitadores principales de la red eléctrica inteligente (smart grid). PLC explota la infraestructura de la red eléctrica para la transmisión de datos y proporciona una red troncal de comunicación económica para poder cumplir con los requisitos de las aplicaciones para smart grids. Si bien la tecnología PLC aporta muchos beneficios a la implementación de la smart grid, los impedimentos, como la atenuación selectiva en frecuencia de la señal de comunicación, la presencia de ruido impulsivo (IN) y las interferencias de banda estrecha (NBI) de los sistemas de comunicación inalámbrica de operación cercana, hacen que la red eléctrica sea un entorno hostil para la transmisión fiable de datos. En este contexto, el objetivo principal de esta tesis es diseñar algoritmos de procesado de señal que estén específicamente diseñados para superar los impedimentos inevitables en el entorno de la red eléctrica como son IN y NBI. Primeramente, proponemos un nuevo esquema de mitigación de IN en sistemas PLC. El esquema propuesto estima activamente las ubicaciones de las muestras de IN y elimina el efecto de IN solo en las muestras contaminadas de la señal recibida. Al hacerlo, el problema típico que se encuentra al mitigar el IN con técnicas tradicionales (donde también se ven afectadas otras muestras que contienen la IN, creando una distorsión adicional en la señal recibida) se puede evitar con la consiguiente mejora del rendimiento. Aparte de IN, los sistemas PLC también se ven afectados por el NBI. Aprovechando la dualidad del problema (el IN es impulsivo en el dominio del tiempo y el NBI es impulsivo en el dominio de la frecuencia), se propone un algoritmo de mitigación de IN ampliado para estimar con precisión y cancelar efectivamente ambas degradaciones de la señal recibida. La validación numérica de los esquemas propuestos muestra un mejor rendimiento en términos de tasa de error de bit (BER) en sistemas PLC con presencia de IN y NBI. En segundo lugar, prestamos atención al problema de la estimación de canal en entornos PLC. La presencia de IN hace que la estimación de canal sea un desafío para los sistemas PLC futuros. En esta tesis, se proponen dos estimadores de canal para sistemas PLC de máxima verosimilitud (ML) para sistemas PLC. Ambos estimadores ML explotan las muestras IN estimadas para determinar los coeficientes del canal. Entre los estimadores de canal propuestos, uno trata la IN estimada como una cantidad determinista, y la otra asume que la IN estimada es una cantidad aleatoria. El rendimiento de ambos estimadores se analiza y se evalúa numéricamente para mostrar la superioridad de los estimadores propuestos en comparación con las estrategias de estimación de canales convencionales en presencia de IN. Además, entre los dos estimadores propuestos, el que se basa en el enfoque aleatorio supera el determinista en escenarios PLC típicos. Sin embargo, el estimador basado en el enfoque determinista puede llevar a cabo una estimación de canal consistente independientemente del comportamiento de la IN con menos esfuerzo computacional y se convierte en una estrategia de estimación de canal eficiente en situaciones donde no es posible disponer de una alta complejidad computacionalPostprint (published version

Space-time-frequency methods for interference-limited communication systems

textTraditionally, noise in communication systems has been modeled as an additive, white Gaussian noise process with independent, identically distributed samples. Although this model accurately reflects thermal noise present in communication system electronics, it fails to capture the statistics of interference and other sources of noise, e.g. in unlicensed communication bands. Modern communication system designers must take into account interference and non-Gaussian noise to maximize efficiencies and capacities of current and future communication networks. In this work, I develop new multi-dimensional signal processing methods to improve performance of communication systems in three applications areas: (i) underwater acoustic, (ii) powerline, and (iii) multi-antenna cellular. In underwater acoustic communications, I address impairments caused by strong, time-varying and Doppler-spread reverberations (self-interference) using adaptive space-time signal processing methods. I apply these methods to array receivers with a large number of elements. In powerline communications, I address impairments caused by non-Gaussian noise arising from devices sharing the powerline. I develop and apply a cyclic adaptive modulation and coding scheme and a factor-graph-based impulsive noise mitigation method to improve signal quality and boost link throughput and robustness. In cellular communications, I develop a low-latency, high-throughput space-time-frequency processing framework used for large scale (up to 128 antenna) MIMO. This framework is used in the world's first 100-antenna MIMO system and processes up to 492 Gbps raw baseband samples in the uplink and downlink directions. My methods prove that multi-dimensional processing methods can be applied to increase communication system performance without sacrificing real-time requirements.Electrical and Computer Engineerin

Model-Based Speech Enhancement

Abstract A method of speech enhancement is developed that reconstructs clean speech from a set of acoustic features using a harmonic plus noise model of speech. This is a significant departure from traditional filtering-based methods of speech enhancement. A major challenge with this approach is to estimate accurately the acoustic features (voicing, fundamental frequency, spectral envelope and phase) from noisy speech. This is achieved using maximum a-posteriori (MAP) estimation methods that operate on the noisy speech. In each case a prior model of the relationship between the noisy speech features and the estimated acoustic feature is required. These models are approximated using speaker-independent GMMs of the clean speech features that are adapted to speaker-dependent models using MAP adaptation and for noise using the Unscented Transform. Objective results are presented to optimise the proposed system and a set of subjective tests compare the approach with traditional enhancement methods. Threeway listening tests examining signal quality, background noise intrusiveness and overall quality show the proposed system to be highly robust to noise, performing significantly better than conventional methods of enhancement in terms of background noise intrusiveness. However, the proposed method is shown to reduce signal quality, with overall quality measured to be roughly equivalent to that of the Wiener filter

System approach to robust acoustic echo cancellation through semi-blind source separation based on independent component analysis

We live in a dynamic world full of noises and interferences. The conventional acoustic echo cancellation (AEC) framework based on the least mean square (LMS) algorithm by itself lacks the ability to handle many secondary signals that interfere with the adaptive filtering process, e.g., local speech and background noise. In this dissertation, we build a foundation for what we refer to as the system approach to signal enhancement as we focus on the AEC problem. We first propose the residual echo enhancement (REE) technique that utilizes the error recovery nonlinearity (ERN) to "enhances" the filter estimation error prior to the filter adaptation. The single-channel AEC problem can be viewed as a special case of semi-blind source separation (SBSS) where one of the source signals is partially known, i.e., the far-end microphone signal that generates the near-end acoustic echo. SBSS optimized via independent component analysis (ICA) leads to the system combination of the LMS algorithm with the ERN that allows for continuous and stable adaptation even during double talk. Second, we extend the system perspective to the decorrelation problem for AEC, where we show that the REE procedure can be applied effectively in a multi-channel AEC (MCAEC) setting to indirectly assist the recovery of lost AEC performance due to inter-channel correlation, known generally as the "non-uniqueness" problem. We develop a novel, computationally efficient technique of frequency-domain resampling (FDR) that effectively alleviates the non-uniqueness problem directly while introducing minimal distortion to signal quality and statistics. We also apply the system approach to the multi-delay filter (MDF) that suffers from the inter-block correlation problem. Finally, we generalize the MCAEC problem in the SBSS framework and discuss many issues related to the implementation of an SBSS system. We propose a constrained batch-online implementation of SBSS that stabilizes the convergence behavior even in the worst case scenario of a single far-end talker along with the non-uniqueness condition on the far-end mixing system. The proposed techniques are developed from a pragmatic standpoint, motivated by real-world problems in acoustic and audio signal processing. Generalization of the orthogonality principle to the system level of an AEC problem allows us to relate AEC to source separation that seeks to maximize the independence, hence implicitly the orthogonality, not only between the error signal and the far-end signal, but rather, among all signals involved. The system approach, for which the REE paradigm is just one realization, enables the encompassing of many traditional signal enhancement techniques in analytically consistent yet practically effective manner for solving the enhancement problem in a very noisy and disruptive acoustic mixing environment.PhDCommittee Chair: Biing-Hwang Juang; Committee Member: Brani Vidakovic; Committee Member: David V. Anderson; Committee Member: Jeff S. Shamma; Committee Member: Xiaoli M

Speech Recognition

Chapters in the first part of the book cover all the essential speech processing techniques for building robust, automatic speech recognition systems: the representation for speech signals and the methods for speech-features extraction, acoustic and language modeling, efficient algorithms for searching the hypothesis space, and multimodal approaches to speech recognition. The last part of the book is devoted to other speech processing applications that can use the information from automatic speech recognition for speaker identification and tracking, for prosody modeling in emotion-detection systems and in other speech processing applications that are able to operate in real-world environments, like mobile communication services and smart homes