Fifty Years of Noise Modeling and Mitigation in Power-Line Communications.

Building on the ubiquity of electric power infrastructure, power line communications (PLC) has been successfully used in diverse application scenarios, including the smart grid and in-home broadband communications systems as well as industrial and home automation. However, the power line channel exhibits deleterious properties, one of which is its hostile noise environment. This article aims for providing a review of noise modeling and mitigation techniques in PLC. Specifically, a comprehensive review of representative noise models developed over the past fifty years is presented, including both the empirical models based on measurement campaigns and simplified mathematical models. Following this, we provide an extensive survey of the suite of noise mitigation schemes, categorizing them into mitigation at the transmitter as well as parametric and non-parametric techniques employed at the receiver. Furthermore, since the accuracy of channel estimation in PLC is affected by noise, we review the literature of joint noise mitigation and channel estimation solutions. Finally, a number of directions are outlined for future research on both noise modeling and mitigation in PLC

Applications of artificial intelligence in powerline communications in terms of noise detection and reduction : a review

Abstract: The technology which utilizes the power line as a medium for transferring information known as powerline communication (PLC) has been in existence for over a hundred years. It is beneficial because it avoids new installation since it uses the present installation for electrical power to transmit data. However, transmission of data signals through a power line channel usually experience some challenges which include impulsive noise, frequency selectivity, high channel attenuation, low line impedance etc. The impulsive noise exhibits a power spectral density within the range of 10-15 dB higher than the background noise, which could cause a severe problem in a communication system. For better outcome of the PLC system, these noises must be detected and suppressed. This paper reviews various techniques used in detecting and mitigating the impulsive noise in PLC and suggests the application of machine learning algorithms for the detection and removal of impulsive noise in power line communication systems

Classification and modeling of power line noise using machine learning techniques

A thesis submitted in ful lment of the requirements for the degree of Doctor of Philosophy in the School of Electrical and Information Engineering Faculty of Engineering and Built Environment June 2017The realization of robust, reliable and e cient data transmission have been the theme of recent research, most importantly in real channel such as the noisy, fading prone power line communication (PLC) channel. The focus is to exploit old techniques or create new techniques capable of improving the transmission reliability and also increasing the transmission capacity of the real communication channels. Multi-carrier modulation scheme such as Orthogonal Frequency Division Multiplexing (OFDM) utilizing conventional single-carrier modulation is developed to facilitate a robust data transmission, increasing transmission capacity (e cient bandwidth usage) and further reducing design complexity in PLC systems. On the contrary, the reliability of data transmission is subjected to several inhibiting factors as a result of the varying nature of the PLC channel. These inhibiting factors include noise, perturbation and disturbances. Contrary to the Additive White Gaussian noise (AWGN) model often assumed in several communication systems, this noise model fails to capture the attributes of noise encountered on the PLC channel. This is because periodic noise or random noise pulses injected by power electronic appliances on the network is a deviation from the AWGN. The nature of the noise is categorized as non-white non-Gaussian and unstable due to its impulsive attributes, thus, it is labeled as Non-additive White Gaussian Noise (NAWGN). These noise and disturbances results into long burst errors that corrupts signals being transmitted, thus, the PLC is labeled as a horrible or burst error channel. The e cient and optimal performance of a conventional linear receiver in the white Gaussian noise environment can therefore be made to drastically degrade in this NAWGN environment. Therefore, transmission reliability in such environment can be greatly enhanced if we know and exploit the knowledge of the channel's statistical attributes, thus, the need for developing statistical channel model based on empirical data. In this thesis, attention is focused on developing a recon gurable software de ned un-coded single-carrier and multicarrier PLC transceiver as a tool for realizing an optimized channel model for the narrowband PLC (NB-PLC) channel. First, a novel recon gurable software de ned un-coded single-carrier and multi-carrier PLC transceiver is developed for real-time NB-PLC transmission. The transceivers can be adapted to implement di erent waveforms for several real-time scenarios and performance evaluation. Due to the varying noise parameters obtained from country to country as a result of the dependence of noise impairment on mains voltages, topology of power line, place and time, the developed transceivers is capable of facilitating constant measurement campaigns to capture these varying noise parameters before statistical and mathematically inclined channel models are derived. Furthermore, the single-carrier (Binary Phase Shift Keying (BPSK), Di erential BPSK (DBPSK), Quadrature Phase Shift Keying (QPSK) and Di erential QPSK (DQPSK)) PLC transceiver system developed is used to facilitate a First-Order semi-hidden Fritchman Markov modeling (SHFMM) of the NB-PLC channel utilizing the e cient iterative Baum- Welch algorithm (BWA) for parameter estimation. The performance of each modulation scheme is evaluated in a mildly and heavily disturbed scenarios for both residential and laboratory site considered. The First-Order estimated error statistics of the realized First- Order SHFMM have been analytically validated in terms of performance metrics such as: log-likelihood ratio (LLR), error-free run distribution (EFRD), error probabilities, mean square error (MSE) and Chi-square ( 2) test. The reliability of the model results is also con rmed by an excellent match between the empirically obtained error sequence and the SHFMM regenerated error sequence as shown by the error-free run distribution plot. This thesis also reports a novel development of a low cost, low complexity Frequency-shift keying (FSK) - On-o keying (OOK) in-house hybrid PLC and VLC system. The functionality of this hybrid PLC-VLC transceiver system was ascertained at both residential and laboratory site at three di erent times of the day: morning, afternoon and evening. A First and Second-Order SHFMM of the hybrid system is realized. The error statistics of the realized First and Second-Order SHFMMs have been analytically validated in terms of LLR, EFRD, error probabilities, MSE and Chi-square ( 2). The Second-Order SHFMMs have also been analytically validated to be superior to the First-Order SHFMMs although at the expense of added computational complexity. The reliability of both First and Second-Order SHFMM results is con rmed by an excellent match between the empirical error sequences and SHFMM re-generated error sequences as shown by the EFRD plot. In addition, the multi-carrier (QPSK-OFDM, Di erential QPSK (DQPSK)-OFDM) and Di erential 8-PSK (D8PSK)-OFDM) PLC transceiver system developed is used to facilitate a First and Second-Order modeling of the NB-PLC system using the SHFMM and BWA for parameter estimation. The performance of each OFDM modulation scheme in evaluated and compared taking into consideration the mildly and heavily disturbed noise scenarios for the two measurement sites considered. The estimated error statistics of the realized SHFMMs have been analytically validated in terms of LLR, EFRD, error probabilities, MSE and Chi-square ( 2) test. The estimated Second-Order SHFMMs have been analytically validated to be outperform the First-Order SHFMMs although with added computational complexity. The reliability of the models is con rmed by an excellent match between the empirical data and SHFMM generated data as shown by the EFRD plot. The statistical models obtained using Baum-Welch to adjust the parameters of the adopted SHFMM are often locally maximized. To solve this problem, a novel Metropolis-Hastings algorithm, a Bayesian inference approach based on Markov Chain Monte Carlo (MCMC) is developed to optimize the parameters of the adopted SHFMM. The algorithm is used to optimize the model results obtained from the single-carrier and multi-carrier PLC systems as well as that of the hybrid PLC-VLC system. Consequently, as deduced from the results, the models obtained utilizing the novel Metropolis-Hastings algorithm are more precise, near optimal model with parameter sets that are closer to the global maxima. Generally, the model results obtained in this thesis are relevant in enhancing transmission reliability on the PLC channel through the use of the models to improve the adopted modulation schemes, create adaptive modulation techniques, develop and evaluate forward error correction (FEC) codes such as a concatenation of Reed-Solomon and Permutation codes and other robust codes suitable for exploiting and mitigating noise impairments encountered on the low voltage NB-PLC channel. Furthermore, the recon gurable software de ned NB-PLC transceiver test-bed developed can be utilized for future measurement campaign as well as adapted for multiple-input and multiple-output (MIMO) PLC applications.MT201

Classification and modeling of power line noise using machine learning techniques

A thesis submitted in ful lment of the requirements for the degree of Doctor of Philosophy in the School of Electrical and Information Engineering Faculty of Engineering and Built Environment June 2017The realization of robust, reliable and e cient data transmission have been the theme of recent research, most importantly in real channel such as the noisy, fading prone power line communication (PLC) channel. The focus is to exploit old techniques or create new techniques capable of improving the transmission reliability and also increasing the transmission capacity of the real communication channels. Multi-carrier modulation scheme such as Orthogonal Frequency Division Multiplexing (OFDM) utilizing conventional single-carrier modulation is developed to facilitate a robust data transmission, increasing transmission capacity (e cient bandwidth usage) and further reducing design complexity in PLC systems. On the contrary, the reliability of data transmission is subjected to several inhibiting factors as a result of the varying nature of the PLC channel. These inhibiting factors include noise, perturbation and disturbances. Contrary to the Additive White Gaussian noise (AWGN) model often assumed in several communication systems, this noise model fails to capture the attributes of noise encountered on the PLC channel. This is because periodic noise or random noise pulses injected by power electronic appliances on the network is a deviation from the AWGN. The nature of the noise is categorized as non-white non-Gaussian and unstable due to its impulsive attributes, thus, it is labeled as Non-additive White Gaussian Noise (NAWGN). These noise and disturbances results into long burst errors that corrupts signals being transmitted, thus, the PLC is labeled as a horrible or burst error channel. The e cient and optimal performance of a conventional linear receiver in the white Gaussian noise environment can therefore be made to drastically degrade in this NAWGN environment. Therefore, transmission reliability in such environment can be greatly enhanced if we know and exploit the knowledge of the channel's statistical attributes, thus, the need for developing statistical channel model based on empirical data. In this thesis, attention is focused on developing a recon gurable software de ned un-coded single-carrier and multicarrier PLC transceiver as a tool for realizing an optimized channel model for the narrowband PLC (NB-PLC) channel. First, a novel recon gurable software de ned un-coded single-carrier and multi-carrier PLC transceiver is developed for real-time NB-PLC transmission. The transceivers can be adapted to implement di erent waveforms for several real-time scenarios and performance evaluation. Due to the varying noise parameters obtained from country to country as a result of the dependence of noise impairment on mains voltages, topology of power line, place and time, the developed transceivers is capable of facilitating constant measurement campaigns to capture these varying noise parameters before statistical and mathematically inclined channel models are derived. Furthermore, the single-carrier (Binary Phase Shift Keying (BPSK), Di erential BPSK (DBPSK), Quadrature Phase Shift Keying (QPSK) and Di erential QPSK (DQPSK)) PLC transceiver system developed is used to facilitate a First-Order semi-hidden Fritchman Markov modeling (SHFMM) of the NB-PLC channel utilizing the e cient iterative Baum- Welch algorithm (BWA) for parameter estimation. The performance of each modulation scheme is evaluated in a mildly and heavily disturbed scenarios for both residential and laboratory site considered. The First-Order estimated error statistics of the realized First- Order SHFMM have been analytically validated in terms of performance metrics such as: log-likelihood ratio (LLR), error-free run distribution (EFRD), error probabilities, mean square error (MSE) and Chi-square ( 2) test. The reliability of the model results is also con rmed by an excellent match between the empirically obtained error sequence and the SHFMM regenerated error sequence as shown by the error-free run distribution plot. This thesis also reports a novel development of a low cost, low complexity Frequency-shift keying (FSK) - On-o keying (OOK) in-house hybrid PLC and VLC system. The functionality of this hybrid PLC-VLC transceiver system was ascertained at both residential and laboratory site at three di erent times of the day: morning, afternoon and evening. A First and Second-Order SHFMM of the hybrid system is realized. The error statistics of the realized First and Second-Order SHFMMs have been analytically validated in terms of LLR, EFRD, error probabilities, MSE and Chi-square ( 2). The Second-Order SHFMMs have also been analytically validated to be superior to the First-Order SHFMMs although at the expense of added computational complexity. The reliability of both First and Second-Order SHFMM results is con rmed by an excellent match between the empirical error sequences and SHFMM re-generated error sequences as shown by the EFRD plot. In addition, the multi-carrier (QPSK-OFDM, Di erential QPSK (DQPSK)-OFDM) and Di erential 8-PSK (D8PSK)-OFDM) PLC transceiver system developed is used to facilitate a First and Second-Order modeling of the NB-PLC system using the SHFMM and BWA for parameter estimation. The performance of each OFDM modulation scheme in evaluated and compared taking into consideration the mildly and heavily disturbed noise scenarios for the two measurement sites considered. The estimated error statistics of the realized SHFMMs have been analytically validated in terms of LLR, EFRD, error probabilities, MSE and Chi-square ( 2) test. The estimated Second-Order SHFMMs have been analytically validated to be outperform the First-Order SHFMMs although with added computational complexity. The reliability of the models is con rmed by an excellent match between the empirical data and SHFMM generated data as shown by the EFRD plot. The statistical models obtained using Baum-Welch to adjust the parameters of the adopted SHFMM are often locally maximized. To solve this problem, a novel Metropolis-Hastings algorithm, a Bayesian inference approach based on Markov Chain Monte Carlo (MCMC) is developed to optimize the parameters of the adopted SHFMM. The algorithm is used to optimize the model results obtained from the single-carrier and multi-carrier PLC systems as well as that of the hybrid PLC-VLC system. Consequently, as deduced from the results, the models obtained utilizing the novel Metropolis-Hastings algorithm are more precise, near optimal model with parameter sets that are closer to the global maxima. Generally, the model results obtained in this thesis are relevant in enhancing transmission reliability on the PLC channel through the use of the models to improve the adopted modulation schemes, create adaptive modulation techniques, develop and evaluate forward error correction (FEC) codes such as a concatenation of Reed-Solomon and Permutation codes and other robust codes suitable for exploiting and mitigating noise impairments encountered on the low voltage NB-PLC channel. Furthermore, the recon gurable software de ned NB-PLC transceiver test-bed developed can be utilized for future measurement campaign as well as adapted for multiple-input and multiple-output (MIMO) PLC applications.MT201

Contributions à l'étude des communications numériques sur le réseau électrique à l'intérieur des bâtiments : modélisation du canal et optimisation du débit

In recent years, the electrical network has become an essential candidate for high-speed data transmission inside buildings. Many solutions are currently underway in order to optimize these technologies known under the name of in-home Power-Line Communications (PLC). Multiple-Input Multiple-Output (MIMO) technique has recently been transposed into power-line networks for which different signal feeding possibilities can be considered between phase, neutral and earth wires. In this thesis, we propose two original contributions to indoor broadband PLC. The first contribution concerns the MIMO-PLC channel modeling. Based on a Single-Input Single-Output (SISO) parametric channel model presented in the literature, we propose a MIMO one by considering a new parameter which characterizes the spatial correlation. The proposed model enables an accurate description of the spatial correlation of European MIMO PLC field measurements. The second contribution is related to the impulsive noise present in power-line networks which constitutes a major problem in communications systems. We propose an outage capacity approach in order to optimize the average data rate in Orthogonal Frequency Division Multiplexing (OFDM) systems affected by impulsive noise. First, we study the channel capacity as a function of a noise margin provided to the transmitted symbols. Then we determine the analytical expression of the outage probability of an OFDM symbol in terms of the noise margin, by studying in detail the interaction between the noise impulse and the symbol. Based on the two aforementioned relations, we deduce the outage capacity. Then we propose an approach that enables to maximize the average system data rate. Finally, we present the results in the particular case of indoor broadband PLC in the presence of impulsive noise.Au cours de ces dernières années, le réseau électrique est devenu un candidat incontournable pour la transmission de données à haut débit à l’intérieur des bâtiments. De nombreuses solutions sont actuellement à l’étude afin d’optimiser ces technologies connues sous le nom Courants Porteurs en Ligne (CPL) ou PLC (Power-Line Communications). La technique MIMO (Multiple-Input Multiple-Output) a été tout récemment transposée au réseau filaire électrique pour lequel différents modes d’alimentation peuvent être envisagés entre la phase, le neutre et la terre. Dans le cadre de cette thèse, nous proposons deux contributions originales à l’étude des communications numériques sur le réseau électrique à l’intérieur des bâtiments. La première contribution concerne la modélisation du canal MIMO-PLC. En repartant d’un modèle du canal paramétrique SISO (Single-Input Single-Output) connu dans la littérature, nous proposons un modèle du canal MIMO en considérant un nouveau paramètre caractérisant la corrélation spatiale. Le modèle proposé permet de représenter fidèlement la corrélation spatiale des mesures effectuées à l’échelle européenne. La deuxième contribution concerne le bruit impulsif présent sur le réseau électrique domestique qui constitue un problème majeur dans les systèmes de communications. Nous proposons une méthode basée sur la notion de capacité de coupure afin d’optimiser le débit moyen dans les systèmes OFDM (Orthogonal Frequency Division Multiplexing) soumis aux bruits impulsifs. D’abord, nous étudions la capacité du système en fonction d’une marge de bruit fournie aux symboles transmis. Ensuite, nous déterminons l’expression analytique de la probabilité de coupure (outage) d’un symbole OFDM en fonction de cette marge, en étudiant de manière détaillée l’interaction entre l’impulsion de bruit et le symbole. A partir de ces deux calculs, nous déduisons la capacité de coupure. Puis, nous proposons une approche qui maximise l’espérance mathématique du débit reçu. Finalement, nous présentons les résultats obtenus dans le cas particulier d’une transmission à haut débit sur PLC en présence de bruits impulsifs

Characterization and Emulation of Low-Voltage Power Line Channels for Narrowband and Broadband Communication

The demand for smart grid and smart home applications has raised the recent interest in power line communication (PLC) technologies, and has driven a broad set of deep surveys in low-voltage (LV) power line channels. This book proposes a set of novel approaches, to characterize and to emulate LV power line channels in the frequency range from0.15to 10 MHz, which closes gaps between the traditional narrowband (up to 500 kHz) and broadband (above1.8 MHz) ranges

Characterization and Emulation of Low-Voltage Power Line Channels for Narrowband and Broadband Communication

The demand for smart grid and smart home applications has raised the recent interest in power line communication (PLC) technologies, and has driven a broad set of deep surveys in low-voltage (LV) power line channels. This book proposes a set of novel approaches, to characterize and to emulate LV power line channels in the frequency range from0.15to 10 MHz, which closes gaps between the traditional narrowband (up to 500 kHz) and broadband (above1.8 MHz) ranges

Noise modeling for standard CENELEC A-band power line communication channel

Power line communications (PLC) usage of low-voltage electrical power supply network as a medium of communication provides an alternative for the telecommunication access and in-house communication. Historically, power lines were majorly used for controlling appliances, however, with recent technology advancements power lines are now able to compete favorably and successfully with other relatively stable home automation and networking technologies like fixed line and wireless. Regardless of the advantages PLC has to offer, like every other communication technology, it has its own technical challenges it must overcome to be fully deployed and maximize its full potential. Such challenges includes noise, which can originate from appliances connected across the network or can be coupled unto the network. Harmful interference to other wireless spectrum users such as broadcast stations, and signal attenuation are other challenges faced by usage of the power line as a communication medium. PLC suffers the risk of not living up to its full development as a reliable means of communication if proper understanding of the channel potential and characteristic is not known. Therefore, understanding of the channel potential and characteristics can be obtained through measurement and modeling of the PLC channel. This model and measurements of the channel characteristics can then be utilized in designing a good PLC system which is able to withstand and mitigate the effect of the different kind of noise and disturbance present on the PLC network. This research therefore aims at formulizing and modeling the error pattern/behavior of noise and disturbances of an in-house CENELEC A-band based on experimental measurements. This is achieved by carrying out a real time experimental measurement of noise over a complete day to show the noise behavior. Error sequences are then generated from the measurement for the different classes of noise present on the CENELEC A-band and the use of Fritchman model, a Markovian chain model, is then employed to model the CENELEC A-band channel. This involves the use of Baum-Welch algorithm (an iterative algorithm) to estimate the model parameters of the three-state Markovian Fritchman model assumed. This precise channel model can then be used to design a good PLC system and facilitate the design of efficient coding and/or modulation schemes to enhance reliable communication on the PLC network. Therefore, answering the question of “how to formulize and model the error pattern/behavior of noise and disturbances of an in-house CENELEC A-band based on experimental measurements”

Independent component analysis applications in CDMA systems

Thesis (Master)--Izmir Institute of Technology, Electronics and Communication Engineering, Izmir, 2004Includes bibliographical references (leaves: 56)Text in English; Abstract: Turkish and Englishxi, 96 leavesBlind source separation (BSS) methods, independent component analysis (ICA) and independent factor analysis (IFA) are used for detecting the signal coming to a mobile user which is subject to multiple access interference in a CDMA downlink communication. When CDMA models are studied for different channel characteristics, it is seen that they are similar with BSS/ICA models. It is also showed that if ICA is applied to these CDMA models, desired user.s signal can be estimated successfully without channel information and other users. code sequences. ICA detector is compared with matched filter detector and other conventional detectors using simulation results and it is seen that ICA has some advantages over the other methods.The other BSS method, IFA is applied to basic CDMA downlink model. Since IFA has some convergence and speed problems when the number of sources is large, firstly basic CDMA model with ideal channel assumption is used in IFA application.With simulation of ideal CDMA channel, IFA is compared with ICA and matched filter.Furthermore, Pearson System-based ICA (PS-ICA) method is used forestimating non-Gaussian multipath fading channel coefficients. Considering some fading channel measurements showing that the fading channel coefficients may have an impulsive nature, these coefficients are modeled with an -stable distribution whose shape parameter takes values close to 2 which makes the distributions slightly impulsive. Simulation results are obtained to compare PS-ICA with classical ICA.Also IFA is applied to the single path CDMA downlink model to estimate fading channel by using the advantage of IFA which is the capability to estimate sources with wide class of distributions

Techniques for broadband power line communications: impulsive noise mitigation and adaptive modulation

The development of power line communication systems for broadband multimedia applications requires a comprehensive knowledge of the channel characteristics and the main peculiarities that may influence the communication over this channel. PLC has the potential to become the preferred connectivity solution to homes and offices. Additionally, indoor power line networks can serve as local area networks offering high-speed data, audio, video and multimedia applications. The PLC technology eliminates the need for new wires by using an already-existing infrastructure that is much more pervasive than any other wired system. Power line networks, however, present a hostile channel for communication signals. Noise, multipath, selective fading and attenuation are well-known peculiarities of power line grids and. Particularly, random impulsive noise characterized with short durations and very high amplitudes is identified as one of the major impairments that degrade the performance of PLC systems. Orthogonal frequency division multiplexing (OFDM) is the technique of choice for broadband PLC systems. OFDM minimizes the effects of multipath and provides high robustness against selective fading. It is also powerful in impulsive noise environments and performs better than single-carrier modulation methods. If an OFDM symbol is affected by impulsive noise, the effect is spread over multiple subcarriers due to the discrete Fourier transform at the receiver. In order to achieve reliable outcomes, suitable channel and noise models must be used in the investigations. In this thesis, the power line channel transfer function is modelled using a multipath model that was proposed by Zimmermann and Dostert [1], [2]. This model describes the signal propagation scenario and attenuation effects in power line networks. To represent the actual noise scenario in power networks, the noise is classified into two main classes: background noise and impulsive noise. To reduce the effect of impulsive noise, conventional time domain nonlinearities are examined in this thesis under PLC environments. An adaptive-threshold selection method based on minimum bit-error rate (BER) is proposed. At the cost of additional complexity, the effect of impulsive noise is further mitigated using a novel joint time-domain/frequency-domain suppression technique. Since channel coding is essential for most telecommunication systems, we examine convolutional codes combined with interleaving in a PLC channel impaired with AWGN and impulsive noise. The results show substantial performance gains especially in heavily-disturbed environments, where signal-to-noise ratio (SNR) gains of more than 15 dB can be achieved with a code rate of 1/3. Bit-interleaved convolutionally-coded OFDM completely eliminates the effect of impulsive noise in weakly-disturbed noise environments, while a negligible effect may remain in medium-disturbed environments. A new power-loading algorithm that minimizes the transmission power for target BER and data rate constraints is introduced in later chapters of the thesis. Results indicate that the algorithm achieves performance gains of more than 4 dB SNR over conventional OFDM systems. Furthermore, a novel minimum-complexity bit-loading algorithm that maximizes the data rate given BER and power level constraints is proposed in chapter 6. Results show that this bit-loading algorithm achieves almost identical performance as the incremental algorithm but with much lower complexity