Classification and modeling of power line noise using machine learning techniques

A thesis submitted in ful lment of the requirements for the degree of Doctor of Philosophy in the School of Electrical and Information Engineering Faculty of Engineering and Built Environment June 2017The realization of robust, reliable and e cient data transmission have been the theme of recent research, most importantly in real channel such as the noisy, fading prone power line communication (PLC) channel. The focus is to exploit old techniques or create new techniques capable of improving the transmission reliability and also increasing the transmission capacity of the real communication channels. Multi-carrier modulation scheme such as Orthogonal Frequency Division Multiplexing (OFDM) utilizing conventional single-carrier modulation is developed to facilitate a robust data transmission, increasing transmission capacity (e cient bandwidth usage) and further reducing design complexity in PLC systems. On the contrary, the reliability of data transmission is subjected to several inhibiting factors as a result of the varying nature of the PLC channel. These inhibiting factors include noise, perturbation and disturbances. Contrary to the Additive White Gaussian noise (AWGN) model often assumed in several communication systems, this noise model fails to capture the attributes of noise encountered on the PLC channel. This is because periodic noise or random noise pulses injected by power electronic appliances on the network is a deviation from the AWGN. The nature of the noise is categorized as non-white non-Gaussian and unstable due to its impulsive attributes, thus, it is labeled as Non-additive White Gaussian Noise (NAWGN). These noise and disturbances results into long burst errors that corrupts signals being transmitted, thus, the PLC is labeled as a horrible or burst error channel. The e cient and optimal performance of a conventional linear receiver in the white Gaussian noise environment can therefore be made to drastically degrade in this NAWGN environment. Therefore, transmission reliability in such environment can be greatly enhanced if we know and exploit the knowledge of the channel's statistical attributes, thus, the need for developing statistical channel model based on empirical data. In this thesis, attention is focused on developing a recon gurable software de ned un-coded single-carrier and multicarrier PLC transceiver as a tool for realizing an optimized channel model for the narrowband PLC (NB-PLC) channel. First, a novel recon gurable software de ned un-coded single-carrier and multi-carrier PLC transceiver is developed for real-time NB-PLC transmission. The transceivers can be adapted to implement di erent waveforms for several real-time scenarios and performance evaluation. Due to the varying noise parameters obtained from country to country as a result of the dependence of noise impairment on mains voltages, topology of power line, place and time, the developed transceivers is capable of facilitating constant measurement campaigns to capture these varying noise parameters before statistical and mathematically inclined channel models are derived. Furthermore, the single-carrier (Binary Phase Shift Keying (BPSK), Di erential BPSK (DBPSK), Quadrature Phase Shift Keying (QPSK) and Di erential QPSK (DQPSK)) PLC transceiver system developed is used to facilitate a First-Order semi-hidden Fritchman Markov modeling (SHFMM) of the NB-PLC channel utilizing the e cient iterative Baum- Welch algorithm (BWA) for parameter estimation. The performance of each modulation scheme is evaluated in a mildly and heavily disturbed scenarios for both residential and laboratory site considered. The First-Order estimated error statistics of the realized First- Order SHFMM have been analytically validated in terms of performance metrics such as: log-likelihood ratio (LLR), error-free run distribution (EFRD), error probabilities, mean square error (MSE) and Chi-square ( 2) test. The reliability of the model results is also con rmed by an excellent match between the empirically obtained error sequence and the SHFMM regenerated error sequence as shown by the error-free run distribution plot. This thesis also reports a novel development of a low cost, low complexity Frequency-shift keying (FSK) - On-o keying (OOK) in-house hybrid PLC and VLC system. The functionality of this hybrid PLC-VLC transceiver system was ascertained at both residential and laboratory site at three di erent times of the day: morning, afternoon and evening. A First and Second-Order SHFMM of the hybrid system is realized. The error statistics of the realized First and Second-Order SHFMMs have been analytically validated in terms of LLR, EFRD, error probabilities, MSE and Chi-square ( 2). The Second-Order SHFMMs have also been analytically validated to be superior to the First-Order SHFMMs although at the expense of added computational complexity. The reliability of both First and Second-Order SHFMM results is con rmed by an excellent match between the empirical error sequences and SHFMM re-generated error sequences as shown by the EFRD plot. In addition, the multi-carrier (QPSK-OFDM, Di erential QPSK (DQPSK)-OFDM) and Di erential 8-PSK (D8PSK)-OFDM) PLC transceiver system developed is used to facilitate a First and Second-Order modeling of the NB-PLC system using the SHFMM and BWA for parameter estimation. The performance of each OFDM modulation scheme in evaluated and compared taking into consideration the mildly and heavily disturbed noise scenarios for the two measurement sites considered. The estimated error statistics of the realized SHFMMs have been analytically validated in terms of LLR, EFRD, error probabilities, MSE and Chi-square ( 2) test. The estimated Second-Order SHFMMs have been analytically validated to be outperform the First-Order SHFMMs although with added computational complexity. The reliability of the models is con rmed by an excellent match between the empirical data and SHFMM generated data as shown by the EFRD plot. The statistical models obtained using Baum-Welch to adjust the parameters of the adopted SHFMM are often locally maximized. To solve this problem, a novel Metropolis-Hastings algorithm, a Bayesian inference approach based on Markov Chain Monte Carlo (MCMC) is developed to optimize the parameters of the adopted SHFMM. The algorithm is used to optimize the model results obtained from the single-carrier and multi-carrier PLC systems as well as that of the hybrid PLC-VLC system. Consequently, as deduced from the results, the models obtained utilizing the novel Metropolis-Hastings algorithm are more precise, near optimal model with parameter sets that are closer to the global maxima. Generally, the model results obtained in this thesis are relevant in enhancing transmission reliability on the PLC channel through the use of the models to improve the adopted modulation schemes, create adaptive modulation techniques, develop and evaluate forward error correction (FEC) codes such as a concatenation of Reed-Solomon and Permutation codes and other robust codes suitable for exploiting and mitigating noise impairments encountered on the low voltage NB-PLC channel. Furthermore, the recon gurable software de ned NB-PLC transceiver test-bed developed can be utilized for future measurement campaign as well as adapted for multiple-input and multiple-output (MIMO) PLC applications.MT201

Classification and modeling of power line noise using machine learning techniques

A thesis submitted in ful lment of the requirements for the degree of Doctor of Philosophy in the School of Electrical and Information Engineering Faculty of Engineering and Built Environment June 2017The realization of robust, reliable and e cient data transmission have been the theme of recent research, most importantly in real channel such as the noisy, fading prone power line communication (PLC) channel. The focus is to exploit old techniques or create new techniques capable of improving the transmission reliability and also increasing the transmission capacity of the real communication channels. Multi-carrier modulation scheme such as Orthogonal Frequency Division Multiplexing (OFDM) utilizing conventional single-carrier modulation is developed to facilitate a robust data transmission, increasing transmission capacity (e cient bandwidth usage) and further reducing design complexity in PLC systems. On the contrary, the reliability of data transmission is subjected to several inhibiting factors as a result of the varying nature of the PLC channel. These inhibiting factors include noise, perturbation and disturbances. Contrary to the Additive White Gaussian noise (AWGN) model often assumed in several communication systems, this noise model fails to capture the attributes of noise encountered on the PLC channel. This is because periodic noise or random noise pulses injected by power electronic appliances on the network is a deviation from the AWGN. The nature of the noise is categorized as non-white non-Gaussian and unstable due to its impulsive attributes, thus, it is labeled as Non-additive White Gaussian Noise (NAWGN). These noise and disturbances results into long burst errors that corrupts signals being transmitted, thus, the PLC is labeled as a horrible or burst error channel. The e cient and optimal performance of a conventional linear receiver in the white Gaussian noise environment can therefore be made to drastically degrade in this NAWGN environment. Therefore, transmission reliability in such environment can be greatly enhanced if we know and exploit the knowledge of the channel's statistical attributes, thus, the need for developing statistical channel model based on empirical data. In this thesis, attention is focused on developing a recon gurable software de ned un-coded single-carrier and multicarrier PLC transceiver as a tool for realizing an optimized channel model for the narrowband PLC (NB-PLC) channel. First, a novel recon gurable software de ned un-coded single-carrier and multi-carrier PLC transceiver is developed for real-time NB-PLC transmission. The transceivers can be adapted to implement di erent waveforms for several real-time scenarios and performance evaluation. Due to the varying noise parameters obtained from country to country as a result of the dependence of noise impairment on mains voltages, topology of power line, place and time, the developed transceivers is capable of facilitating constant measurement campaigns to capture these varying noise parameters before statistical and mathematically inclined channel models are derived. Furthermore, the single-carrier (Binary Phase Shift Keying (BPSK), Di erential BPSK (DBPSK), Quadrature Phase Shift Keying (QPSK) and Di erential QPSK (DQPSK)) PLC transceiver system developed is used to facilitate a First-Order semi-hidden Fritchman Markov modeling (SHFMM) of the NB-PLC channel utilizing the e cient iterative Baum- Welch algorithm (BWA) for parameter estimation. The performance of each modulation scheme is evaluated in a mildly and heavily disturbed scenarios for both residential and laboratory site considered. The First-Order estimated error statistics of the realized First- Order SHFMM have been analytically validated in terms of performance metrics such as: log-likelihood ratio (LLR), error-free run distribution (EFRD), error probabilities, mean square error (MSE) and Chi-square ( 2) test. The reliability of the model results is also con rmed by an excellent match between the empirically obtained error sequence and the SHFMM regenerated error sequence as shown by the error-free run distribution plot. This thesis also reports a novel development of a low cost, low complexity Frequency-shift keying (FSK) - On-o keying (OOK) in-house hybrid PLC and VLC system. The functionality of this hybrid PLC-VLC transceiver system was ascertained at both residential and laboratory site at three di erent times of the day: morning, afternoon and evening. A First and Second-Order SHFMM of the hybrid system is realized. The error statistics of the realized First and Second-Order SHFMMs have been analytically validated in terms of LLR, EFRD, error probabilities, MSE and Chi-square ( 2). The Second-Order SHFMMs have also been analytically validated to be superior to the First-Order SHFMMs although at the expense of added computational complexity. The reliability of both First and Second-Order SHFMM results is con rmed by an excellent match between the empirical error sequences and SHFMM re-generated error sequences as shown by the EFRD plot. In addition, the multi-carrier (QPSK-OFDM, Di erential QPSK (DQPSK)-OFDM) and Di erential 8-PSK (D8PSK)-OFDM) PLC transceiver system developed is used to facilitate a First and Second-Order modeling of the NB-PLC system using the SHFMM and BWA for parameter estimation. The performance of each OFDM modulation scheme in evaluated and compared taking into consideration the mildly and heavily disturbed noise scenarios for the two measurement sites considered. The estimated error statistics of the realized SHFMMs have been analytically validated in terms of LLR, EFRD, error probabilities, MSE and Chi-square ( 2) test. The estimated Second-Order SHFMMs have been analytically validated to be outperform the First-Order SHFMMs although with added computational complexity. The reliability of the models is con rmed by an excellent match between the empirical data and SHFMM generated data as shown by the EFRD plot. The statistical models obtained using Baum-Welch to adjust the parameters of the adopted SHFMM are often locally maximized. To solve this problem, a novel Metropolis-Hastings algorithm, a Bayesian inference approach based on Markov Chain Monte Carlo (MCMC) is developed to optimize the parameters of the adopted SHFMM. The algorithm is used to optimize the model results obtained from the single-carrier and multi-carrier PLC systems as well as that of the hybrid PLC-VLC system. Consequently, as deduced from the results, the models obtained utilizing the novel Metropolis-Hastings algorithm are more precise, near optimal model with parameter sets that are closer to the global maxima. Generally, the model results obtained in this thesis are relevant in enhancing transmission reliability on the PLC channel through the use of the models to improve the adopted modulation schemes, create adaptive modulation techniques, develop and evaluate forward error correction (FEC) codes such as a concatenation of Reed-Solomon and Permutation codes and other robust codes suitable for exploiting and mitigating noise impairments encountered on the low voltage NB-PLC channel. Furthermore, the recon gurable software de ned NB-PLC transceiver test-bed developed can be utilized for future measurement campaign as well as adapted for multiple-input and multiple-output (MIMO) PLC applications.MT201

High performance binary LDPC-coded OFDM systems over indoor PLC channels

Power line communication (PLC) technology is actually among the most renowned technologies for home environments due to their low-cost installation opportunities. In this study, the bit error rate (BER) performances of binary low-density parity check (LDPC) coded orthogonal frequency-division multiplexing (OFDM) systems have been considered over indoor PLC channels. Performances comparison of diverse soft and hard decision LDPC decoder schemes such as Min-Sum (MS), weighted bit flipping (WBF), gradient descent bit-flip (GDBF), noisy gradient descent bit-flip (NGDBF) and its few variants including the single-bit NGDBF (S-NGDBF), multi-bit NGDBF (M-NGDBF) and smoothed-multi-bit NGDBF (SM-NGDBF) decoders were examined in the modeled network. To evaluate the BER performance analyses three different PLC channel scenarios were generated by using new and more realistic PLC channel model proposal were also employed. All of the simulations performed in Canete’s PLC channel model showed that remarkable performance improvement can be achieved by using short-length LDPC codes. Especially, the improvements are striking when the MS or SM-NGDBF decoding algorithms are employed on the receiver side

Characterization and Emulation of Low-Voltage Power Line Channels for Narrowband and Broadband Communication

The demand for smart grid and smart home applications has raised the recent interest in power line communication (PLC) technologies, and has driven a broad set of deep surveys in low-voltage (LV) power line channels. This book proposes a set of novel approaches, to characterize and to emulate LV power line channels in the frequency range from0.15to 10 MHz, which closes gaps between the traditional narrowband (up to 500 kHz) and broadband (above1.8 MHz) ranges

Characterization and Emulation of Low-Voltage Power Line Channels for Narrowband and Broadband Communication

The demand for smart grid and smart home applications has raised the recent interest in power line communication (PLC) technologies, and has driven a broad set of deep surveys in low-voltage (LV) power line channels. This book proposes a set of novel approaches, to characterize and to emulate LV power line channels in the frequency range from0.15to 10 MHz, which closes gaps between the traditional narrowband (up to 500 kHz) and broadband (above1.8 MHz) ranges

Impulsive Noise Characterization in Narrowband Power Line Communication

Currently, narrowband Power line communication (PLC) is considered an attractive communication system in smart grid environments for applications such as advanced metering infrastructure (AMI). In this paper, we will present a comprehensive comparison and analysis in time and frequency domain of noise measured in China and Italy. In addition, impulsive noise in these two countries are mainly analyzed and modeled using two probability based models, Middleton Class A (MCA) model and α stable distribution model. The results prove that noise measured in China is rich in impulsive noise, and can be modeled well by α stable distribution model, while noise measured in Italy has less impulsive noise, and can be better modeled by the MCA model

Noise Characterization and Emulation for Low-Voltage Power Line Channels between 150 kHz and 10 MHz

Characterization and emulation of power line noise have attracted interest since long, in both narrowband and broadband applications. Based on existing models, this paper presents a systematic approach to extract and parameterize each subtype of low-voltage (LV) power line noise between 150 kHz and 10 MHz. Based on the characterization, a FPGA-based emulator is proposed to emulate power line noise scenarios flexibly. A LV power line noise measuring platform is also presented with sample measurements and their emulation

A flexible statistical framework for the characterization and modelling of noise in powerline communication channels.

Doctor of Philosophy in Electronic Engineering.One communication medium that has received a lot of interest in recent years is the power line channel, especially for the delivery of broadband content. This channel has been traditionally used to carry electrical power only. But with the recent advancements in digital signal processing, it is now possible to realize communications through the power grid, both in narrowband and broadband. The use of the power line network for telecommunication purposes constitutes what is referred to as powerline carrier communications or simply powerline communications (PLC). The biggest incentive for PLC technology use is the fact that the power line network is already in place, which greatly reduces the communication network set up cost, since no new cabling layout is required. PLC technology is widely applied in home networking, broadband internet provision and smart grid solutions. However, the PLC channel presents a very hostile communication environment. And as such, no consideration has been made in the design of traditional power line network to accommodate communication services. Of all the PLC channel impairments which include frequency-dependent attenuation, frequency selectivity, multipath and noise, noise is the biggest threat to communication signals. This noise manifests itself in form of coloured background noise, narrowband interference and impulsive noise. A thorough understanding of this noise distribution is therefore crucial for the design of a reliable and high performing PLC system. A proper understanding of the noise characteristics in the PLC channel can only be realized through noise measurements in live power networks, and then analyzing and modeling the noise appropriately. Moreover, the noise scenario in power line networks is very complex and therefore cannot be modeled through mere analytical methods. Additionally, most of the models that have been proposed for the PLC noise previously are mere adaptations of the measured noise to some existing impulsive noise models. These earlier modeling approaches are also rigid and model the noise via a fixed set of parameters. In the introductory work in this thesis, a study of orthogonal frequency division multiplexing (OFDM) as the modulation of choice for PLC systems is presented. A thorough survey of the salient features of this modulation scheme that make it the perfect candidate for PLC modulation needs is presented. In the end, a performance analysis study on the impact of impulsive noise on an OFDM based binary phase shift keying (BPSK) system is done. This study differs from earlier ones in that its focus is on how the elementary parameters that define the impulsive noise affect the system, a departure from the usual norm of considering the overall noise distribution. This study focuses on the impact of interarrival times (IAT), pulse amplitudes as well as pulse widths, among other parameters. In the first part of the main work in this thesis, results of an intensive noise measurement campaign for indoor low voltage power line noise carried out in various power line networks, in the Department of Electrical, Electronic and Computer Engineering buildings at the University of KwaZulu-Natal, Howard campus are presented. The noise measurements are carried out in both time and frequency domains. Next, the noise measurements are then analyzed and modeled using two very flexible data modeling tools; nonparametric kernel density estimators and parametric alpha stable (α-stable) distributions. The kernel method’s ability to overcome all the shortcomings of the primitive histogram method makes it very attractive. In this method, the noise data structure is derived straight from the data itself, with no prior assumptions or restrictions on the data structure, thus effectively overcoming the rigidity associated with previous noise models for power line channels. As such, it results in density estimates that “hug” the measured density as much as possible. The models obtained using the kernel methods are therefore better than any parametric equivalent; something that can always be proven through goodness of fit tests. These models therefore form an excellent reference for parametric modeling of the power line noise. This work forms the author’s first main contribution to PLC research. As a demonstration of the kernel models suitability to act as a reference, parametric models of the noise distribution using the alpha stable (α-stable) distribution are also developed. This distribution is chosen due to its flexibility and ability to capture impulsiveness (long-tailed behaviour), such as the one found in power line noise. Stable distributions are characterized by long/fat tails than those of the Gaussian distribution, and that is the main reason why they are preferable here since the noise characteritics obtained in the kernel technique show visible long/heavy tailed behavior. A parameter estimation technique that is based on quantiles and another on the empirical characteristic function are employed in the extraction of the four parameters that define the characteristic function of the α-stable distribution. The application of the α-stable distribution in other signal processing problems has often been over-simplied by considering the symmetric alpha stable distribution, but in this thesis, the general α-stable distribution is used to model the power line noise. This is necessary so as to ensure that no features of the noise distribution are missed. All the models obtained are validated through error analysis and Chi-square fitness tests. This work forms the author’s second main contribution to PLC research. The author’s last contribution in this thesis is the development of an algorithm for the synthesis of the power line as a Levy stable stochastic process. The algorithm developed is then used to generate the PLC noise process for a random number of alpha stable noise samples using the alpha stable noise parameters obtained in the parametric modeling using stable distributions. This algorithm is generalized for all admissible values of alpha stable noise parameters and therefore results for a Levy stable Gaussian process are also presented for the same number of random noise samples for comparison purposes