Classification and modeling of power line noise using machine learning techniques

A thesis submitted in ful lment of the requirements for the degree of Doctor of Philosophy in the School of Electrical and Information Engineering Faculty of Engineering and Built Environment June 2017The realization of robust, reliable and e cient data transmission have been the theme of recent research, most importantly in real channel such as the noisy, fading prone power line communication (PLC) channel. The focus is to exploit old techniques or create new techniques capable of improving the transmission reliability and also increasing the transmission capacity of the real communication channels. Multi-carrier modulation scheme such as Orthogonal Frequency Division Multiplexing (OFDM) utilizing conventional single-carrier modulation is developed to facilitate a robust data transmission, increasing transmission capacity (e cient bandwidth usage) and further reducing design complexity in PLC systems. On the contrary, the reliability of data transmission is subjected to several inhibiting factors as a result of the varying nature of the PLC channel. These inhibiting factors include noise, perturbation and disturbances. Contrary to the Additive White Gaussian noise (AWGN) model often assumed in several communication systems, this noise model fails to capture the attributes of noise encountered on the PLC channel. This is because periodic noise or random noise pulses injected by power electronic appliances on the network is a deviation from the AWGN. The nature of the noise is categorized as non-white non-Gaussian and unstable due to its impulsive attributes, thus, it is labeled as Non-additive White Gaussian Noise (NAWGN). These noise and disturbances results into long burst errors that corrupts signals being transmitted, thus, the PLC is labeled as a horrible or burst error channel. The e cient and optimal performance of a conventional linear receiver in the white Gaussian noise environment can therefore be made to drastically degrade in this NAWGN environment. Therefore, transmission reliability in such environment can be greatly enhanced if we know and exploit the knowledge of the channel's statistical attributes, thus, the need for developing statistical channel model based on empirical data. In this thesis, attention is focused on developing a recon gurable software de ned un-coded single-carrier and multicarrier PLC transceiver as a tool for realizing an optimized channel model for the narrowband PLC (NB-PLC) channel. First, a novel recon gurable software de ned un-coded single-carrier and multi-carrier PLC transceiver is developed for real-time NB-PLC transmission. The transceivers can be adapted to implement di erent waveforms for several real-time scenarios and performance evaluation. Due to the varying noise parameters obtained from country to country as a result of the dependence of noise impairment on mains voltages, topology of power line, place and time, the developed transceivers is capable of facilitating constant measurement campaigns to capture these varying noise parameters before statistical and mathematically inclined channel models are derived. Furthermore, the single-carrier (Binary Phase Shift Keying (BPSK), Di erential BPSK (DBPSK), Quadrature Phase Shift Keying (QPSK) and Di erential QPSK (DQPSK)) PLC transceiver system developed is used to facilitate a First-Order semi-hidden Fritchman Markov modeling (SHFMM) of the NB-PLC channel utilizing the e cient iterative Baum- Welch algorithm (BWA) for parameter estimation. The performance of each modulation scheme is evaluated in a mildly and heavily disturbed scenarios for both residential and laboratory site considered. The First-Order estimated error statistics of the realized First- Order SHFMM have been analytically validated in terms of performance metrics such as: log-likelihood ratio (LLR), error-free run distribution (EFRD), error probabilities, mean square error (MSE) and Chi-square ( 2) test. The reliability of the model results is also con rmed by an excellent match between the empirically obtained error sequence and the SHFMM regenerated error sequence as shown by the error-free run distribution plot. This thesis also reports a novel development of a low cost, low complexity Frequency-shift keying (FSK) - On-o keying (OOK) in-house hybrid PLC and VLC system. The functionality of this hybrid PLC-VLC transceiver system was ascertained at both residential and laboratory site at three di erent times of the day: morning, afternoon and evening. A First and Second-Order SHFMM of the hybrid system is realized. The error statistics of the realized First and Second-Order SHFMMs have been analytically validated in terms of LLR, EFRD, error probabilities, MSE and Chi-square ( 2). The Second-Order SHFMMs have also been analytically validated to be superior to the First-Order SHFMMs although at the expense of added computational complexity. The reliability of both First and Second-Order SHFMM results is con rmed by an excellent match between the empirical error sequences and SHFMM re-generated error sequences as shown by the EFRD plot. In addition, the multi-carrier (QPSK-OFDM, Di erential QPSK (DQPSK)-OFDM) and Di erential 8-PSK (D8PSK)-OFDM) PLC transceiver system developed is used to facilitate a First and Second-Order modeling of the NB-PLC system using the SHFMM and BWA for parameter estimation. The performance of each OFDM modulation scheme in evaluated and compared taking into consideration the mildly and heavily disturbed noise scenarios for the two measurement sites considered. The estimated error statistics of the realized SHFMMs have been analytically validated in terms of LLR, EFRD, error probabilities, MSE and Chi-square ( 2) test. The estimated Second-Order SHFMMs have been analytically validated to be outperform the First-Order SHFMMs although with added computational complexity. The reliability of the models is con rmed by an excellent match between the empirical data and SHFMM generated data as shown by the EFRD plot. The statistical models obtained using Baum-Welch to adjust the parameters of the adopted SHFMM are often locally maximized. To solve this problem, a novel Metropolis-Hastings algorithm, a Bayesian inference approach based on Markov Chain Monte Carlo (MCMC) is developed to optimize the parameters of the adopted SHFMM. The algorithm is used to optimize the model results obtained from the single-carrier and multi-carrier PLC systems as well as that of the hybrid PLC-VLC system. Consequently, as deduced from the results, the models obtained utilizing the novel Metropolis-Hastings algorithm are more precise, near optimal model with parameter sets that are closer to the global maxima. Generally, the model results obtained in this thesis are relevant in enhancing transmission reliability on the PLC channel through the use of the models to improve the adopted modulation schemes, create adaptive modulation techniques, develop and evaluate forward error correction (FEC) codes such as a concatenation of Reed-Solomon and Permutation codes and other robust codes suitable for exploiting and mitigating noise impairments encountered on the low voltage NB-PLC channel. Furthermore, the recon gurable software de ned NB-PLC transceiver test-bed developed can be utilized for future measurement campaign as well as adapted for multiple-input and multiple-output (MIMO) PLC applications.MT201

Classification and modeling of power line noise using machine learning techniques

A thesis submitted in ful lment of the requirements for the degree of Doctor of Philosophy in the School of Electrical and Information Engineering Faculty of Engineering and Built Environment June 2017The realization of robust, reliable and e cient data transmission have been the theme of recent research, most importantly in real channel such as the noisy, fading prone power line communication (PLC) channel. The focus is to exploit old techniques or create new techniques capable of improving the transmission reliability and also increasing the transmission capacity of the real communication channels. Multi-carrier modulation scheme such as Orthogonal Frequency Division Multiplexing (OFDM) utilizing conventional single-carrier modulation is developed to facilitate a robust data transmission, increasing transmission capacity (e cient bandwidth usage) and further reducing design complexity in PLC systems. On the contrary, the reliability of data transmission is subjected to several inhibiting factors as a result of the varying nature of the PLC channel. These inhibiting factors include noise, perturbation and disturbances. Contrary to the Additive White Gaussian noise (AWGN) model often assumed in several communication systems, this noise model fails to capture the attributes of noise encountered on the PLC channel. This is because periodic noise or random noise pulses injected by power electronic appliances on the network is a deviation from the AWGN. The nature of the noise is categorized as non-white non-Gaussian and unstable due to its impulsive attributes, thus, it is labeled as Non-additive White Gaussian Noise (NAWGN). These noise and disturbances results into long burst errors that corrupts signals being transmitted, thus, the PLC is labeled as a horrible or burst error channel. The e cient and optimal performance of a conventional linear receiver in the white Gaussian noise environment can therefore be made to drastically degrade in this NAWGN environment. Therefore, transmission reliability in such environment can be greatly enhanced if we know and exploit the knowledge of the channel's statistical attributes, thus, the need for developing statistical channel model based on empirical data. In this thesis, attention is focused on developing a recon gurable software de ned un-coded single-carrier and multicarrier PLC transceiver as a tool for realizing an optimized channel model for the narrowband PLC (NB-PLC) channel. First, a novel recon gurable software de ned un-coded single-carrier and multi-carrier PLC transceiver is developed for real-time NB-PLC transmission. The transceivers can be adapted to implement di erent waveforms for several real-time scenarios and performance evaluation. Due to the varying noise parameters obtained from country to country as a result of the dependence of noise impairment on mains voltages, topology of power line, place and time, the developed transceivers is capable of facilitating constant measurement campaigns to capture these varying noise parameters before statistical and mathematically inclined channel models are derived. Furthermore, the single-carrier (Binary Phase Shift Keying (BPSK), Di erential BPSK (DBPSK), Quadrature Phase Shift Keying (QPSK) and Di erential QPSK (DQPSK)) PLC transceiver system developed is used to facilitate a First-Order semi-hidden Fritchman Markov modeling (SHFMM) of the NB-PLC channel utilizing the e cient iterative Baum- Welch algorithm (BWA) for parameter estimation. The performance of each modulation scheme is evaluated in a mildly and heavily disturbed scenarios for both residential and laboratory site considered. The First-Order estimated error statistics of the realized First- Order SHFMM have been analytically validated in terms of performance metrics such as: log-likelihood ratio (LLR), error-free run distribution (EFRD), error probabilities, mean square error (MSE) and Chi-square ( 2) test. The reliability of the model results is also con rmed by an excellent match between the empirically obtained error sequence and the SHFMM regenerated error sequence as shown by the error-free run distribution plot. This thesis also reports a novel development of a low cost, low complexity Frequency-shift keying (FSK) - On-o keying (OOK) in-house hybrid PLC and VLC system. The functionality of this hybrid PLC-VLC transceiver system was ascertained at both residential and laboratory site at three di erent times of the day: morning, afternoon and evening. A First and Second-Order SHFMM of the hybrid system is realized. The error statistics of the realized First and Second-Order SHFMMs have been analytically validated in terms of LLR, EFRD, error probabilities, MSE and Chi-square ( 2). The Second-Order SHFMMs have also been analytically validated to be superior to the First-Order SHFMMs although at the expense of added computational complexity. The reliability of both First and Second-Order SHFMM results is con rmed by an excellent match between the empirical error sequences and SHFMM re-generated error sequences as shown by the EFRD plot. In addition, the multi-carrier (QPSK-OFDM, Di erential QPSK (DQPSK)-OFDM) and Di erential 8-PSK (D8PSK)-OFDM) PLC transceiver system developed is used to facilitate a First and Second-Order modeling of the NB-PLC system using the SHFMM and BWA for parameter estimation. The performance of each OFDM modulation scheme in evaluated and compared taking into consideration the mildly and heavily disturbed noise scenarios for the two measurement sites considered. The estimated error statistics of the realized SHFMMs have been analytically validated in terms of LLR, EFRD, error probabilities, MSE and Chi-square ( 2) test. The estimated Second-Order SHFMMs have been analytically validated to be outperform the First-Order SHFMMs although with added computational complexity. The reliability of the models is con rmed by an excellent match between the empirical data and SHFMM generated data as shown by the EFRD plot. The statistical models obtained using Baum-Welch to adjust the parameters of the adopted SHFMM are often locally maximized. To solve this problem, a novel Metropolis-Hastings algorithm, a Bayesian inference approach based on Markov Chain Monte Carlo (MCMC) is developed to optimize the parameters of the adopted SHFMM. The algorithm is used to optimize the model results obtained from the single-carrier and multi-carrier PLC systems as well as that of the hybrid PLC-VLC system. Consequently, as deduced from the results, the models obtained utilizing the novel Metropolis-Hastings algorithm are more precise, near optimal model with parameter sets that are closer to the global maxima. Generally, the model results obtained in this thesis are relevant in enhancing transmission reliability on the PLC channel through the use of the models to improve the adopted modulation schemes, create adaptive modulation techniques, develop and evaluate forward error correction (FEC) codes such as a concatenation of Reed-Solomon and Permutation codes and other robust codes suitable for exploiting and mitigating noise impairments encountered on the low voltage NB-PLC channel. Furthermore, the recon gurable software de ned NB-PLC transceiver test-bed developed can be utilized for future measurement campaign as well as adapted for multiple-input and multiple-output (MIMO) PLC applications.MT201

Understanding Peripheral Blood Pressure Signals: A Statistical Learning Approach

Proper estimation of body fluid status for human or animal subjects has always been a challenging problem. Accurate and timely estimate of body fluid can prevent life threatening conditions under trauma and severe dehydration. The main objective of this research is the estimation, classification and detection of dehydration in human and animal subjects using peripheral blood pressure (PBP) signals. Peripheral venous pressure (PVP) and peripheral arterial pressure (PAP) signals have been investigated in this research. Both PVP and PAP signals are PBP signals. A dataset of PVP signals was collected using standard peripheral intravenous catheters from human subjects suffering from hypertrophic pyloric stenosis. Using this dataset, we successfully classified dehydrated subjects from hydrated subjects using regularized logistic regression on frequency domain data of the PVP signals. During the data acquisition process, the PVP signals was corrupted by noise and blood clot. So, we developed an unsupervised anomaly detection algorithm for PVP signals using hidden Markov model and Kalman filter. This anomaly detection algorithm removed the human bias in data-preprocessing. Another dataset of PAP and PVP signals was collected from pigs under anesthesia using the Millar catheter. We proposed a integral pulse frequency modulation (IPFM) based signal model for both PAP and PVP signals. The proposed model-synthesized signal is highly correlated with the experimental data. The model-synthesized signals also performs similar to experimental signals under classification tasks. We also examine the model estimated parameters both qualitatively and quantitatively. This model can also quantify the effect of respiratory rate on heart rate variability. Increasing doses of anesthesia has similar effect of getting hydrated from dehydration

Understanding Peripheral Blood Pressure Signals: A Statistical Learning Approach

Proper estimation of body fluid status for human or animal subjects has always been a challenging problem. Accurate and timely estimate of body fluid can prevent life threatening conditions under trauma and severe dehydration. The main objective of this research is the estimation, classification and detection of dehydration in human and animal subjects using peripheral blood pressure (PBP) signals. Peripheral venous pressure (PVP) and peripheral arterial pressure (PAP) signals have been investigated in this research. Both PVP and PAP signals are PBP signals. A dataset of PVP signals was collected using standard peripheral intravenous catheters from human subjects suffering from hypertrophic pyloric stenosis. Using this dataset, we successfully classified dehydrated subjects from hydrated subjects using regularized logistic regression on frequency domain data of the PVP signals. During the data acquisition process, the PVP signals was corrupted by noise and blood clot. So, we developed an unsupervised anomaly detection algorithm for PVP signals using hidden Markov model and Kalman filter. This anomaly detection algorithm removed the human bias in data-preprocessing. Another dataset of PAP and PVP signals was collected from pigs under anesthesia using the Millar catheter. We proposed a integral pulse frequency modulation (IPFM) based signal model for both PAP and PVP signals. The proposed model-synthesized signal is highly correlated with the experimental data. The model-synthesized signals also performs similar to experimental signals under classification tasks. We also examine the model estimated parameters both qualitatively and quantitatively. This model can also quantify the effect of respiratory rate on heart rate variability. Increasing doses of anesthesia has similar effect of getting hydrated from dehydration

A Framework for Bioacoustic Vocalization Analysis Using Hidden Markov Models

Using Hidden Markov Models (HMMs) as a recognition framework for automatic classification of animal vocalizations has a number of benefits, including the ability to handle duration variability through nonlinear time alignment, the ability to incorporate complex language or recognition constraints, and easy extendibility to continuous recognition and detection domains. In this work, we apply HMMs to several different species and bioacoustic tasks using generalized spectral features that can be easily adjusted across species and HMM network topologies suited to each task. This experimental work includes a simple call type classification task using one HMM per vocalization for repertoire analysis of Asian elephants, a language-constrained song recognition task using syllable models as base units for ortolan bunting vocalizations, and a stress stimulus differentiation task in poultry vocalizations using a non-sequential model via a one-state HMM with Gaussian mixtures. Results show strong performance across all tasks and illustrate the flexibility of the HMM framework for a variety of species, vocalization types, and analysis tasks

A Framework for Bioacoustic Vocalization Analysis Using Hidden Markov Models

Using Hidden Markov Models (HMMs) as a recognition framework for automatic classification of animal vocalizations has a number of benefits, including the ability to handle duration variability through nonlinear time alignment, the ability to incorporate complex language or recognition constraints, and easy extendibility to continuous recognition and detection domains. In this work, we apply HMMs to several different species and bioacoustic tasks using generalized spectral features that can be easily adjusted across species and HMM network topologies suited to each task. This experimental work includes a simple call type classification task using one HMM per vocalization for repertoire analysis of Asian elephants, a language-constrained song recognition task using syllable models as base units for ortolan bunting vocalizations, and a stress stimulus differentiation task in poultry vocalizations using a non-sequential model via a one-state HMM with Gaussian mixtures. Results show strong performance across all tasks and illustrate the flexibility of the HMM framework for a variety of species, vocalization types, and analysis tasks

Classification of linear and nonlinear modulations using Bayesian methods

La reconnaissance de modulations numériques consiste à identifier, au niveau du récepteur d'une chaîne de transmission, l'alphabet auquel appartiennent les symboles du message transmis. Cette reconnaissance est nécessaire dans de nombreux scénarios de communication, afin, par exemple, de sécuriser les transmissions pour détecter d'éventuels utilisateurs non autorisés ou bien encore de déterminer quel terminal brouille les autres. Le signal observé en réception est généralement affecté d'un certain nombre d'imperfections, dues à une synchronisation imparfaite de l'émetteur et du récepteur, une démodulation imparfaite, une égalisation imparfaite du canal de transmission. Nous proposons plusieurs méthodes de classification qui permettent d'annuler les effets liés aux imperfections de la chaîne de transmission. Les symboles reçus sont alors corrigés puis comparés à ceux du dictionnaire des symboles transmis. Plus précisément, nous étudions trois techniques permettant d'estimer la loi a posteriori d'une modulation au niveau du récepteur. La première technique estime les paramètres inconnus associés aux diverses imperfections affectant le récepteur à l'aide d'une approche Bayésienne couplée avec une méthode de simulation MCMC (Markov Chain Monte Carlo). Une deuxième technique utilise l'algorithme de Baum Welch qui permet d'estimer de manière récursive la loi a posteriori du signal reçu et de déterminer la modulation la plus probable parmi un catalogue donné. La dernière méthode étudiée dans cette thèse consiste à corriger les erreurs de synchronisation de phase et de fréquence avec une boucle de phase. Les algorithmes considérés dans cette thèse ont permis de reconnaître un certain nombre de modulations linéaires de types QAM (Quadrature Amplitude Modulation) et PSK (Phase Shift Keying) mais aussi des modulations non linéaires de type GMSK (Gaussian Minimum Shift Keying). ABSTRACT : This thesis studies classification of digital linear and nonlinear modulations using Bayesian methods. Modulation recognition consists of identifying, at the receiver, the type of modulation signals used by the transmitter. It is important in many communication scenarios, for example, to secure transmissions by detecting unauthorized users, or to determine which transmitter interferes the others. The received signal is generally affected by a number of impairments. We propose several classification methods that can mitigate the effects related to imperfections in transmission channels. More specifically, we study three techniques to estimate the posterior probabilities of the received signals conditionally to each modulation. The first technique estimates the unknown parameters associated with various imperfections using a Bayesian approach coupled with Markov Chain Monte Carlo (MCMC) methods. A second technique uses the Baum Welch (BW) algorithm to estimate recursively the posterior probabilities and determine the most likely modulation type from a catalogue. The last method studied in this thesis corrects synchronization errors (phase and frequency offsets) with a phase-locked loop (PLL). The classification algorithms considered in this thesis can recognize a number of linear modulations such as Quadrature Amplitude Modulation (QAM), Phase Shift Keying (PSK), and nonlinear modulations such as Gaussian Minimum Shift Keying (GMSK

A Mobile Wireless Channel State Recognition Algorihm: Introduction, Definition, and Verification - Sensing for Cognitive Environmental Awareness

This research includes mobile wireless systems limited by time and frequency dispersive channels. A blind mobile wireless channel (MWC) state recognition (CSR) algorithm that detects hidden coherent nonselective and noncoherent selective processes is verified. Because the algorithm is blind, it releases capacity based on current channel state that traditionally is fixed and reserved for channel gain estimation and distortion mitigation. The CSR algorithm enables cognitive communication system control including signal processing, resource allocation/deallocation, or distortion mitigation selections based on channel coherence states. MWC coherent and noncoherent states, ergodicity, stationarity, uncorrelated scattering, and Markov processes are assumed for each time block. Furthermore, a hidden Markov model (HMM) is utilized to represent the statistical relationships between hidden dispersive processes and observed receive waveform processes. First-order and second-order statistical extracted features support state hard decisions which are combined in order to increase the accuracy of channel state estimates. This research effort has architected, designed, and verified a blind statistical feature recognition algorithm capable of detecting coherent nonselective, single time selective, single frequency selective, or dual selective noncoherent states. A MWC coherence state model (CSM) was designed to represent these hidden dispersive processes. Extracted statistical features are input into a parallel set of trained HMMs that compute state sequence conditional likelihoods. Hard state decisions are combined to produce a single most likely channel state estimate for each time block. To verify the CSR algorithm performance, combinations of hidden state sequences are applied to the CSR algorithm and verified against input hidden state sequences. State sequence recognition accuracy sensitivity was found to be above 99% while specificity was determined to be above 98% averaged across all features, states, and sequences. While these results establish the feasibility of a MWC blind CSR algorithm, optimal configuration requires future research to further improve performance including: 1) characterizing the range of input signal configurations, 2) waveform feature block size reduction, 3) HMM parameter tracking, 4) HMM computational complexity and latency reduction, 5) feature soft decision combining, 6) recursive implementation, 7) interfacing with state based mobile wireless communication control processes, and 8) extension to wired or wireless waveform recognition