Advanced Wide-Area Monitoring System Design, Implementation, and Application

Wide-area monitoring systems (WAMSs) provide an unprecedented way to collect, store and analyze ultra-high-resolution synchrophasor measurements to improve the dynamic observability in power grids. This dissertation focuses on designing and implementing a wide-area monitoring system and a series of applications to assist grid operators with various functionalities. The contributions of this dissertation are below: First, a synchrophasor data collection system is developed to collect, store, and forward GPS-synchronized, high-resolution, rich-type, and massive-volume synchrophasor data. a distributed data storage system is developed to store the synchrophasor data. A memory-based cache system is discussed to improve the efficiency of real-time situation awareness. In addition, a synchronization system is developed to synchronize the configurations among the cloud nodes. Reliability and Fault-Tolerance of the developed system are discussed. Second, a novel lossy synchrophasor data compression approach is proposed. This section first introduces the synchrophasor data compression problem, then proposes a methodology for lossy data compression, and finally presents the evaluation results. The feasibility of the proposed approach is discussed. Third, a novel intelligent system, SynchroService, is developed to provide critical functionalities for a synchrophasor system. Functionalities including data query, event query, device management, and system authentication are discussed. Finally, the resiliency and the security of the developed system are evaluated. Fourth, a series of synchrophasor-based applications are developed to utilize the high-resolution synchrophasor data to assist power system engineers to monitor the performance of the grid as well as investigate the root cause of large power system disturbances. Lastly, a deep learning-based event detection and verification system is developed to provide accurate event detection functionality. This section introduces the data preprocessing, model design, and performance evaluation. Lastly, the implementation of the developed system is discussed

Image Embedding of PMU Data for Deep Learning towards Transient Disturbance Classification

This paper presents a study on power grid disturbance classification by Deep Learning (DL). A real synchrophasor set composing of three different types of disturbance events from the Frequency Monitoring Network (FNET) is used. An image embedding technique called Gramian Angular Field is applied to transform each time series of event data to a two-dimensional image for learning. Two main DL algorithms, i.e. CNN (Convolutional Neural Network) and RNN (Recurrent Neural Network) are tested and compared with two widely used data mining tools, the Support Vector Machine and Decision Tree. The test results demonstrate the superiority of the both DL algorithms over other methods in the application of power system transient disturbance classification.Comment: An updated version of this manuscript has been accepted by the 2018 IEEE International Conference on Energy Internet (ICEI), Beijing, Chin

Aplicação de interpretabilidade para melhorar o desempenho de um classificador LSTM para eventos de sistema de potência

Orientador: Daniel DottaDissertação (mestrado) - Universidade Estadual de Campinas, Faculdade de Engenharia Elétrica e de ComputaçãoResumo: Atualmente, uma grande quantidade de dados é coletada pelos WAMS (Wide Area Measurement Systems). Portanto, existe uma clara necessidade de métodos de aprendizagem de máquina (ML - Machine Learning), capazes de extrair informações relevantes e confiáveis dos dados de sincrofasores. Entre as abordagens de ML, os modelos de Rede Neural Profunda (DNN - Deep Neural Network) têm a vantagem de aprender diretamente com os dados, tornando essas abordagens não dependentes das técnicas de extração de atributos. No entanto, esses modelos profundos produzem classificadores caixa-preta (black-box) que podem suscitar preocupações quando aplicados a ambientes de alto risco (infraestrutura crítica), como o sistema elétrico de potência (EPS-Electric Power Systems). Neste trabalho, a aplicação de um método orientado a dados (data-driven) explicável é realizada a fim de inspecionar o desempenho do classificador DNN para identificação de eventos usando medições de sincrofasores. O classificador DNN é uma LSTM (Long-Short Term Memory) que tem demostrado bom desempenho na extração de características dinâmicas. A principal vantagem dessa abordagem é o uso de uma inspeção baseada em interpretabilidade denominada SHAP (SHapley Additive exPlanation), que é baseada na teoria dos jogos cooperativos (valores Shapley), que fornece os meios para avaliar as previsões da LSTM, destacando as partes das séries temporais de entrada que mais contribuíram para a identificação dos eventos e detecção de possíveis vieses. Além disso, usando a inspeção SHAP juntamente com o conhecimento de domínio (domain knowledge) sobre o problema, o desempenho e a coerência do classificador LSTM são aprimorados ao escolher o classificador que não apenas possui a maior acurácia de identificação (IAR - Identification Accuracy Rate), mas também é coerente com o conhecimento de domínio do problema, minimizando possíveis vieses detectados. O uso dessa abordagem interpretável é útil porque: i) explica como o classificador LSTM está tomando suas decisões; ii) ajuda o designer a melhorar o treinamento do classificador; iii) certifica que o classificador resultante tem um desempenho consistente e coerente de acordo com o conhecimento do domínio; iv) quando o usuário entende que o classificador está tomando decisões coerentes, reduz claramente as preocupações da aplicação dos métodos DNN em uma infraestrutura crítica. O método proposto é avaliado usando registros reais de eventos sincrofasores do Sistema Interligado Nacional (SIN)Abstract: Nowadays, vast amounts of data are collected by Wide Area Measurement Systems (WAMS). Therefore, there is an obvious necessity for Machine Learning (ML) methods, as useful knowledge to extract relevant and reliable information from this synchrophasor data. Among the ML approaches, the Deep Neural Network (DNN) models provide an important opportunity to advance direct learning from the data, making these approaches independent from feature extraction techniques. However, these deep models produce black-box classifiers that can be matter of concern when applying to high-risk environment (critical infrastructure) such as the EPS (Electric Power Systems). In this work, the application of an explainable data-driven method is carried out in order to inspect the performance of DNN classifier for event identification using synchrophasor measurements. The DNN classifier is a Long-Short Term Memory (LSTM) with positive performance in the extraction of dynamic features. The principal benefit of this approach is the use of an interpretability inspection named SHAP (SHapley Additive exPlanation) values, which are based on cooperative game theory (Shapley values). These SHAP values provide the means to evaluate the predictions of the LSTM, highlight the parts of the input time-series with the most contribution to the identification of the events, and detect possible bias. Moreover, by employing the SHAP inspection along with domain knowledge of the problem, the performance and coherence of the LSTM classifier will be improved by choosing the classifier that not only has highest Identification Accuracy Rate (IAR) but is also coherent with domain knowledge of the problem, minimizing detected bias. The application of this interpretable approach is desirable because: i) it explains how the LSTM classifier is making its decisions; ii) it helps the designer to improve the training of the classifier; iii) it certifies that the resulting classifier has a consistent and coherent performance according to domain knowledge of the problem; iv) it clearly reduces the concerns of the application of DNN methods in a critical infrastructure, in the cases that the user understands that the classifier is taking coherent decisions. The proposed method has been evaluated using real synchrophasor event records from the Brazilian Interconnected Power System (BIPS)MestradoEnergia ElétricaMestre em Engenharia Elétrica2017/25425-5FAPES

Fast Extraction and Characterization of Fundamental Frequency Events from a Large PMU Dataset using Big Data Analytics

A novel method for fast extraction of fundamental frequency events (FFE) based on measurements of frequency and rate of change of frequency by Phasor Measurement Units (PMU) is introduced. The method is designed to work with exceptionally large historical PMU datasets. Statistical analysis was used to extract the features and train Random Forest and Catboost classifiers. The method is capable of fast extraction of FFE from a historical dataset containing measurements from hundreds of PMUs captured over multiple years. The reported accuracy of the best algorithm for classification expressed as Area Under the receiver operating Characteristic curve reaches 0.98, which was obtained in out-of-sample evaluations on 109 system-wide events over 2 years observed at 43 PMUs. Then Minimum Volume Enclosing Ellipsoid Algorithm was used to further analyze the events. 93.72% events were correctly characterized, where average duration of the event as seen by the PMU was 9.93 sec

Adversarial Purification for Data-Driven Power System Event Classifiers with Diffusion Models

The global deployment of the phasor measurement units (PMUs) enables real-time monitoring of the power system, which has stimulated considerable research into machine learning-based models for event detection and classification. However, recent studies reveal that machine learning-based methods are vulnerable to adversarial attacks, which can fool the event classifiers by adding small perturbations to the raw PMU data. To mitigate the threats posed by adversarial attacks, research on defense strategies is urgently needed. This paper proposes an effective adversarial purification method based on the diffusion model to counter adversarial attacks on the machine learning-based power system event classifier. The proposed method includes two steps: injecting noise into the PMU data; and utilizing a pre-trained neural network to eliminate the added noise while simultaneously removing perturbations introduced by the adversarial attacks. The proposed adversarial purification method significantly increases the accuracy of the event classifier under adversarial attacks while satisfying the requirements of real-time operations. In addition, the theoretical analysis reveals that the proposed diffusion model-based adversarial purification method decreases the distance between the original and compromised PMU data, which reduces the impacts of adversarial attacks. The empirical results on a large-scale real-world PMU dataset validate the effectiveness and computational efficiency of the proposed adversarial purification method

Vulnerability Assessment and Privacy-preserving Computations in Smart Grid

Modern advances in sensor, computing, and communication technologies enable various smart grid applications which highlight the vulnerability that requires novel approaches to the field of cybersecurity. While substantial numbers of technologies have been adopted to protect cyber attacks in smart grid, there lacks a comprehensive review of the implementations, impacts, and solutions of cyber attacks specific to the smart grid.In this dissertation, we are motivated to evaluate the security requirements for the smart grid which include three main properties: confidentiality, integrity, and availability. First, we review the cyber-physical security of the synchrophasor network, which highlights all three aspects of security issues. Taking the synchrophasor network as an example, we give an overview of how to attack a smart grid network. We test three types of attacks and show the impact of each attack consisting of denial-of-service attack, sniffing attack, and false data injection attack.Next, we discuss how to protect against each attack. For protecting availability, we examine possible defense strategies for the associated vulnerabilities.For protecting data integrity, a small-scale prototype of secure synchrophasor network is presented with different cryptosystems. Besides, a deep learning based time-series anomaly detector is proposed to detect injected measurement. Our approach observes both data measurements and network traffic features to jointly learn system states and can detect attacks when state vector estimator fails.For protecting data confidentiality, we propose privacy-preserving algorithms for two important smart grid applications. 1) A distributed privacy-preserving quadratic optimization algorithm to solve Security Constrained Optimal Power Flow (SCOPF) problem. The SCOPF problem is decomposed into small subproblems using the Alternating Direction Method of Multipliers (ADMM) and gradient projection algorithms. 2) We use Paillier cryptosystem to secure the computation of the power system dynamic simulation. The IEEE 3-Machine 9-Bus System is used to implement and demonstrate the proposed scheme. The security and performance analysis of our implementations demonstrate that our algorithms can prevent chosen-ciphertext attacks at a reasonable cost

Synchronized measurement data conditioning and real-time applications

Phasor measurement units (PMU), measuring voltage and current phasor with synchronized timestamps, is the fundamental component in wide-area monitoring systems (WAMS) and reveals complex dynamic behaviors of large power systems. The synchronized measurements collected from power grid may degrade due to many factors and impacts of the distorted synchronized measurement data are significant to WAMS. This dissertation focus on developing and improving applications with distorted synchronized measurements from power grid. The contributions of this dissertation are summarized below. In Chapter 2, synchronized frequency measurements of 13 power grids over the world, including both mainland and island systems, are retrieved from Frequency Monitoring Network (FNET/GridEye) and the statistical analysis of the typical power grids are presented. The probability functions of the power grid frequency based on the measurements are calculated and categorized. Developments of generation trip/load shedding and line outage events detection and localization based on high-density PMU measurements are investigated in Chapters 3 and 4 respectively. Four different types of abnormal synchronized measurements are identified from the PMU measurements of a power grid. The impacts of the abnormal synchronized measurements on generation trip/load shedding events detection and localization are evaluated. A line outage localization method based on power flow measurements is proposed to improve the accuracy of line outage events location estimation. A deep learning model is developed to detect abnormal synchronized measurements in Chapter 5. The performance of the model is evaluated with abnormal synchronized measurements from a power grid under normal operation status. Some types of abnormal synchronized measurements in the testing cases are recently observed and reported. An extensive study of hyper-parameters in the model is conducted and evaluation metrics of the model performance are presented. A non-contact synchronized measurements study using electric field strength is investigated in Chapter 6. The theoretical foundation and equation derivations are presented. The calculation process for a single circuit AC transmission line and a double circuit AC transmission line are derived. The derived method is implemented with Matlab and tested in simulation cases