Artificial Intelligence and Machine Learning Approaches to Energy Demand-Side Response: A Systematic Review

Recent years have seen an increasing interest in Demand Response (DR) as a means to provide flexibility, and hence improve the reliability of energy systems in a cost-effective way. Yet, the high complexity of the tasks associated with DR, combined with their use of large-scale data and the frequent need for near real-time de-cisions, means that Artificial Intelligence (AI) and Machine Learning (ML) — a branch of AI — have recently emerged as key technologies for enabling demand-side response. AI methods can be used to tackle various challenges, ranging from selecting the optimal set of consumers to respond, learning their attributes and pref-erences, dynamic pricing, scheduling and control of devices, learning how to incentivise participants in the DR schemes and how to reward them in a fair and economically efficient way. This work provides an overview of AI methods utilised for DR applications, based on a systematic review of over 160 papers, 40 companies and commercial initiatives, and 21 large-scale projects. The papers are classified with regards to both the AI/ML algorithm(s) used and the application area in energy DR. Next, commercial initiatives are presented (including both start-ups and established companies) and large-scale innovation projects, where AI methods have been used for energy DR. The paper concludes with a discussion of advantages and potential limitations of reviewed AI techniques for different DR tasks, and outlines directions for future research in this fast-growing area

Application of demand response programs for peak reduction using load aggregator

O aumento do consumo de energia requer atenção. Os especialistas propuseram muitas soluções para otimizar o uso de energia e propõem um sistema de gestão de energia eficiente. No entanto, desenvolver um sistema de energia que contempla agregadores de carga é óbvio para aprimorar o processo de gestão de energia. Este trabalho discute um sistema de gestão de energia para implementar programas de Demand Response (DR) usando abordagens de agregação de carga. Neste trabalho, dois estudos de caso comparam as diferentes respostas do sistema. O objetivo principal é discutir o papel de diferentes modelos de agregador de carga no sistema de energia, implementando um programa de DR. Esses agregadores de carga controlam diferentes tipos de cargas. Neste contexto, vários tipos de cargas domésticas são consideradas cargas controláveis. No processo de agregação, o objetivo é agregar as cargas que possuem as mesmas características usando a análise de agrupamento das cargas. A contribuição científica desta dissertação está relacionada com a redução da ponta e a agregação de cargas, considerando as cargas controláveis e os recursos de geração no sistema. Para atingir o objetivo anterior, foram realizados dois estudos de caso. Cada estudo de caso consiste em três cenários baseados no modelo de agregação de carga. Os resultados dos estudos indicam as respostas do sistema aos diferentes cenários e ilustram os méritos do modelo de agregador de carga. Além disso, os resultados demonstram como o agrupamento dos dispositivos de carga no sistema pode efetivamente fornecer redução de pico com recurso a programas de DR.The increment of energy consumption takes a high level of attention. The experts have proposed many solutions to optimize energy use and propose an efficient energy management system. However, verifying the load aggregators' role energy system is obvious to enhance the energy management process. This work discusses an energy management system to implement DR programs using load aggregation approaches. In this work, two case studies compare the different responses of the system. The main goal is to discuss the role of different load aggregator models in the power system by implementing a DR program. Those load aggregators control different types of loads. In this context, various types of domestic loads are considered controllable loads. In the aggregation process, the goal is to aggregate the loads that have the same features using the clustering analysis of the loads. The scientific contribution of this thesis is related to the integration of providing the peak reduction and the clustered aggregation of loads, considering the controllable loads and generation resources in the system. To achieve the previous goal, two case studies have been done. Each case study consists of three scenarios based on the load aggregation model. The results of the case studies indicate the system responses to the different scenarios and illustrate the merits of the load aggregator model. Furthermore, the results demonstrate how clustering the load appliances in the system can effectively provide peak reduction due to the DR programs

Artificial intelligence for decision making in energy demand-side response

This thesis examines the role and application of data-driven Artificial Intelligence (AI) approaches for the energy demand-side response (DR). It follows the point of view of a service provider company/aggregator looking to support its decision-making and operation. Overall, the study identifies data-driven AI methods as an essential tool and a key enabler for DR. The thesis is organised into two parts. It first provides an overview of AI methods utilised for DR applications based on a systematic review of over 160 papers, 40 commercial initiatives, and 21 large-scale projects. The reviewed work is categorised based on the type of AI algorithm(s) employed and the DR application area of the AI methods. The end of the first part of the thesis discusses the advantages and potential limitations of the reviewed AI techniques for different DR tasks and how they compare to traditional approaches. The second part of the thesis centres around designing machine learning algorithms for DR. The undertaken empirical work highlights the importance of data quality for providing fair, robust, and safe AI systems in DR — a high-stakes domain. It furthers the state of the art by providing a structured approach for data preparation and data augmentation in DR to minimise propagating effects in the modelling process. The empirical findings on residential response behaviour show better response behaviour in households with internet access, air-conditioning systems, power-intensive appliances, and lower gas usage. However, some insights raise questions about whether the reported levels of consumers’ engagement in DR schemes translate to actual curtailment behaviour and the individual rationale of customer response to DR signals. The presented approach also proposes a reinforcement learning framework for the decision problem of an aggregator selecting a set of consumers for DR events. This approach can support an aggregator in leveraging small-scale flexibility resources by providing an automated end-to-end framework to select the set of consumers for demand curtailment during Demand-Side Response (DR) signals in a dynamic environment while considering a long-term view of their selection process

Assessment of the value of flexibility by using stochastic scheduling tool

This thesis proposes novel analytical models for assessing the role and the value of various flexibility resources in the future low-carbon systems with high penetration of renewable energy resources. A novel stochastic scheduling model is developed, which optimises system operation by simultaneously scheduling energy production, standing/spinning reserves and inertia-dependent frequency regulation in light of uncertainties associated with wind energy production and thermal generation outages. The proposed model is shown to be particularly suitable for analysing the value of flexibility. Following this, the thesis presents an assessment of the value that energy storage may deliver to the owner in the application to energy and ancillary service markets. The results suggest that the value of energy storage is mainly driven by the temporal arbitrage opportunities created by volatility in energy prices. The value of energy storage is shown to be site-specific when there are active network constraints. A novel methodology is then proposed and applied to assess the role and the value of frequency regulation support (synthetic inertia (SI) and primary frequency response (PRF)) from wind plants (WPs). The results suggest the SI could effectively reduce the system operation cost in the system, especially with high penetration of wind generation. The analysis also demonstrates the value for WPs in providing PFR is system-specified. Combined provision of SI and PFR is required, in the case that there exists severe recovery effect associated with SI provision. This thesis also proposes a novel demand side response model (DSRM), which models and controls the recovery period during and after frequency regulation provision and thus optimally allocates multiple frequency services. The results attest the value of the DSRM compared with alternative approaches for demand response schemes. Moreover, this thesis quantifies the implications of electric vehicle deployment, heat pumps, industrial and commercial and dynamic time-of-use tariffs for the carbon emissions and renewable integration cost of the broader GB electricity system. Finally, this thesis investigates the value of enhanced flexibility from conventional plants. It has been shown that the value increases with penetration of RES; however, different systems may require different types of enhanced flexibility features. Moreover, different system scheduling methods, risk attitudes, frequency response requirements and carbon prices could significantly change the value of flexibility.Open Acces

Flexibility market for congestion management in smart grids

Mención Internacional en el título de doctorCurrent power systems are facing several sustainability challenges to meet the increasing demand of electricity. In addition, there is a global direction to increase the share of renewable energy sources in the power generation mix and energy efficiency. In the face of all such challenges, smart grids were incepted. Smart grids are modernized power systems that integrate state-of-the art communication and information technology to facilitate the bidirectional flow of information and electricity between the supply and demand sides. The resilience of smart grids can pave the way for having more flexibility at the distribution level of the power systems. Demand response (DR) programs are considered one of the sources of system flexibility and it is one of the main components of smart grids. DR can be defined as the willingness of customers to alter their electricity consumption profile in response to price signals. Transmission system operators have been implementing demand response programs in a straightforward fashion for several years now. For example, by having energy prices that are expensive during on-peak periods and low-priced at off-peak periods. Other type of DR programs introduces price signals when grid reliability is compromised and a reduction in energy consumption is necessary. In this way, customers can plan their activities accordingly in order to save money. Now, a new era of technology, artificial intelligence and the so-called “internet of things”, have provided new ways to explore the full potential of demand response, by allowing to alter loads in a much more dynamic and precise manner, thus optimizing the operation of grid assets. This thesis focuses on one of the main types of DR programs which is demand flexibility. Demand flexibility is the ability of the demand-side customers to adjust their load profiles in response to an external market signal. On the short- and medium-term periods, distribution system operators (DSOs) can take advantage of the flexibility of demand to mitigate network congestions caused by increased peaks or high penetration of renewable energy. On the long-term period, DSOs can include demand flexibility in their network expansion planning process for future demand growth. The optimal usage of demand flexibility can help in postponing needed investments for upgrading the networks’ capacity. Demand flexibility can be acquired through market-based solutions which can deliver cost-efficient flexibility services for several market agents by facilitating competition between different flexibility providers. Market mechanisms are considered by policy makers as the optimal solution for flexibility access. With respect to that, this thesis proposes a comprehensive framework for a distribution-level flexibility market, called “Flex-DLM” that enables and facilitates the trading of demand flexibility between the distribution system operator, as the main buyer, and aggregators, as sellers representing flexible consumers. Two types of demand flexibility services were modelled, which are: 1- Up-regulation flexibility (UREG), which corresponds to load decrease volumes, and 2- Down-regulation flexibility (DREG), which corresponds load increase volumes. In addition, the payback effect, which is a common event to the activation of demand flexibility, is considered for both types of flexibility services. Also, the distribution network constraints were modelled, which represents the power flow constraints of the network, which is key to present a realistic model for the flexibility market. In the Flex-DLM, the DSO is considered as the market operator who is responsible of clearing the market, while making sure the network congestions are mitigated. The Flex-DLM operates on two timeframes which are day-ahead and real-time with an objective to provide the DSO with flexibility products that can help it in the congestion management process. In addition to this, the uncertainty of demand is taken into consideration to prevent the DSO from procuring inaccurate amounts of demand flexibility. A new option is introduced in the day-ahead Flex-DLM, called the right-to-use (RtU) that allows the DSO to reserve the right to activate demand flexibility during the day-ahead period for congestions that have low probability of occurrence on the following operation day. In this way, the DSO can call upon this option in real-time if the congestion takes place. Also, the uncertainty behind the customers’ commitment to the flexibility activation requests and amounts is taken into consideration. In this thesis, the decision-making process of the DSO for optimizing its choice of demand flexibility and minimizing its total cost is modelled. Two methods were carried out for the optimization model proposed in this work. The first method follows a deterministic approach, where the objective is to optimize the DSO’s cost and clear the Flex-DLM during the day-ahead period only, without taking into account the uncertainty of demand and the uncertainty of consumers’ participation. The second method follows probabilistic approach, which considers the demand uncertainty during the day-ahead and real-time periods and models the uncertainty behind the customers’ commitment. Both optimization methods were integrated with an optimal power flow (OPF) solver tool in order to check the technical validity of the activated flexibility services and to make sure that the payback effect does not cause further congestions in the network. The advantage of the proposed framework is that it requires minimum regulatory changes and it does not involve the DSO in any electricity trading. Also, the proposed optimization method can be integrated with any OPF solver tool. Different distribution feeders obtained from a distribution network located in Spain were used to check the validity of the proposed framework and the decision-making process. The case studies are divided into two parts: 1- The first part applies the proposed flexibility framework from a deterministic perspective and 2- The second part applies the Flex-DLM framework considering all uncertainties, which corresponds to the probabilistic optimization approach. Finally, to help the DSO in the long-term planning process of its local network, a cost & benefit analysis is carried out to value the economic impact of implementing demand flexibility programs as an alternate solution to conventional network upgradesLos sistemas de energía actuales se enfrentan a varios desafíos de sostenibilidad para satisfacer la creciente demanda de electricidad. Además, existe una clara tendencia a aumentar la proporción de fuentes renovables de energía en la generación de energía y así como hacia la eficiencia energética. Como parte de la respuesta a estos desafíos, se iniciaron las redes inteligentes. Las redes inteligentes son sistemas de energía modernizados que integran tecnología de comunicación e información de última generación para facilitar el flujo bidireccional de información y electricidad entre la oferta y la demanda. La utilización de las redes inteligentes pretende facilitar el empleo de la flexibilidad en la red de distribución de los sistemas eléctricos. Los programas de gestión de la demanda se consideran una de las fuentes de flexibilidad del sistema y es uno de los puntos sobre los que se apoyan las redes inteligentes. La gestión de la demanda se puede definir como la disposición de los clientes a alterar su perfil de consumo de electricidad en respuesta a las señales de precios. Los operadores de sistemas de transporte han estado implementando programas de respuesta a la demanda de manera directa desde hace varios años. Por ejemplo, la diferencia entre precios altos y bajos en el mercado mayorista introduce un incentivo para el consumo en horas de menor precio. Otro tipo de programas de gestión de la demanda introduce señales de precios cuando la fiabilidad de la red se ve comprometida y es necesaria una reducción en el consumo de energía. De esta manera, los consumidores pueden planificar sus actividades en consecuencia para ahorrar costes. Ahora, una nueva era de la tecnología, la inteligencia artificial y el llamado "internet de las cosas" han proporcionado nuevas formas de explorar el potencial completo de la respuesta de la demanda, al permitir alterar las cargas de una manera mucho más dinámica y precisa, optimizando así la utilización de los activos de red. Esta tesis se centra en uno de los principales tipos de programas de DR que es la flexibilidad de la demanda. La flexibilidad de la demanda es la capacidad de los clientes del lado de la demanda para ajustar sus perfiles de carga en respuesta a una señal del mercado externo. En los períodos a corto y mediano plazo, los operadores de sistemas de distribución pueden aprovechar la flexibilidad de la demanda para mitigar las congestiones en la red causadas por el aumento de los picos de demanda o la alta penetración de energía renovable. En el período a largo plazo, los distribuidores pueden incluir la flexibilidad de la demanda en su proceso de planificación de expansión de la red para el crecimiento futuro de la demanda. El uso óptimo de la flexibilidad de la demanda puede ayudar a posponer las inversiones necesarias para mejorar la capacidad de las redes. La flexibilidad de la demanda se puede conseguir mediante soluciones basadas en el mercado que pueden ofrecer servicios de flexibilidad rentables para varios agentes del mercado al facilitar la competencia entre diferentes proveedores de flexibilidad. Los reguladores suelen considerar que son los mecanismos de mercado los que dan la solución óptima para la gestión de la flexibilidad. En relación con estos temas, esta tesis propone un marco integral para un mercado de flexibilidad a en la red de distribución, denominado “Flex-DLM” que permite y facilita el comercio de flexibilidad de demanda entre el operador del sistema de distribución, como el principal comprador, y los agregadores, como vendedores que representan a los consumidores flexibles. Se han modelado dos tipos de servicios de flexibilidad de demanda, que son: 1- Flexibilidad a subir (UREG), que corresponde a un requerimiento disminución de carga, y 2- Flexibilidad a bajar (DREG), que corresponde a un requerimiento de aumento de carga. Además, el efecto de rebote, o consumo posterior al uso de la flexibilidad, que es un fenómeno común tras la activación de la flexibilidad de la demanda, se tiene en cuenta para ambos tipos de servicios de flexibilidad. Además, se han modelado las restricciones de la red de distribución, que representan las restricciones de flujo de potencia de la red, que es clave para presentar un modelo realista para el mercado de flexibilidad. En el mercado Flex-DLM propuesto, se considera al distribuidor como el operador responsable de despejar el mercado, al tiempo que se encarga de mitigar las congestiones de la red. El Flex-DLM opera en dos marcos de tiempo: el diario y el tiempo real con el objetivo de proporcionar al distribuidor productos flexibles que puedan ayudarlo en el proceso de gestión de la congestión. Además de esto, la incertidumbre de la demanda se tiene en cuenta para evitar que el distribuidor adquiera cantidades incorrectas de flexibilidad de la demanda. Se introduce una nueva opción en el Flex-DLM del día siguiente, denominado derecho de uso que le permite al distribuidor reservar el derecho de activar la flexibilidad de la demanda durante el período del día anterior para congestiones que tienen poca probabilidad de ocurrencia en el siguiente día de operación. De esta manera, el distribuidor puede recurrir a esta opción en tiempo real si se produce la congestión. Además, se tiene en cuenta la incertidumbre sobre del compromiso de cumplimiento de los clientes con los requerimientos y las cantidades de energía activadas durante el proceso de gestión de la flexibilidad. En esta tesis, se modela asimismo el proceso de toma de decisiones del DSO para optimizar su elección de flexibilidad de demanda y minimizar su costo total. Se llevaron a cabo dos métodos para el modelo de optimización propuesto en este trabajo. El primer método sigue un enfoque determinista, donde el objetivo es optimizar el coste de la flexibilidad para el distribuidor y eliminar el Flex-DLM solo durante el mercado diario , sin tener en cuenta la incertidumbre de la demanda y la de la participación de los consumidores. El segundo método sigue un enfoque probabilístico, que considera la incertidumbre de la demanda durante los períodos diarios y en tiempo real y modela la incertidumbre del compromiso de los clientes. Ambos métodos de optimización se integraron con una herramienta de solución de flujo de potencia óptimo (OPF) para verificar la validez técnica de los servicios de flexibilidad activados y asegurar que el efecto de recuperación no cause más congestiones en la red. La ventaja del marco propuesto es que requiere cambios regulatorios mínimos y no involucra al DSO en ningún comercio de electricidad. Además, el método de optimización propuesto se puede integrar con cualquier herramienta de solución OPF. Se han utiliado diferentes líneas de distribución obtenidos de una red de distribución ubicada en España para verificar la validez del marco propuesto y el proceso de toma de decisiones. Los estudios de caso se dividen en dos partes: 1- La primera parte aplica el marco de flexibilidad propuesto desde una perspectiva determinista y 2- La segunda parte aplica el marco Flex-DLM considerando todas las incertidumbres, que corresponden al enfoque de optimización probabilística. Finalmente, para ayudar al distribuidor en el proceso de planificación a largo plazo de su red local, se lleva a cabo un análisis coste - beneficio para valorar el impacto económico de la implementación de programas de flexibilidad de la demanda como una solución alternativa a las actualizaciones de red convencionales.Programa Oficial de Doctorado en Ingeniería Eléctrica, Electrónica y AutomáticaPresidente: Hortensia Elena Amaris Duarte.- Secretario: Milan Prodanovic.- Vocal: Barry Patrick Haye