Demand Response Strategy Based on Reinforcement Learning and Fuzzy Reasoning for Home Energy Management

As energy demand continues to increase, demand response (DR) programs in the electricity distribution grid are gaining momentum and their adoption is set to grow gradually over the years ahead. Demand response schemes seek to incentivise consumers to use green energy and reduce their electricity usage during peak periods which helps support grid balancing of supply-demand and generate revenue by selling surplus of energy back to the grid. This paper proposes an effective energy management system for residential demand response using Reinforcement Learning (RL) and Fuzzy Reasoning (FR). RL is considered as a model-free control strategy which learns from the interaction with its environment by performing actions and evaluating the results. The proposed algorithm considers human preference by directly integrating user feedback into its control logic using fuzzy reasoning as reward functions. Q-learning, a RL strategy based on a reward mechanism, is used to make optimal decisions to schedule the operation of smart home appliances by shifting controllable appliances from peak periods, when electricity prices are high, to off-peak hours, when electricity prices are lower without affecting the customer’s preferences. The proposed approach works with a single agent to control 14 household appliances and uses a reduced number of state-action pairs and fuzzy logic for rewards functions to evaluate an action taken for a certain state. The simulation results show that the proposed appliances scheduling approach can smooth the power consumption profile and minimise the electricity cost while considering user’s preferences, user’s feedbacks on each action taken and his/her preference settings. A user-interface is developed in MATLAB/Simulink for the Home Energy Management System (HEMS) to demonstrate the proposed DR scheme. The simulation tool includes features such as smart appliances, electricity pricing signals, smart meters, solar photovoltaic generation, battery energy storage, electric vehicle and grid supply.Peer reviewe

Simplified Algorithm for Dynamic Demand Response in Smart Homes Under Smart Grid Environment

Under Smart Grid environment, the consumers may respond to incentive--based smart energy tariffs for a particular consumption pattern. Demand Response (DR) is a portfolio of signaling schemes from the utility to the consumers for load shifting/shedding with a given deadline. The signaling schemes include Time--of--Use (ToU) pricing, Maximum Demand Limit (MDL) signals etc. This paper proposes a DR algorithm which schedules the operation of home appliances/loads through a minimization problem. The category of loads and their operational timings in a day have been considered as the operational parameters of the system. These operational parameters determine the dynamic priority of a load, which is an intermediate step of this algorithm. The ToU pricing, MDL signals, and the dynamic priority of loads are the constraints in this formulated minimization problem, which yields an optimal schedule of operation for each participating load within the consumer provided duration. The objective is to flatten the daily load curve of a smart home by distributing the operation of its appliances in possible low--price intervals without violating the MDL constraint. This proposed algorithm is simulated in MATLAB environment against various test cases. The obtained results are plotted to depict significant monetary savings and flattened load curves.Comment: This paper was accepted and presented in 2019 IEEE PES GTD Grand International Conference and Exposition Asia (GTD Asia). Furthermore, the conference proceedings has been published in IEEE Xplor

Heuristic optimization of clusters of heat pumps: A simulation and case study of residential frequency reserve

The technological challenges of adapting energy systems to the addition of more renewables are intricately interrelated with the ways in which markets incentivize their development and deployment. Households with own onsite distributed generation augmented by electrical and thermal storage capacities (prosumers), can adjust energy use based on the current needs of the electricity grid. Heat pumps, as an established technology for enhancing energy efficiency, are increasingly seen as having potential for shifting electricity use and contributing to Demand Response (DR). Using a model developed and validated with monitoring data of a household in a plus-energy neighborhood in southern Germany, the technical and financial viability of utilizing household heat pumps to provide power in the market for Frequency Restoration Reserve (FRR) are studied. The research aims to evaluate the flexible electrical load offered by a cluster of buildings whose heat pumps are activated depending on selected rule-based participation strategies. Given the prevailing prices for FRR in Germany, the modelled cluster was unable to reduce overall electricity costs and thus was unable to show that DR participation as a cluster with the heat pumps is financially viable. Five strategies that differed in the respective contractual requirements that would need to be agreed upon between the cluster manager and the aggregator were studied. The relatively high degree of flexibility necessary for the heat pumps to participate in FRR activations could be provided to varying extents in all strategies, but the minimum running time of the heat pumps turned out to be the primary limiting physical (and financial) factor. The frequency, price and duration of the activation calls from the FRR are also vital to compensate the increase of the heat pumps’ energy use. With respect to thermal comfort and self-sufficiency constraints, the buildings were only able to accept up to 34% of the activation calls while remaining within set comfort parameters. This, however, also depends on the characteristics of the buildings. Finally, a sensitivity analysis showed that if the FRR market changed and the energy prices were more advantageous, the proposed approaches could become financially viable. This work suggests the need for further study of the role of heat pumps in flexibility markets and research questions concerning the aggregation of local clusters of such flexible technologies.Comisión Europea 69596

Smart Grid Technologies in Europe: An Overview

The old electricity network infrastructure has proven to be inadequate, with respect to modern challenges such as alternative energy sources, electricity demand and energy saving policies. Moreover, Information and Communication Technologies (ICT) seem to have reached an adequate level of reliability and flexibility in order to support a new concept of electricity network—the smart grid. In this work, we will analyse the state-of-the-art of smart grids, in their technical, management, security, and optimization aspects. We will also provide a brief overview of the regulatory aspects involved in the development of a smart grid, mainly from the viewpoint of the European Unio

Small-scale (≤6 kWe) stand-alone and grid-connected photovoltaic, wind, hydroelectric, biodiesel, and wood gasification system's simulated technical, economic, and mitigation analyses for rural regions in Western Australia

This research develops models and simulations of technical performance, net emission reductions, and discounted market values of thirteen small-scale (≤6 kWe) renewable energy projects. The research uses a simple methodology suitable for small private entities and governments to compare alternative investment options for both climate change mitigation and adaptation in the southwest of Western Australia. The system simulation and modelling results indicate that privately-owned, small-scale, grid-connected renewable energy systems were not competitive options for private entities relative to sourcing electricity from electricity networks, despite subsidies. The total discounted capital and operating costs, combined with the minimal mitigation potentials of the small-scale renewable energy systems resulted in unnecessarily high electricity costs and equivalent carbon prices, relative to grid-connection and large-scale clean energy systems. In contrast, this research suggests that small-scale renewable energy systems are cost-effective for both private entities and governments and exhibit good mitigation potentials when installed in remote locations far from the electricity network, mostly displacing diesel capacity