Demand Response Strategy Based on Reinforcement Learning and Fuzzy Reasoning for Home Energy Management

As energy demand continues to increase, demand response (DR) programs in the electricity distribution grid are gaining momentum and their adoption is set to grow gradually over the years ahead. Demand response schemes seek to incentivise consumers to use green energy and reduce their electricity usage during peak periods which helps support grid balancing of supply-demand and generate revenue by selling surplus of energy back to the grid. This paper proposes an effective energy management system for residential demand response using Reinforcement Learning (RL) and Fuzzy Reasoning (FR). RL is considered as a model-free control strategy which learns from the interaction with its environment by performing actions and evaluating the results. The proposed algorithm considers human preference by directly integrating user feedback into its control logic using fuzzy reasoning as reward functions. Q-learning, a RL strategy based on a reward mechanism, is used to make optimal decisions to schedule the operation of smart home appliances by shifting controllable appliances from peak periods, when electricity prices are high, to off-peak hours, when electricity prices are lower without affecting the customer’s preferences. The proposed approach works with a single agent to control 14 household appliances and uses a reduced number of state-action pairs and fuzzy logic for rewards functions to evaluate an action taken for a certain state. The simulation results show that the proposed appliances scheduling approach can smooth the power consumption profile and minimise the electricity cost while considering user’s preferences, user’s feedbacks on each action taken and his/her preference settings. A user-interface is developed in MATLAB/Simulink for the Home Energy Management System (HEMS) to demonstrate the proposed DR scheme. The simulation tool includes features such as smart appliances, electricity pricing signals, smart meters, solar photovoltaic generation, battery energy storage, electric vehicle and grid supply.Peer reviewe

Ready To Roll: Southeastern Pennsylvania's Regional Electric Vehicle Action Plan

On-road internal combustion engine (ICE) vehicles are responsible for nearly one-third of energy use and one-quarter of greenhouse gas (GHG) emissions in southeastern Pennsylvania.1 Electric vehicles (EVs), including plug-in hybrid electric vehicles (PHEVs) and all-electric vehicles (AEVs), present an opportunity to serve a significant portion of the region's mobility needs while simultaneously reducing energy use, petroleum dependence, fueling costs, and GHG emissions. As a national leader in EV readiness, the region can serve as an example for other efforts around the country."Ready to Roll! Southeastern Pennsylvania's Regional EV Action Plan (Ready to Roll!)" is a comprehensive, regionally coordinated approach to introducing EVs and electric vehicle supply equipment (EVSE) into the five counties of southeastern Pennsylvania (Bucks, Chester, Delaware, Montgomery, and Philadelphia). This plan is the product of a partnership between the Delaware Valley Regional Planning Commission (DVRPC), the City of Philadelphia, PECO Energy Company (PECO; the region's electricity provider), and Greater Philadelphia Clean Cities (GPCC). Additionally, ICF International provided assistance to DVRPC with the preparation of this plan. The plan incorporates feedback from key regional stakeholders, national best practices, and research to assess the southeastern Pennsylvania EV market, identify current market barriers, and develop strategies to facilitate vehicle and infrastructure deployment

Multi-household energy management in a smart neighborhood in the presence of uncertainties and electric vehicles

none4noThe pathway toward the reduction of greenhouse gas emissions is dependent upon increasing Renewable Energy Sources (RESs), demand response, and electrification of public and private transportation. Energy management techniques are necessary to coordinate the operation in this complex scenario, and in recent years several works have appeared in the literature on this topic. This paper presents a study on multi-household energy management for Smart Neighborhoods integrating RESs and electric vehicles participating in Vehicle-to-Home (V2H) and Vehicle-to-Neighborhood (V2N) programs. The Smart Neighborhood comprises multiple households, a parking lot with public charging stations, and an aggregator that coordinates energy transactions using a Multi-Household Energy Manager (MH-EM). The MH-EM jointly maximizes the profits of the aggregator and the households by using the augmented ɛ-constraint approach. The generated Pareto optimal solutions allow for different decision policies to balance the aggregator’s and households’ profits, prioritizing one of them or the RES energy usage within the Smart Neighborhood. The experiments have been conducted over an entire year considering uncertainties related to the energy price, electric vehicles usage, energy production of RESs, and energy demand of the households. The results show that the MH-EM optimizes the Smart Neighborhood operation and that the solution that maximizes the RES energy usage provides the greatest benefits also in terms of peak-shaving and valley-filling capability of the energy demand.openLuca Serafini, Emanuele Principi, Susanna Spinsante, Stefano SquartiniSerafini, Luca; Principi, Emanuele; Spinsante, Susanna; Squartini, Stefan

Smart Grid for the Smart City

Modern cities are embracing cutting-edge technologies to improve the services they offer to the citizens from traffic control to the reduction of greenhouse gases and energy provisioning. In this chapter, we look at the energy sector advocating how Information and Communication Technologies (ICT) and signal processing techniques can be integrated into next generation power grids for an increased effectiveness in terms of: electrical stability, distribution, improved communication security, energy production, and utilization. In particular, we deliberate about the use of these techniques within new demand response paradigms, where communities of prosumers (e.g., households, generating part of their electricity consumption) contribute to the satisfaction of the energy demand through load balancing and peak shaving. Our discussion also covers the use of big data analytics for demand response and serious games as a tool to promote energy-efficient behaviors from end users

Energy Transparency in the Multifamily Housing Sector

Mirroring recent trends in other real estate sectors, the multifamily housing sector is subject to an increasing number of rules and regulations related to energy-performance benchmarking and performance disclosure. State and local governments are moving rapidly to institutionalize benchmarking and make energy performance information available in the real estate marketplace, while major lending institutions are taking initial steps to factor building energy performance into financial products. The goal of these new rules is to enable transparent building energy-performance information to drive energy efficiency improvements in multifamily housing that lower energy bills for residents; contribute to greater local housing affordability; and new jobs and services related to energy efficiency. Many multifamily owners and operators have never benchmarked the energy performance of their buildings, while other parties -- including state, local, and federal policymakers, tenants, utilities, and lenders -- have little or no access to building energy-performance information that can help shape real estate decisions or inform the development of policies, incentives, and financial vehicles to advance energy efficiency. This critical shortage of information about building energy performance has prevented property markets from valuing energy efficiency and severely undermined both public and private efforts to increase the energy efficiency of multifamily housing.While energy benchmarking and disclosure policies are an innovative approach to overcome energy-performance information gaps in the multifamily sector, several challenges must be addressed. The multifamily sector is fragmented and resists a one-size-fits-all approach, ranging from low-income public housing to luxury properties, all with varied sources of public and private financing. Policies must reflect and accommodate the diversity of both the building stock and its stakeholders. In many cases, underlying barriers continue to limit the ability of many multifamily owners to conduct benchmarking and other energy-performance assessment measures. This report is intended to serve as a guide for policymakers and multifamily stakeholders on benchmarking and disclosure rules and regulations. It provides an introduction to the multifamily housing sector, followed by a thorough review of existing benchmarking and disclosure policies and an assessment of continuing policy challenges and opportunities

Individual Characteristics and Stated Preferences for Alternative Energy Sources and Propulsion Technologies in Vehicles: A Discrete Choice Analysis

This paper empirically examines the determinants of the demand for alternative energy sources and propulsion technologies in vehicles. The data stem from a stated preference discrete choice experiment with 598 potential car buyers. In order to simulate a realistic automobile purchase situation, seven alternatives were incorporated in each of the six choice sets, i.e. hybrid, gas, biofuel, hydrogen, and electric as well as the common fuels gasoline and diesel. The vehicle types were additionally characterized by a set of attributes, such as purchase price or motor power. Besides these vehicle attributes, our study particularly considers a multitude of individual characteristics, such as socio-demographic and vehicle purchase variables. The econometric analysis with multinomial probit models identifies some population groups with a higher propensity for alternative energy sources or propulsion technologies in vehicles, which can be focused by policy and automobile firms. For example, younger people and people who usually purchase environment-friendly products have a higher stated preference to purchase biofuel, hydrogen, and electric automobiles than other population groups. Methodologically, our study highlights the importance of the inclusion of taste persistence across the choice sets. Furthermore, it suggests a high number of random draws in the Geweke-Hajivassiliou-Keane simulator, which is incorporated in the simulated maximum likelihood estimation and the simulated testing of statistical hypotheses.Alternative energy sources and propulsion technologies in vehicles, stated preferences, discrete choice, multinomial probit models, unobserved heterogeneity, simulated maximum likelihood estimation

Demand Side Management of Electric Vehicles in Smart Grids: A survey on strategies, challenges, modeling, and optimization

The shift of transportation technology from internal combustion engine (ICE) based vehicles to electricvehicles (EVs) in recent times due to their lower emissions, fuel costs, and greater efficiency hasbrought EV technology to the forefront of the electric power distribution systems due to theirability to interact with the grid through vehicle-to-grid (V2G) infrastructure. The greater adoptionof EVs presents an ideal use-case scenario of EVs acting as power dispatch, storage, and ancillaryservice-providing units. This EV aspect can be utilized more in the current smart grid (SG) scenarioby incorporating demand-side management (DSM) through EV integration. The integration of EVswith DSM techniques is hurdled with various issues and challenges addressed throughout thisliterature review. The various research conducted on EV-DSM programs has been surveyed. This reviewarticle focuses on the issues, solutions, and challenges, with suggestions on modeling the charginginfrastructure to suit DSM applications, and optimization aspects of EV-DSM are addressed separatelyto enhance the EV-DSM operation. Gaps in current research and possible research directions have beendiscussed extensively to present a comprehensive insight into the current status of DSM programsemployed with EV integration. This extensive review of EV-DSM will facilitate all the researchersto initiate research for superior and efficient energy management and EV scheduling strategies andmitigate the issues faced by system uncertainty modeling, variations, and constraints