6,011 research outputs found
Optimization of stochastic lossy transport networks and applications to power grids
Motivated by developments in renewable energy and smart grids, we formulate a
stylized mathematical model of a transport network with stochastic load
fluctuations. Using an affine control rule, we explore the trade-off between
the number of controllable resources in a lossy transport network and the
performance gain they yield in terms of expected power losses. Our results are
explicit and reveal the interaction between the level of flexibility, the
intrinsic load uncertainty and the network structure.Comment: 30 pages, 10 figure
Demand Response Strategy Based on Reinforcement Learning and Fuzzy Reasoning for Home Energy Management
As energy demand continues to increase, demand response (DR) programs in the electricity distribution grid are gaining momentum and their adoption is set to grow gradually over the years ahead. Demand response schemes seek to incentivise consumers to use green energy and reduce their electricity usage during peak periods which helps support grid balancing of supply-demand and generate revenue by selling surplus of energy back to the grid. This paper proposes an effective energy management system for residential demand response using Reinforcement Learning (RL) and Fuzzy Reasoning (FR). RL is considered as a model-free control strategy which learns from the interaction with its environment by performing actions and evaluating the results. The proposed algorithm considers human preference by directly integrating user feedback into its control logic using fuzzy reasoning as reward functions. Q-learning, a RL strategy based on a reward mechanism, is used to make optimal decisions to schedule the operation of smart home appliances by shifting controllable appliances from peak periods, when electricity prices are high, to off-peak hours, when electricity prices are lower without affecting the customer’s preferences. The proposed approach works with a single agent to control 14 household appliances and uses a reduced number of state-action pairs and fuzzy logic for rewards functions to evaluate an action taken for a certain state. The simulation results show that the proposed appliances scheduling approach can smooth the power consumption profile and minimise the electricity cost while considering user’s preferences, user’s feedbacks on each action taken and his/her preference settings. A user-interface is developed in MATLAB/Simulink for the Home Energy Management System (HEMS) to demonstrate the proposed DR scheme. The simulation tool includes features such as smart appliances, electricity pricing signals, smart meters, solar photovoltaic generation, battery energy storage, electric vehicle and grid supply.Peer reviewe
Learning and Management for Internet-of-Things: Accounting for Adaptivity and Scalability
Internet-of-Things (IoT) envisions an intelligent infrastructure of networked
smart devices offering task-specific monitoring and control services. The
unique features of IoT include extreme heterogeneity, massive number of
devices, and unpredictable dynamics partially due to human interaction. These
call for foundational innovations in network design and management. Ideally, it
should allow efficient adaptation to changing environments, and low-cost
implementation scalable to massive number of devices, subject to stringent
latency constraints. To this end, the overarching goal of this paper is to
outline a unified framework for online learning and management policies in IoT
through joint advances in communication, networking, learning, and
optimization. From the network architecture vantage point, the unified
framework leverages a promising fog architecture that enables smart devices to
have proximity access to cloud functionalities at the network edge, along the
cloud-to-things continuum. From the algorithmic perspective, key innovations
target online approaches adaptive to different degrees of nonstationarity in
IoT dynamics, and their scalable model-free implementation under limited
feedback that motivates blind or bandit approaches. The proposed framework
aspires to offer a stepping stone that leads to systematic designs and analysis
of task-specific learning and management schemes for IoT, along with a host of
new research directions to build on.Comment: Submitted on June 15 to Proceeding of IEEE Special Issue on Adaptive
and Scalable Communication Network
Risk-Aware Stochastic Scheduling of Hybrid Integrated Energy Systems with 100% Renewables
Recently, ambitious endeavors have been carried out to facilitate the transition from traditional grids to hybrid interconnected energy networks in the form of grid modernization. Align to such efforts, this article aims at developing a novel framework for satisfying techno-economic-environmental goals in the grid modernization process. To this end, a detailed examination is conducted for the optimal exploitation of energy hubs (EHs) equipped with 100% renewables to pursue the environmental goal alongside intending technical and economic constraints. The energy conversion technology is adopted to enable the power-to-gas system for establishing multi-energy interactions among electricity and gas networks. Fully benefiting from renewable units has exposed the system to uncertain fluctuations that necessitate the modeling of uncertainties to achieve near-reality results. Hence, risk-averse and seeker strategies are developed based on robustness and opportunistic modes of the information gap decision theory (IGDT) method to deal with stochastic fluctuations of uncertain parameters. The integrated electricity and gas test system is considered to analyze the applicability of the proposed framework in modeling efficient multi-energy interactions. Given the obtained results, 43.68% more energy cost is reached for EHs when they adopted a robust strategy against uncertainties under the risk-averse strategy. Moreover, the proposed framework procured a rational decision-making model for balancing multi-energy in the hybrid energy grid with 100% renewables
- …