A Classification Scheme for Local Energy Trading

The current trend towards more renewable and sustainable energy generation leads to an increased interest in new energy management systems and the concept of a smart grid. One important aspect of this is local energy trading, which is an extension of existing electricity markets by including prosumers, who are consumers also producing electricity. Prosumers having a surplus of energy may directly trade this surplus with other prosumers, which are currently in demand. In this paper, we present an overview of the literature in the area of local energy trading. In order to provide structure to the broad range of publications, we identify key characteristics, define the various settings, and cluster the considered literature along these characteristics. We identify three main research lines, each with a distinct setting and research question. We analyze and compare the settings, the used techniques, and the results and findings within each cluster and derive connections between the clusters. In addition, we identify important aspects, which up to now have to a large extent been neglected in the considered literature and highlight interesting research directions, and open problems for future work.Comment: 38 pages, 1 figure, This work has been submitted and accepted at OR Spectru

Advanced Mechanism Design for Electric Vehicle Charging Scheduling in the Smart Infrastructure

Electric vehicle (EV) continues to grow rapidly due to low emission and high intelligence. This thesis considers a smart infrastructure (SI) as an EV-centered ecosystem, which is an integrated and connected multi-modal network involving interacting intelligent agents, such as EVs, charging facilities, electric power grids, distributed energy resources, etc. The system modeling paradigm is derived from distributed artificial intelligence and modelled as multi-agent systems (MAS), where the agents are self-interested and reacting strategically to maximize their own benefits. The integration, interaction, and coordination of EVs with SI components will raise various features and challenges on the transportation efficiency, power system stability, and user satisfaction, as well as opportunities provided by optimization, economics, and control theories, and other advanced technologies to engage more proactively and efficiently in allocating the limited charging resources and collaborative decision-making in a market environment. A core challenge in such an EV ecosystem is to trade-off the two objectives of the smart infrastructure, of system-wide efficiency and at the same time the social welfare and individual well-being against agents’ selfishness and collective behaviors. In light of this, scheduling EVs' charging activities is of great importance to ensure an efficient operation of the smart infrastructure and provide economical and satisfactory charging experiences to EV users under the support of two-way flow of information and energy of charging facilities. In this thesis, we develop an advanced mechanism design framework to optimize the charging resource allocation and automate the interaction process across the overall system. The key innovation is to design specific market-based mechanisms and interaction rules, integrated with concepts and principles of mechanism design, scheduling theory, optimization theory, and reinforcement learning, for charging scheduling and dynamic pricing problem in various market structures. Specifically, this research incorporates three synergistic areas: (1) Mathematical modelling for EV charging scheduling. We have developed various mixed-integer linear programs for single-charge with single station, single-charge with multiple stations, and multi-charge with multiple stations in urban or highway environments. (2) Market-based mechanism design. Based on the proposed mathematical models, we have developed particular market-based mechanisms from the resource provider’s prospective, including iterative bidding auction, incentive-compatible auction, and simultaneous multi-round auction. These proposed auctions contain bids, winner determination models, and bidding procedure, with which the designer can compute high quality schedules and preserve users’ privacy by progressively eliciting their preference information as necessary. (3) Reinforcement learning-based mechanism design. We also proposed a reinforcement mechanism design framework for dynamic pricing-based demand response, which determines the optimal charging prices over a sequence of time considering EV users’ private utility functions. The learning-based mechanism design has effectively improved the long-term revenue despite highly-uncertain requests and partially-known individual preferences of users. This Ph.D. dissertation presents a market prospective and unlocks economic opportunities for MAS optimization with applications to EV charging related problems; furthermore, applies AI techniques to facilitate the evolution from manual mechanism design to automated and data-driven mechanism design when gathering, distributing, storing, and mining data and state information in SI. The proposed advanced mechanism design framework will provide various collaboration opportunities with the research expertise of reinforcement learning with innovative collective intelligence and interaction rules in game theory and optimization tools, as well as offers research thrust to more complex interfaces in intelligent transportation system, smart grid, and smart city environments

Wide-Area Time-Synchronized Closed-Loop Control of Power Systems And Decentralized Active Distribution Networks

The rapidly expanding power system grid infrastructure and the need to reduce the occurrence of major blackouts and prevention or hardening of systems against cyber-attacks, have led to increased interest in the improved resilience of the electrical grid. Distributed and decentralized control have been widely applied to computer science research. However, for power system applications, the real-time application of decentralized and distributed control algorithms introduce several challenges. In this dissertation, new algorithms and methods for decentralized control, protection and energy management of Wide Area Monitoring, Protection and Control (WAMPAC) and the Active Distribution Network (ADN) are developed to improve the resiliency of the power system. To evaluate the findings of this dissertation, a laboratory-scale integrated Wide WAMPAC and ADN control platform was designed and implemented. The developed platform consists of phasor measurement units (PMU), intelligent electronic devices (IED) and programmable logic controllers (PLC). On top of the designed hardware control platform, a multi-agent cyber-physical interoperability viii framework was developed for real-time verification of the developed decentralized and distributed algorithms using local wireless and Internet-based cloud communication. A novel real-time multiagent system interoperability testbed was developed to enable utility independent private microgrids standardized interoperability framework and define behavioral models for expandability and plug-and-play operation. The state-of-theart power system multiagent framework is improved by providing specific attributes and a deliberative behavior modeling capability. The proposed multi-agent framework is validated in a laboratory based testbed involving developed intelligent electronic device prototypes and actual microgrid setups. Experimental results are demonstrated for both decentralized and distributed control approaches. A new adaptive real-time protection and remedial action scheme (RAS) method using agent-based distributed communication was developed for autonomous hybrid AC/DC microgrids to increase resiliency and continuous operability after fault conditions. Unlike the conventional consecutive time delay-based overcurrent protection schemes, the developed technique defines a selectivity mechanism considering the RAS of the microgrid after fault instant based on feeder characteristics and the location of the IEDs. The experimental results showed a significant improvement in terms of resiliency of microgrids through protection using agent-based distributed communication

Agile Market Engineering: Bridging the gap between business concepts and running markets

The agile market engineering process model (AMEP) is built on the insight, that market design and development is a wicked problem. Electronic markets are too complex to be completely designed upfront. Instead, AMEP tries to bridge the gap between theoretic market design and practical electronic market platform development using an agile, iterative approach that relies on early customer feedback and continuous improvement. The AMEP model is complemented by several supporting software artifacts

Learning for Cross-layer Resource Allocation in the Framework of Cognitive Wireless Networks

The framework of cognitive wireless networks is expected to endow wireless devices with a cognition-intelligence ability with which they can efficiently learn and respond to the dynamic wireless environment. In this dissertation, we focus on the problem of developing cognitive network control mechanisms without knowing in advance an accurate network model. We study a series of cross-layer resource allocation problems in cognitive wireless networks. Based on model-free learning, optimization and game theory, we propose a framework of self-organized, adaptive strategy learning for wireless devices to (implicitly) build the understanding of the network dynamics through trial-and-error. The work of this dissertation is divided into three parts. In the first part, we investigate a distributed, single-agent decision-making problem for real-time video streaming over a time-varying wireless channel between a single pair of transmitter and receiver. By modeling the joint source-channel resource allocation process for video streaming as a constrained Markov decision process, we propose a reinforcement learning scheme to search for the optimal transmission policy without the need to know in advance the details of network dynamics. In the second part of this work, we extend our study from the single-agent to a multi-agent decision-making scenario, and study the energy-efficient power allocation problems in a two-tier, underlay heterogeneous network and in a self-sustainable green network. For the heterogeneous network, we propose a stochastic learning algorithm based on repeated games to allow individual macro- or femto-users to find a Stackelberg equilibrium without flooding the network with local action information. For the self-sustainable green network, we propose a combinatorial auction mechanism that allows mobile stations to adaptively choose the optimal base station and sub-carrier group for transmission only from local payoff and transmission strategy information. In the third part of this work, we study a cross-layer routing problem in an interweaved Cognitive Radio Network (CRN), where an accurate network model is not available and the secondary users that are distributed within the CRN only have access to local action/utility information. In order to develop a spectrum-aware routing mechanism that is robust against potential insider attackers, we model the uncoordinated interaction between CRN nodes in the dynamic wireless environment as a stochastic game. Through decomposition of the stochastic routing game, we propose two stochastic learning algorithm based on a group of repeated stage games for the secondary users to learn the best-response strategies without the need of information flooding