1,554 research outputs found
Self-organising multi-agent control for distribution networks with distributed energy resources
Recent years have seen an increase in the connection of dispersed distributed energy resources (DERs) and advanced control and operational components to the distribution network. These DERs can come in various forms, including distributed generation (DG), electric vehicles (EV), energy storage, etc. The conditions of these DERs can be varying and unpredictably intermittent. The integration of these distributed components adds more complexity and uncertainty to the operation of future power networks, such as voltage, frequency, and active/reactive power control. The stochastic and distributed nature of DGs and the difficulty in predicting EV charging patterns presents problems to the control and management of the distribution network. This adds more challenges to the planning and operation of such systems. Traditional methods for dealing with network problems such as voltage and power control could therefore be inadequate. In addition, conventional optimisation techniques will be difficult to apply successfully and will be accompanied with a large computational load.
There is therefore a need for new control techniques that break the problem into smaller subsets and one that uses a multi-agent system (MAS) to implement distributed solutions. These groups of agents would coordinate amongst themselves, to regulate local resources and voltage levels in a distributed and adaptive manner considering varying conditions of the network.
This thesis investigates the use of self-organising systems, presenting suitable approaches and identifying the challenges of implementing such techniques. It presents the development of fully functioning self-organising multi-agent control algorithms that can perform as effectively as full optimization techniques. It also demonstrates these new control algorithms on models of large and complex networks with DERs. Simulation results validate the autonomy of the system to control the voltage independently using only local DERs and proves the robustness and adaptability of the system by maintaining stable voltage control in response to network conditions over time.Recent years have seen an increase in the connection of dispersed distributed energy resources (DERs) and advanced control and operational components to the distribution network. These DERs can come in various forms, including distributed generation (DG), electric vehicles (EV), energy storage, etc. The conditions of these DERs can be varying and unpredictably intermittent. The integration of these distributed components adds more complexity and uncertainty to the operation of future power networks, such as voltage, frequency, and active/reactive power control. The stochastic and distributed nature of DGs and the difficulty in predicting EV charging patterns presents problems to the control and management of the distribution network. This adds more challenges to the planning and operation of such systems. Traditional methods for dealing with network problems such as voltage and power control could therefore be inadequate. In addition, conventional optimisation techniques will be difficult to apply successfully and will be accompanied with a large computational load.
There is therefore a need for new control techniques that break the problem into smaller subsets and one that uses a multi-agent system (MAS) to implement distributed solutions. These groups of agents would coordinate amongst themselves, to regulate local resources and voltage levels in a distributed and adaptive manner considering varying conditions of the network.
This thesis investigates the use of self-organising systems, presenting suitable approaches and identifying the challenges of implementing such techniques. It presents the development of fully functioning self-organising multi-agent control algorithms that can perform as effectively as full optimization techniques. It also demonstrates these new control algorithms on models of large and complex networks with DERs. Simulation results validate the autonomy of the system to control the voltage independently using only local DERs and proves the robustness and adaptability of the system by maintaining stable voltage control in response to network conditions over time
Resilient Autonomous Control of Distributed Multi-agent Systems in Contested Environments
An autonomous and resilient controller is proposed for leader-follower
multi-agent systems under uncertainties and cyber-physical attacks. The leader
is assumed non-autonomous with a nonzero control input, which allows changing
the team behavior or mission in response to environmental changes. A resilient
learning-based control protocol is presented to find optimal solutions to the
synchronization problem in the presence of attacks and system dynamic
uncertainties. An observer-based distributed H_infinity controller is first
designed to prevent propagating the effects of attacks on sensors and actuators
throughout the network, as well as to attenuate the effect of these attacks on
the compromised agent itself. Non-homogeneous game algebraic Riccati equations
are derived to solve the H_infinity optimal synchronization problem and
off-policy reinforcement learning is utilized to learn their solution without
requiring any knowledge of the agent's dynamics. A trust-confidence based
distributed control protocol is then proposed to mitigate attacks that hijack
the entire node and attacks on communication links. A confidence value is
defined for each agent based solely on its local evidence. The proposed
resilient reinforcement learning algorithm employs the confidence value of each
agent to indicate the trustworthiness of its own information and broadcast it
to its neighbors to put weights on the data they receive from it during and
after learning. If the confidence value of an agent is low, it employs a trust
mechanism to identify compromised agents and remove the data it receives from
them from the learning process. Simulation results are provided to show the
effectiveness of the proposed approach
Approaches for Future Internet architecture design and Quality of Experience (QoE) Control
Researching a Future Internet capable of overcoming the current Internet limitations is a strategic
investment. In this respect, this paper presents some concepts that can contribute to provide some guidelines to
overcome the above-mentioned limitations. In the authors' vision, a key Future Internet target is to allow
applications to transparently, efficiently and flexibly exploit the available network resources with the aim to
match the users' expectations. Such expectations could be expressed in terms of a properly defined Quality of
Experience (QoE). In this respect, this paper provides some approaches for coping with the QoE provision
problem
Strategic Learning for Active, Adaptive, and Autonomous Cyber Defense
The increasing instances of advanced attacks call for a new defense paradigm
that is active, autonomous, and adaptive, named as the \texttt{`3A'} defense
paradigm. This chapter introduces three defense schemes that actively interact
with attackers to increase the attack cost and gather threat information, i.e.,
defensive deception for detection and counter-deception, feedback-driven Moving
Target Defense (MTD), and adaptive honeypot engagement. Due to the cyber
deception, external noise, and the absent knowledge of the other players'
behaviors and goals, these schemes possess three progressive levels of
information restrictions, i.e., from the parameter uncertainty, the payoff
uncertainty, to the environmental uncertainty. To estimate the unknown and
reduce uncertainty, we adopt three different strategic learning schemes that
fit the associated information restrictions. All three learning schemes share
the same feedback structure of sensation, estimation, and actions so that the
most rewarding policies get reinforced and converge to the optimal ones in
autonomous and adaptive fashions. This work aims to shed lights on proactive
defense strategies, lay a solid foundation for strategic learning under
incomplete information, and quantify the tradeoff between the security and
costs.Comment: arXiv admin note: text overlap with arXiv:1906.1218
A Survey and Analysis of Cooperative Multi-Agent Robot Systems: Challenges and Directions
Research in the area of cooperative multi-agent robot systems has received wide attention among researchers in recent years. The main concern is to find the effective coordination among autonomous agents to perform the task in order to achieve a high quality of overall performance. Therefore, this paper reviewed various selected literatures primarily from recent conference proceedings and journals related to cooperation and coordination of multi-agent robot systems (MARS). The problems, issues, and directions of MARS research have been investigated in the literature reviews. Three main elements of MARS which are the type of agents, control architectures, and communications were discussed thoroughly in the beginning of this paper. A series of problems together with the issues were analyzed and reviewed, which included centralized and decentralized control, consensus, containment, formation, task allocation, intelligences, optimization and communications of multi-agent robots. Since the research in the field of multi-agent robot research is expanding, some issues and future challenges in MARS are recalled, discussed and clarified with future directions. Finally, the paper is concluded with some recommendations with respect to multi-agent systems
- …