Distributed Management of Resources in a Smart City using Multi-Agent Systems (MAS)

This document describes study of distributed management of resources in the context of Smart City with support of multi-agent systems. The investigated points include theoretical concepts of Smart City and application of multi-agent systems, decentralized and centralized designs for agent-based solutions and aspects of interactions between different self-interested agents. The document explores design of an agent-based solutions for the set of proposed problems related to Smart City environment with the emphasis on sharing common good, models of agent interactions within the modeled environments and possibilities of multi-agent approaches in terms of collective problem-solving, adaptability and learning proficiency

Using Magentix2 in Smart-Home Environments

[EN] In this paper, we present the application of a multi-agent platform Magentix2 for the development of MAS in smart-homes. Specificallly, the use of Magentix2 (http://gti-ia.upv.es/sma/tools/magentix2/index.php) platform facilitates the management of the multiple occupancy in smart living spaces. Virtual organizations provide the possibility of defining a set of norms and roles that facilitate the regulation and control of the actions that can be carried out by the internal and external agents depending on their profile. We illustrate the applicability of our proposal with a set of scenarios. © Springer International Publishing Switzerland 2015.This work is supported by the Spanish government grants CONSOLIDER INGENIO 2010 CSD2007-00022, MINECO/FEDER TIN2012-36586-C03-01, TIN2011-27652-C03-01, and SP2014800.Valero Cubas, S.; Del Val Noguera, E.; Alemany Bordera, J.; Botti, V. (2015). Using Magentix2 in Smart-Home Environments. En 10th International Conference on Soft Computing Models in Industrial and Environmental Applications. Springer Verlag. 27-37. https://doi.org/10.1007/978-3-319-19719-7_3S2737Bajo J, Fraile JA, Pérez-Lancho B, Corchado JM (2010) The thomas architecture in home care scenarios: a case study. Expert Syst Appl 37(5):3986–3999Cetina C, Giner P, Fons J, Pelechano V (2009) Autonomic computing through reuse of variability models at runtime: The case of smart homes. Computer 42(10):37–43Cook DJ (2009) Multi-agent smart environments. J Ambient Intell Smart Environ 1(1):51–55Crandall AS, Cook DJ (2010) Using a hidden markov model for resident identification. In: 6th international conference on intelligent environments, pp 74–79. IEEECriado N, Argente E, Botti V (2013) THOMAS: an agent platform for supporting normative multi-agent systems. J Logic Comput 23(2):309–333Davidoff S, Lee MK, Zimmerman J, Dey A (2006) Socially-aware requirements for a smart home. In: Proceedings of the international symposium on intelligent, environments, pp 41–44Grupo de Tecnología Informática e Inteligencia Artificial (GTI-IA) (2015). http://www.gti-ia.upv.es/sma/tools/magentix2/archivos/Magentix2UserManualv2.1.0.pdf . Magentix2 User’s Manual v2.0Loseto G, Scioscia F, Ruta M, di Sciascio E (2012) Semantic-based smart homes: a multi-agent approach. In: 13th Workshop on objects and agents (WOA 2012), vol 892, pp 49–55Rodriguez S, Julián V, Bajo J, Carrascosa C, Botti V, Corchado JM (2011) Agent-based virtual organization architecture. Eng Appl Artif Intell 24(5):895–910Rodríguez S, Paz JFD, Villarrubia G, Zato C, Bajo J, Corchado JM (2015) Multi-agent information fusion system to manage data from a WSN in a residential home. Inf Fusion 23:43–57Such JM, Garca-Fornes A, Espinosa A, Bellver J (2012) Magentix2: a Privacy-enhancing Agent Platform. Eng Appl Artif IntellSun Q, Yu W, Kochurov N, Hao Q, Hu F (2013) A multi-agent-based intelligent sensor and actuator network design for smart house and home automation. J Sens Actuator Netw 2(3):557–588Val E, Criado N, Rebollo M, Argente E, Julian V (2009) Service-oriented framework for virtual organizations. 1:108–114Wu C-L, Liao C-F, Fu L-C (2007) Service-oriented smart-home architecture based on osgi and mobile-agent technology. IEEE Trans Syst Man Cybern Part C Appl Rev 37(2):193–205Yin J, Yang Q, Shen D, Li Z-N (2008) Activity recognition via user-trace segmentation. ACM Trans Sens Netw (TOSN) 4(4):1

Deep Q-Learning on Internet of Things System for Trust Management in Multi-Agent Environments for Smart City

Smart Cities are vital to improving urban efficiency and citizen quality of life due to the fast rise of the Internet of Things (IoT) and its integration into varied applications. Smart Cities are dynamic and complicated, making trust management in multi-agent systems difficult. Trust helps IoT devices and agents in smart ecosystems connect and cooperate. This study suggests using Deep Q-Learning and Bidirectional Long Short-Term Memory (Bi-LSTM) to manage trust in multi-agent Smart City settings. Deep Q-Learning and Bi-LSTM represent long-term relationships and temporal dynamics in the IoT network, enabling intelligent trust-related judgments. The architecture supports real-time trust assessment, decision-making, and response to smart city changes. The suggested solution improves dependability, security, and trustworthiness in the IoT system's networked agents. A complete collection of studies utilizing real-world IoT data from a simulated Smart City evaluates the system's performance. The Deep Q-Learning and Bi-LSTM technique surpasses existing trust management approaches in dynamic, complicated multi-agent environments. The system's capacity to adapt to changing situations and improve decision-making make IoT device interactions more dependable and trustworthy, helping Smart Cities expand sustainably and efficiently

Smart Grid Ecosystem Modeling Using a Novel Framework for Heterogenous Agent Communities

The modeling of smart grids using multi-agent systems is a common approach due to the ability to model complex and distributed systems using an agent-based solution. However, the use of a multi-agent system framework can limit the integration of new operation and management models, especially artificial intelligence algorithms. Therefore, this paper presents a study of available open-source multi-agent systems frameworks developed in Python, as it is a growing programming language and is largely used for data analytics and artificial intelligence models. As a consequence of the presented study, the authors proposed a novel open-source multi-agent system framework built for smart grid modeling, entitled Python-based framework for heterogeneous agent communities (PEAK). This framework enables the use of simulation environments but also allows real integration at pilot sites using a real-time clock. To demonstrate the capabilities of the PEAK framework, a novel agent ecosystem based on agent communities is shown and tested. This novel ecosystem, entitled Agent-based ecosystem for Smart Grid modeling (A4SG), takes full advantage of the PEAK framework and enables agent mobility, agent branching, and dynamic agent communities. An energy community of 20 prosumers, of which six have energy storage systems, that can share energy among them, using a peer-to-peer market, is used to test and validate the PEAK and A4SG solutions.The authors acknowledge the work facilities and equipment provided by the GECAD research center (UIDB/00760/2020) to the project team.info:eu-repo/semantics/publishedVersio

Leveraging Statistical Multi-Agent Online Planning with Emergent Value Function Approximation

Making decisions is a great challenge in distributed autonomous environments due to enormous state spaces and uncertainty. Many online planning algorithms rely on statistical sampling to avoid searching the whole state space, while still being able to make acceptable decisions. However, planning often has to be performed under strict computational constraints making online planning in multi-agent systems highly limited, which could lead to poor system performance, especially in stochastic domains. In this paper, we propose Emergent Value function Approximation for Distributed Environments (EVADE), an approach to integrate global experience into multi-agent online planning in stochastic domains to consider global effects during local planning. For this purpose, a value function is approximated online based on the emergent system behaviour by using methods of reinforcement learning. We empirically evaluated EVADE with two statistical multi-agent online planning algorithms in a highly complex and stochastic smart factory environment, where multiple agents need to process various items at a shared set of machines. Our experiments show that EVADE can effectively improve the performance of multi-agent online planning while offering efficiency w.r.t. the breadth and depth of the planning process.Comment: Accepted at AAMAS 201

Enhancing Smart-Home Environments using Magentix2

[EN] Multi-agent system paradigm has been envisioned as an appropriate solution for challenges in the area of smart-environments. Specifically, MAS add new capabilities such as adaption, reorganization, learning, coordination, etc. These features allow to deal with open issues in the context of smart-homes such as multi-occupancy, activity tracking or profiling activities and behaviors from multiple residents. In this paper, we present Magentix2 as a suitable MAS platform for the development of dynamic smart environments. Specifically, the use of Magentix2 (http://gti-ia.upv.es/sma/tools/magentix2/index.php) facilitates the management of the multiple occupancy in smart living spaces. Normative virtual organizations provide the possibility of defining a set of norms and organizational roles that facilitate the regulation and control of the actions that can be carried out by internal and external agents depending on their profile. Moreover, Magentix2 provides a tracing service to keep track of activities carried out in the system. We illustrate the applicability and benefits of Magentix2 in a set of scenarios in the context of smart-homes.This work is supported by the Spanish government grants PROMETEOII/2013/019,TIN2014-55206-R, TIN2015-65515-C4-1-R, H2020-ICT-2015-688095.Valero Cubas, S.; Del Val Noguera, E.; Alemany-Bordera, J.; Botti, V. (2017). Enhancing Smart-Home Environments using Magentix2. Journal of Applied Logic. 24:32-44. https://doi.org/10.1016/j.jal.2016.11.022S32442

A Gossip Algorithm based Clock Synchronization Scheme for Smart Grid Applications

The uprising interest in multi-agent based networked system, and the numerous number of applications in the distributed control of the smart grid leads us to address the problem of time synchronization in the smart grid. Utility companies look for new packet based time synchronization solutions with Global Positioning System (GPS) level accuracies beyond traditional packet methods such as Network Time Proto- col (NTP). However GPS based solutions have poor reception in indoor environments and dense urban canyons as well as GPS antenna installation might be costly. Some smart grid nodes such as Phasor Measurement Units (PMUs), fault detection, Wide Area Measurement Systems (WAMS) etc., requires synchronous accuracy as low as 1 ms. On the other hand, 1 sec accuracy is acceptable in management information domain. Acknowledging this, in this study, we introduce gossip algorithm based clock synchronization method among network entities from the decision control and communication point of view. Our method synchronizes clock within dense network with a bandwidth limited environment. Our technique has been tested in different kinds of network topologies- complete, star and random geometric network and demonstrated satisfactory performance

Load Control Timescales Simulation in a Multi-Agent Smart Grid Platform

Environmental concerns and the shortage in the fossil fuel reserves have been potentiating the growth and globalization of distributed generation. Another resource that has been increasing its importance is the demand response, which is used to change consumers’ consumption profile, helping to reduce peak demand. Aiming to support small players’ participation in demand response events, the Curtailment Service Provider emerged. This player works as an aggregator for demand response events. The control of small and medium players which act in smart grid and micro grid environments is enhanced with a multi-agent system with artificial intelligence techniques – the MASGriP (Multi-Agent Smart Grid Platform). Using strategic behaviours in each player, this system simulates the profile of real players by using software agents. This paper shows the importance of modeling these behaviours for studying this type of scenarios. A case study with three examples shows the differences between each player and the best behaviour in order to achieve the higher profit in each situation