Analysis of Bullying in Cooperative Multi-agent Systems’ Communications

Cooperative Multi-agent Systems frameworks do not include modules to test communications yet. The proposed framework incorporates robust analysis tools using IDKAnalysis2.0 to evaluate bullying effect in communications. The present work is based on ICARO-T. This platform follows the Adaptive Multi-agent Systems paradigm. Experimentation with ICARO-T includes two deployments: the equitative and the authoritative. Results confirm the usefulness of the analysis tools when exporting to Cooperative Multi-agent Systems that use different configurations. Besides, ICARO-T is provided with new functionality by a set of tools for communication analysis

Scalable {\delta}-Level Coherent State Synchronization of Multi-Agent Systems in the Presence of Bounded Disturbances

In this paper, we study scalable {\delta}-Level coherent state synchronization for multi-agent systems (MAS) where the agents are subject to bounded disturbances/noises. We propose a scale-free framework designed solely based on the knowledge of agent models and agnostic to the communication graphs and size of the network. We define the level of coherency for each agent as the norm of the weighted sum of the disagreement dynamics with its neighbors. The objective is to restrict the level of coherency of the network to {\delta} without a-priori information about the disturbances.Comment: 18 pages, 11 figures, This is a preprint of the paper "Scalable {\delta}-Level Coherent State Synchronization of Multi-Agent Systems with Adaptive Protocols and Bounded Disturbances" submitted to the International Journal of Robust and Nonlinear Contro

Efficient Communication and Coordination for Large-Scale Multi-Agent Systems

The growth of the computational power of computers and the speed of networks has made large-scale multi-agent systems a promising technology. As the number of agents in a single application approaches thousands or millions, distributed computing has become a general paradigm in large-scale multi-agent systems to take the benefits of parallel computing. However, since these numerous agents are located on distributed computers and interact intensively with each other to achieve common goals, the agent communication cost significantly affects the performance of applications. Therefore, optimizing the agent communication cost on distributed systems could considerably reduce the runtime of multi-agent applications. Furthermore, because static multi-agent frameworks may not be suitable for all kinds of applications, and the communication patterns of agents may change during execution, multi-agent frameworks should adapt their services to support applications differently according to their dynamic characteristics. This thesis proposes three adaptive services at the agent framework level to reduce the agent communication and coordination cost of large-scale multi-agent applications. First, communication locality-aware agent distribution aims at minimizing inter-node communication by collocating heavily communicating agents on the same platform and maintaining agent group-based load sharing. Second, application agent-oriented middle agent services attempt to optimize agent interaction through middle agents by executing application agent-supported search algorithms on the middle agent address space. Third, message passing for mobile agents aims at reducing the time of message delivery to mobile agents using location caches or by extending the agent address scheme with location information. With these services, we have achieved very impressive experimental results in large- scale UAV simulations including up to 10,000 agents. Also, we have provided a formal definition of our framework and services with operational semantics

Towards self-organized service-oriented multi-agent systems

The demand for large-scale systems running in complex and even chaotic environments requires the consideration of new paradigms and technologies that provide flexibility, robustness, agility and responsiveness. Multiagents systems is pointed out as a suitable approach to address this challenge by offering an alternative way to design control systems, based on the decentralization of control functions over distributed autonomous and cooperative entities. However, in spite of their enormous potential, they usually lack some aspects related to interoperability, optimization in decentralized structures and truly self-adaptation. This paper discusses a new perspective to engineer adaptive complex systems considering a 3-layer framework integrating several complementary paradigms and technologies. In a first step, it suggests the integration of multi-agent systems with service-oriented architectures to overcome the limitations of interoperability and smooth migration, followed by the use of technology enablers, such as cloud computing and wireless sensor networks, to provide a ubiquitous and reconfigurable environment. Finally, the resulted service-oriented multi-agent system should be enhanced with biologically inspired techniques, namely self-organization, to reach a truly robust, agile and adaptive system

A flux balance approach to integrate cell metabolism into multicelluar agent-based simulations

The study of multicellular systems such as tumors, tissues, or organoids is critical to improve our understanding of the complex dynamics exhibited by these systems. For instance, the emergence of resistant cancer cells is process that manifest at many different scales from the molecular, to the population level. Multicellular systems such as tumors are complex adaptive systems an thus are no reducible to classical analytical techniques. Nevertheless, multi-scale simulations can used study these systems by integrating models of processes taking place at these different scales. In this way, multi-scale model simulations provide a genotype-to-phenotype mapping framework, that allow the exploration of genetic variations and their interaction with changing environmental conditions. In the Computational Biology Group we are extending a multiscale modelling framework combining agent-based and models of signaling pathways (PhysiCell/PhysiBoSS), to link pathways’ activity and cells’ phenotypes to physical interactions among cells and with their environment. In this seminar, I will introduce the current status of our multi-scale framework, as well as the ongoing development of a novel extension to integrate metabolic models within the agent-based framework. This novel feature will allow to study the intersection between cell metabolism and their microenvironment, at the population

LIGS: Learnable Intrinsic-Reward Generation Selection for Multi-Agent Learning

Efficient exploration is important for reinforcement learners to achieve high rewards. In multi-agent systems, coordinated exploration and behaviour is critical for agents to jointly achieve optimal outcomes. In this paper, we introduce a new general framework for improving coordination and performance of multi-agent reinforcement learners (MARL). Our framework, named Learnable Intrinsic-Reward Generation Selection algorithm (LIGS) introduces an adaptive learner, Generator that observes the agents and learns to construct intrinsic rewards online that coordinate the agents' joint exploration and joint behaviour. Using a novel combination of MARL and switching controls, LIGS determines the best states to learn to add intrinsic rewards which leads to a highly efficient learning process. LIGS can subdivide complex tasks making them easier to solve and enables systems of MARL agents to quickly solve environments with sparse rewards. LIGS can seamlessly adopt existing MARL algorithms and, our theory shows that it ensures convergence to policies that deliver higher system performance. We demonstrate its superior performance in challenging tasks in Foraging and StarCraft II.Comment: arXiv admin note: text overlap with arXiv:2103.0915

Intelligent interface agents for biometric applications

This thesis investigates the benefits of applying the intelligent agent paradigm to biometric identity verification systems. Multimodal biometric systems, despite their additional complexity, hold the promise of providing a higher degree of accuracy and robustness. Multimodal biometric systems are examined in this work leading to the design and implementation of a novel distributed multi-modal identity verification system based on an intelligent agent framework. User interface design issues are also important in the domain of biometric systems and present an exceptional opportunity for employing adaptive interface agents. Through the use of such interface agents, system performance may be improved, leading to an increase in recognition rates over a non-adaptive system while producing a more robust and agreeable user experience. The investigation of such adaptive systems has been a focus of the work reported in this thesis. The research presented in this thesis is divided into two main parts. Firstly, the design, development and testing of a novel distributed multi-modal authentication system employing intelligent agents is presented. The second part details design and implementation of an adaptive interface layer based on interface agent technology and demonstrates its integration with a commercial fingerprint recognition system. The performance of these systems is then evaluated using databases of biometric samples gathered during the research. The results obtained from the experimental evaluation of the multi-modal system demonstrated a clear improvement in the accuracy of the system compared to a unimodal biometric approach. The adoption of the intelligent agent architecture at the interface level resulted in a system where false reject rates were reduced when compared to a system that did not employ an intelligent interface. The results obtained from both systems clearly express the benefits of combining an intelligent agent framework with a biometric system to provide a more robust and flexible application