Multi-Agent Pursuit-Evasion Game Based on Organizational Architecture

Multi-agent coordination mechanisms are frequently used in pursuit-evasion games with the aim of enabling the coalitions of the pursuers and unifying their individual skills to deal with the complex tasks encountered. In this paper, we propose a coalition formation algorithm based on organizational principles and applied to the pursuit-evasion problem. In order to allow the alliances of the pursuers in different pursuit groups, we have used the concepts forming an organizational modeling framework known as YAMAM (Yet Another Multi Agent Model). Specifically, we have used the concepts Agent, Role, Task, and Skill, proposed in this model to develop a coalition formation algorithm to allow the optimal task sharing. To control the pursuers\u27 path planning in the environment as well as their internal development during the pursuit, we have used a Reinforcement learning method (Q-learning). Computer simulations reflect the impact of the proposed techniques

Using reputation and adaptive coalitions to support collaboration in competitive environments

Internet-based scenarios, like co-working, e-freelancing, or crowdsourcing, usually need supporting collaboration among several actors that compete to service tasks. Moreover, the distribution of service requests, i.e., the arrival rate, varies over time, as well as the service workload required by each customer. In these scenarios, coalitions can be used to help agents to manage tasks they cannot tackle individually. In this paper we present a model to build and adapt coalitions with the goal of improving the quality and the quantity of tasks completed. The key contribution is a decision making mechanism that uses reputation and adaptation to allow agents in a competitive environment to autonomously enact and sustain coalitions, not only its composition, but also its number, i.e., how many coalitions are necessary. We provide empirical evidence showing that when agents employ our mechanism it is possible for them to maintain high levels of customer satisfaction. First, we show that coalitions keep a high percentage of tasks serviced on time despite a high percentage of unreliable workers. Second, coalitions and agents demonstrate that they successfully adapt to a varying distribution of customers' incoming tasks. This occurs because our decision making mechanism facilitates coalitions to disband when they become non-competitive, and individual agents detect opportunities to start new coalitions in scenarios with high task demand. © 2015 Elsevier Ltd. All rights reserved.The first author thanks the grant Formación de Profesorado Universitario (FPU), reference AP2010-1742. Arcos and Rodriguez-Aguilar thank projects COR (TIN2012-38876-C02-01/02) and Generalitat of Catalunya (2014 SGR-118). Work supported by the European Regional Development Fund (ERDF) and the Galician Regional Government under agreement for funding the Atlantic Research Center for Information and Communication Technologies (AtlantTIC)Peer Reviewe

Coalition Formation and Execution in Multi-robot Tasks

In this research, I explore several related problems in distributed robot systems that must be addressed in order to achieve multi-robot tasks, in which individual robots may not possess all the required capabilities. While most previous research work on multi-robot cooperation mainly concentrates on loosely-coupled multi-robot tasks, a more challenging problem is to also address tightly-coupled multi- robot tasks involving close robot interactions, which often require capability sharing. Three related topics towards addressing these tasks are discussed, as follows: Forming coalitions, which determines how robots should form into subgroups (i.e., coalitions) to address individual tasks. To achieve system autonomy, the ability to identify the feasibility of potential solutions is critical for forming coalitions. A general IQ-ASyMTRe architecture, which is formally proven to be sound and complete in this research, is introduced to incorporate this capability based on the ASyMTRe architecture. Executing coalitions, which coordinates different robots within the same coalition during physical execution to accomplish individual tasks. For executing coalitions, the IQ-ASyMTRe+ approach is presented. An information quality measure is introduced to control the robots to maintain the required constraints for task execution in dynamic environment. Redundancies at sensory and computational levels are utilized to enable execution that is robust to internal and external influences. Task allocation, which optimizes the overall performance of the system when multiple tasks need to be addressed. In this research, this problem is analyzed and the formulation is extended. A new greedy heuristic is introduced, which considers inter-task resource constraints to approximate the influence between different assignments in task allocation. Through combining the above approaches, a framework that achieves system autonomy can be created for addressing multi-robot tasks

The use of emotions in the implementation of various types of learning in a cognitive agent

Les tuteurs professionnels humains sont capables de prendre en considération des événements du passé et du présent et ont une capacité d'adaptation en fonction d'événements sociaux. Afin d'être considéré comme une technologie valable pour l'amélioration de l'apprentissage humain, un agent cognitif artificiel devrait pouvoir faire de même. Puisque les environnements dynamiques sont en constante évolution, un agent cognitif doit pareillement évoluer et s'adapter aux modifications structurales et aux phénomènes nouveaux. Par conséquent, l'agent cognitif idéal devrait posséder des capacités d'apprentissage similaires à celles que l'on retrouve chez l'être humain ; l'apprentissage émotif, l'apprentissage épisodique, l'apprentissage procédural, et l'apprentissage causal. Cette thèse contribue à l'amélioration des architectures d'agents cognitifs. Elle propose 1) une méthode d'intégration des émotions inspirée du fonctionnement du cerveau; et 2) un ensemble de méthodes d'apprentissage (épisodique, causale, etc.) qui tiennent compte de la dimension émotionnelle. Le modèle proposé que nous avons appelé CELTS (Conscious Emotional Learning Tutoring System) est une extension d'un agent cognitif conscient dans le rôle d'un tutoriel intelligent. Il comporte un module de gestion des émotions qui permet d'attribuer des valences émotionnelles positives ou négatives à chaque événement perçu par l'agent. Deux voies de traitement sont prévues : 1) une voie courte qui permet au système de répondre immédiatement à certains événements sans un traitement approfondis, et 2) une voie longue qui intervient lors de tout événement qui exige la volition. Dans cette perspective, la dimension émotionnelle est considérée dans les processus cognitifs de l'agent pour la prise de décision et l'apprentissage. L'apprentissage épisodique dans CELTS est basé sur la théorie du Multiple Trace Memory consolidation qui postule que lorsque l'on perçoit un événement, l'hippocampe fait une première interprétation et un premier apprentissage. Ensuite, l'information acquise est distribuée aux différents cortex. Selon cette théorie, la reconsolidation de la mémoire dépend toujours de l'hippocampe. Pour simuler de tel processus, nous avons utilisé des techniques de fouille de données qui permettent la recherche de motifs séquentiels fréquents dans les données générées durant chaque cycle cognitif. L'apprentissage causal dans CELTS se produit à l'aide de la mémoire épisodique. Il permet de trouver les causes et les effets possibles entre différents événements. Il est mise en œuvre grâce à des algorithmes de recherche de règles d'associations. Les associations établies sont utilisées pour piloter les interventions tutorielles de CELTS et, par le biais des réponses de l'apprenant, pour évaluer les règles causales découvertes. \ud ______________________________________________________________________________ \ud MOTS-CLÉS DE L’AUTEUR : agents cognitifs, émotions, apprentissage épisodique, apprentissage causal

Modeling Long-Term Intentions and Narratives in Autonomous Agents

Across various fields it is argued that the self in part consists of an autobiographical self-narrative and that the self-narrative has an impact on agential behavior. Similarly, within action theory, it is claimed that the intentional structure of coherent long-term action is divided into a hierarchy of distal, proximal, and motor intentions. However, the concrete mechanisms for how narratives and distal intentions are generated and impact action is rarely fleshed out concretely. We here demonstrate how narratives and distal intentions can be generated within cognitive agents and how they can impact agential behavior over long time scales. We integrate narratives and distal intentions into the LIDA model,and demonstrate how they can guide agential action in a manner that is consistent with the Global Workspace Theory of consciousness. This paper serves both as an addition to the LIDA cognitive architecture and an elucidation of how narratives and distal intention emerge and play their role in cognition and action

Uma comparação entre arquiteturas cognitivas : análise teórica e prática

Orientador: Ricardo Ribeiro GudwinDissertação (mestrado) - Universidade Estadual de Campinas, Faculdade de Engenharia Elétrica e de ComputaçãoResumo: Este trabalho apresenta uma comparação teórica e prática entre três das mais populares arquiteturas cognitivas: SOAR, CLARION e LIDA. A comparação teórica é realizada com base em um conjunto de funções cognitivas supostamente existentes no ciclo cognitivo humano. A comparação prática é realizada aplicando-se um mesmo experimento em todas as arquiteturas, coletando alguns dados e comparando-as usando como base algumas métricas de qualidade de software. O objetivo é enfatizar semelhanças e diferenças entre os modelos e implementações, com o objetivo de aconselhar um novo usuário a escolher a arquitetura mais apropriada para uma certa aplicaçãoAbstract: This work presents a theoretical and practical comparison of three popular cognitive architectures: SOAR, CLARION, and LIDA. The theoretical comparison is performed based on a set of cognitive functions supposed to exist in the human cognitive cycle. The practical comparison is performed applying the same experiment in all architectures, collecting some data and comparing them using a set of software quality metrics as a basis. The aim is to emphasize similarities and differences among the models and implementations, with the purpose to advise a newcomer on how to choose the appropriated architecture for an applicationMestradoEngenharia de ComputaçãoMestre em Engenharia Elétric

Softwarization of Large-Scale IoT-based Disasters Management Systems

The Internet of Things (IoT) enables objects to interact and cooperate with each other for reaching common objectives. It is very useful in large-scale disaster management systems where humans are likely to fail when they attempt to perform search and rescue operations in high-risk sites. IoT can indeed play a critical role in all phases of large-scale disasters (i.e. preparedness, relief, and recovery). Network softwarization aims at designing, architecting, deploying, and managing network components primarily based on software programmability properties. It relies on key technologies, such as cloud computing, Network Functions Virtualization (NFV), and Software Defined Networking (SDN). The key benefits are agility and cost efficiency. This thesis proposes softwarization approaches to tackle the key challenges related to large-scale IoT based disaster management systems. A first challenge faced by large-scale IoT disaster management systems is the dynamic formation of an optimal coalition of IoT devices for the tasks at hand. Meeting this challenge is critical for cost efficiency. A second challenge is an interoperability. IoT environments remain highly heterogeneous. However, the IoT devices need to interact. Yet another challenge is Quality of Service (QoS). Disaster management applications are known to be very QoS sensitive, especially when it comes to delay. To tackle the first challenge, we propose a cloud-based architecture that enables the formation of efficient coalitions of IoT devices for search and rescue tasks. The proposed architecture enables the publication and discovery of IoT devices belonging to different cloud providers. It also comes with a coalition formation algorithm. For the second challenge, we propose an NFV and SDN based - architecture for on-the-fly IoT gateway provisioning. The gateway functions are provisioned as Virtual Network Functions (VNFs) that are chained on-the-fly in the IoT domain using SDN. When it comes to the third challenge, we rely on fog computing to meet the QoS and propose algorithms that provision IoT applications components in hybrid NFV based - cloud/fogs. Both stationary and mobile fog nodes are considered. In the case of mobile fog nodes, a Tabu Search-based heuristic is proposed. It finds a near-optimal solution and we numerically show that it is faster than the Integer Linear Programming (ILP) solution by several orders of magnitude