CernoCAMAL : a probabilistic computational cognitive architecture

This thesis presents one possible way to develop a computational cognitive architecture, dubbed CernoCAMAL, that can be used to govern artificial minds probabilistically. The primary aim of the CernoCAMAL research project is to investigate how its predecessor architecture CAMAL can be extended to reason probabilistically about domain model objects through perception, and how the probability formalism can be integrated into its BDI (Belief-Desire-Intention) model to coalesce a number of mechanisms and processes. The motivation and impetus for extending CAMAL and developing CernoCAMAL is the considerable evidence that probabilistic thinking and reasoning is linked to cognitive development and plays a role in cognitive functions, such as decision making and learning. This leads us to believe that a probabilistic reasoning capability is an essential part of human intelligence. Thus, it should be a vital part of any system that attempts to emulate human intelligence computationally. The extensions and augmentations to CAMAL, which are the main contributions of the CernoCAMAL research project, are as follows: - The integration of the EBS (Extended Belief Structure) that associates a probability value with every belief statement, in order to represent the degrees of belief numerically. - The inclusion of the CPR (CernoCAMAL Probabilistic Reasoner) that reasons probabilistically over the goal- and task-oriented perceptual feedback generated by reactive sub-systems. - The compatibility of the probabilistic BDI model with the affect and motivational models and affective and motivational valences used throughout CernoCAMAL. A succession of experiments in simulation and robotic testbeds is carried out to demonstrate improvements and increased efficacy in CernoCAMAL’s overall cognitive performance. A discussion and critical appraisal of the experimental results, together with a summary, a number of potential future research directions, and some closing remarks conclude the thesis

CernoCAMAL : a probabilistic computational cognitive architecture

This thesis presents one possible way to develop a computational cognitive architecture, dubbed CernoCAMAL, that can be used to govern artificial minds probabilistically. The primary aim of the CernoCAMAL research project is to investigate how its predecessor architecture CAMAL can be extended to reason probabilistically about domain model objects through perception, and how the probability formalism can be integrated into its BDI (Belief-Desire-Intention) model to coalesce a number of mechanisms and processes.The motivation and impetus for extending CAMAL and developing CernoCAMAL is the considerable evidence that probabilistic thinking and reasoning is linked to cognitive development and plays a role in cognitive functions, such as decision making and learning. This leads us to believe that a probabilistic reasoning capability is an essential part of human intelligence. Thus, it should be a vital part of any system that attempts to emulate human intelligence computationally.The extensions and augmentations to CAMAL, which are the main contributions of the CernoCAMAL research project, are as follows:- The integration of the EBS (Extended Belief Structure) that associates a probability value with every belief statement, in order to represent the degrees of belief numerically.- The inclusion of the CPR (CernoCAMAL Probabilistic Reasoner) that reasons probabilistically over the goal- and task-oriented perceptual feedback generated by reactive sub-systems.- The compatibility of the probabilistic BDI model with the affect and motivational models and affective and motivational valences used throughout CernoCAMAL.A succession of experiments in simulation and robotic testbeds is carried out to demonstrate improvements and increased efficacy in CernoCAMAL’s overall cognitive performance. A discussion and critical appraisal of the experimental results, together with a summary, a number of potential future research directions, and some closing remarks conclude the thesis

The Persuasive Tutor: a BDI Teaching Agent with Role and Reference Grammar Language Interface – Sustainable design of a conversational agent for language learning

This paper investigates how an intelligent teaching agent with Role and Reference Grammar [RRG] (cf. Van Valin 2005) as linguistic engine can support language learning. Based on a user-centred empirical design study the architecture of a highly persuasive tool for language learning as an extension of PLOTLearner (http://europlot.blogspot.dk/2012/07/try-plotlearner-2.html) is developed. Based on grounded theory it is shown that feedback and support is of greatest importance even in self-directed computer assisted language learning. Is also shown how this overall approach to language learning can be situated into traditional conversation based learning theories (cf. Laurillard 2009). It is shown that a computationally adequate model of the RRG-linking algorithm, extended into a computational processing model, can account for communication between a learner and the software by employing conceptual graphs to represent mental states in the software agent and the important role of speech acts is emphasized in this context

From Affect Theoretical Foundations to Computational Models of Intelligent Affective Agents

[EN] The links between emotions and rationality have been extensively studied and discussed. Several computational approaches have also been proposed to model these links. However, is it possible to build generic computational approaches and languages so that they can be "adapted " when a specific affective phenomenon is being modeled? Would these approaches be sufficiently and properly grounded? In this work, we want to provide the means for the development of these generic approaches and languages by making a horizontal analysis inspired by philosophical and psychological theories of the main affective phenomena that are traditionally studied. Unfortunately, not all the affective theories can be adapted to be used in computational models; therefore, it is necessary to perform an analysis of the most suitable theories. In this analysis, we identify and classify the main processes and concepts which can be used in a generic affective computational model, and we propose a theoretical framework that includes all these processes and concepts that a model of an affective agent with practical reasoning could use. Our generic theoretical framework supports incremental research whereby future proposals can improve previous ones. This framework also supports the evaluation of the coverage of current computational approaches according to the processes that are modeled and according to the integration of practical reasoning and affect-related issues. This framework is being used in the development of the GenIA(3) architecture.This work is partially supported by the Spanish Government projects PID2020-113416RB-I00, GVA-CEICE project PROMETEO/2018/002, and TAILOR, a project funded by EU Horizon 2020 research and innovation programme under GA No 952215.Alfonso, B.; Taverner-Aparicio, JJ.; Vivancos, E.; Botti, V. (2021). From Affect Theoretical Foundations to Computational Models of Intelligent Affective Agents. Applied Sciences. 11(22):1-29. https://doi.org/10.3390/app112210874S129112

Using Norms To Control Open Multi-Agent Systems

Internet es, tal vez, el avance científico más relevante de nuestros días. Entre otras cosas, Internet ha permitido la evolución de los paradigmas de computación tradicionales hacia el paradigma de computaciónn distribuida, que se caracteriza por utilizar una red abierta de ordenadores. Los sistemas multiagente (SMA) son una tecnolog a adecuada para abordar los retos motivados por estos sistemas abiertos distribuidos. Los SMA son aplicaciones formadas por agentes heterog eneos y aut onomos que pueden haber sido dise~nados de forma independiente de acuerdo con objetivos y motivaciones diferentes. Por lo tanto, no es posible realizar ninguna hip otesis a priori sobre el comportamiento de los agentes. Por este motivo, los SMA necesitan de mecanismos de coordinaci on y cooperaci on, como las normas, para garantizar el orden social y evitar la aparici on de conictos. El t ermino norma cubre dos dimensiones diferentes: i) las normas como un instrumento que gu a a los ciudadanos a la hora de realizar acciones y actividades, por lo que las normas de nen los procedimientos y/o los protocolos que se deben seguir en una situaci on concreta, y ii) las normas como ordenes o prohibiciones respaldadas por un sistema de sanciones, por lo que las normas son medios para prevenir o castigar ciertas acciones. En el area de los SMA, las normas se vienen utilizando como una especi caci on formal de lo que est a permitido, obligado y prohibido dentro de una sociedad. De este modo, las normas permiten regular la vida de los agentes software y las interacciones entre ellos. La motivaci on principal de esta tesis es permitir a los dise~nadores de los SMA utilizar normas como un mecanismo para controlar y coordinar SMA abiertos. Nuestro objetivo es elaborar mecanismos normativos a dos niveles: a nivel de agente y a nivel de infraestructura. Por lo tanto, en esta tesis se aborda primero el problema de la de nici on de agentes normativos aut onomos que sean capaces de deliberar acercaCriado Pacheco, N. (2012). Using Norms To Control Open Multi-Agent Systems [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/17800Palanci

Agents with Affective Traits for Decision-Making in Complex Environments

Recent events have probably lead us to wonder why people make decisions that seem to be irrational, and that go against any easily understandable logic. The fact that these decisions are emotionally driven often explains what, at first glance, does not have a plausible explanation. Evidence has been found that proves that emotions and other affective characteristics guide decisions beyond a purely rational deliberation. Understanding the way emotions take place, the way emotions change, and/or the way emotions influence behavior, has traditionally been a concern of several fields including psychology and neurology. Moreover, other sciences such as behavioral economics, artificial intelligence, and in general, all sciences that aim to understand, explain, or simulate human behavior, acknowledge the important role of affective characteristics in this task. Specifically, artificial intelligence uses psychological findings in order to create agents that simulate human behavior. Nevertheless, individual research efforts in modeling affective characteristics are often overlapped, short of integration, and they lack of a common conceptual system. This deprives individual researches of the exchange and cooperation's inherent benefits, and makes the task of computationally simulating affective characteristics more difficult. Although much individual effort has been put in classifying, formalizing and modeling emotions and emotion theories on some fields, recognized researchers of emotions' and affective processes' modeling report that a common formal language, an informal conceptual system, and a general purpose affective agent architecture will greatly improve the interdisciplinary exchange and the intradisciplinary coordination. The research literature proposes a wide amount of affective models that deal with some of: relationship between emotions and cognition, relationship between emotions and behavior, emotions and their evolutionary account, emotions for appraising situations, emotion regulation, etc. These models are useful tools for addressing particular emotion-related issues. Furthermore, computational approaches that are based on particular psychological theories have also been proposed. They often address domain specific issues starting from a specific psychological theory. In such solutions, the absence of a common conceptual system and/or platform, makes difficult the feedback between psychological theories and computational approaches. This thesis systematizes and formalizes affect-related theories, what can benefit the interdisciplinary exchange, the intradisciplinary coordination, and hence, allows the improvement of involved disciplines. Specifically this thesis makes the following contributions: (1) a theoretical framework that includes the main processes and concepts that a model of an affective agent with practical reasoning should have; (2) a general-purpose affective agent architecture that shares the concepts of the proposed theoretical framework; (3) an implementation-independent formal language for designing affective agents that have the proposed architecture; and (4) a specific agent language for implementing affective agents which is an extension of a BDI language. Some studies with human participants have helped to validate the contributions of this thesis. They include classical games of game theory, and an study with 300 participants, which have provided the necessary information to evaluate the contributions. The validation has been performed in three directions: determine whether the proposed computational approach represents better the human behavior than traditional computational approaches; determine whether this approach allows to improve psychological theories used by default; and determine whether the proposed affective agents' behavior is closer to human behavior than the behavior of a purely rational agent.Probablemente algunos eventos recientes nos han conducido a preguntarnos por qué las personas toman decisiones aparentemente irracionales y en contra de alguna lógica fácilmente comprensible. El hecho de que estas decisiones estén bajo la influencia de las emociones a menudo explica lo que, a primera vista, parece no tener una explicación aceptable. En este sentido, se han encontrado evidencias que prueban que las emociones y otras características afectivas condicionan las decisiones más allá de una deliberación meramente racional. Entender cómo las emociones tienen lugar, cómo cambian y cómo influyen en el comportamiento, ha sido tradicionalmente de interés para muchos campos de investigación, incluyendo la psicología y la neurología. Además, otras ciencias como la economía conductual o la inteligencia artificial reconocen el importante papel de las características afectivas en esta tarea. Específicamente, la inteligencia artificial utiliza los resultados obtenidos en psicología para crear agentes que simulan el comportamiento humano. Sin embargo, a menudo los esfuerzos individuales de investigación en el modelado del afecto se solapan, carecen de la suficiente integración y de un sistema conceptual común. Esto limita a las investigaciones individuales para disponer de los beneficios que ofrecen el intercambio y la cooperación, y hace más compleja la tarea de simular los procesos afectivos. Las emociones y teorías relacionadas han sido clasificadas, formalizadas y modeladas. No obstante, reconocidos investigadores argumentan que un lenguaje formal común, un sistema conceptual informal y una arquitectura de agentes de propósito general, mejorarán significativamente el intercambio interdisciplinar y la coordinación intradisciplinar. En la literatura se propone una amplia cantidad de modelos afectivos que modelan: la relación entre las emociones y la cognición, la relación entre las emociones y el comportamiento, las emociones para evaluar las situaciones, la regulación de emociones, etc. Estos modelos son herramientas útiles para abordar aspectos particulares relacionados con las emociones. Además, se han realizado propuestas computacionales que abordan aspectos específicos sobre la base de teorías psicológicas específicas. En éstas soluciones, la ausencia de una plataforma y/o sistema conceptual dificulta la retroalimentación entre las teorías psicológicas y las propuestas computacionales. Esta tesis sistematiza y formaliza teorías relacionadas con el afecto, lo cual beneficia el intercambio interdisciplinar y la coordinación intradisciplinar, y por tanto, permite el desarrollo de las disciplinas correspondientes. Específicamente esta tesis realiza las siguientes contribuciones: (1) una plataforma teórica que incluye los conceptos y procesos principales que debería poseer un modelo de agentes afectivos con razonamiento práctico; (2) una arquitectura de agentes de propósito general que comparte los conceptos de la plataforma teórica propuesta; (3) un lenguaje formal independiente de la implementación, para diseñar agentes afectivos que poseen la arquitectura propuesta; y (4) un lenguaje de agentes específico para implementar agentes afectivos el cual es un extensión de un lenguaje BDI. Algunos estudios con participantes humanos han ayudado a validar las contribuciones de esta tesis. Estos incluyen juegos clásicos de teoría de juegos y un estudio con 300 participantes, los cuales han proporcionado la información necesaria para evaluar las contribuciones. La validación se ha realizado en tres direcciones: determinar si la propuesta computacional que se ha realizado representa mejor el comportamiento humano que propuestas computacionales tradicionales; determinar si esta propuesta permite mejorar las teorías psicológicas empleadas por defecto; y determinar si el comportamiento de los agentes afectivos propuestos se acerca más al comportamiento humano que el comporProbablement alguns esdeveniments recents ens han conduït a preguntar-nos per què les persones prenen decisions que aparentment són irracionals i que van en contra d'algun tipus de lògica fàcilment comprensible. El fet que aquestes decisions estiguin sota la influència de les emocions sovint explica el que, a primera vista, sembla no tenir una explicació acceptable. En aquest sentit, s'han trobat evidències que proven que les emocions i altres característiques afectives condicionen les decisions més enllà d'una deliberació merament racional. Entendre com les emocions tenen lloc, com canvien i com influeixen en el comportament, ha estat tradicionalment d'interès per a molts camps d'investigació, incloent la psicologia i la neurologia. A més, altres ciències com l'economia conductual, la intel·ligència artificial i, en general, totes les ciències que intenten entendre, explicar o simular el comportament humà, reconeixen l'important paper de les característiques afectives en aquesta tasca. Específicament, la intel·ligència artificial utilitza els resultats obtinguts en psicologia per crear agents que simulen el comportament humà. No obstant això, sovint els esforços individuals d'investigació en el modelatge de l'afecte es solapen, no tenen la suficient integració ni compten amb un sistema conceptual comú. Això limita a les investigacions individuals, que no poden disposar dels beneficis que ofereixen l'intercanvi i la cooperació, i fa més complexa la tasca de simular els processos afectius. Les emocions i teories relacionades han estat classificades, formalitzades i modelades. No obstant això reconeguts investigadors argumenten que un llenguatge formal comú, un sistema conceptual informal i una arquitectura d'agents de propòsit general, milloraran significativament l'intercanvi interdisciplinar i la coordinació intradisciplinar. En la literatura es proposa una àmplia quantitat de models afectius que modelen: la relació entre les emocions i la cognició, la relació entre les emocions i el comportament, les emocions per avaluar les situacions, la regulació d'emocions, etc. Aquests models són eines útils per abordar aspectes particulars relacionats amb les emocions. A més, s'han realitzat propostes computacionals que aborden aspectes específics sobre la base de teories psicològiques específiques. En aquestes solucions, l'absència d'una plataforma i/o sistema conceptual dificulta la retroalimentació entre les teories psicològiques i les propostes computacionals. Aquesta tesi sistematitza i formalitza teories relacionades amb l'afecte, la qual cosa beneficia l'intercanvi interdisciplinar i la coordinació intradisciplinar, i per tant, permet el desenvolupament de les disciplines corresponents. Específicament aquesta tesi realitza les següents contribucions: (1) una plataforma teòrica que inclou els conceptes i processos principals que hauria de posseir un model d'agents afectius amb raonament pràctic; (2) una arquitectura d'agents de propòsit general que comparteix els conceptes de la plataforma teòrica proposta; (3) un llenguatge formal independent de la implementació, per dissenyar agents afectius que posseeixen l'arquitectura proposada; i (4) un llenguatge d'agents específic per implementar agents afectius el qual és un extensió d'un llenguatge BDI. Alguns estudis amb participants humans han ajudat a validar les contribucions d'aquesta tesi. Aquests inclouen jocs clàssics de teoria de jocs i un estudi amb 300 participants, els quals han proporcionat la informació necessària per avaluar les contribucions. La validació s'ha realitzat en tres direccions: determinar si la proposta computacional que s'ha realitzat representa millor el comportament humà que propostes computacionals tradicionals; determinar si aquesta proposta permet millorar les teories psicològiques emprades per defecte; i determinar si el comportament dels agents afectius proposats s'acosta més alAlfonso Espinosa, B. (2017). Agents with Affective Traits for Decision-Making in Complex Environments [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/90497TESI

A Framework for Modeling Human Behavior in Large-scale Agent-based Epidemic Simulations

Acknowledgements We thank Cuebiq; mobility data is provided by Cuebiq, a location intelligence and measurement platform. Through its Data for Good program, Cuebiq provides access to aggregated mobility data for academic research and humanitarian initiatives. This first-party data is collected from anonymized users who have opted-in to provide access to their location data anonymously, through a GDPR and CCPA compliant framework. To further preserve privacy, portions of the data are aggregated to the census-block group level. For the purpose of open access, the authors have applied a Creative Commons Attribution (CC BY) licence to any Author Accepted Manuscript version arising from this submission.Peer reviewedPublisher PD

A Review of Platforms for the Development of Agent Systems

Agent-based computing is an active field of research with the goal of building autonomous software of hardware entities. This task is often facilitated by the use of dedicated, specialized frameworks. For almost thirty years, many such agent platforms have been developed. Meanwhile, some of them have been abandoned, others continue their development and new platforms are released. This paper presents a up-to-date review of the existing agent platforms and also a historical perspective of this domain. It aims to serve as a reference point for people interested in developing agent systems. This work details the main characteristics of the included agent platforms, together with links to specific projects where they have been used. It distinguishes between the active platforms and those no longer under development or with unclear status. It also classifies the agent platforms as general purpose ones, free or commercial, and specialized ones, which can be used for particular types of applications.Comment: 40 pages, 2 figures, 9 tables, 83 reference

Agents for educational games and simulations

This book consists mainly of revised papers that were presented at the Agents for Educational Games and Simulation (AEGS) workshop held on May 2, 2011, as part of the Autonomous Agents and MultiAgent Systems (AAMAS) conference in Taipei, Taiwan. The 12 full papers presented were carefully reviewed and selected from various submissions. The papers are organized topical sections on middleware applications, dialogues and learning, adaption and convergence, and agent applications