Agent programming in the cognitive era

It is claimed that, in the nascent ‘Cognitive Era’, intelligent systems will be trained using machine learning techniques rather than programmed by software developers. A contrary point of view argues that machine learning has limitations, and, taken in isolation, cannot form the basis of autonomous systems capable of intelligent behaviour in complex environments. In this paper, we explore the contributions that agent-oriented programming can make to the development of future intelligent systems. We briefly review the state of the art in agent programming, focussing particularly on BDI-based agent programming languages, and discuss previous work on integrating AI techniques (including machine learning) in agent-oriented programming. We argue that the unique strengths of BDI agent languages provide an ideal framework for integrating the wide range of AI capabilities necessary for progress towards the next-generation of intelligent systems. We identify a range of possible approaches to integrating AI into a BDI agent architecture. Some of these approaches, e.g., ‘AI as a service’, exploit immediate synergies between rapidly maturing AI techniques and agent programming, while others, e.g., ‘AI embedded into agents’ raise more fundamental research questions, and we sketch a programme of research directed towards identifying the most appropriate ways of integrating AI capabilities into agent programs

Extending External Agent Capabilities in Healthcare Social Networks

A social health care system, such as palliative care, can be viewed as a social network of interacting patients and care providers. Each patient in the network has a set of capabilities to perform his or her intended daily tasks. However, some patients may not have the required capabilities to carry out their desired tasks. Consequently, different groups of care providers - consist of doctors, volunteers, nurses, etc.- offer the patients support by providing them with a variety of needed services. Assuming there are a cost and resource limitations for providing care within the system, where each care provider can support a limited number of patients, the problem is to find a set of suitable care providers to match the needs of the maximum number of patients. In this dissertation, we propose a novel agent-based model to address this problem by extending the agent\u27s capabilities using the benefit of the social network. Our assumption is that each agent, or patient, can cover its disabilities and perform its desired tasks through collaboration with other agents, or care providers, in the network. The goal of this work is to improve the quality of services in the network at both individual and system levels. On the one hand, an individual patient wants to maximize the quality of his/her life, while at the system level we want to achieve quality care for as many patients as possible with minimum cost. The performance and functionality of this proposed model have been evaluated based on various synthetic networks. The results demonstrate a significant reduction in the operational costs and enhancement of the service quality

Integrating BDI and Reinforcement Learning: the Case Study of Autonomous Driving

Recent breakthroughs in machine learning are paving the way to the vision of software 2.0 era, which foresees the replacement of traditional software development with such techniques for many applications. In the context of agent-oriented programming, we believe that mixing together cognitive architectures like the BDI one and learning techniques could trigger new interesting scenarios. In that view, our previous work presents Jason-RL, a framework that integrates BDI agents and Reinforcement Learning (RL) more deeply than what has been already proposed so far in the literature. The framework allows the development of BDI agents having both explicitly programmed plans and plans learned by the agent using RL. The two kinds of plans are seamlessly integrated and can be used without differences. Here, we take autonomous driving as a case study to verify the advantages of the proposed approach and framework. The BDI agent has hard-coded plans that define high-level directions while fine-grained navigation is learned by trial and error. This approach – compared to plain RL – is encouraging as RL struggles in temporally extended planning. We defined and trained an agent able to drive in a track with an intersection, at which it has to choose the correct path to reach the assigned target. A first step towards porting the system in the real-world has been done by building a 1/10 scale racecar prototype which learned how to drive in a simple track

Integrating Learning into a BDI Agent for Environments with Changing Dynamics

We propose a framework that adds learning for improving plan selection in the popular BDI agent programming paradigm. In contrast with previous proposals, the approach given here is able to scale up well with the complexity of the agent's plan library. Technically, we develop a novel confidence measure which allows the agent to adjust its reliance on the learning dynamically, facilitating in principle infinitely many (re)learning phases. We demonstrate the benefits of the approach in an example controller for energy management

Technological Support for a Learning Oriented Knowledge Management System

Knowledge management is quickly becoming a requirement for today’s complex organizations. Creating and managing existing knowledge has been linked to successful innovation and to sustainable competitive advantage. However, systems specifically designed to manage knowledge, support knowledge creation, and verify existing knowledge are in their infancy. This article follows the framework for a Learning-Oriented Knowledge Management System, and shows how such a complex system can be supported by an equally complex technology – that is, a multi-agent system. We define single agents and multi-agent systems and subsystems in the context of knowledge management systems in general, and the Learning-Oriented Knowledge Management System (LOKMS) specifically. We show how a multi-agent system can be conceived to fully support the LOKMS, describe some necessary agents and agent subsystems, and demonstrate prototypically a multi-agent system designed and built to support the integrity-checking component of the LOKMS. This system begins the process of LOKMS design and development

Using the Myers-Briggs Type Indicator (MBTI) for Modeling Multiagent Systems

The formation of high-performance teams has been a constant challenge for organizations, which despite considering human capital as one of the most important resources, it still lacks the means to allow them to have a better understanding of several factors that influence the formation of these teams. In this sense, studies also demonstrate that teamwork has a significant impact on the results presented by organizations, in which human behavior is highlighted as one of the main aspects to be considered in the building of work teams. The Myers-Briggs Type Indicator seeks to classify the behavioral preferences of individuals around eight characteristics, which grouped as dichotomies, describe different psychological types. With it, researchers have sought to expand the ability to understand the human factor, using strategies with multiagent systems that, through experiments and simulations, using computer resources, enable the development of artificial agents that simulate human actions. In this work, we present an overview of the research approaches that use MBTI to model agents, aiming at providing a better knowledge of human behavior. Additionally, we make a preliminary discussion of how these results could be explored in order to advance the studies of psychological factors' influence in organizations' work teams formation

Extending BDI plan selection to incorporate learning from experience

An important drawback to the popular Belief, Desire, and Intentions (BDI) paradigm is that such systems include no element of learning from experience. We describe a novel BDI execution framework that models context conditions as decision trees, rather than boolean formulae, allowing agents to learn the probability of success for plans based on experience. By using a probabilistic plan selection function, the agents can balance exploration and exploitation of their plans. We extend earlier work to include both parameterised goals and recursion and modify our previous approach to decision tree confidence to include large and even non-finite domains that arise from such consideration. Our evaluation on a pre-existing program that relies heavily on recursion and parametrised goals confirms previous results that naive learning fails in some circumstances, and demonstrates that the improved approach learns relatively well