Towards VEsNA, a Framework for Managing Virtual Environments via Natural Language Agents

Automating a factory where robots are involved is neither trivial nor cheap. Engineering the factory automation process in such a way that return of interest is maximized and risk for workers and equipment is minimized, is hence of paramount importance. Simulation can be a game changer in this scenario but requires advanced programming skills that domain experts and industrial designers might not have. In this paper we present the preliminary design and implementation of a general-purpose framework for creating and exploiting Virtual Environments via Natural language Agents (VEsNA). VEsNA takes advantage of agent-based technologies and natural language processing to enhance the design of virtual environments. The natural language input provided to VEsNA is understood by a chatbot and passed to a cognitive intelligent agent that implements the logic behind displacing objects in the virtual environment. In the VEsNA vision, the intelligent agent will be able to reason on this displacement and on its compliance to legal and normative constraints. It will also be able to implement what-if analysis and case-based reasoning. Objects populating the virtual environment will include active objects and will populate a dynamic simulation whose outcomes will be interpreted by the cognitive agent; explanations and suggestions will be passed back to the user by the chatbot

An interactive, generative Punch and Judy show using institutions, ASP and emotional agents

Using Punch and Judy as a story domain, we describe an interactive puppet show, where the flow and content of the story can be influenced by the actions of the audience. As the puppet show is acted out, the audience reacts to events by cheering or booing the characters. This affects the agents’ emotional state, potentially causing them to change their actions, altering the course of the narrative. An institutional normative model is used to constrain the narrative so that it remains consistent with the Punch and Judy canon. Through this vignette of a socio-technical system (STS), comprising human and software actors, an institutional model – derived from narrative theory – and (simplistic) technological interaction artifacts, we begin to be able to explore some of the issues that can arise in STS through the prism of the World-Institution-Technology (WIT) model

A data-driven approach towards a realistic and generic crowd simulation framework

Jacob Sinclair studied and developed a data-driven approach towards a realistic and generic crowd simulation framework. He found that by using virtual reality and questionnaires, we can gather all types of real world data. He also found that an AI framework developed using all types of data can produce similar results to the real world. This AI framework has the potential to be used to improve areas such as emergency management and response, traffic control, building design, video games, etc

A hybrid data gathering and agent based cognitive architecture for realistic crowd simulations

This paper proposes a realistic agent-based framework for crowd simulations that can encompass the input phase, the simulation process phase, and the output evaluation phase. In order to achieve this gathering, the three types of real-world data (physical, mental and visual) need to be considered. However, existing research has not used all the three data types to develop an agent-based framework since current data gathering methods are unable to collect all the three types. This paper introduces anew hybrid data gathering approach using a combination of virtual reality and questionnaires to gather all three data types. The data collected are incorporated into the simulation model to provide realism and flexibility. The performance of the framework is evaluated and benchmarked to prove the robustness and effectiveness of our framework. Various types of settings (self-set parameters and random parameters) are simulated to demonstrate that the framework can produce real-world like simulation

Governing narrative events with institutional norms

A narrative world can be viewed as a form of society in which characters follow a set of social norms whose collective function is to guide the characters through (the creation of) a story arc and reach some conclusion. By modelling the rules of a narrative using norms, we can govern the actions of agents that act out the characters in a story. Agents are given sets of permitted actions and obligations to fulfil based on their and the story's current situation. However, the decision to conform to these expectations is ultimately left to the agent. This means that the characters have control over fine-grained elements of the story, resulting in a more flexible and dynamic narrative experience. This would allow the creator of an interactive narrative to specify only the general structure of a story, leaving the details to the agents. We illustrate a particular realisation of this vision using a formalization of Propp's morphology in a normative social framework, with belief-desire-intention agents playing the characters

Virtual Reality Games for Motor Rehabilitation

This paper presents a fuzzy logic based method to track user satisfaction without the need for devices to monitor users physiological conditions. User satisfaction is the key to any product’s acceptance; computer applications and video games provide a unique opportunity to provide a tailored environment for each user to better suit their needs. We have implemented a non-adaptive fuzzy logic model of emotion, based on the emotional component of the Fuzzy Logic Adaptive Model of Emotion (FLAME) proposed by El-Nasr, to estimate player emotion in UnrealTournament 2004. In this paper we describe the implementation of this system and present the results of one of several play tests. Our research contradicts the current literature that suggests physiological measurements are needed. We show that it is possible to use a software only method to estimate user emotion

Multi-Agent Systems

A multi-agent system (MAS) is a system composed of multiple interacting intelligent agents. Multi-agent systems can be used to solve problems which are difficult or impossible for an individual agent or monolithic system to solve. Agent systems are open and extensible systems that allow for the deployment of autonomous and proactive software components. Multi-agent systems have been brought up and used in several application domains

Proceedings of The Multi-Agent Logics, Languages, and Organisations Federated Workshops (MALLOW 2010)

http://ceur-ws.org/Vol-627/allproceedings.pdfInternational audienceMALLOW-2010 is a third edition of a series initiated in 2007 in Durham, and pursued in 2009 in Turin. The objective, as initially stated, is to "provide a venue where: the cost of participation was minimum; participants were able to attend various workshops, so fostering collaboration and cross-fertilization; there was a friendly atmosphere and plenty of time for networking, by maximizing the time participants spent together"