An Overview of Self-Adaptive Technologies Within Virtual Reality Training

This overview presents the current state-of-the-art of self-adaptive technologies within virtual reality (VR) training. Virtual reality training and assessment is increasingly used for five key areas: medical, industrial & commercial training, serious games, rehabilitation and remote training such as Massive Open Online Courses (MOOCs). Adaptation can be applied to five core technologies of VR including haptic devices, stereo graphics, adaptive content, assessment and autonomous agents. Automation of VR training can contribute to automation of actual procedures including remote and robotic assisted surgery which reduces injury and improves accuracy of the procedure. Automated haptic interaction can enable tele-presence and virtual artefact tactile interaction from either remote or simulated environments. Automation, machine learning and data driven features play an important role in providing trainee-specific individual adaptive training content. Data from trainee assessment can form an input to autonomous systems for customised training and automated difficulty levels to match individual requirements. Self-adaptive technology has been developed previously within individual technologies of VR training. One of the conclusions of this research is that while it does not exist, an enhanced portable framework is needed and it would be beneficial to combine automation of core technologies, producing a reusable automation framework for VR training

Towards Integration of Cognitive Models in Dialogue Management: Designing the Virtual Negotiation Coach Application

This paper presents an approach to flexible and adaptive dialogue management driven by cognitive modelling of human dialogue behaviour. Artificial intelligent agents, based on the ACT-R cognitive architecture, together with human actors are participating in a (meta)cognitive skills training within a negotiation scenario. The agent  employs instance-based learning to decide about its own actions and to reflect on the behaviour of the opponent. We show that task-related actions can be handled by a cognitive agent who is a plausible dialogue partner.  Separating task-related and dialogue control actions enables the application of sophisticated models along with a flexible architecture  in which  various alternative modelling methods can be combined. We evaluated the proposed approach with users assessing  the relative contribution of various factors to the overall usability of a dialogue system. Subjective perception of effectiveness, efficiency and satisfaction were correlated with various objective performance metrics, e.g. number of (in)appropriate system responses, recovery strategies, and interaction pace. It was observed that the dialogue system usability is determined most by the quality of agreements reached in terms of estimated Pareto optimality, by the user's negotiation strategies selected, and by the quality of system recognition, interpretation and responses. We compared human-human and human-agent performance with respect to the number and quality of agreements reached, estimated cooperativeness level, and frequency of accepted negative outcomes. Evaluation experiments showed promising, consistently positive results throughout the range of the relevant scales

A contribution to the incorporation of sociability and creativity skills to computers and robots

This dissertation contains the research and work completed by the PhD candidate on the incorporation of sociability and creativity skills to computers and robots. Both skills can be directly related with empathy, which is the ability to understand and share the feelings of another. In this form, this research can be contextualized in the framework of recent developments towards the achievement of empathy machines. The first challenge at hands refers to designing pioneering techniques based on the use of social robots to improve user experience interacting with them. In particular, research focus is on eliminating or minimizing pain and anxiety as well as loneliness and stress of long-term hospitalized child patients. This challenge is approached by developing a cloud-based robotics architecture to effectively develop complex tasks related to hospitalized children assistance. More specifically, a multiagent learning system is introduced based on a combination of machine learning and cloud computing using low-cost robots (Innvo labs's Pleo rb). Moreover, a wireless communication system is also developed for the Pleo robot in order to help the health professional who conducts therapy with the child, monitoring, understanding, and controlling Pleo behavior at any moment. As a second challenge, a new formulation of the concept of creativity is proposed in order to empower computers with. Based on previous well established theories from Boden and Wiggins, this thesis redefines the formal mechanism of exploratory and transformational creativity in a way which facilitates the computational implementation of these mechanisms in Creativity Support Systems. The proposed formalization is applied and validated on two real cases: the first, about chocolate designing, in which a novel and flavorful combination of chocolate and fruit is generated. The second case is about the composition of a single voice tune of reel using ABC notation.Postprint (published version