Intelligent tutoring in virtual reality for highly dynamic pedestrian safety training

This thesis presents the design, implementation, and evaluation of an Intelligent Tutoring System (ITS) with a Virtual Reality (VR) interface for child pedestrian safety training. This system enables children to train practical skills in a safe and realistic virtual environment without the time and space dependencies of traditional roadside training. This system also employs Domain and Student Modelling techniques to analyze user data during training automatically and to provide appropriate instructions and feedback. Thus, the traditional requirement of constant monitoring from teaching personnel is greatly reduced. Compared to previous work, especially the second aspect is a principal novelty for this domain. To achieve this, a novel Domain and Student Modeling method was developed in addition to a modular and extensible virtual environment for the target domain. While the Domain and Student Modeling framework is designed to handle the highly dynamic nature of training in traffic and the ill-defined characteristics of pedestrian tasks, the modular virtual environment supports different interaction methods and a simple and efficient way to create and adapt exercises. The thesis is complemented by two user studies with elementary school children. These studies testify great overall user acceptance and the system’s potential for improving key pedestrian skills through autonomous learning. Last but not least, the thesis presents experiments with different forms of VR input and provides directions for future work.Diese Arbeit behandelt den Entwurf, die Implementierung sowie die Evaluierung eines intelligenten Tutorensystems (ITS) mit einer Virtual Reality (VR) basierten Benutzeroberfläche zum Zwecke von Verkehrssicherheitstraining für Kinder. Dieses System ermöglicht es Kindern praktische Fähigkeiten in einer sicheren und realistischen Umgebung zu trainieren, ohne den örtlichen und zeitlichen Abhängigkeiten des traditionellen, straßenseitigen Trainings unterworfen zu sein. Dieses System macht außerdem von Domain und Student Modelling Techniken gebrauch, um Nutzerdaten während des Trainings zu analysieren und daraufhin automatisiert geeignete Instruktionen und Rückmeldung zu generieren. Dadurch kann die bisher erforderliche, ständige Überwachung durch Lehrpersonal drastisch reduziert werden. Verglichen mit bisherigen Lösungen ist insbesondere der zweite Aspekt eine grundlegende Neuheit für diesen Bereich. Um dies zu erreichen wurde ein neuartiges Framework für Domain und Student Modelling entwickelt, sowie eine modulare und erweiterbare virtuelle Umgebung für diese Art von Training. Während das Domain und Student Modelling Framework so entworfen wurde, um mit der hohen Dynamik des Straßenverkehrs sowie den vage definierten Fußgängeraufgaben zurecht zu kommen, unterstützt die modulare Umgebung unterschiedliche Eingabeformen sowie eine unkomplizierte und effiziente Methode, um Übungen zu erstellen und anzupassen. Die Arbeit beinhaltet außerdem zwei Nutzerstudien mit Grundschulkindern. Diese Studien belegen dem System eine hohe Benutzerakzeptanz und stellt das Potenzial des Systems heraus, wichtige Fähigkeiten für Fußgängersicherheit durch autodidaktisches Training zu verbessern. Nicht zuletzt beschreibt die Arbeit Experimente mit verschiedenen Formen von VR Eingaben und zeigt die Richtung für zukünftige Arbeit auf

Cognitive Maps

undefine

Virtual Reality Games for Motor Rehabilitation

This paper presents a fuzzy logic based method to track user satisfaction without the need for devices to monitor users physiological conditions. User satisfaction is the key to any product’s acceptance; computer applications and video games provide a unique opportunity to provide a tailored environment for each user to better suit their needs. We have implemented a non-adaptive fuzzy logic model of emotion, based on the emotional component of the Fuzzy Logic Adaptive Model of Emotion (FLAME) proposed by El-Nasr, to estimate player emotion in UnrealTournament 2004. In this paper we describe the implementation of this system and present the results of one of several play tests. Our research contradicts the current literature that suggests physiological measurements are needed. We show that it is possible to use a software only method to estimate user emotion

Contributions to interoperability, scalability and formalization of personal health systems

The ageing of the world's population combined with unhealthy lifestyles are contributing to a major prevalence of chronic diseases. This scenario poses the challenge of providing good healthcare services to that people affected by chronic illnesses, but without increasing its costs. A prominent way to face this challenge is through pervasive healthcare. Research in pervasive healthcare tries to shift the current centralized healthcare delivery model focused on the doctors, to a more distributed model focused on the patients. In this context Personal Health Systems (PHSs) consists on approaching sampling technologies into the hands of the patients, without disturbing its activities of the daily life, to monitor patient's physiological parameters and providing feedback on their state. The use of PHSs involves the patients in the management of their illness and in their own well being too. The development of PHSs has to face technological issues in order to be accepted by our society. Within them it is important to ensure interoperability between different systems in order to make them work together. Scalability it is also a concern, as their performance must not decrease when increasing the number of users. Another issue is how to formalize the medical knowledge for each patient, as different patients may have different target goals. Security and privacy are a must feature because of the sensitive nature of medical data. Other issues involve the the integration with legacy systems, and the usability of graphical user interfaces in order to encourage old people with the use these technologies. The aim of this PhD thesis is to contribute into the state-of-the-art of PHSs by tackling together different of the above-mentioned challenges. First, to achieve interoperability we use the CDA standard as a format to encode and exchange health data and alerts related with the status of the patient. We show how these documents can be generated automatically through the use of XML templates. Second, we address the scalability by distributing the computations needed to monitor the patients over their devices, rather than performing them in a centralized server. In this context we develop the MAGPIE agent platform, which runs on Android devices, as a framework able to provide intelligence to PHSs, and generate alerts that can be of interest for the patients and the medical doctors. Third, we focus on the formalization of PHSs by providing a tool for the practitioners where they can define, in a graphical way, monitoring rules related with chronic diseases that are integrated with the MAGPIE agent platform. The thesis also explores different ways to share the data collected with PHSs in order to improve the outcomes obtained with the use of this technology. Data is shared between individuals following a Distributed Event-Based System (DEBS) approach, where different people can subscribe to the alerts produced by the patient. Data is also shared between institutions with a network protocol called MOSAIC, and we focus on the security aspects of this protocol. The research in this PhD focuses in the use case of Diabetes Mellitus; and it has been developed in the context of the projects MONDAINE, MAGPIE, COMMODITY12 and TAMESIS.L'envelliment de la població mundial combinat amb uns estils de vida no saludables contribueixen a una major prevalença d'enfermetats cròniques. Aquest escenari presenta el repte de proporcionar uns bons serveis sanitaris a les persones afectades per aquestes enfermetats, sense incrementar-ne els costos. Una solució prometedora a aquest repte és mitjançant l'aplicació del que en anglès s'anomena "pervasive healthcare". L'investigació en aquesta camp tracta de canviar l'actual model centralitzat de serveis sanitaris enfocat en el personal sanitari, per un model de serveis distribuït enfocat en els pacients. En aquest context, els Personal Health Systems (PHSs) consisteixen en posar a l'abast dels pacients les tecnologies de monitorització, i proporcionar-los informació sobre el seu estat. L'ús de PHSs involucra els pacients en la gestió de la seva enfermetat i del seu propi benestar. L'acceptació dels PHSs per part de la societat implica certs reptes tecnològics en el seu desenvolupament. És important garantir la seva interoperabilitat per tal de que puguin treballar conjuntament. La seva escalabilitat també s'ha de tenir en compte, ja que el seu rendiment no s'ha de veure afectat al incrementar-ne el número d'usuaris. Un altre aspecte a considerar és com formalitzar el coneixement mèdic per cada pacient, ja que cada un d'ells pot tenir objectius diferents. La seguretat i privacitat són característiques desitjades degut a la naturalesa sensible de les dades mèdiques. Altres problemàtiques impliquen la integració amb sistemes heretats, i la usabilitat de les interfícies gràfiques per fomentar-ne el seu ús entre les persones grans. L'objectiu d'aquesta tesi és contribuir a l'estat de l'art dels PHSs tractant de manera conjunta varis dels reptes mencionats. Per abordar l'interoperabilitat s'utilitza l'estàndard CDA com a format per codificar les dades mèdiques i alertes relacionades amb el pacient. A més es mostra com aquests documents poden generar-se de forma automàtica mitjançant l' ús de plantilles XML. Per tractar l'escalabilitat es distribueixen les computacions per monitoritzar els pacients entre els seus terminals mòbils, en comptes de realitzar-les en un servidor central. En aquest context es desenvolupa la plataforma d'agents MAGPIE com a framework per proporcionar intelligència als PHSs i generar alertes d'interès per al metge i el pacient. La formalització s'aborda mitjançant una eina que permet als metges definir de manera gràfica regles de monitorització relacionades amb enfermetats cròniques, que a més estan integrades amb la plataforma d'agents MAGPIE. La tesi també explora diferents maneres de compartir les dades recol·lectades amb un PHS, amb l'objectiu de millorar els resultats obtinguts amb aquesta tecnologia. Les dades es comparteixen entre individus seguint un enfoc de sistemes distribuïts basats en events (DEBS), on diferents usuaris poden subscriure's a les alertes produïdes per el pacient. Les dades també es comparteixen entre institucions mitjançant un protocol de xarxa anomenat MOSAIC. A la tesi es desenvolupen els aspectes de seguretat d'aquest protocol. La test es centra en la Diabetis Mellitus com a cas d'ús, i s'ha realitzat en el context dels projectes MONDAINE, MAGPIE, COMMODITY12 i TAMESIS.El envejecimiento de la población mundial combinado con unos estilos de vida no saludables contribuyen a una mayor prevalencia de enfermedades crónicas. Este escenario presenta el reto de proporcionar unos buenos servicios sanitarios a las personas afectadas por estas enfermedades, sin incrementar sus costes. Una solución prometedora a este reto es mediante la aplicación de lo que en inglés se denomina "pervasive healthcare". La investigación en este campo trata de cambiar el actual modelo centralizado de servicios sanitarios enfocado hacia el personal sanitario, por un modelo distribuido enfocado hacia los pacientes. En este contexto, los Personal Health Systems (PHSs) consisten en poner al alcance de los pacientes las tecnologías de monitorización, y proporcionarles información sobre su estado. El uso de PHSs involucra a los pacientes en la gestión de su enfermedad y en su propio bienestar. La aceptación de los PHSs por parte de la sociedad implica ciertos retos tecnológicos en su desarrollo. Es importante garantizar su interoperabilidad para que puedan trabajar conjuntamente. Su escalabilidad también se debe tener en cuenta, ya que su rendimiento no tiene que verse afectado al incrementar su número de usuarios. Otro aspecto a considerar es cómo formalizar el conocimiento médico para cada paciente, ya que cada uno puede tener objetivos distintos. La seguridad y privacidad son características deseadas debido a la naturaleza sensible de los datos médicos. Otras problemáticas implican la integración con sistemas heredados, y la usabilidad de las interfaces gráficas para fomentar su uso entre las personas mayores. El objetivo de esta tesis es contribuir al estado del arte de los PHSs tratando de manera conjunta varios de los retos mencionados. Para abordar la interoperabilidad se usa el estándar CDA como formato para codificar los datos médicos y alertas relacionados con el paciente. Además se muestra como estros documentos pueden generarse de forma automática mediante el uso de plantillas XML. Para tratar la escalabilidad se distribuye la computación para monitorizar a los pacientes en sus terminales móbiles, en lugar de realizarla en un servidor central. En este contexto se desarrolla la plataforma de agentes MAGPIE como framework para proporcionar inteligencia a los PHSs y generar alertas de interés para el médico y el paciente. La formalización se aborda mediante una herramienta que permite a los médicos definir de manera gráfica reglas de monitorización relacionadas con enfermedades crónicas, que ademas están integradas con la plataforma de agentes MAGPIE. La tesis también explora distintas formas de compartir los datos recolectados con un PHS, con el fin de mejorar los resultados obtenidos mediante esta tecnología. Los datos se comparten entre individuos siguiendo un enfoque de sistemas distribuidos basados en eventos (DEBS), donde distintos usuarios pueden suscribirse a las alertas producidas por el paciente. Los datos también se comparten entre instituciones mediante un protocolo dered llamado MOSAIC. En la tesis se desarrollan los aspectos de seguridad de este protocolo. La tesis se centra en la Diabetes Mellitus como caso de uso, y se ha realizado en el contexto de los proyectos MONDAINE, MAGPIE, COMMODITY12 y TAMESIS.Postprint (published version

Extracting Ontologies From Neural Networks

Artificial neural network-based methods have been growing in popularity, being success- fully applied to perform a variety of tasks. As these systems begin to be deployed in domains where it is desired that they have a certain degree of autonomy and respon- sibility, the need to comprehend the reasoning behind their answers is becoming a re- quirement. Though, neural networks are still regarded as black boxes, since their internal representation do not provide any human-understandable explanation for their outputs. A considerable amount of work has been done towards the development of methods to increase the interpretability of neural networks. However, these methods often produce interpretations are too complex and do not have any declarative meaning, leaving the user with the burden of rationalizing them. Recent work has shown that it is possible to establish mappings between a neural network’s internal representations and a set of human-understandable concepts. In this dissertation we propose a method that leverage these mappings to induce an ontology that describes a neural network’s classification process, through logical relations between human-understandable concepts.Métodos com base em redes neuronais artificiais têm ganho cada vez mais popularidade, e têm sido aplicados na resolução das mais variadas tarefas. À medida que estes sistemas são usados em domínios onde se pretende que tenham um determinado grau de auto- nomia e responsabilidade, a necessidade de compreender o raciocínio que os conduz às suas respostas torna-se indispensável. No entanto, as redes neuronais são vistas como caixas negras, dado que as suas representações internas não constituem uma explicação interpretável para os seus resultados. Tem sido realizada uma quantidade considerável de investigação com o objetivo de desenvolver métodos que permitam o aumento da interpretabilidade de redes neuronais. Todavia, estes métodos tendem a produzir inter- pretações complexas e a que não possuem nenhum significado declarativo, deixando o utilizador com a responsabilidade as racionalizar. Uma publicação recente mostrou que é possível estabelecer mapeamentos entre as representações internas de uma rede neuronal e conceitos interpretáveis. Nesta dissertação propomos um método que faz uso destes mapeamentos para induzir uma ontologia que reflete o processo de classificação de uma rede neuronal, através de conceitos compreensiveis relacionados logicamente

Logic programming in the context of multiparadigm programming: the Oz experience

Oz is a multiparadigm language that supports logic programming as one of its major paradigms. A multiparadigm language is designed to support different programming paradigms (logic, functional, constraint, object-oriented, sequential, concurrent, etc.) with equal ease. This article has two goals: to give a tutorial of logic programming in Oz and to show how logic programming fits naturally into the wider context of multiparadigm programming. Our experience shows that there are two classes of problems, which we call algorithmic and search problems, for which logic programming can help formulate practical solutions. Algorithmic problems have known efficient algorithms. Search problems do not have known efficient algorithms but can be solved with search. The Oz support for logic programming targets these two problem classes specifically, using the concepts needed for each. This is in contrast to the Prolog approach, which targets both classes with one set of concepts, which results in less than optimal support for each class. To explain the essential difference between algorithmic and search programs, we define the Oz execution model. This model subsumes both concurrent logic programming (committed-choice-style) and search-based logic programming (Prolog-style). Instead of Horn clause syntax, Oz has a simple, fully compositional, higher-order syntax that accommodates the abilities of the language. We conclude with lessons learned from this work, a brief history of Oz, and many entry points into the Oz literature.Comment: 48 pages, to appear in the journal "Theory and Practice of Logic Programming

A heuristic-based approach to code-smell detection

Encapsulation and data hiding are central tenets of the object oriented paradigm. Deciding what data and behaviour to form into a class and where to draw the line between its public and private details can make the difference between a class that is an understandable, flexible and reusable abstraction and one which is not. This decision is a difficult one and may easily result in poor encapsulation which can then have serious implications for a number of system qualities. It is often hard to identify such encapsulation problems within large software systems until they cause a maintenance problem (which is usually too late) and attempting to perform such analysis manually can also be tedious and error prone. Two of the common encapsulation problems that can arise as a consequence of this decomposition process are data classes and god classes. Typically, these two problems occur together – data classes are lacking in functionality that has typically been sucked into an over-complicated and domineering god class. This paper describes the architecture of a tool which automatically detects data and god classes that has been developed as a plug-in for the Eclipse IDE. The technique has been evaluated in a controlled study on two large open source systems which compare the tool results to similar work by Marinescu, who employs a metrics-based approach to detecting such features. The study provides some valuable insights into the strengths and weaknesses of the two approache

SWA-KMDLS: An Enhanced e-Learning Management System Using Semantic Web and Knowledge Management Technology

In this era of knowledge economy in which knowledge have become the most precious resource, surveys have shown that e-Learning has been on the increasing trend in various organizations including, among others, education and corporate. The use of e-Learning is not only aim to acquire knowledge but also to maintain competitiveness and advantages for individuals or organizations. However, the early promise of e-Learning has yet to be fully realized, as it has been no more than a handout being published online, coupled with simple multiple-choice quizzes. The emerging of e-Learning 2.0 that is empowered by Web 2.0 technology still hardly overcome common problem such as information overload and poor content aggregation in a highly increasing number of learning objects in an e-Learning Management System (LMS) environment. The aim of this research study is to exploit the Semantic Web (SW) and Knowledge Management (KM) technology; the two emerging and promising technology to enhance the existing LMS. The proposed system is named as Semantic Web Aware-Knowledge Management Driven e-Learning System (SWA-KMDLS). An Ontology approach that is the backbone of SW and KM is introduced for managing knowledge especially from learning object and developing automated question answering system (Aquas) with expert locator in SWA-KMDLS. The METHONTOLOGY methodology is selected to develop the Ontology in this research work. The potential of SW and KM technology is identified in this research finding which will benefit e-Learning developer to develop e-Learning system especially with social constructivist pedagogical approach from the point of view of KM framework and SW environment. The (semi-) automatic ontological knowledge base construction system (SAOKBCS) has contributed to knowledge extraction from learning object semiautomatically whilst the Aquas with expert locator has facilitated knowledge retrieval that encourages knowledge sharing in e-Learning environment. The experiment conducted has shown that the SAOKBCS can extract concept that is the main component of Ontology from text learning object with precision of 86.67%, thus saving the expert time and effort to build Ontology manually. Additionally the experiment on Aquas has shown that more than 80% of users are satisfied with answers provided by the system. The expert locator framework can also improve the performance of Aquas in the future usage. Keywords: semantic web aware – knowledge e-Learning Management System (SWAKMDLS), semi-automatic ontological knowledge base construction system (SAOKBCS), automated question answering system (Aquas), Ontology, expert locator