Using Student Mood And Task Performance To Train Classifier Algorithms To Select Effective Coaching Strategies Within Intelligent Tutoring Systems (its)

The ultimate goal of this research was to improve student performance by adjusting an Intelligent Tutoring System\u27s (ITS) coaching strategy based on the student\u27s mood. As a step toward this goal, this study evaluated the relationships between each student\u27s mood variables (pleasure, arousal, dominance and mood intensity), the coaching strategy selected by the ITS and the student\u27s performance. Outcomes included methods to increase the perception of the intelligent tutor to allow it to adapt coaching strategies (methods of instruction) to the student\u27s affective needs to mitigate barriers to performance (e.g. negative affect) during the one-to-one tutoring process. The study evaluated whether the affective state (specifically mood) of the student moderated the student\u27s interaction with the tutor and influenced performance. This research examined the relationships, interactions and influences of student mood in the selection of ITS coaching strategies to determine which strategies were more effective in terms of student performance given the student\u27s mood, state (recent sleep time, previous knowledge and training, and interest level) and actions (e.g. mouse movement rate). Two coaching strategies were used in this study: Student-Requested Feedback (SRF) and Tutor-Initiated Feedback (TIF). The SRF coaching strategy provided feedback in the form of hints, questions, direction and support only when the student requested help. The TIF coaching strategy provided feedback (hints, questions, direction or support) at key junctures in the learning process when the student either made progress or failed to make progress in a timely fashion. The relationships between the coaching strategies, mood, performance and other variables of interest were considered in light of five hypotheses. At alpha = .05 and beta at least as great as .80, significant effects were limited in predicting performance. Highlighted findings include no significant differences in the mean performance due to coaching strategies, and only small effect sizes in predicting performance making the regression models developed not of practical significance. However, several variables including performance, energy level and mouse movement rates were significant, unobtrusive predictors of mood. Regression algorithms were developed using Arbuckle\u27s (2008) Analysis of MOment Structures (AMOS) tool to compare the predicted performance for each strategy and then to choose the optimal strategy. A set of production rules were also developed to train a machine learning classifier using Witten & Frank\u27s (2005) Waikato Environment for Knowledge Analysis (WEKA) toolset. The classifier was tested to determine its ability to recognize critical relationships and adjust coaching strategies to improve performance. This study found that the ability of the intelligent tutor to recognize key affective relationships contributes to improved performance. Study assumptions include a normal distribution of student mood variables, student state variables and student action variables and the equal mean performance of the two coaching strategy groups (student-requested feedback and tutor-initiated feedback ). These assumptions were substantiated in the study. Potential applications of this research are broad since its approach is application independent and could be used within ill-defined or very complex domains where judgment might be influenced by affect (e.g. study of the law, decisions involving risk of injury or death, negotiations or investment decisions). Recommendations for future research include evaluation of the temporal, as well as numerical, relationships of student mood, performance, actions and state variables

Serious Games to Teach Ethics

In this paper, we are focusing on digital serious games (edugames) and how they can be utilized in teaching in the ethics and citizenship domain. Our aim is to combine narrative techniques with intelligent tutoring techniques in a single model that adopts and based on educational theories and classroom educational strategies. The model has been used to implement an adaptive educational interactive narrative system (AEINS). AEINS is an inquiry based edugame to support teaching ethics. The AEINS version presented in this paper targets students between the age of 8 and 11. The idea is centered around presenting and involving students in different moral dilemmas (called teaching moments) within which the Socratic Method is the used pedagogy in the teaching process. AEINS monitors and analyzes the students actions in order to provide an individualized story-path and an individualized learning process. The student is an active participant in the educational process and is able to interact with the edugame as a first person player. We claim that such interaction can help in developing new or deeper thoughts about different moral situations. Our aim is to contribute to the design of serious games and help raise awareness of ethics and citizenship in children

Intelligent tutoring in virtual reality for highly dynamic pedestrian safety training

This thesis presents the design, implementation, and evaluation of an Intelligent Tutoring System (ITS) with a Virtual Reality (VR) interface for child pedestrian safety training. This system enables children to train practical skills in a safe and realistic virtual environment without the time and space dependencies of traditional roadside training. This system also employs Domain and Student Modelling techniques to analyze user data during training automatically and to provide appropriate instructions and feedback. Thus, the traditional requirement of constant monitoring from teaching personnel is greatly reduced. Compared to previous work, especially the second aspect is a principal novelty for this domain. To achieve this, a novel Domain and Student Modeling method was developed in addition to a modular and extensible virtual environment for the target domain. While the Domain and Student Modeling framework is designed to handle the highly dynamic nature of training in traffic and the ill-defined characteristics of pedestrian tasks, the modular virtual environment supports different interaction methods and a simple and efficient way to create and adapt exercises. The thesis is complemented by two user studies with elementary school children. These studies testify great overall user acceptance and the system’s potential for improving key pedestrian skills through autonomous learning. Last but not least, the thesis presents experiments with different forms of VR input and provides directions for future work.Diese Arbeit behandelt den Entwurf, die Implementierung sowie die Evaluierung eines intelligenten Tutorensystems (ITS) mit einer Virtual Reality (VR) basierten Benutzeroberfläche zum Zwecke von Verkehrssicherheitstraining für Kinder. Dieses System ermöglicht es Kindern praktische Fähigkeiten in einer sicheren und realistischen Umgebung zu trainieren, ohne den örtlichen und zeitlichen Abhängigkeiten des traditionellen, straßenseitigen Trainings unterworfen zu sein. Dieses System macht außerdem von Domain und Student Modelling Techniken gebrauch, um Nutzerdaten während des Trainings zu analysieren und daraufhin automatisiert geeignete Instruktionen und Rückmeldung zu generieren. Dadurch kann die bisher erforderliche, ständige Überwachung durch Lehrpersonal drastisch reduziert werden. Verglichen mit bisherigen Lösungen ist insbesondere der zweite Aspekt eine grundlegende Neuheit für diesen Bereich. Um dies zu erreichen wurde ein neuartiges Framework für Domain und Student Modelling entwickelt, sowie eine modulare und erweiterbare virtuelle Umgebung für diese Art von Training. Während das Domain und Student Modelling Framework so entworfen wurde, um mit der hohen Dynamik des Straßenverkehrs sowie den vage definierten Fußgängeraufgaben zurecht zu kommen, unterstützt die modulare Umgebung unterschiedliche Eingabeformen sowie eine unkomplizierte und effiziente Methode, um Übungen zu erstellen und anzupassen. Die Arbeit beinhaltet außerdem zwei Nutzerstudien mit Grundschulkindern. Diese Studien belegen dem System eine hohe Benutzerakzeptanz und stellt das Potenzial des Systems heraus, wichtige Fähigkeiten für Fußgängersicherheit durch autodidaktisches Training zu verbessern. Nicht zuletzt beschreibt die Arbeit Experimente mit verschiedenen Formen von VR Eingaben und zeigt die Richtung für zukünftige Arbeit auf

Designing a training tool for imaging mental models

The training process can be conceptualized as the student acquiring an evolutionary sequence of classification-problem solving mental models. For example a physician learns (1) classification systems for patient symptoms, diagnostic procedures, diseases, and therapeutic interventions and (2) interrelationships among these classifications (e.g., how to use diagnostic procedures to collect data about a patient's symptoms in order to identify the disease so that therapeutic measures can be taken. This project developed functional specifications for a computer-based tool, Mental Link, that allows the evaluative imaging of such mental models. The fundamental design approach underlying this representational medium is traversal of virtual cognition space. Typically intangible cognitive entities and links among them are visible as a three-dimensional web that represents a knowledge structure. The tool has a high degree of flexibility and customizability to allow extension to other types of uses, such a front-end to an intelligent tutoring system, knowledge base, hypermedia system, or semantic network

Sensemaking and metacognitive prompting in ill-structured problems

Purpose – The purpose of this paper is to develop a set of generic prompting principles and a framework of prompts that have the potential to foster learning and skill acquisition among adult novices when performing complex, ill-structured problems. Design/methodology/approach – Relevant research in the literatures surrounding problem structure, sensemaking, expertise, metacognition, scaffolding, and cognitive load were reviewed and synthesised in order to derive generic prompting principles and guidelines for their implementation. Findings – A framework of generic principles and prompts is proposed. Differentiation between prompts supporting cognition either within, or after an ill-structured problem-solving task was supported. Practical implications – Prompts such as those proposed in the framework developed presently can be designed into technology-enhanced learning environments in order to structure and guide the cognitive processes of novices. In addition, prompts can be combined with other learning support technologies (e.g. research diaries, collaborative discourse) in order to support learning. Empirical testing will be required to quantify the potential benefits (and limitations of) the proposed prompting framework. Originality/value – The prompts developed constitute a framework for structuring and guiding learning efforts in domains where explicit, actionable feedback is often unavailable. The proposed framework offers a method of tailoring the scaffolding of prompts in order to support differing levels of problem structure and may serve as the basis for establishing an internalised and adaptive learning approach that can be transferred to new problems or contexts

Innovative integrated architecture for educational games: Challenges and merits

Interactive Narrative in game environments acts as the main catalyst to provide a motivating learning experience. In previous work, we have described how the use of a dual narrative generation technique could help to resolve the conflict between allowing high player student agency and also the track of the learning process. In this paper, we define a novel architecture that assists the dual narrative generation technique to be employed effectively in an adaptive educational game environment. The architecture composes components that individually have shown effectiveness in educational games environments. These components are graph structured narrative, dynamically generated narrative, evolving agents and a student model. An adaptive educational game, AEINS, has been developed to investigate the synergy of the architecture components. AEINS aims to foster character education at 8-12 year old children through the use of various interactive moral dilemmas that attempt the different student\u27s cognitive levels. AEINS was evaluated through a study involved 20 participants who interacted with AEINS on an individual basis

Explicit Feedback Within Game-based Training: Examining The Influence Of Source Modality Effects On Interaction

This research aims to enhance Simulation-Based Training (SBT) applications to support training events in the absence of live instruction. The overarching purpose is to explore available tools for integrating intelligent tutoring communications in game-based learning platforms and to examine theory-based techniques for delivering explicit feedback in such environments. The primary tool influencing the design of this research was the Generalized Intelligent Framework for Tutoring (GIFT), a modular domain-independent architecture that provides the tools and methods to author, deliver, and evaluate intelligent tutoring technologies within any training platform. Influenced by research surrounding Social Cognitive Theory and Cognitive Load Theory, the resulting experiment tested varying approaches for utilizing an Embodied Pedagogical Agent (EPA) to function as a tutor during interaction in a game-based environment. Conditions were authored to assess the tradeoffs between embedding an EPA directly in a game, embedding an EPA in GIFT’s browser-based Tutor-User Interface (TUI), or using audio prompts alone with no social grounding. The resulting data supports the application of using an EPA embedded in GIFT’s TUI to provide explicit feedback during a game-based learning event. Analyses revealed conditions with an EPA situated in the TUI to be as effective as embedding the agent directly in the game environment. This inference is based on evidence showing reliable differences across conditions on the metrics of performance and self-reported mental demand and feedback usefulness items. This research provides source modality tradeoffs linked to tactics for relaying training relevant explicit information to a user based on real-time performance in a game

A generic architecture for interactive intelligent tutoring systems

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University, 07/06/2001.This research is focused on developing a generic intelligent architecture for an interactive tutoring system. A review of the literature in the areas of instructional theories, cognitive and social views of learning, intelligent tutoring systems development methodologies, and knowledge representation methods was conducted. As a result, a generic ITS development architecture (GeNisa) has been proposed, which combines the features of knowledge base systems (KBS) with object-oriented methodology. The GeNisa architecture consists of the following components: a tutorial events communication module, which encapsulates the interactive processes and other independent computations between different components; a software design toolkit; and an autonomous knowledge acquisition from a probabilistic knowledge base. A graphical application development environment includes tools to support application development, and learning environments and which use a case scenario as a basis for instruction. The generic architecture is designed to support client-side execution in a Web browser environment, and further testing will show that it can disseminate applications over the World Wide Web. Such an architecture can be adapted to different teaching styles and domains, and reusing instructional materials automatically can reduce the effort of the courseware developer (hence cost and time) in authoring new materials. GeNisa was implemented using Java scripts, and subsequently evaluated at various commercial and academic organisations. Parameters chosen for the evaluation include quality of courseware, relevancy of case scenarios, portability to other platforms, ease of use, content, user-friendliness, screen display, clarity, topic interest, and overall satisfaction with GeNisa. In general, the evaluation focused on the novel characteristics and performances of the GeNisa architecture in comparison with other ITS and the results obtained are discussed and analysed. On the basis of the experience gained during the literature research and GeNisa development and evaluation. a generic methodology for ITS development is proposed as well as the requirements for the further development of ITS tools. Finally, conclusions are drawn and areas for further research are identified

Research and Applications of Expert Systems in Military Training

This report surveys recent research and applications of Expert Systems in the military training and simulation community. The report reviews twenty-one recent papers covering this subject. Each paper reviewed has been assigned a class which establishes the phase of development of the system or activities described. For each paper the abstract is given, followed by comments which summarize in more detail significant parameters of the activities reported. This is then followed by a listing of the specific Expert System areas of interest described in the paper