The Multimodal Tutor: Adaptive Feedback from Multimodal Experiences

This doctoral thesis describes the journey of ideation, prototyping and empirical testing of the Multimodal Tutor, a system designed for providing digital feedback that supports psychomotor skills acquisition using learning and multimodal data capturing. The feedback is given in real-time with machine-driven assessment of the learner's task execution. The predictions are tailored by supervised machine learning models trained with human annotated samples. The main contributions of this thesis are: a literature survey on multimodal data for learning, a conceptual model (the Multimodal Learning Analytics Model), a technological framework (the Multimodal Pipeline), a data annotation tool (the Visual Inspection Tool) and a case study in Cardiopulmonary Resuscitation training (CPR Tutor). The CPR Tutor generates real-time, adaptive feedback using kinematic and myographic data and neural networks

AI in Learning: Designing the Future

AI (Artificial Intelligence) is predicted to radically change teaching and learning in both schools and industry causing radical disruption of work. AI can support well-being initiatives and lifelong learning but educational institutions and companies need to take the changing technology into account. Moving towards AI supported by digital tools requires a dramatic shift in the concept of learning, expertise and the businesses built off of it. Based on the latest research on AI and how it is changing learning and education, this book will focus on the enormous opportunities to expand educational settings with AI for learning in and beyond the traditional classroom. This open access book also introduces ethical challenges related to learning and education, while connecting human learning and machine learning. This book will be of use to a variety of readers, including researchers, AI users, companies and policy makers

Using Student Mood And Task Performance To Train Classifier Algorithms To Select Effective Coaching Strategies Within Intelligent Tutoring Systems (its)

The ultimate goal of this research was to improve student performance by adjusting an Intelligent Tutoring System\u27s (ITS) coaching strategy based on the student\u27s mood. As a step toward this goal, this study evaluated the relationships between each student\u27s mood variables (pleasure, arousal, dominance and mood intensity), the coaching strategy selected by the ITS and the student\u27s performance. Outcomes included methods to increase the perception of the intelligent tutor to allow it to adapt coaching strategies (methods of instruction) to the student\u27s affective needs to mitigate barriers to performance (e.g. negative affect) during the one-to-one tutoring process. The study evaluated whether the affective state (specifically mood) of the student moderated the student\u27s interaction with the tutor and influenced performance. This research examined the relationships, interactions and influences of student mood in the selection of ITS coaching strategies to determine which strategies were more effective in terms of student performance given the student\u27s mood, state (recent sleep time, previous knowledge and training, and interest level) and actions (e.g. mouse movement rate). Two coaching strategies were used in this study: Student-Requested Feedback (SRF) and Tutor-Initiated Feedback (TIF). The SRF coaching strategy provided feedback in the form of hints, questions, direction and support only when the student requested help. The TIF coaching strategy provided feedback (hints, questions, direction or support) at key junctures in the learning process when the student either made progress or failed to make progress in a timely fashion. The relationships between the coaching strategies, mood, performance and other variables of interest were considered in light of five hypotheses. At alpha = .05 and beta at least as great as .80, significant effects were limited in predicting performance. Highlighted findings include no significant differences in the mean performance due to coaching strategies, and only small effect sizes in predicting performance making the regression models developed not of practical significance. However, several variables including performance, energy level and mouse movement rates were significant, unobtrusive predictors of mood. Regression algorithms were developed using Arbuckle\u27s (2008) Analysis of MOment Structures (AMOS) tool to compare the predicted performance for each strategy and then to choose the optimal strategy. A set of production rules were also developed to train a machine learning classifier using Witten & Frank\u27s (2005) Waikato Environment for Knowledge Analysis (WEKA) toolset. The classifier was tested to determine its ability to recognize critical relationships and adjust coaching strategies to improve performance. This study found that the ability of the intelligent tutor to recognize key affective relationships contributes to improved performance. Study assumptions include a normal distribution of student mood variables, student state variables and student action variables and the equal mean performance of the two coaching strategy groups (student-requested feedback and tutor-initiated feedback ). These assumptions were substantiated in the study. Potential applications of this research are broad since its approach is application independent and could be used within ill-defined or very complex domains where judgment might be influenced by affect (e.g. study of the law, decisions involving risk of injury or death, negotiations or investment decisions). Recommendations for future research include evaluation of the temporal, as well as numerical, relationships of student mood, performance, actions and state variables

AI in Learning: Designing the Future

AI (Artificial Intelligence) is predicted to radically change teaching and learning in both schools and industry causing radical disruption of work. AI can support well-being initiatives and lifelong learning but educational institutions and companies need to take the changing technology into account. Moving towards AI supported by digital tools requires a dramatic shift in the concept of learning, expertise and the businesses built off of it. Based on the latest research on AI and how it is changing learning and education, this book will focus on the enormous opportunities to expand educational settings with AI for learning in and beyond the traditional classroom. This open access book also introduces ethical challenges related to learning and education, while connecting human learning and machine learning. This book will be of use to a variety of readers, including researchers, AI users, companies and policy makers

Mobile Games for Learning:A Pattern-Based Approach

The core concern of this thesis is the design of mobile games for learning. The conditions and requirements that are vital in order to make mobile games suitable and effective for learning environments are investigated. The base for exploration is the pattern approach as an established form of templates that provide solutions for recurrent problems. Building on this acknowledged form of exchanging and re-using knowledge, patterns for game design are used to classify the many gameplay rules and mechanisms in existence. This research draws upon pattern descriptions to analyze learning game concepts and to abstract possible relationships between gameplay patterns and learning outcomes. The linkages that surface are the starting bases for a series of game design concepts and their implementations are subsequently evaluated with regard to learning outcomes. The findings and resulting knowledge from this research is made accessible by way of implications and recommendations for future design decisions

Mobile Apps Catalog

The Mobile Apps Catalog is a collection of emergency management and assistive mobile applications intended to assist first responders, emergency managers, and the public, specifically people with disabilities or others with access and function needs. Highlighted in this catalog are readily available preparedness and response apps that can be accessed by wireless devices, as well as assistive resources to advance the usability of wireless devices for consumers with disabilities. The apps are also helpful for the whole community. “Federal Emergency Management Agency (FEMA)’s “Whole Community” approach to emergency management recognizes that individuals, families and communities are assets and keys to success (Fugate 2011).