The Multimodal Tutor: Adaptive Feedback from Multimodal Experiences

This doctoral thesis describes the journey of ideation, prototyping and empirical testing of the Multimodal Tutor, a system designed for providing digital feedback that supports psychomotor skills acquisition using learning and multimodal data capturing. The feedback is given in real-time with machine-driven assessment of the learner's task execution. The predictions are tailored by supervised machine learning models trained with human annotated samples. The main contributions of this thesis are: a literature survey on multimodal data for learning, a conceptual model (the Multimodal Learning Analytics Model), a technological framework (the Multimodal Pipeline), a data annotation tool (the Visual Inspection Tool) and a case study in Cardiopulmonary Resuscitation training (CPR Tutor). The CPR Tutor generates real-time, adaptive feedback using kinematic and myographic data and neural networks

Enhancing Humanities Research Productivity in a Collaborative Data Sharing Environment

This project represents a multi-organizational, interdisciplinary effort to enhance collaborative research in cultural heritage fields by exploring user experience with Web-based technologies. The objective of this project is to document user needs around online systems for sharing primary data and documentation of cultural heritage collections. To this end, we will draw upon the experience and insights of representatives from different stakeholder groups in three broad arenas: academic researchers, heritage managers, and specialist communities. Investigations undertaken in this study will result in best-practice guidelines to guide humanities computing efforts on how to best meet the diverse user needs in future online data sharing systems. Using an iterative cycle of development, deployment, and evaluation, this project will enhance Open Context, a collaborative, open-access data sharing system already in use for archaeology and related disciplines

Discovering communities of social e-learning practice

Teaching and Professional Development Fellowship Report 201