Proficiency-aware systems

In an increasingly digital world, technological developments such as data-driven algorithms and context-aware applications create opportunities for novel human-computer interaction (HCI). We argue that these systems have the latent potential to stimulate users and encourage personal growth. However, users increasingly rely on the intelligence of interactive systems. Thus, it remains a challenge to design for proficiency awareness, essentially demanding increased user attention whilst preserving user engagement. Designing and implementing systems that allow users to become aware of their own proficiency and encourage them to recognize learning benefits is the primary goal of this research. In this thesis, we introduce the concept of proficiency-aware systems as one solution. In our definition, proficiency-aware systems use estimates of the user's proficiency to tailor the interaction in a domain and facilitate a reflective understanding for this proficiency. We envision that proficiency-aware systems leverage collected data for learning benefit. Here, we see self-reflection as a key for users to become aware of necessary efforts to advance their proficiency. A key challenge for proficiency-aware systems is the fact that users often have a different self-perception of their proficiency. The benefits of personal growth and advancing one's repertoire might not necessarily be apparent to users, alienating them, and possibly leading to abandoning the system. To tackle this challenge, this work does not rely on learning strategies but rather focuses on the capabilities of interactive systems to provide users with the necessary means to reflect on their proficiency, such as showing calculated text difficulty to a newspaper editor or visualizing muscle activity to a passionate sportsperson. We first elaborate on how proficiency can be detected and quantified in the context of interactive systems using physiological sensing technologies. Through developing interaction scenarios, we demonstrate the feasibility of gaze- and electromyography-based proficiency-aware systems by utilizing machine learning algorithms that can estimate users' proficiency levels for stationary vision-dominant tasks (reading, information intake) and dynamic manual tasks (playing instruments, fitness exercises). Secondly, we show how to facilitate proficiency awareness for users, including design challenges on when and how to communicate proficiency. We complement this second part by highlighting the necessity of toolkits for sensing modalities to enable the implementation of proficiency-aware systems for a wide audience. In this thesis, we contribute a definition of proficiency-aware systems, which we illustrate by designing and implementing interactive systems. We derive technical requirements for real-time, objective proficiency assessment and identify design qualities of communicating proficiency through user reflection. We summarize our findings in a set of design and engineering guidelines for proficiency awareness in interactive systems, highlighting that proficiency feedback makes performance interpretable for the user.In einer zunehmend digitalen Welt schaffen technologische Entwicklungen - wie datengesteuerte Algorithmen und kontextabhängige Anwendungen - neuartige Interaktionsmöglichkeiten mit digitalen Geräten. Jedoch verlassen sich Nutzer oftmals auf die Intelligenz dieser Systeme, ohne dabei selbst auf eine persönliche Weiterentwicklung hinzuwirken. Wird ein solches Vorgehen angestrebt, verlangt dies seitens der Anwender eine erhöhte Aufmerksamkeit. Es ist daher herausfordernd, ein entsprechendes Design für Kompetenzbewusstsein (Proficiency Awareness) zu etablieren. Das primäre Ziel dieser Arbeit ist es, eine Methodik für das Design und die Implementierung von interaktiven Systemen aufzustellen, die Nutzer dabei unterstützen über ihre eigene Kompetenz zu reflektieren, um dadurch Lerneffekte implizit wahrnehmen können. Diese Arbeit stellt ein Konzept für fähigkeitsbewusste Systeme (proficiency-aware systems) vor, welche die Fähigkeiten von Nutzern abschätzen, die Interaktion entsprechend anpassen sowie das Bewusstsein der Nutzer über deren Fähigkeiten fördern. Hierzu sollten die Systeme gesammelte Daten von Nutzern einsetzen, um Lerneffekte sichtbar zu machen. Die Möglichkeit der Anwender zur Selbstreflexion ist hierbei als entscheidend anzusehen, um als Motivation zur Verbesserung der eigenen Fähigkeiten zu dienen. Eine zentrale Herausforderung solcher Systeme ist die Tatsache, dass Nutzer - im Vergleich zur Abschätzung des Systems - oft eine divergierende Selbstwahrnehmung ihrer Kompetenz haben. Im ersten Moment sind daher die Vorteile einer persönlichen Weiterentwicklung nicht unbedingt ersichtlich. Daher baut diese Forschungsarbeit nicht darauf auf, Nutzer über vorgegebene Lernstrategien zu unterrichten, sondern sie bedient sich der Möglichkeiten interaktiver Systeme, die Anwendern die notwendigen Hilfsmittel zur Verfügung stellen, damit diese selbst über ihre Fähigkeiten reflektieren können. Einem Zeitungseditor könnte beispielsweise die aktuelle Textschwierigkeit angezeigt werden, während einem passionierten Sportler dessen Muskelaktivität veranschaulicht wird. Zunächst wird herausgearbeitet, wie sich die Fähigkeiten der Nutzer mittels physiologischer Sensortechnologien erkennen und quantifizieren lassen. Die Evaluation von Interaktionsszenarien demonstriert die Umsetzbarkeit fähigkeitsbewusster Systeme, basierend auf der Analyse von Blickbewegungen und Muskelaktivität. Hierbei kommen Algorithmen des maschinellen Lernens zum Einsatz, die das Leistungsniveau der Anwender für verschiedene Tätigkeiten berechnen. Im Besonderen analysieren wir stationäre Aktivitäten, die hauptsächlich den Sehsinn ansprechen (Lesen, Aufnahme von Informationen), sowie dynamische Betätigungen, die die Motorik der Nutzer fordern (Spielen von Instrumenten, Fitnessübungen). Der zweite Teil zeigt auf, wie Systeme das Bewusstsein der Anwender für deren eigene Fähigkeiten fördern können, einschließlich der Designherausforderungen , wann und wie das System erkannte Fähigkeiten kommunizieren sollte. Abschließend wird die Notwendigkeit von Toolkits für Sensortechnologien hervorgehoben, um die Implementierung derartiger Systeme für ein breites Publikum zu ermöglichen. Die Forschungsarbeit beinhaltet eine Definition für fähigkeitsbewusste Systeme und veranschaulicht dieses Konzept durch den Entwurf und die Implementierung interaktiver Systeme. Ferner werden technische Anforderungen objektiver Echtzeitabschätzung von Nutzerfähigkeiten erforscht und Designqualitäten für die Kommunikation dieser Abschätzungen mittels Selbstreflexion identifiziert. Zusammengefasst sind die Erkenntnisse in einer Reihe von Design- und Entwicklungsrichtlinien für derartige Systeme. Insbesondere die Kommunikation, der vom System erkannten Kompetenz, hilft Anwendern, die eigene Leistung zu interpretieren

Climbing up the leaderboard: An empirical study of applying gamification techniques to a computer programming class

Conventional taught learning practices often experience difficulties in keeping students motivated and engaged. Video games, however, are very successful at sustaining high levels of motivation and engagement through a set of tasks for hours without apparent loss of focus. In addition, gamers solve complex problems within a gaming environment without feeling fatigue or frustration, as they would typically do with a comparable learning task. Based on this notion, the academic community is keen on exploring methods that can deliver deep learner engagement and has shown increased interest in adopting gamification – the integration of gaming elements, mechanics, and frameworks into non-game situations and scenarios – as a means to increase student engagement and improve information retention. Its effectiveness when applied to education has been debatable though, as attempts have generally been restricted to one-dimensional approaches such as transposing a trivial reward system onto existing teaching materials and/or assessments. Nevertheless, a gamified, multi-dimensional, problem-based learning approach can yield improved results even when applied to a very complex and traditionally dry task like the teaching of computer programming, as shown in this paper. The presented quasi-experimental study used a combination of instructor feedback, real time sequence of scored quizzes, and live coding to deliver a fully interactive learning experience. More specifically, the “Kahoot!” Classroom Response System (CRS), the classroom version of the TV game show “Who Wants To Be A Millionaire?”, and Codecademy’s interactive platform formed the basis for a learning model which was applied to an entry-level Python programming course. Students were thus allowed to experience multiple interlocking methods similar to those commonly found in a top quality game experience. To assess gamification’s impact on learning, empirical data from the gamified group were compared to those from a control group who was taught through a traditional learning approach, similar to the one which had been used during previous cohorts. Despite this being a relatively small-scale study, the results and findings for a number of key metrics, including attendance, downloading of course material, and final grades, were encouraging and proved that the gamified approach was motivating and enriching for both students and instructors

Game-Based Learning, Gamification in Education and Serious Games

The aim of this book is to present and discuss new advances in serious games to show how they could enhance the effectiveness and outreach of education, advertising, social awareness, health, policies, etc. We present their use in structured learning activities, not only with a focus on game-based learning, but also on the use of game elements and game design techniques to gamify the learning process. The published contributions really demonstrate the wide scope of application of game-based approaches in terms of purpose, target groups, technologies and domains and one aspect they have in common is that they provide evidence of how effective serious games, game-based learning and gamification can be

May / June 2019

I just wanted to let you know that I will be retiring on July 1, 2019, and Lisa Friesen will be the new Director of the Center for Excellence in Teaching and Learning

Gamificação e cicloturismo sénior : design de uma app para a comunidade miOne

As the aging population continues to grow, there has been an increasing interest in the subject of gerontechnology. In the specific case of the digital game industry, senior citizens are becoming better consumers due to their purchasing power and free time, so it is important to focus on the role of games to their wellbeing and meet their needs and preferences. However, there is a general lack of information and products that address physical exercise in the interrelationship of cycling, tourism, games, gamification and senior citizens. The aim of this research is to understand the way gamification interventions can motivate senior citizens to adhere to cyclo-tourism. This dissertation reports on the use of the Development Research Method, deploying a broad array of methods, including focus groups, eye-tracking and interviews. A total of 46 participants (7 focus group participants, 8 participants in eye-tracking and 31 cyclists’ interviewees) were involved in this research. Based on the literature review, related work and the insights from each method, a cyclo-tourism digital app entitled Jizo was co-designed and prototyped. Findings indicate that certain gamification techniques and elements can trigger senior citizens’ motivations towards cyclo-tourism, being essential integrative parts of a digital app in this context. The elements highlighted were social relationships, progression, challenges, competition, feedback and rewards, having an important role in pre-, in loco and post- experience. These data support the view on gamification capability to motivate senior cyclo-tourism.Com o contínuo crescimento do envelhecimento da população, tem havido um interesse progressivo na área da gerontecnologia. No caso específico da indústria dos jogos digitais, os cidadãos seniores fazem parte de um grupo de consumidores com poder de compra e tempo livre, pelo que é essencial compreender o papel dos jogos digitais no seu bem-estar e atender às suas necessidades e preferências. No entanto, continua a prevalecer uma falta de informação e de produtos que abordam o exercício físico nas inter-relações entre o ciclismo, turismo, jogos, gamificação e cidadãos seniores. O objetivo desta investigação é compreender o uso de estratégias de gamificação para motivar os cidadãos seniores a aderirem ao cicloturismo. Esta dissertação reporta a utilização do Método de Investigação de Desenvolvimento, tendo como base os seguintes métodos: grupos de discussão, eye-tracking e entrevistas. Um total de 46 participantes (7 participantes de grupos de discussão, 8 participantes de eye-tracking e 31 ciclistas entrevistados) foram envolvidos nesta investigação. Após a revisão da literatura, trabalho relacionado, e os resultados obtidos de cada método, procedeu-se ao co-design e prototipagem uma app de cicloturismo designada Jizo. Os resultados indicam que certas técnicas e elementos da gamificação podem desencadear as motivações dos cidadãos seniores para o cicloturismo, além de serem partes essenciais e integrantes de um aplicativo deste contexto. Os elementos destacados foram as relações sociais, progressão, desafios, competição, feedback e recompensas, na medida em que eles têm um papel importante na pré, in loco e na pós-experiência. Estes dados suportam a ideia da capacidade da gamificação para motivar o cicloturismo sénior.Mestrado em Comunicação Multimédi

Serious Games and Mixed Reality Applications for Healthcare

Virtual reality (VR) and augmented reality (AR) have long histories in the healthcare sector, offering the opportunity to develop a wide range of tools and applications aimed at improving the quality of care and efficiency of services for professionals and patients alike. The best-known examples of VR–AR applications in the healthcare domain include surgical planning and medical training by means of simulation technologies. Techniques used in surgical simulation have also been applied to cognitive and motor rehabilitation, pain management, and patient and professional education. Serious games are ones in which the main goal is not entertainment, but a crucial purpose, ranging from the acquisition of knowledge to interactive training.These games are attracting growing attention in healthcare because of their several benefits: motivation, interactivity, adaptation to user competence level, flexibility in time, repeatability, and continuous feedback. Recently, healthcare has also become one of the biggest adopters of mixed reality (MR), which merges real and virtual content to generate novel environments, where physical and digital objects not only coexist, but are also capable of interacting with each other in real time, encompassing both VR and AR applications.This Special Issue aims to gather and publish original scientific contributions exploring opportunities and addressing challenges in both the theoretical and applied aspects of VR–AR and MR applications in healthcare

Digital innovation in Multiple Sclerosis Management

Due to innovation in technology, a new type of patient has been created, the e-patient, characterized by the use of electronic communication tools and commitment to participate in their own care. The extent to which the world of digital health has changed during the COVID-19 pandemic has been widely recognized. Remote medicine has become part of the new normal for patients and clinicians, introducing innovative care delivery models that are likely to endure even if the pendulum swings back to some degree in a post-COVID age. The development of digital applications and remote communication technologies for patients with multiple sclerosis has increased rapidly in recent years. For patients, eHealth apps have been shown to improve outcomes and increase access to care, disease information, and support. For HCPs, eHealth technology may facilitate the assessment of clinical disability, analysis of lab and imaging data, and remote monitoring of patient symptoms, adverse events, and outcomes. It may allow time optimization and more timely intervention than is possible with scheduled face-to-face visits. The way we measure the impact of MS on daily life has remained relatively unchanged for decades, and is heavily reliant on clinic visits that may only occur once or twice each year.These benefits are important because multiple sclerosis requires ongoing monitoring, assessment, and management.The aim of this Special Issue is to cover the state of knowledge and expertise in the field of eHealth technology applied to multiple sclerosis, from clinical evaluation to patient education