The Effect of Augmented Reality Treatment on Learning, Cognitive Load, and Spatial Visualization Abilities

This study investigated the effects of Augmented Reality (AR) on learning, cognitive load and spatial abilities. More specifically, it measured learning gains, perceived cognitive load, and the role spatial abilities play with students engaged in an astronomy lesson about lunar phases. Research participants were 182 students from a public university in southeastern United States, and were recruited from psychology research pool. Participants were randomly assigned to two groups: (a) Augmented Reality and Text Astronomy Treatment (ARTAT); and (b) Images and Text Astronomy Treatment (ITAT). Upon entering the experimental classroom, participants were given (a) Paper Folding Test to measure their spatial abilities; (b) the Lunar Phases Concept Inventory (LPCI) pre-test; (c) lesson on Lunar Phases; (d) NASA-TLX to measure participants’ cognitive load; and (e) LPCI post-test. Statistical analysis found (a) no statistical difference for learning gains between the ARTAT and ITAT groups; (b) statistically significant difference for cognitive load; and (c) no significant difference for spatial abilities scores

Haptic-Enhanced Learning in Preclinical Operative Dentistry

Background: Virtual reality haptic simulators represent a new paradigm in dental education that may potentially impact the rate and efficiency of basic skill acquisition, as well as pedagogically influence the various aspects of students’ preclinical experience. However, the evidence to support their efficiency and inform their implementation is still limited. Objectives: This thesis set out to empirically examine how haptic VR simulator (Simodont®) can enhance the preclinical dental education experience particularly in the context of operative dentistry. We specify 4 distinct research themes to explore, namely: simulator validity (face, content and predictive), human factors in 3D stereoscopic display, motor skill acquisition, and curriculum integration. Methods: Chapter 3 explores the face and content validity of Simodont® haptic dental simulator among a group of postgraduate dental students. Chapter 4 examines the predictive utility of Simodont® in predicting subsequent preclinical and clinical performance. The results indicate the potential utility of the simulator in predicting future clinical dental performance among undergraduate students. Chapter 5 investigates the role of stereopsis in dentistry from two different perspectives via two studies. Chapter 6 explores the effect of qualitatively different types of pedagogical feedback on the training, transfer and retention of basic manual dexterity dental skills. The results indicate that the acquisition and retention of basic dental motor skills in novice trainees is best optimised through a combination of instructor and visualdisplay VR-driven feedback. A pedagogical model for integration of haptic dental simulator into the dental curriculum has been proposed in Chapter 7. Conclusion: The findings from this thesis provide new insights into the utility of the haptic virtual reality simulator in undergraduate preclinical dental education. Haptic simulators have promising potential as a pedagogical tool in undergraduate dentistry that complements the existing simulation methods. Integration of haptic VR simulators into the dental curriculum has to be informed by sound pedagogical principles and mapped into specific learning objectives

A new approach to study gait impairments in Parkinson’s disease based on mixed reality

Dissertação de mestrado integrado em Engenharia Biomédica (especialização em Eletrónica Médica)Parkinson’s disease (PD) is the second most common neurodegenerative disorder after Alzheimer's disease. PD onset is at 55 years-old on average, and its incidence increases with age. This disease results from dopamine-producing neurons degeneration in the basal ganglia and is characterized by various motor symptoms such as freezing of gait, bradykinesia, hypokinesia, akinesia, and rigidity, which negatively impact patients’ quality of life. To monitor and improve these PD-related gait disabilities, several technology-based methods have emerged in the last decades. However, these solutions still require more customization to patients’ daily living tasks in order to provide more objective, reliable, and long-term data about patients’ motor conditions in home-related contexts. Providing this quantitative data to physicians will ensure more personalized and better treatments. Also, motor rehabilitation sessions fostered by assistance devices require the inclusion of quotidian tasks to train patients for their daily motor challenges. One of the most promising technology-based methods is virtual, augmented, and mixed reality (VR/AR/MR), which immerse patients in virtual environments and provide sensory stimuli (cues) to assist with these disabilities. However, further research is needed to improve and conceptualize efficient and patient-centred VR/AR/MR approaches and increase their clinical evidence. Bearing this in mind, the main goal of this dissertation was to design, develop, test, and validate virtual environments to assess and train PD-related gait impairments using mixed reality smart glasses, integrated with another high-technological motion tracking device. Using specific virtual environments that trigger PD-related gait impairments (turning, doorways, and narrow spaces), it is hypothesized that patients can be assessed and trained in their daily challenges related to walking. Also, this tool integrates on-demand visual cues to provide visual biofeedback and foster motor training. This solution was validated with end-users to test the identified hypothesis. The results showed that, in fact, mixed reality has the potential to recreate real-life environments that often provoke PD-related gait disabilities, by placing virtual objects on top of the real world. On the contrary, biofeedback strategies did not significantly improve the patients’ motor performance. The user experience evaluation showed that participants enjoyed participating in the activity and felt that this tool can help their motor performance.A doença de Parkinson (DP) é a segunda doença neurodegenerativa mais comum depois da doença de Alzheimer. O início da DP ocorre, em média, aos 55 anos de idade, e a sua incidência aumenta com a idade. Esta doença resulta da degeneração dos neurónios produtores de dopamina nos gânglios basais e é caracterizada por vários sintomas motores como o congelamento da marcha, bradicinesia, hipocinesia, acinesia, e rigidez, que afetam negativamente a qualidade de vida dos pacientes. Nas últimas décadas surgiram métodos tecnológicos para monitorizar e treinar estas desabilidades da marcha. No entanto, estas soluções ainda requerem uma maior personalização relativamente às tarefas diárias dos pacientes, a fim de fornecer dados mais objetivos, fiáveis e de longo prazo sobre o seu desempenho motor em contextos do dia-a-dia. Através do fornecimento destes dados quantitativos aos médicos, serão assegurados tratamentos mais personalizados. Além disso, as sessões de reabilitação motora, promovidas por dispositivos de assistência, requerem a inclusão de tarefas quotidianas para treinar os pacientes para os seus desafios diários. Um dos métodos tecnológicos mais promissores é a realidade virtual, aumentada e mista (RV/RA/RM), que imergem os pacientes em ambientes virtuais e fornecem estímulos sensoriais para ajudar nestas desabilidades. Contudo, é necessária mais investigação para melhorar e conceptualizar abordagens RV/RA/RM eficientes e centradas no paciente e ainda aumentar as suas evidências clínicas. Tendo isto em mente, o principal objetivo desta dissertação foi conceber, desenvolver, testar e validar ambientes virtuais para avaliar e treinar as incapacidades de marcha relacionadas com a DP usando óculos inteligentes de realidade mista, integrados com outro dispositivo de rastreio de movimento. Utilizando ambientes virtuais específicos que desencadeiam desabilidades da marcha (rodar, portas e espaços estreitos), é possível testar hipóteses de que os pacientes possam ser avaliados e treinados nos seus desafios diários. Além disso, esta ferramenta integra pistas visuais para fornecer biofeedback visual e fomentar a reabilitação motora. Esta solução foi validada com utilizadores finais de forma a testar as hipóteses identificadas. Os resultados mostraram que, de facto, a realidade mista tem o potencial de recriar ambientes da vida real que muitas vezes provocam deficiências de marcha relacionadas à DP. Pelo contrário, as estratégias de biofeedback não provocaram melhorias significativas no desempenho motor dos pacientes. A avaliação feita pelos pacientes mostrou que estes gostaram de participar nos testes e sentiram que esta ferramenta pode auxiliar no seu desempenho motor

From presence to consciousness through virtual reality

Immersive virtual environments can break the deep, everyday connection between where our senses tell us we are and where we are actually located and whom we are with. The concept of 'presence' refers to the phenomenon of behaving and feeling as if we are in the virtual world created by computer displays. In this article, we argue that presence is worthy of study by neuroscientists, and that it might aid the study of perception and consciousness

Surgical Skill and Video Games: A Meta-Analytic Review

As the popularity of video games has grown over the past decade, so has interest in their capacity to serve as tools for education. The technology behind modern laparoscopic surgery draws strong parallels to modern video games, and as such has inspired initial research into the potential relationship between video game play and surgical performance. To date, a number of researchers have conducted studies on this relationship; however, no structured, statistical review of accessible data has taken place. Thus, the goal of this analysis was to examine the available literature and report the significance of the cumulative findings. Through my process, a total of 21 studies involving 1220 participants were gathered through multi-step review, and organized into one of three experimental domains - game training, VR training, and gaming history. Effect size analysis using Hedge’s G and Fisher’s Z yielded statistically significant results in all three domains, thus supporting the consensus belief that video game play has a positive effect on laparoscopic surgical training and performance. Given the particularly strong effect of virtual reality training on surgical performance, it would be valuable to investigate the differential effects of virtual reality, and how these effects might be further developed into more effective educational instruments

Augmented Interaction Systems for Supporting Autistic Children. Evolution of a Multichannel Expressive Tool: The SEMI Project Feasibility Study

International audienceBackground: Over the past ten years, the authors have been designing, developing, and testing pervasive technology to support children with autism (ASD). Methods: In the present study, an integrated system based on multimedia and augmented interaction technologies have been tested on young subjects with ASD and dyspraxia in the age range of 6-10 years, in charge for rehabilitation treatments; a team of clinical psychologists has analyzed the results of the experimentation. The ten children involved in the project underwent an initial assessment of praxis skills and motor coordination. Subsequently, the subjects were subdivided into two subgroups: five children participated in the experimentation and five were evaluated as the control group (treatment as usual). Results: The evaluation showed an increased score in the several aspects considered, and particularly those related to motor coordination. An improvement in balancing tests and in hands-movement testing was found. Conclusion: The children involved in the sessions showed greater ability to self-control the movement as well as to select specific motor areas. The methods used seem to be promising to improve emotional and social skills too in a motivating and enjoyable climate. A high level of acceptance by professionals was observed and parents' feedback was also positive

The effect of 3D-stereogram mobile AR on engineering drawing course outcomes among first-year vocational high schoolers with different spatial abilities: a Bloom�s taxonomy perspective

ABSTRACT Engineering drawing is valuable in capturing geometric features, conveying engineering ideas, and creating a blueprint of the intended product. Engineering students usually perform orthographic projections, imagining a 3D situation and sketching its 2D representation. That requires imagination and mental visualization, determined by the learner�s spatial ability. This study proposes the infusion of an AR stereogram mobile application into an engineering drawing course to establish how it influences learning outcomes among students with different spatial abilities. The quantitative experimental study involved two mechanical engineering classes in northern Taiwan, N = 69 first-year vocational high schoolers. Statistical analysis revealed that the experimental group with high spatial ability recorded better results and excellent drawing skills. Bloom�s taxonomy categorization reported that spatial ability influenced �understanding� and �applying� levels, with the strongest effect on �understanding.� Although no significant interaction existed, learning outcomes were highly affected by spatial ability in �understanding� and �applying� levels and AR in the overall performance. The findings and discussions show AR holds great potential to enhance students� spatial ability for real-time visualization and enables better concept comprehension by improving their understanding of engineering topics. Future studies should consider these implications in creating effective and immersive learning environments for different courses in engineering education