Design and Comparison of Immersive Interactive Learning and Instructional Techniques for 3D Virtual Laboratories

This work presents the design, development, and testing of 3D virtual laboratories for practice, specifically in undergraduate mechanical engineering laboratories. The 3D virtual laboratories, implemented under two virtual environments3DTV and Computer Automated Virtual Environment (CAVE)serve as pre-lab sessions performed before the actual physical laboratory experiment. The current study compares the influence of two instructional methods (conventional lecture-based and inquiry-based) under two virtual environments, and the results are compared with the pre-lab sessions using a traditional paper-based lab manual. Subsequently, the evaluation is done by conducting performance and quantitative assessments from students pre-and post-laboratory performances. The research results demonstrate that students in the virtual modules (3DTV and CAVE) performed significantly better in the actual physical experiment than the students in the control group in terms of the overall experiment familiarity and procedure and the conceptual knowledge associated with the experiment. 2015 by the Massachusetts Institute of Technology

A Utility Framework for Selecting Immersive Interactive Capability and Technology for Virtual Laboratories

There has been an increase in the use of virtual reality (VR) technology in the education community since VR is emerging as a potent educational tool that offers students with a rich source of educational material and makes learning exciting and interactive. With a rise of popularity and market expansion in VR technology in the past few years, a variety of consumer VR electronics have boosted educators and researchers’ interest in using these devices for practicing engineering and science laboratory experiments. However, little is known about how such devices may be well-suited for active learning in a laboratory environment. This research aims to address this gap by formulating a utility framework to help educators and decision-makers efficiently select a type of VR device that matches with their design and capability requirements for their virtual laboratory blueprint. Furthermore, a framework use case is demonstrated by not only surveying five types of VR devices ranging from low-immersive to full-immersive along with their capabilities (i.e., hardware specifications, cost, and availability) but also considering the interaction techniques in each VR device based on the desired laboratory task. To validate the framework, a research study is carried out to compare these five VR devices and investigate which device can provide an overall best-fit for a 3D virtual laboratory content that we implemented based on the interaction level, usability and performance effectiveness

Effects of Desktop Virtual Reality on Learner Performance and Confidence in Environment Mastery: Opening a Line of Inquiry

Virtual reality (VR) has demonstrated effectiveness as an instructional technology in many technical fields. However, VR research has generally lacked a sound theory base to provide explanatory or predictive strength. Further, research into the effectiveness of new desktop technologies that place VR within the reach of schools and teachers is currently embryonic. The study reported here is a pilot and is highly exploratory. It is a first step in developing a theory-based line of inquiry into desktop VR as an instructional technology with potential for Career and Technical Education. Grounded in several theory and research strands, this study compared the effects of presenting a complex scene via desktop VR and a set of still photographic images. The two treatments were given to groups drawn from the general population with equal representation by both genders and two age groups. Two performance measures and a confidence measure were analyzed using 2-way ANOVAs. Statistically significant main effects for treatment were found for all three measures, all in favor of the VR treatment. These findings were consistent with predictions based on the study’s theory base. Several main effects for age and gender, and trends for interactions of age and gender with treatment, were also identified that may provide impetus for further research

The Immersive Education Laboratory: understanding affordances, structuring experiences, and creating constructivist, collaborative processes, in mixed-reality smart environments

In this paper we describe how the iClassroom and other technologies are providing the testbed through which we are able to design, develop, and research future intelligent environments. We describe the process of distinguishing between the technical and pedagogical aspects of immersive learning environments, while simultaneously considering both in the redefinition of effective intelligent learning spaces. This paper describes how our laboratory is working on specific projects that increase our understanding of the distinct advantages of technical design elements, like immersive visual displays, and pedagogical design elements that need to be in place as we go through the process of structuring learning situations that create constructivist, collaborative experiences. We describe specific technologies and their design across these multiple dimensions and the ways in which they are helping us better understand how to maximize technological affordances for increased positive learning outcomes. Finally, through this design research process, as we begin to better understand the affordances and iteratively create design guidelines, our hope is that eventually a prescriptive framework emerges that informs both the practice of embedded technology development and the deliberate incorporation of technical attributes into both the educational space and the pedagogy through which students learn

Framework to Enhance Teaching and Learning in System Analysis and Unified Modelling Language

Cowling, MA ORCiD: 0000-0003-1444-1563; Munoz Carpio, JC ORCiD: 0000-0003-0251-5510Systems Analysis modelling is considered foundational for Information and Communication Technology (ICT) students, with introductory and advanced units included in nearly all ICT and computer science degrees. Yet despite this, novice systems analysts (learners) find modelling and systems thinking quite difficult to learn and master. This makes the process of teaching the fundamentals frustrating and time intensive. This paper will discuss the foundational problems that learners face when learning Systems Analysis modelling. Through a systematic literature review, a framework will be proposed based on the key problems that novice learners experience. In this proposed framework, a sequence of activities has been developed to facilitate understanding of the requirements, solutions and incremental modelling. An example is provided illustrating how the framework could be used to incorporate visualization and gaming elements into a Systems Analysis classroom; therefore, improving motivation and learning. Through this work, a greater understanding of the approach to teaching modelling within the computer science classroom will be provided, as well as a framework to guide future teaching activities

Effectiveness of Distance Learning Computer Numerical Control Based on Virtual Laboratory Using a Metaverse Platform to Improve Students’ Cognitive Ability and Practice Skills

This study analyzes the effectiveness of virtual laboratory-based distance learning as a means of improving the learning outcomes of students’ cognitive abilities and practical skills in the Computer Numerical Control course. This study utilized a pre-experimental design with a onegroup pretest-posttest structure. The research subjects were 31 second-year vocational students from the Department of Mechanical Engineering at Universitas Negeri Padang who had recently participated in four distance learning sessions. The research instruments included a pre-test, a post-test, and a student perception survey to assess the effectiveness of virtual laboratory treatment. The findings of this study demonstrate that the presence of a virtual laboratory enhances learning outcomes in terms of cognitive abilities. The pre-test value for cognitive abilities was 52.04, which increased to 82.36 in the post-test. Similarly, the pre-test value for practical skills was 56.98, which improved to 83.44 in the post-test. These improvements significantly contribute to the enhancement of learning outcomes, as indicated by an average N-gain value of 0.642 in the medium/effective category. We conclude that the use of virtual laboratory media through the Metaverse platform is effective for distance learning. This method reduces the initial requirement of 24 hours of face-to-face learning to just five hours of more effective self-study

The usability attributes and evaluation measurements of mobile media AR (augmented reality)

This research aims to develop a tool for creating user-based design interfaces in mobile augmented reality (MAR) education. To develop a design interface evaluation tool, previous literature was examined for key design elements in the educational usage of MAR. The evaluation criteria identified were presence, affordance, and usability. The research used a focus group interview with 7 AR experts to develop a basic usability evaluation checklist, which was submitted to factor analysis for reliability by 122 experts in practice and academia. Based on this checklist, a MAR usability design interface test was conducted with seven fourth-grade elementary students. Then, it conducted follow-up structured interviews and questionnaires. This resulted in 29 questions being developed for the MAR interface design checklist.ope

Holistic Approach for Authoring Immersive and Smart Environments for the Integration in Engineering Education

Die vierte industrielle Revolution und der rasante technologische Fortschritt stellen die etablierten Bildungsstrukturen und traditionellen Bildungspraktiken in Frage. Besonders in der Ingenieurausbildung erfordert das lebenslange Lernen, dass man sein Wissen und seine Fähigkeiten ständig verbessern muss, um auf dem Arbeitsmarkt wettbewerbsfähig zu sein. Es besteht die Notwendigkeit eines Paradigmenwechsels in der Bildung und Ausbildung hin zu neuen Technologien wie virtueller Realität und künstlicher Intelligenz. Die Einbeziehung dieser Technologien in ein Bildungsprogramm ist jedoch nicht so einfach wie die Investition in neue Geräte oder Software. Es müssen neue Bildungsprogramme geschaffen oder alte von Grund auf umgestaltet werden. Dabei handelt es sich um komplexe und umfangreiche Prozesse, die Entscheidungsfindung, Design und Entwicklung umfassen. Diese sind mit erheblichen Herausforderungen verbunden, die die Überwindung vieler Hindernisse erfordert. Diese Arbeit stellt eine Methodologie vor, die sich mit den Herausforderungen der Nutzung von Virtueller Realität und Künstlicher Intelligenz als Schlüsseltechnologien in der Ingenieurausbildung befasst. Die Methodologie hat zum Ziel, die Hauptakteure anzuleiten, um den Lernprozess zu verbessern, sowie neuartige und effiziente Lernerfahrungen zu ermöglichen. Da jedes Bildungsprogramm einzigartig ist, folgt die Methodik einem ganzheitlichen Ansatz, um die Erstellung maßgeschneiderter Kurse oder Ausbildungen zu unterstützen. Zu diesem Zweck werden die Wechselwirkung zwischen verschiedenen Aspekten berücksichtigt. Diese werden in den drei Ebenen - Bildung, Technologie und Management zusammengefasst. Die Methodik betont den Einfluss der Technologien auf die Unterrichtsgestaltung und die Managementprozesse. Sie liefert Methoden zur Entscheidungsfindung auf der Grundlage einer umfassenden pädagogischen, technologischen und wirtschaftlichen Analyse. Darüber hinaus unterstützt sie den Prozess der didaktischen Gestaltung durch eine umfassende Kategorisierung der Vor- und Nachteile immersiver Lernumgebungen und zeigt auf, welche ihrer Eigenschaften den Lernprozess verbessern können. Ein besonderer Schwerpunkt liegt auf der systematischen Gestaltung immersiver Systeme und der effizienten Erstellung immersiver Anwendungen unter Verwendung von Methoden aus dem Bereich der künstlichen Intelligenz. Es werden vier Anwendungsfälle mit verschiedenen Ausbildungsprogrammen vorgestellt, um die Methodik zu validieren. Jedes Bildungsprogramm hat seine eigenen Ziele und in Kombination decken sie die Validierung aller Ebenen der Methodik ab. Die Methodik wurde iterativ mit jedem Validierungsprojekt weiterentwickelt und verbessert. Die Ergebnisse zeigen, dass die Methodik zuverlässig und auf viele Szenarien sowie auf die meisten Bildungsstufen und Bereiche übertragbar ist. Durch die Anwendung der in dieser Arbeit vorgestellten Methoden können Interessengruppen immersiven Technologien effektiv und effizient in ihre Unterrichtspraxis integrieren. Darüber hinaus können sie auf der Grundlage der vorgeschlagenen Ansätze Aufwand, Zeit und Kosten für die Planung, Entwicklung und Wartung der immersiven Systeme sparen. Die Technologie verlagert die Rolle des Lehrenden in eine Moderatorrolle. Außerdem bekommen die Lehrkräfte die Möglichkeit die Lernenden individuell zu unterstützen und sich auf deren kognitive Fähigkeiten höherer Ordnung zu konzentrieren. Als Hauptergebnis erhalten die Lernenden eine angemessene, qualitativ hochwertige und zeitgemäße Ausbildung, die sie qualifizierter, erfolgreicher und zufriedener macht

Investigating Real-time Touchless Hand Interaction and Machine Learning Agents in Immersive Learning Environments

The recent surge in the adoption of new technologies and innovations in connectivity, interaction technology, and artificial realities can fundamentally change the digital world. eXtended Reality (XR), with its potential to bridge the virtual and real environments, creates new possibilities to develop more engaging and productive learning experiences. Evidence is emerging that thissophisticated technology offers new ways to improve the learning process for better student interaction and engagement. Recently, immersive technology has garnered much attention as an interactive technology that facilitates direct interaction with virtual objects in the real world. Furthermore, these virtual objects can be surrogates for real-world teaching resources, allowing for virtual labs. Thus XR could enable learning experiences that would not bepossible in impoverished educational systems worldwide. Interestingly, concepts such as virtual hand interaction and techniques such as machine learning are still not widely investigated in immersive learning. Hand interaction technologies in virtual environments can support the kinesthetic learning pedagogical approach, and the need for its touchless interaction nature hasincreased exceptionally in the post-COVID world. By implementing and evaluating real-time hand interaction technology for kinesthetic learning and machine learning agents for self-guided learning, this research has addressed these underutilized technologies to demonstrate the efficiency of immersive learning. This thesis has explored different hand-tracking APIs and devices to integrate real-time hand interaction techniques. These hand interaction techniques and integrated machine learning agents using reinforcement learning are evaluated with different display devices to test compatibility. The proposed approach aims to provide self-guided, more productive, and interactive learning experiences. Further, this research has investigated ethics, privacy, and security issues in XR and covered the future of immersive learning in the Metaverse.<br/