The matrix revisited: A critical assessment of virtual reality technologies for modeling, simulation, and training

A convergence of affordable hardware, current events, and decades of research have advanced virtual reality (VR) from the research lab into the commercial marketplace. Since its inception in the 1960s, and over the next three decades, the technology was portrayed as a rarely used, high-end novelty for special applications. Despite the high cost, applications have expanded into defense, education, manufacturing, and medicine. The promise of VR for entertainment arose in the early 1990\u27s and by 2016 several consumer VR platforms were released. With VR now accessible in the home and the isolationist lifestyle adopted due to the COVID-19 global pandemic, VR is now viewed as a potential tool to enhance remote education. Drawing upon over 17 years of experience across numerous VR applications, this dissertation examines the optimal use of VR technologies in the areas of visualization, simulation, training, education, art, and entertainment. It will be demonstrated that VR is well suited for education and training applications, with modest advantages in simulation. Using this context, the case is made that VR can play a pivotal role in the future of education and training in a globally connected world

The Functional, Ecological, and Evolutionary Morphology of Sea Lampreys (Petromyzon marinus)

Lampreys (Petromyzontiformes) are jawless vertebrates with an evolutionary history lasting at least 360 million years and are often used in comparisons with jawed vertebrates because some of their morphological aspects, such as the segmented trunk musculature with curved myosepta and a non-mineralized skeleton fibrous skeleton, are thought to resemble the condition of early vertebrates before the evolution of jaws. Although earlier authors studied the morphology of the skeleto-muscular system of the trunk of lampreys, their studies are not detailed and complete enough to allow a functional and biomechanical analysis that is needed as a basis for modeling the mechanics of lamprey locomotion and for understanding the causal roles played by the anatomical structures within the trunk. Questions remain, such as what is the architecture of the trunk fibroskeleton, and how does it function with the musculature to bend the trunk? This dissertation studied the functional, ecological and evolutionary morphology of the trunk of Sea Lampreys (Petromyzon marinus) as well as its relevance in understanding the environmental history of landlocked lamprey populations. Functional morphology revealed that the fibroskeleton of the trunk is a self-supporting concatenated system of fibers, which creates a scaffold for the musculature and transmits forces to bend the trunk during swimming. Ecological morphology demonstrated the adaptive advantage of the fibroskeleton’s architecture, which enables the movements that are performed during migration and spawning and gives lampreys the capacity to colonize upstream realms. These results help explain the evolutionary morphology of lampreys, which likely originated in freshwater as algal feeders and evolved into parasites after going through an intermediary scavenging stage. When these insights are applied to the evolution of landlocked Sea Lampreys, it becomes evident that their entry into freshwater lakes occurred as soon as they were able to reach them and that populations likely became established in Lake Ontario, Lake Champlain, and the Finger Lakes thousands of years ago. This insight undermines the current status of landlocked Sea Lampreys as invasive species in these lakes and the case for their eradication. Hence, this dissertation provides a comprehensive and integrative analysis of lamprey biology from their anatomy to environmental policy

A Modular and Open-Source Framework for Virtual Reality Visualisation and Interaction in Bioimaging

Life science today involves computational analysis of a large amount and variety of data, such as volumetric data acquired by state-of-the-art microscopes, or mesh data from analysis of such data or simulations. The advent of new imaging technologies, such as lightsheet microscopy, has resulted in the users being confronted with an ever-growing amount of data, with even terabytes of imaging data created within a day. With the possibility of gentler and more high-performance imaging, the spatiotemporal complexity of the model systems or processes of interest is increasing as well. Visualisation is often the first step in making sense of this data, and a crucial part of building and debugging analysis pipelines. It is therefore important that visualisations can be quickly prototyped, as well as developed or embedded into full applications. In order to better judge spatiotemporal relationships, immersive hardware, such as Virtual or Augmented Reality (VR/AR) headsets and associated controllers are becoming invaluable tools. In this work we present scenery, a modular and extensible visualisation framework for the Java VM that can handle mesh and large volumetric data, containing multiple views, timepoints, and color channels. scenery is free and open-source software, works on all major platforms, and uses the Vulkan or OpenGL rendering APIs. We introduce scenery's main features, and discuss its use with VR/AR hardware and in distributed rendering. In addition to the visualisation framework, we present a series of case studies, where scenery can provide tangible benefit in developmental and systems biology: With Bionic Tracking, we demonstrate a new technique for tracking cells in 4D volumetric datasets via tracking eye gaze in a virtual reality headset, with the potential to speed up manual tracking tasks by an order of magnitude. We further introduce ideas to move towards virtual reality-based laser ablation and perform a user study in order to gain insight into performance, acceptance and issues when performing ablation tasks with virtual reality hardware in fast developing specimen. To tame the amount of data originating from state-of-the-art volumetric microscopes, we present ideas how to render the highly-efficient Adaptive Particle Representation, and finally, we present sciview, an ImageJ2/Fiji plugin making the features of scenery available to a wider audience.:Abstract Foreword and Acknowledgements Overview and Contributions Part 1 - Introduction 1 Fluorescence Microscopy 2 Introduction to Visual Processing 3 A Short Introduction to Cross Reality 4 Eye Tracking and Gaze-based Interaction Part 2 - VR and AR for System Biology 5 scenery — VR/AR for Systems Biology 6 Rendering 7 Input Handling and Integration of External Hardware 8 Distributed Rendering 9 Miscellaneous Subsystems 10 Future Development Directions Part III - Case Studies C A S E S T U D I E S 11 Bionic Tracking: Using Eye Tracking for Cell Tracking 12 Towards Interactive Virtual Reality Laser Ablation 13 Rendering the Adaptive Particle Representation 14 sciview — Integrating scenery into ImageJ2 & Fiji Part IV - Conclusion 15 Conclusions and Outlook Backmatter & Appendices A Questionnaire for VR Ablation User Study B Full Correlations in VR Ablation Questionnaire C Questionnaire for Bionic Tracking User Study List of Tables List of Figures Bibliography Selbstständigkeitserklärun

Art and Medicine: A Collaborative Project Between Virginia Commonwealth University in Qatar and Weill Cornell Medicine in Qatar

Four faculty researchers, two from Virginia Commonwealth University in Qatar, and two from Weill Cornell Medicine in Qatar developed a one semester workshop-based course in Qatar exploring the connections between art and medicine in a contemporary context. Students (6 art / 6 medicine) were enrolled in the course. The course included presentations by clinicians, medical engineers, artists, computing engineers, an art historian, a graphic designer, a painter, and other experts from the fields of art, design, and medicine. To measure the student experience of interdisciplinarity, the faculty researchers employed a mixed methods approach involving psychometric tests and observational ethnography. Data instruments included pre- and post-course semi-structured audio interviews, pre-test / post-test psychometric instruments (Budner Scale and Torrance Tests of Creativity), observational field notes, self-reflective blogging, and videography. This book describes the course and the experience of the students. It also contains images of the interdisciplinary work they created for a culminating class exhibition. Finally, the book provides insight on how different fields in a Middle Eastern context can share critical /analytical thinking tools to refine their own professional practices

NIH-NSF Visualization Research Challenges Report

Engineering and Applied Science

A Quantitative Assessment and Comparison of Conceptual Learning in Online and Classroom-Instructed Anatomy and Physiology

Online and virtual technologies have allowed higher education institutions to expand educational opportunities to a broader range of students. The number of students enrolling in online courses is rapidly accelerating, and therefore performance-based evidence of the effectiveness and equivalence of such courses to enhance student learning is necessary, especially in lab-based science courses – where research is currently lacking. This study compared conceptual learning of online and on-campus students in a two-semester anatomy and physiology course sequence. Two terms of students (N=397) completed standardized pre-test and post-test assessments designed to assess content knowledge and conceptual learning based on change scores before and after the intervention. Descriptive statistics were calculated to provide information on the background and equivalency of the groups with respect to certain learner variables, and a multiple regression model was used to assess the influence of learner variables on the knowledge-based assessment outcomes. The analysis showed that GPA significantly predicted performance on the learning assessment for the online treatment group, and GPA and the number of employment hours significantly predicted performance on the learning assessment for the on-campus control group. An Analysis of Covariance was used to examine the effect of course modality on learning. Both online and on-campus participants significantly improved their performance on the post-test, and there were no significant differences in learning gains between the groups. The results of this study suggest, and support previous research regarding online learning, that both online and on-campus instructional modalities can achieve the same conceptual learning goals in anatomy and physiology. The results of this study can be used to inform the ways in which learning in online anatomy and physiology courses parallels that of its physical on-campus counterpart, and prompt further research in this area. One of the most salient consequences of the present findings is the potential implications for higher education institutions regarding research, support, and transfer of online courses in the natural sciences, and further exploration of the potentials of such courses to attract and retain students