Software-Enhanced Teaching and Visualization Capabilities of an Ultra-High-Resolution Video Wall

This paper presents a modular approach to enhance the capabilities and features of a visualization and teaching room using software. This approach was applied to a room with a large, high resolution (7680$\times$4320 pixels), tiled screen of 13 $\times$ 7.5 feet as its main display, and with a variety of audio and video inputs, connected over a network. Many of the techniques described are possible because of a software-enhanced setup, utilizing existing hardware and a collection of mostly open-source tools, allowing to perform collaborative, high-resolution visualizations as well as broadcasting and recording workshops and lectures. The software approach is flexible and allows one to add functionality without changing the hardware.Comment: PEARC'19: "Practice and Experience in Advanced Research Computing", July 28-August 1, 2019 - Chicago, IL, US

State of the Art of Virtual Reality Simulation Technology and Its Applications in 2005

The School of Mining Engineering at the University of New South Wales (UNSW) has been developing immersive, interactive computer-based training simulators for a number of years with research funding provided by Coal Services (CS), the Australian Coal Association Research Program (ACARP) and the Australian Research Council (ARC). The virtual reality(VR) simulators are being developed to improve the effectiveness of training in the Australian coal mining industry with a view to enhancing health and safety. VR theatres have been established at UNSW and at the Newcastle Mines Rescue Station (NMRS).A range of experienced and inexperienced mining personnel has already had the opportunity to train in them. A capability in immersive, interactive virtual reality training has been established and the reaction to the new technology has been positive and confirmed the benefits to be gained in going to the next stage in developing this capability. Given the significant advances in computer technology that have occurred since this research was initiated at UNSW, it was considered wise to undertake a study of the ‘State of the Art of Virtual Reality Simulation Technology and Its Application in 2005’. This should enable nformed decisions to be made on technologies and techniques that could further enhance the simulators and give insight into how the existing VR capability at UNSW can be placed on a sustainable foundation. This Research Overview summarises the findings of the study. It recommends the continued development and testing of the simulators towards a system that presents the users with hi-fidelity imagery and function that is based on 3D models, developed using real mine plans, safety data and manufacturer’s drawings. The simulators should remain modular in design, such that equipment can be updated and added easily over time. Different mine training scenarios and models based on sound educational principles should be developed with major input from experienced mining industry personnel. The simulations that have been developed, that is, Self-Escape, Rib Stability and Sprains and Strains should also continue to be developed and refined. The study has confirmed that such simulations are a powerful visualisation and training tool for enhancing the understanding of mine safety procedures and operations in the coal mining industry. This Scoping Study was undertaken with funding provided from the JCB Health and Safety Trust administered by Coal Services Pty Limited. The support of the Trust and trustees is gratefully acknowledged. The contributors of information are also gratefully acknowledged

Augmented Reality Ultrasound Guidance in Anesthesiology

Real-time ultrasound has become a mainstay in many image-guided interventions and increasingly popular in several percutaneous procedures in anesthesiology. One of the main constraints of ultrasound-guided needle interventions is identifying and distinguishing the needle tip from needle shaft in the image. Augmented reality (AR) environments have been employed to address challenges surrounding surgical tool visualization, navigation, and positioning in many image-guided interventions. The motivation behind this work was to explore the feasibility and utility of such visualization techniques in anesthesiology to address some of the specific limitations of ultrasound-guided needle interventions. This thesis brings together the goals, guidelines, and best development practices of functional AR ultrasound image guidance (AR-UIG) systems, examines the general structure of such systems suitable for applications in anesthesiology, and provides a series of recommendations for their development. The main components of such systems, including ultrasound calibration and system interface design, as well as applications of AR-UIG systems for quantitative skill assessment, were also examined in this thesis. The effects of ultrasound image reconstruction techniques, as well as phantom material and geometry on ultrasound calibration, were investigated. Ultrasound calibration error was reduced by 10% with synthetic transmit aperture imaging compared with B-mode ultrasound. Phantom properties were shown to have a significant effect on calibration error, which is a variable based on ultrasound beamforming techniques. This finding has the potential to alter how calibration phantoms are designed cognizant of the ultrasound imaging technique. Performance of an AR-UIG guidance system tailored to central line insertions was evaluated in novice and expert user studies. While the system outperformed ultrasound-only guidance with novice users, it did not significantly affect the performance of experienced operators. Although the extensive experience of the users with ultrasound may have affected the results, certain aspects of the AR-UIG system contributed to the lackluster outcomes, which were analyzed via a thorough critique of the design decisions. The application of an AR-UIG system in quantitative skill assessment was investigated, and the first quantitative analysis of needle tip localization error in ultrasound in a simulated central line procedure, performed by experienced operators, is presented. Most participants did not closely follow the needle tip in ultrasound, resulting in 42% unsuccessful needle placements and a 33% complication rate. Compared to successful trials, unsuccessful procedures featured a significantly greater (p=0.04) needle-tip to image-plane distance. Professional experience with ultrasound does not necessarily lead to expert level performance. Along with deliberate practice, quantitative skill assessment may reinforce clinical best practices in ultrasound-guided needle insertions. Based on the development guidelines, an AR-UIG system was developed to address the challenges in ultrasound-guided epidural injections. For improved needle positioning, this system integrated A-mode ultrasound signal obtained from a transducer housed at the tip of the needle. Improved needle navigation was achieved via enhanced visualization of the needle in an AR environment, in which B-mode and A-mode ultrasound data were incorporated. The technical feasibility of the AR-UIG system was evaluated in a preliminary user study. The results suggested that the AR-UIG system has the potential to outperform ultrasound-only guidance

I-Light Symposium 2005 Proceedings

I-Light was made possible by a special appropriation by the State of Indiana. The research described at the I-Light Symposium has been supported by numerous grants from several sources. Any opinions, findings and conclusions, or recommendations expressed in the 2005 I-Light Symposium Proceedings are those of the researchers and authors and do not necessarily reflect the views of the granting agencies.Indiana University Office of the Vice President for Research and Information Technology, Purdue University Office of the Vice President for Information Technology and CI

VGC 2023 - Unveiling the dynamic Earth with digital methods: 5th Virtual Geoscience Conference: Book of Abstracts

Conference proceedings of the 5th Virtual Geoscience Conference, 21-22 September 2023, held in Dresden. The VGC is a multidisciplinary forum for researchers in geoscience, geomatics and related disciplines to share their latest developments and applications.:Short Courses 9 Workshops Stream 1 10 Workshop Stream 2 11 Workshop Stream 3 12 Session 1 – Point Cloud Processing: Workflows, Geometry & Semantics 14 Session 2 – Visualisation, communication & Teaching 27 Session 3 – Applying Machine Learning in Geosciences 36 Session 4 – Digital Outcrop Characterisation & Analysis 49 Session 5 – Airborne & Remote Mapping 58 Session 6 – Recent Developments in Geomorphic Process and Hazard Monitoring 69 Session 7 – Applications in Hydrology & Ecology 82 Poster Contributions 9

Smartphones and consumer electronics for eye examinations and ophthalmology teaching – proof of concepts for five novel and inexpensive optical instruments.

The ability to examine eyes and identify pathology in Ophthalmology is dependent on the availability and capability of optical instrument technologies. For many clinicians, teachers and medical students who cannot access appropriate optical instruments, these users have been blinded to seeing inside eyes. In comparison, the optical technology in iPhones and other smartphones is widely available. Their extraordinary inbuilt cameras and photo processing software makes smartphones an ideal readymade platform to develop new optical instruments to examine eyes. This thesis developed five inexpensive optical instrument prototypes and showed proofs of concepts for an iPhone Direct Ophthalmoscope, Near Infrared Non-Mydriatic iPhone Ophthalmoscope, iPhone Exophthalmometer, Operating Microscope Recording System and a ‘Heads up’ repurposed Slit Lamp. The prototypes were substantially lower in cost when compared with existing devices on the market, offering viable alternative optical instruments in clinical practice. A working prototype of the Near Infrared Non-Mydriatic Ophthalmoscope can be developed in future research, which would eliminate the need for using mydriatic eye drops to dilate pupils before retinal examinations. This research can be used to develop affordable and widely available precision optical instruments based on smartphones for eye examinations in clinics, classrooms and throughout developing countries

NIH-NSF Visualization Research Challenges Report

Engineering and Applied Science