Recent Advancements in Augmented Reality for Robotic Applications: A Survey

Robots are expanding from industrial applications to daily life, in areas such as medical robotics, rehabilitative robotics, social robotics, and mobile/aerial robotics systems. In recent years, augmented reality (AR) has been integrated into many robotic applications, including medical, industrial, human–robot interactions, and collaboration scenarios. In this work, AR for both medical and industrial robot applications is reviewed and summarized. For medical robot applications, we investigated the integration of AR in (1) preoperative and surgical task planning; (2) image-guided robotic surgery; (3) surgical training and simulation; and (4) telesurgery. AR for industrial scenarios is reviewed in (1) human–robot interactions and collaborations; (2) path planning and task allocation; (3) training and simulation; and (4) teleoperation control/assistance. In addition, the limitations and challenges are discussed. Overall, this article serves as a valuable resource for working in the field of AR and robotic research, offering insights into the recent state of the art and prospects for improvement

An aesthetics of touch: investigating the language of design relating to form

How well can designers communicate qualities of touch? This paper presents evidence that they have some capability to do so, much of which appears to have been learned, but at present make limited use of such language. Interviews with graduate designer-makers suggest that they are aware of and value the importance of touch and materiality in their work, but lack a vocabulary to fully relate to their detailed explanations of other aspects such as their intent or selection of materials. We believe that more attention should be paid to the verbal dialogue that happens in the design process, particularly as other researchers show that even making-based learning also has a strong verbal element to it. However, verbal language alone does not appear to be adequate for a comprehensive language of touch. Graduate designers-makers’ descriptive practices combined non-verbal manipulation within verbal accounts. We thus argue that haptic vocabularies do not simply describe material qualities, but rather are situated competences that physically demonstrate the presence of haptic qualities. Such competencies are more important than groups of verbal vocabularies in isolation. Design support for developing and extending haptic competences must take this wide range of considerations into account to comprehensively improve designers’ capabilities

Improving mechanical and neuromuscular deficits following anterior cruciate ligament reconstruction

Despite consistent resolution of knee laxity and return to physical activity following ACL reconstruction, a growing body of evidence implicates impaired weight acceptance strategies as frequent primary drivers in a host of poor long-term outcomes. Most egregiously, the majority of the people with ACL reconstruction will show radiographic evidence of knee osteoarthritis within 15 years of surgery. Abnormal compression of the knee joint due to impaired knee flexion during weight acceptance is exacerbated by a tendency toward concomitant co-contraction of the knee musculature. Despite a plethora of proposed training paradigms, performance deficits after ACL reconstruction prove particularly resistant to enduring change. The studies included in this dissertation examine the mechanical and neuromuscular impairments in weight acceptance during landing from a jump that underlie the limitations to success following ACL reconstruction. A path toward improving functional recovery by treating impairments in landing is suggested and a novel training approach is tested. First, a cross-sectional study examines both the impaired patterns of neuromuscular recruitment in people who have returned to sporting activity following ACL reconstruction and their relationship to mechanics in landing. A pre-test/post-test laboratory study further examines the relationship between imposed changes in landing mechanics and co-contraction between the hamstrings and the quadriceps musculature. Clarification of neuromuscular activation and coordination impairments allows development of specific treatment techniques. To address limitations in current practice, a new device, the Bodyweight Reduction Instrument to Deliver Graded Exercise (BRIDGE), is validated in a third study, in which the effects of body weight support on the mechanics of repetitive single leg hopping are tested. The use of the BRIDGE is then described in a clinical case study. Finally, a randomized clinical trial determines whether high volume jump training with reduced loading intensity via body weight support will preferentially enhance motor learning for improved coordination of the neuromuscular system during high demand tasks such as single leg landing. This dissertation thereby advances the science of rehabilitation to more effectively target mechanical and neuromuscular impairments that devastatingly contribute to the risk of re-injury and early onset osteoarthritis following ACL reconstruction

SOTL in the South

Abstract: Please refer to full text to view abstract

Development and Validation of a Hybrid Virtual/Physical Nuss Procedure Surgical Trainer

With continuous advancements and adoption of minimally invasive surgery, proficiency with nontrivial surgical skills involved is becoming a greater concern. Consequently, the use of surgical simulation has been increasingly embraced by many for training and skill transfer purposes. Some systems utilize haptic feedback within a high-fidelity anatomically-correct virtual environment whereas others use manikins, synthetic components, or box trainers to mimic primary components of a corresponding procedure. Surgical simulation development for some minimally invasive procedures is still, however, suboptimal or otherwise embryonic. This is true for the Nuss procedure, which is a minimally invasive surgery for correcting pectus excavatum (PE) – a congenital chest wall deformity. This work aims to address this gap by exploring the challenges of developing both a purely virtual and a purely physical simulation platform of the Nuss procedure and their implications in a training context. This work then describes the development of a hybrid mixed-reality system that integrates virtual and physical constituents as well as an augmentation of the haptic interface, to carry out a reproduction of the primary steps of the Nuss procedure and satisfy clinically relevant prerequisites for its training platform. Furthermore, this work carries out a user study to investigate the system’s face, content, and construct validity to establish its faithfulness as a training platform

Cognitive Decay And Memory Recall During Long Duration Spaceflight

This dissertation aims to advance the efficacy of Long-Duration Space Flight (LDSF) pre-flight and in-flight training programs, acknowledging existing knowledge gaps in NASA\u27s methodologies. The research\u27s objective is to optimize the cognitive workload of LDSF crew members, enhance their neurocognitive functionality, and provide more meaningful work experiences, particularly for Mars missions.The study addresses identified shortcomings in current training and learning strategies and simulation-based training systems, focusing on areas requiring quantitative measures for astronaut proficiency and training effectiveness assessment. The project centers on understanding cognitive decay and memory loss under LDSF-related stressors, seeking to establish when such cognitive decline exceeds acceptable performance levels throughout mission phases. The research acknowledges the limitations of creating a near-orbit environment due to resource constraints and the need to develop engaging tasks for test subjects. Nevertheless, it underscores the potential impact on future space mission training and other high-risk professions. The study further explores astronaut training complexities, the challenges encountered in LDSF missions, and the cognitive processes involved in such demanding environments. The research employs various cognitive and memory testing events, integrating neuroimaging techniques to understand cognition\u27s neural mechanisms and memory. It also explores Rasmussen\u27s S-R-K behaviors and Brain Network Theory’s (BNT) potential for measuring forgetting, cognition, and predicting training needs. The multidisciplinary approach of the study reinforces the importance of integrating insights from cognitive psychology, behavior analysis, and brain connectivity research. Research experiments were conducted at the University of North Dakota\u27s Integrated Lunar Mars Analog Habitat (ILMAH), gathering data from selected subjects via cognitive neuroscience tools and Electroencephalography (EEG) recordings to evaluate neurocognitive performance. The data analysis aimed to assess brain network activations during mentally demanding activities and compare EEG power spectra across various frequencies, latencies, and scalp locations. Despite facing certain challenges, including inadequacies of the current adapter boards leading to analysis failure, the study provides crucial lessons for future research endeavors. It highlights the need for swift adaptation, continual process refinement, and innovative solutions, like the redesign of adapter boards for high radio frequency noise environments, for the collection of high-quality EEG data. In conclusion, while the research did not reveal statistically significant differences between the experimental and control groups, it furnished valuable insights and underscored the need to optimize astronaut performance, well-being, and mission success. The study contributes to the ongoing evolution of training methodologies, with implications for future space exploration endeavors

Using Immersive Virtual Reality for Student Learning: A Qualitative Case Study

ABSTRACT The prominence of virtual reality (VR) in the educational field has grown in recent years due to increased availability and lower costs. I conducted a global study regarding how pioneering K-12 teachers use VR to engage students in learning activities. The purpose of this qualitative case study was to identify how and why teachers used VR for student learning. Fifteen educators from five continents participated in the study. They described their initial VR experiences and how these experiences motivated them to pursue ways to implement VR in their disciplinary fields. I used the video conference tool “Zoom” to conduct interviews. Participants described the “spark” of discovery and recognition of VR for learning. They explained measures to obtain permission, approaches to funding, and the implementation process. Participants developed structures for student learning, transformed physical spaces, and invented pedagogies to ensure positive learning experiences. Participants provided optimal immersive experiences by repurposing content and adopting other applications to achieve learning goals. Three levels of incorporating VR for student learning were identified, including: (1) exploration; (2) acquiring and applying disciplinary knowledge; and (3) content creation and interactive problem solving. The quality of headsets dictated the level(s) of implementation. Dewey’s (1923) experiential learning theories as well as the Technology, Pedagogy, and Content Knowledge framework (TPACK; Mishra & Koehler, 2006) helped to interpret data. Successful implementation requires collaboration and pedagogical modifications and administrative support. This study highlights the successful methods and practices for others considering the implementation of VR for K-12 student learning. Keywords: TPACK, Dewey, Virtual Reality (VR), Innovation, Experiential Learnin