Mixed reality in medical simulation: A comprehensive design methodology

In the medical education field, the use of highly sophisticated simulators and extended reality (XR) simulations allow training complex procedures and acquiring new knowledge and attitudes. XR is considered useful for the enhancement of healthcare education; however, several issues need further research. The main aim of this study is to define a comprehensive method to design and optimize every kind of simulator and simulation, integrating all the relevant elements concerning the scenario design and prototype development. A complete framework for the design of any kind of advanced clinical simulation is proposed and it has been applied to realize a mixed reality (MR) prototype for the simulation of the rachicentesis. The purpose of the MR application is to immerse the trainee in a more realistic environment and to put him/her under pressure during the simulation, as in real practice. The application was tested with two different devices: the headset Vox Gear Plus for smartphone and the Microsoft Hololens. Eighteen students of the 6th year of Medicine and Surgery Course were enrolled in the study. Results show the comparison of user experience related to the two different devices and simulation performance using the Hololens

A comprehensive method to design and assess mixed reality simulations

The scientific literature highlights how Mixed Reality (MR) simulations allow obtaining several benefits in healthcare education. Simulation-based training, boosted by MR, offers an exciting and immersive learning experience that helps health professionals to acquire knowledge and skills, without exposing patients to unnecessary risks. High engagement, informational overload, and unfamiliarity with virtual elements could expose students to cognitive overload and acute stress. The implementation of effective simulation design strategies able to preserve the psychological safety of learners and the investigation of the impacts and effects of simulations are two open challenges to be faced. In this context, the present study proposes a method to design a medical simulation and evaluate its effectiveness, with the final aim to achieve the learning outcomes and do not compromise the students' psychological safety. The method has been applied in the design and development of an MR application to simulate the rachicentesis procedure for diagnostic purposes in adults. The MR application has been tested by involving twenty students of the 6th year of Medicine and Surgery of Università Politecnica delle Marche. Multiple measurement techniques such as self-report, physiological indices, and observer ratings of performance, cognitive and emotional states of learners have been implemented to improve the rigour of the study. Also, a user-experience analysis has been accomplished to discriminate between two different devices: Vox Gear Plus® and Microsoft Hololens®. To compare the results with a reference, students performed the simulation also without using the MR application. The use of MR resulted in increased stress measured by physiological parameters without a high increase in perceived workload. It satisfies the objective to enhance the realism of the simulation without generating cognitive overload, which favours productive learning. The user experience (UX) has found greater benefits in involvement, immersion, and realism; however, it has emphasized the technological limitations of devices such as obstruction, loss of depth (Vox Gear Plus), and narrow FOV (Microsoft Hololens)

UX assessment strategy to identify potential stressful conditions for workers

The European Commission defined the new concept of Industry 5.0 meaning a more human-centric, resilient, and sustainable approach for the design of industrial systems and operations. A deep understanding of the work environment and organization is important to start analysing the working conditions and the resulting User eXperience (UX) of the operators. Also, the knowledge about users' needs and ergonomics is fundamental to optimize the workers' wellbeing, working conditions, and industrial results. In this context, the paper presents a strategy to effectively assess the UX of workers to promote human-centric vision of manufacturing sites, enhancing the overall sustainability of the modern factories. A set of non-invasive wearable devices is used to monitor human activities and collect physiological parameters, as well as questionnaires to gather subjective self assessment. This set-up was applied to virtual reality (VR) simulation, replicating heavy duty work sequence tasks that took place in an oil and gas pipes manufacturing site. This approach allowed the identification of possible stressful conditions for the operator, from physical and mental perspectives, which may compromise the performance. This research was funded by the European Community's HORIZON 2020 programme under grant agreement No. 958303 (PENELOPE)

Re-design of the Household Appliance UI to make it an Adaptive System

Everyday life is increasingly rich in man-machine interactions and new challenges in user interface design arise. In particular, it emerges the need of adaptable solutions that learn from the user's behavior to improve their experience. In this context, the paper aims to redesign an existing UI to make it an Adaptive System. The introduction of an adaptive module allows finding the optimal interface features combination based on the user profile and previously interactions. The experimentation results demonstrate the adaptability and versatility of the proposed application by evaluating the user satisfaction and the perceived adaptability with respect to the native application

Multi sensors platform for stress monitoring of workers in smart manufacturing context

In factories of the future, advanced automation systems (e.g., cobots, exoskeletons, cyber physical systems) will reduce the physical effort of workers and compensate their limitations as well as ensure more flexibility, agility, and competitiveness. However, the activities of the operator 4.0 will entail an increased share of complex cognitive tasks. Therefore, monitoring the mental load will be increasingly important to ensure work environments that promote healthy life and wellbeing for all at all ages. For this aim, this paper proposes a framework to analyze heart rate, galvanic skin response and electrooculogram signals in order to extract features able to detect an excessive stress or cognitive load. Two wearable devices are used: Empatica E4 wristband and J!NS MEME electrooculography glasses. The proposed framework has been experimented through a laboratory test focused on LEGO brick-based simulations of manufacturing activities

A virtual design approach to simulate the hob energy performance

Eco-design strategies aim to integrate environmental considerations into product design and development. Several regulations, directives and standards have been issued on this topic during last years. In particular, European Directive (2009/125/EC) establishes the eco-design requirements related to domestic and commercial kitchen appliances (e.g. cookers, hobs, grills). The present paper focuses on the virtual product eco-design of domestic induction heating cookers, which are becoming one of the leading cooking systems due to their advantages, e.g. energy efficiency, rapid heating, cleanliness, and user safety. The adoption of numerical analysis tools for the simulation of cooktops use phase, based on thermodynamic modelling, allows to provide useful information regarding the performance of cooking system at each phase of cooking. The paper provides a progress beyond the state-of-art on thermodynamic models for induction hob simulation considering interaction between the cooktop and the pot in the work environment. The goal of the paper is therefore to propose a methodology able to support designers in evaluating heating performances of induction cooking appliances, early in the design phases, through a virtual and multi-physical product model. Thermodynamic performances are determined by measuring several parameters and reproducing the energy consumption test by the mean of a virtual prototyping tool. Results highlight how the proposed model is adherent with the real tests following a specific standard in this sector with a maximum deviation of 3.2% considering the different cooking pot sizes

UX assessment strategy to identify potential stressful conditions for workers

The European Commission defined the new concept of Industry 5.0 meaning a more human-centric, resilient, and sustainable approach for the design of industrial systems and operations. A deep understanding of the work environment and organization is important to start analysing the working conditions and the resulting User eXperience (UX) of the operators. Also, the knowledge about users’ needs and ergonomics is fundamental to optimize the workers’ wellbeing, working conditions, and industrial results. In this context, the paper presents a strategy to effectively assess the UX of workers to promote human-centric vision of manufacturing sites, enhancing the overall sustainability of the modern factories. A set of non-invasive wearable devices is used to monitor human activities and collect physiological parameters, as well as questionnaires to gather subjective self-assessment. This set-up was applied to virtual reality (VR) simulation, replicating heavy duty work sequence tasks that took place in an oil and gas pipes manufacturing site. This approach allowed the identification of possible stressful conditions for the operator, from physical and mental perspectives, which may compromise the performance. This research was funded by the European Community's HORIZON 2020 programme under grant agreement No. 958303 (PENELOPE)

How to Improve Medical Simulation Training: A New Methodology Based on Ergonomic Evaluation

An adequate medical education is the key driver of healthcare quality improvement. Technological innovations have led to consistent improvement in learning outcomes but the systematic measurement of students performance and cognitive workload need further research. The aim of this paper is to propose an innovative method for the Design and Development of new advanced learning models, to be used in the training of medical students, which includes also the analysis of students performance and cognitive ergonomics. A web-based survey, on team simulation training and technology role, has been administered to 180 medical students. On the basis of this analysis, a list of guidelines for the design of medical education training has been proposed