Developing a virtual reality environment for petrous bone surgery: a state-of-the-art review

The increasing power of computers has led to the development of sophisticated systems that aim to immerse the user in a virtual environment. The benefits of this type of approach to the training of physicians and surgeons are immediately apparent. Unfortunately the implementation of “virtual reality” (VR) surgical simulators has been restricted by both cost and technical limitations. The few successful systems use standardized scenarios, often derived from typical clinical data, to allow the rehearsal of procedures. In reality we would choose a system that allows us not only to practice typical cases but also to enter our own patient data and use it to define the virtual environment. In effect we want to re-write the scenario every time we use the environment and to ensure that its behavior exactly duplicates the behavior of the real tissue. If this can be achieved then VR systems can be used not only to train surgeons but also to rehearse individual procedures where variations in anatomy or pathology present specific surgical problems. The European Union has recently funded a multinational 3-year project (IERAPSI, Integrated Environment for Rehearsal and Planning of Surgical Interventions) to produce a virtual reality system for surgical training and for rehearsing individual procedures. Building the IERAPSI system will bring together a wide range of experts and combine the latest technologies to produce a true, patient specific virtual reality surgical simulator for petrous/temporal bone procedures. This article presents a review of the “state of the art” technologies currently available to construct a system of this type and an overview of the functionality and specifications such a system requires

A Review of Virtual Reality Based Training Simulators for Orthopaedic Surgery

This review presents current virtual reality based training simulators for hip, knee and other orthopaedic surgery, including elective and trauma surgical procedures. There have not been any reviews focussing on hip and knee orthopaedic simulators. A comparison of existing simulator features is provided to identify what is missing and what is required to improve upon current simulators. In total 11 total hip replacement pre-operative planning tools were analysed, plus 9 hip trauma fracture training simulators. Additionally 9 knee arthroscopy simulators and 8 other orthopaedic simulators were included for comparison. The findings are that for orthopaedic surgery simulators in general, there is increasing use of patient-specific virtual models which reduce the learning curve. Modelling is also being used for patient-specific implant design and manufacture. Simulators are being increasingly validated for assessment as well as training. There are very few training simulators available for hip replacement, yet more advanced virtual reality is being used for other procedures such as hip trauma and drilling. Training simulators for hip replacement and orthopaedic surgery in general lag behind other surgical procedures for which virtual reality has become more common. Further developments are required to bring hip replacement training simulation up to date with other procedures. This suggests there is a gap in the market for a new high fidelity hip replacement and resurfacing training simulator

The application of virtual reality and augmented reality in oral & maxillofacial surgery

Background: Virtual reality is the science of creating a virtual environment for the assessment of various anatomical regions of the body for the diagnosis, planning and surgical training. Augmented reality is the superimposition of a 3D real environment specific to individual patient onto the surgical filed using semi-transparent glasses to augment the virtual scene.. The aim of this study is to provide an over view of the literature on the application of virtual and augmented reality in oral & maxillofacial surgery. Methods: We reviewed the literature and the existing database using Ovid MEDLINE search, Cochran Library and PubMed. All the studies in the English literature in the last 10 years, from 2009 to 2019 were included. Results: We identified 101 articles related the broad application of virtual reality in oral & maxillofacial surgery. These included the following: Eight systematic reviews, 4 expert reviews, 9 case reports, 5 retrospective surveys, 2 historical perspectives, 13 manuscripts on virtual education and training, 5 on haptic technology, 4 on augmented reality, 10 on image fusion, 41 articles on the prediction planning for orthognathic surgery and maxillofacial reconstruction. Dental implantology and orthognathic surgery are the most frequent applications of virtual reality and augmented reality. Virtual planning improved the accuracy of inserting dental implants using either a statistic guidance or dynamic navigation. In orthognathic surgery, prediction planning and intraoperative navigation are the main applications of virtual reality. Virtual reality has been utilised to improve the delivery of education and the quality of training in oral & maxillofacial surgery by creating a virtual environment of the surgical procedure. Haptic feedback provided an additional immersive reality to improve manual dexterity and improve clinical training. Conclusion: Virtual and augmented reality have contributed to the planning of maxillofacial procedures and surgery training. Few articles highlighted the importance of this technology in improving the quality of patients’ care. There are limited prospective randomized studies comparing the impact of virtual reality with the standard methods in delivering oral surgery education

Application of virtual reality, augmented reality, and mixed reality in endourology and urolithiasis: An update by YAU endourology and Urolithiasis Working Group

The integration of virtual reality (VR), augmented reality (AR), and mixed reality (MR) in urological practices and medical education has led to modern training systems that are cost-effective and with an increased expectation toward surgical performance and outcomes. VR aids the user in interacting with the virtual environment realistically by providing a three-dimensional (3D) view of the structures inside the body with high-level precision. AR enhances the real environment around users by integrating experience with virtual information over physical models and objects, which in turn has improved understanding of physiological mechanisms and anatomical structures. MR is an immersive technology that provides virtual content to interact with real elements. The field of urolithiasis has adapted the technological advancements, newer instruments, and methods to perform endourologic treatment procedures. This mini-review discusses the applications of Virtual Reality, Augmented Reality, and Mixed Reality in endourology and urolithiasis.publishedVersio

Study of gender differences in VR response following cardiac surgery

Cardiac and other invasive surgical procedures cause significant anxiety and stress to patients and their family members. In this study Virtual Reality (VR) was used as a method to reduce stress, anxiety and pain in patients undergoing surgical procedures. This study compared a cohort of patients in the interval prior to and successive to the surgery, differentiating the responses achieved by males and females and comparing the effectiveness. The results are encouraging: they demonstrate the efficacy of VR treatment and the safety of the method and detection of differences in the responses based on gender

A review of virtual reality based training simulators for orthopaedic surgery

This is the author accepted manuscript. The final version is available from Elsevier via the DOI in this recordThis review presents current virtual reality based training simulators for hip, knee and other orthopaedic surgery, including elective and trauma surgical procedures. There have not been any reviews focussing on hip and knee orthopaedic simulators. A comparison of existing simulator features is provided to identify what is missing and what is required to improve upon current simulators. In total 11 hip replacements pre-operative planning tools were analysed, plus 9 hip trauma fracture training simulators. Additionally 9 knee arthroscopy simulators and 8 other orthopaedic simulators were included for comparison. The findings are that for orthopaedic surgery simulators in general, there is increasing use of patient-specific virtual models which reduce the learning curve. Modelling is also being used for patient-specific implant design and manufacture. Simulators are being increasingly validated for assessment as well as training. There are very few training simulators available for hip replacement, yet more advanced virtual reality is being used for other procedures such as hip trauma and drilling. Training simulators for hip replacement and orthopaedic surgery in general lag behind other surgical procedures for which virtual reality has become more common. Further developments are required to bring hip replacement training simulation up to date with other procedures. This suggests there is a gap in the market for a new high fidelity hip replacement and resurfacing training simulator.Wessex Academic Health Science Network (Wessex AHSN) Innovation and Wealth Creation Accelerator Fund 2014/15Bournemouth Universit

Development of a Virtual Laparoscopic Trainer using Accelerometer Augmented Tools to Assess Performance in Surgical training

Previous research suggests that virtual reality (VR) may supplement conventional training in laparoscopy. It may prove useful in the selection of surgical trainees in terms of their dexterity and spatial awareness skills in the near future. Current VR training solutions provide levels of realism and in some instances, haptic feedback, but they are cumbersome by being tethered and not ergonomically close to the actual surgical instruments for weight and freedom of use factors. In addition, they are expensive hence making them less accessible to departments than conventional box trainers. The box trainers in comparison, although more economical, lack tangible feedback and realism for handling delicate tissue structures. We have previously reported on the development of a modified digitally enhanced surgical instrument for laparoscopic training, named the Parkar Tool. This tool contains wireless accelerometer and gyroscopic sensors integrated into actual laparoscopic instruments. By design, it alleviates the need for both tethered and physically different shaped tools thereby enhancing the realism when performing surgical procedures. Additionally the software (Valhalla) has the ability to digitally record surgical motions, thereby enabling it to remotely capture surgical training data to analyse and objectively evaluate performance. We have adapted and further developed our initial single training tool method as used with a laparoscopic pyloromyotomy scenario, to an enhanced method using multiple Parkar wireless tools simultaneously, for use in several different case scenarios. This allows the use and measurement of right and left handed dexterity with the benefit of using several tasks of differing complexity. The development of a 3D tissue-surface deformations solution written in OpenGL gives us several different virtual surgical training scenario approximations to use with the instruments. The trainee can start with learning simple tasks e.g. incising tissue, grasping, squeezing and stretching tissue, to more complex procedures such as suturing, herniotomies, bowel anastomoses, as well as the original pyloromyotomy as used in the first model

Augmented Reality Visualization for Image-Guided Surgery:A Validation Study Using a Three-Dimensional Printed Phantom

Background Oral and maxillofacial surgery currently relies on virtual surgery planning based on image data (CT, MM). Three-dimensional (3D) visualizations are typically used to plan and predict the outcome of complex surgical procedures. To translate the virtual surgical plan to the operating room, it is either converted into physical 3D-printed guides or directly translated using real-time navigation systems. Purpose This study aims to improve the translation of the virtual surgery plan to a surgical procedure, such as oncologic or trauma surgery, in terms of accuracy and speed. Here we report an augmented reality visualization technique for image-guided surgery. It describes how surgeons can visualize and interact with the virtual surgery plan and navigation data while in the operating room. The user friendliness and usability is objectified by a formal user study that compared our augmented reality assisted technique to the gold standard setup of a perioperative navigation system (Brainlab). Moreover, accuracy of typical navigation tasks as reaching landmarks and following trajectories is compared. Results Overall completion time of navigation tasks was 1.71 times faster using augmented reality (P = .034). Accuracy improved significantly using augmented reality (P < .001), for reaching physical landmarks a less strong correlation was found (P = .087). Although the participants were relatively unfamiliar with VR/AR (rated 2.25/5) and gesture-based interaction (rated 2/5), they reported that navigation tasks become easier to perform using augmented reality (difficulty Brainlab rated 3.25/5, HoloLens 2.4/5). Conclusion The proposed workflow can be used in a wide range of image-guided surgery procedures as an addition to existing verified image guidance systems. Results of this user study imply that our technique enables typical navigation tasks to be performed faster and more accurately compared to the current gold standard. In addition, qualitative feedback on our augmented reality assisted technique was more positive compared to the standard setup. (C) 2021 The Author. Published by Elsevier Inc. on behalf of The American Association of Oral and Maxillofacial Surgeons

Integration of multimedia technology into the curriculum of forensic science courses using crime scene investigations.

Virtual reality technology is a powerful tool for the development of experimental learning in practical situations. Creation of software packages with some element of virtual learning allows educators to broaden the available experience of students beyond the scope that a standard curriculum provides. This teaching methodology is widely used in the delivery of medical education with many surgical techniques being practised via virtual reality technologies (see Engum et al., 2003). Use has been made of this technology for a wide range of teaching applications such as virtual field trials for an environmental science course (Ramasundaram et al., 2005), and community nursing visiting education scenarios (Nelson et al., 2005) for example. Nelson et al. (2005) imaged three-dimensional representations of patient living accommodation incorporating views of patient medication in order to deliver care modules via a problem-based learning approach. The use of virtual reality in the teaching of crime scene science was pioneered by the National Institute of Forensic Science in Australia as part of their Science Proficiency Advisory Committee testing programme. A number of scenarios were created using CDROM interfacing, allowing as near as possible normal procedures to be adopted. This package included proficiency testing integrated into the package and serves as a paradigm for the creation of virtual reality crime scene scenarios (Horswell, 2000). The package is commercially available on CD-ROM as part of the series ‘After the Fact’ (http://www.nfis.com.au). The CD-ROM package is geared to proficiency training of serving scenes of crime officers and thus contains details that may not be needed in the education of other parties with a need for forensic awareness. These include undergraduate students studying towards forensic science degree programmes in the UK as well as serving Police Officers. These groups may need virtual reality crime scene material geared to their specific knowledge requirements. In addition, Prof J Fraser, President of the Forensic Science Society and a former police Scientific Support Manager, speaking to the United Kingdom, House of Commons Science and Technology Select Committee in its report ‘Forensic Science on Trial’ (2005) states: ‘The documented evidence in relation to police knowledge of forensic science, in terms of making the best use of forensic science, is consistently clear, that their knowledge needs to improve and therefore their training needs to improve’. This clearly identifies a need for further training of serving police officers in forensic science. It was with this in mind that staff at the University collaborated with the West Midlands Police Service. The aim was to create a virtual reality CD-ROM that could serve as part of the continuing professional development of serving police officers in the area of scene management. Adaptation of the CD-ROM could allow some introductory materials to help undergraduate students of forensic science

The application of virtual reality simulators in laparoscopic surgery training (a review)

Introduction: The last decade saw a significant introduction of minimally invasive surgery into medical practice. Laparoscopy has even become the gold standard for some interventions. This has led to an increased demand for qualified specialists. The acquisition of laparoscopic surgery skills entrains a time investment both on part of the trainee and the instructor. The need for an accelerated development of specific psycho-motor perceptions which are a requirement for the execution of laparoscopic procedures, led to the establishment of virtual reality simulator training. For the first time in Bulgaria, in 2016, the Medical University of Varna introduced formal education via the way of virtual reality laparoscopic simulators. They permit the development of laparoscopic skills even at the level of a medical student.Aim: The aim of the article is to analyze the efficiency of existing virtual reality simulators and their application in laparoscopic surgery training.Materials and Methods:  А systematic literature analysis was performed via the databases PubMed, Web of Science, Scopus and Google Scholar using various combinations of the following keywords: “simulation”, “virtual*”, “VR”, “laparoscopic*”, “surgery”, “education”, “LapMentor”, “LapSim”, for articles published in the past 10 years. The keywords were in combination with Boolean operators “and”, “or”. After a thorough review of all pertinent articles the most relevant publications were selected.Results: The electronic inquiry yielded 106 articles in total. After the application of suitable inclusion and exclusion criteria, 98 of them were deemed unfit, leaving 8 randomized control trials. To meet the inclusion criteria, the publications needed to be systemized random prospective studies regarding virtual reality simulators in laparoscopic surgery.Conclusion: Advancements in the field of surgery follow closely the introduction of new technologies. This leads to the need for a change of traditional surgery training practices. The need of laparoscopic surgery specialists becomes greater with every passing year. The new generation of virtual reality simulators provides a complete set of basic skill procedures and complete operative procedures. Due to their limitless repeatability, an expert level of proficiency is able to be reached in a relatively short period of time. The surgical community must take note of the practices that have already been adopted by aviation training and introduce mandatory laparoscopic surgery training programs, which all specialists must undergo before undertaking procedures in the operating theater.