Dan, Lilly

Erolin, Caroline

Maniam, Pavithran

Mountain, Rodney

Portelli, Rony

Schnell, Philipp

Wilkinson, Tracey

English

Mixed reality (MR), a technology which supplements the real world with virtual objects, is increasingly becoming available as a teaching tool in medical education. The Microsoft HoloLens device allows operators to experience MR using a head-mounted device without interfering with their physical reality, stimulating a realistic learning experience using virtual objects. This project aimed to develop a MR anatomy teaching application with HoloLens for exploring the anatomy of the temporal bone. The educational application was developed from a multidisciplinary collaboration between undergraduate and postgraduate students across several academic disciplines with Medtronic, a medical technology company. 3D anatomical models were built using ZBrush and Blender, while the HoloLens1 application was developed using Windows 10, Visual Studio 2017, Unity and Mixed Reality Toolkit (MRTK). Modules developed within the application included a basic HoloLens tutorial, a virtual temporal bone with surgical anatomy landmarks and free drilling of the temporal bone. The basic tutorial allows the operator to adapt to the MR environment prior to exploring the anatomical landmarks of the 3D temporal bone. The free drilling of the temporal bone using vertex displacement and texture stretching replicates a real-time bone drilling experience and allows the operator to explore the anatomical relationship between different otological structures.</p

University of Birmingham Research Portal

Exploration of temporal bone anatomy using mixed reality (HoloLens):development of a mixed reality anatomy teaching resource prototype

University of Dundee Online Publications

                                                                    University of DundeeExploration of temporal bone anatomy using mixed reality (HoloLens)Maniam, Pavithran; Schnell, Philipp; Dan, Lilly; Portelli, Rony; Erolin, Caroline; Mountain,RodneyPublished in:Journal of Visual Communication in MedicineDOI:10.1080/17453054.2019.1671813Publication date:2020Document VersionPeer reviewed versionLink to publication in Discovery Research PortalCitation for published version (APA):Maniam, P., Schnell, P., Dan, L., Portelli, R., Erolin, C., Mountain, R., & Wilkinson, T. (2020). Exploration oftemporal bone anatomy using mixed reality (HoloLens): development of a mixed reality anatomy teachingresource prototype. Journal of Visual Communication in Medicine, 43(1), 17-26.https://doi.org/10.1080/17453054.2019.1671813General rightsCopyright and moral rights for the publications made accessible in Discovery Research Portal are retained by the authors and/or othercopyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated withthese rights. • Users may download and print one copy of any publication from Discovery Research Portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain. • You may freely distribute the URL identifying the publication in the public portal.Take down policyIf you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediatelyand investigate your claim.Download date: 20. Apr. 2021

https://discovery.dundee.ac.uk/ws/files/41376539/Figure_1_Revision.pdf

Exploration of temporal bone anatomy using mixed reality (HoloLens):development of a mixed reality anatomy teaching resource prototype

Abstract

Similar works

Full text

Available Versions

University of Birmingham Research Portal

University of Birmingham Research Portal

University of Dundee Online Publications

University of Dundee Online Publications