HAPPY: Hip Arthroscopy Portal Placement Using Augmented Reality

Correct positioning of the endoscope is crucial for successful hip arthroscopy. Only with adequate alignment can the anatomical target area be visualized and the procedure be successfully performed. Conventionally, surgeons rely on anatomical landmarks such as bone structure, and on intraoperative X-ray imaging, to correctly place the surgical trocar and insert the endoscope to gain access to the surgical site. One factor complicating the placement is deformable soft tissue, as it can obscure important anatomical landmarks. In addition, the commonly used endoscopes with an angled camera complicate hand-eye coordination and, thus, navigation to the target area. Adjusting for an incorrectly positioned endoscope prolongs surgery time, requires a further incision and increases the radiation exposure as well as the risk of infection. In this work, we propose an augmented reality system to support endoscope placement during arthroscopy. Our method comprises the augmentation of a tracked endoscope with a virtual augmented frustum to indicate the reachable working volume. This is further combined with an in situ visualization of the patient anatomy to improve perception of the target area. For this purpose, we highlight the anatomy that is visible in the endoscopic camera frustum and use an automatic colorization method to improve spatial perception. Our system was implemented and visualized on a head-mounted display. The results of our user study indicate the benefit of the proposed system compared to baseline positioning without additional support, such as an increased alignment speed, improved positioning error and reduced mental effort. The proposed approach might aid in the positioning of an angled endoscope, and may result in better access to the surgical area, reduced surgery time, less patient trauma, and less X-ray exposure during surgery

PENGEMBANGAN APLIKASI TUR DAN NAVIGASI DENGAN AUGMENTED REALITY BERBASIS LOKASI

Penelitian ini dilatar belakangi oleh masalah yang sering dihadapi ketika mencari tempat di daerah yang tidak familiar, ada beberapa cara yang dapat dilakukan diantaranya menanyakan kepada orang lain atau mencarinya sendiri. Bertanya bukan hanya tidak efektif karena sangat mengandalkan keberadaan orang lain tetapi juga tidak efisien karena orang yang ditanya belum tentu tahu dan mampu menjelaskan dengan baik mengenai lokasi yang ditanyakan. Masalah seperti ini juga dapat dijumpai di kampus-kampus universitas yang luas seperti di Universitas Pendidikan Indonesia (UPI). Augmented Reality (AR) adalah teknologi yang dapat menambahkan objek virtual ke dalam dunia nyata. Salah satu keunggulan AR adalah antarmuka yang intuitif dan menarik, sehingga sangat baik digunakan untuk keperluan navigasi. Maka dari itu, peneliti mencoba mengembangkan aplikasi tur dan navigasi berbasis Augmented Reality (AR) dengan fitur-fitur seperti (1) fitur navigasi, dimana pengguna dapat memilih tujuan tempat yang ingin dituju yang selanjutnya aplikasi akan menampilkan arah yang harus dilalui oleh pengguna untuk mencapai tempat tersebut. (2) Fitur tur, yaitu memberikan pengguna informasi mengenai tempat-tempat disekitar pengguna sesuai dengan lokasi pengguna, dan terakhir adalah fitur galeri yang menampilkan foto-foto dari tempat disekitar pengguna. Aplikasi ini kemudian diuji dengan 4 tingkat pengujian yaitu unit testing, integration testing, system testing dan user acceptance testing. Hasil dari penelitian ini adalah (1) peneliti berhasil membangun aplikasi tur dan navigasi dengan AR berbasis lokasi UPNAV dengan menggunakan sistem tracking gps, accelerometer dan magnetometer, (2) aplikasi UPNAV memiliki nilai usability 80,5 atau “Bagus” setelah diukur dengan System Usability Scale (SUS). Kata Kunci: Augmented Reality, navigation, GPS, location based. ABSTRACT This research is motivated by problems that often occur when looking for a place in an unknown region, there are several ways that can be done by asking other people for directions or look for it yourself. Asking is not only ineffective because it is very dependent on other people it is also inefficient because the person who was asked not necessarily know and able to explain well about the location in question. Such problems can also be found in wide university campuses such as the Universitas Pendidikan Indonesia (UPI). Augmented Reality (AR) is a technology that can attach virtual objects into the real world. One of the advantages of AR is its intuitive and attractive interface, so its good to be used for navigation purposes. Therefore, the author get am idea to try to develop a tour and navigation apps with location based Augmented Reality (AR). With features such as (1) the navigation feature, where the user can select the destination to which the application will display the direction that must be passed by the User in order to reach the place. (2) tour, which gives users information about the places around the user in accordance with the user location, and the last is a gallery feature that displays the photos from the place around the user. The application is then tested with 4 levels of testing ie unit testing, integration testing, system testing and user acceptance testing. The results of this study were (1) the researcher successfully built the tour and navigation application with the location-based AR UPNAV using gps tracking system, accelerometer and magnetometer, (2) UPNAV application has 80.5 or "Good" usability score after measured with System Usability Scale (SUS). Keywoards: Augmented Reality, navigation, GPS, location base

Proof of Concept: Wearable Augmented Reality Video See-Through Display for Neuro-Endoscopy

In mini-invasive surgery and in endoscopic procedures, the surgeon operates without a direct visualization of the patient’s anatomy. In image-guided surgery, solutions based on wearable augmented reality (AR) represent the most promising ones. The authors describe the characteristics that an ideal Head Mounted Display (HMD) must have to guarantee safety and accuracy in AR-guided neurosurgical interventions and design the ideal virtual content for guiding crucial task in neuro endoscopic surgery. The selected sequence of AR content to obtain an effective guidance during surgery is tested in a Microsoft Hololens based app

Augmented Reality in Minimally Invasive Surgery

In the last 15 years Minimally Invasive Surgery, with techniques such as laparoscopy or endoscopy, has become very important and research in this field is increasing since these techniques provide the surgeons with less invasive means of reaching the patient’s internal anatomy and allow for entire procedures to be performed with only minimal trauma to the patient. The advantages of the use of this surgical method are evident for patients because the possible trauma is reduced, postoperative recovery is generally faster and there is less scarring. Despite the improvement in outcomes, indirect access to the operation area causes restricted vision, difficulty in hand-eye coordination, limited mobility handling instruments, two-dimensional imagery with a lack of detailed information and a limited visual field during the whole operation. The use of the emerging Augmented Reality technology shows the way forward by bringing the advantages of direct visualization (which you have in open surgery) back to minimally invasive surgery and increasing the physician's view of his surroundings with information gathered from patient medical images. Augmented Reality can avoid some drawbacks of Minimally Invasive Surgery and can provide opportunities for new medical treatments. After two decades of research into medical Augmented Reality, this technology is now advanced enough to meet the basic requirements for a large number of medical applications and it is feasible that medical AR applications will be accepted by physicians in order to evaluate their use and integration into the clinical workflow. Before seeing the systematic use of these technologies as support for minimally invasive surgery some improvements are still necessary in order to fully satisfy the requirements of operating physicians

Augmented Reality in grocery retailing : strategic value for companies?

The purpose of this dissertation is to shed a light on whether Augmented Reality (AR) can be a source of strategic value for grocery retailing companies. PromoPad, an AR-based device that provides context-sensitive shopping assistant as well as personalized advertising, was chosen to embody the functionalities AR can add to the grocery shopping experience. To understand if PromoPad’s functionalities were valued by customers, an online questionnaire was conducted as a way to collect empirical data. With the results of the questionnaire it was possible to understand the functionalities that were valued the most, and that privacy issues, user-friendly concerns and/or fashion concerns were not an impeditive for customers to use PromoPad. From this, it was concluded that customers value the extra functionalities AR can bring to the shopping experience in grocery retailing. Finally, it was assessed if AR could be used strategically. In this regard, by applying RBV theory, it was concluded that the information PromoPad enables companies to gather was the needed “raw material” to derive valuable, unique, non-substitutable and inimitable customer knowledge, being therefore, a source of company’s sustainable competitive advantage. Hence, the implementation of AR can indeed be strategic if properly integrated with a CRM strategy from which customer knowledge can be derived. This dissertation concludes that the customer knowledge, derived from the information PromoPad collects and the use of CRM, can have a strategic relevance for companies. As so, this means that indeed AR can bring strategic value for grocery retailing companies

On-Line Visualization of Underground Structures using Context Features

International audienceWe introduce an on-line framework for the visualizing of underground structures that improves X-Ray vision and Focus and Context Rendering for Augmented Reality. Our approach does not require an accurate reconstruction of the 3D environment and runs on-line on modern hardwares. For these purposes, we extract characteristic features from video frames and create visual cues to reveal occlusion relationships. To enhance the perception of occluding order, the extracted features are either directly rendered, or used to create hybrid blending masks: we thus ensures that the resulting cues are clearly noticeable

The Challenge of Augmented Reality in Surgery

Imaging has revolutionized surgery over the last 50 years. Diagnostic imaging is a key tool for deciding to perform surgery during disease management; intraoperative imaging is one of the primary drivers for minimally invasive surgery (MIS), and postoperative imaging enables effective follow-up and patient monitoring. However, notably, there is still relatively little interchange of information or imaging modality fusion between these different clinical pathway stages. This book chapter provides a critique of existing augmented reality (AR) methods or application studies described in the literature using relevant examples. The aim is not to provide a comprehensive review, but rather to give an indication of the clinical areas in which AR has been proposed, to begin to explain the lack of clinical systems and to provide some clear guidelines to those intending pursue research in this area

Scene creation and exploration in outdoor augmented reality

This thesis investigates Outdoor Augmented Reality (AR) especially for scene creation and exploration aspects.We decompose a scene into several components: a) Device, b) Target Object(s), c) Task, and discuss their interrelations. Based on those relations we outline use-cases and workflows. The main contribution of this thesis is providing AR oriented workflows for selected professional fields specifically for scene creation and exploration purposes, through case studies as well as analyzing the relations between AR scene components. Our contributions inlude, but not limited to: i) analysis of scene components and factoring inherintly available errors, to create a transitional hybrid tracking scheme for multiple targets, ii) a novel image-based approach that uses building block analogy for modelling and introduces volumetric and temporal labeling for annotations, iii) an evaluation of the state of the art X-Ray visualization methods as well as our proposed multi-view method. AR technology and capabilities tend to change rapidly, however we believe the relation between scene components and the practical advantages their analysis provide are valuable. Moreover, we have chosen case studies as diverse as possible in order to cover a wide range of professional field studies. We believe our research is extendible to a variety of field studies for disciplines including but not limited to: Archaeology, architecture, cultural heritage, tourism, stratigraphy, civil engineering, and urban maintenance