Collaborative Augmented Reality

Over the past number of years augmented reality (AR) has become an increasingly pervasive as a consumer level technology. The principal drivers of its recent development has been the evolution of mobile and handheld devices, in conjunction with algorithms and techniques from fields such as 3D computer vision. Various commercial platforms and SDKs are now available that allow developers to quickly develop mobile AR apps requiring minimal understanding of the underlying technology. Much of the focus to date, both in the research and commercial environment, has been on single user AR applications. Just as collaborative mobile applications have a demonstrated role in the increasing popularity of mobile devices, and we believe collaborative AR systems present a compelling use-case for AR technology. The aim of this thesis is the development a mobile collaborative augmented reality framework. We identify the elements required in the design and implementation stages of collaborative AR applications. Our solution enables developers to easily create multi-user mobile AR applications in which the users can cooperatively interact with the real environment in real time. It increases the sense of collaborative spatial interaction without requiring complex infrastructure. Assuming the given low level communication and AR libraries have modular structures, the proposed approach is also modular and flexible enough to adapt to their requirements without requiring any major changes

Collaborative Augmented Reality

Over the past number of years augmented reality (AR) has become an increasingly pervasive as a consumer level technology. The principal drivers of its recent development has been the evolution of mobile and handheld devices, in conjunction with algorithms and techniques from fields such as 3D computer vision. Various commercial platforms and SDKs are now available that allow developers to quickly develop mobile AR apps requiring minimal understanding of the underlying technology. Much of the focus to date, both in the research and commercial environment, has been on single user AR applications. Just as collaborative mobile applications have a demonstrated role in the increasing popularity of mobile devices, and we believe collaborative AR systems present a compelling use-case for AR technology. The aim of this thesis is the development a mobile collaborative augmented reality framework. We identify the elements required in the design and implementation stages of collaborative AR applications. Our solution enables developers to easily create multi-user mobile AR applications in which the users can cooperatively interact with the real environment in real time. It increases the sense of collaborative spatial interaction without requiring complex infrastructure. Assuming the given low level communication and AR libraries have modular structures, the proposed approach is also modular and flexible enough to adapt to their requirements without requiring any major changes

Potential applications for virtual and augmented reality technologies in sensory science

peer-reviewedSensory science has advanced significantly in the past decade and is quickly evolving to become a key tool for predicting food product success in the marketplace. Increasingly, sensory data techniques are moving towards more dynamic aspects of sensory perception, taking account of the various stages of user-product interactions. Recent technological advancements in virtual reality and augmented reality have unlocked the potential for new immersive and interactive systems which could be applied as powerful tools for capturing and deciphering the complexities of human sensory perception. This paper reviews recent advancements in virtual and augmented reality technologies and identifies and explores their potential application within the field of sensory science. The paper also considers the possible benefits for the food industry as well as key challenges posed for widespread adoption. The findings indicate that these technologies have the potential to alter the research landscape in sensory science by facilitating promising innovations in five principal areas: consumption context, biometrics, food structure and texture, sensory marketing and augmenting sensory perception. Although the advent of augmented and virtual reality in sensory science offers new exciting developments, the exploitation of these technologies is in its infancy and future research will understand how they can be fully integrated with food and human responses. Industrial relevance: The need for sensory evaluation within the food industry is becoming increasingly complex as companies continuously compete for consumer product acceptance in today's highly innovative and global food environment. Recent technological developments in virtual and augmented reality offer the food industry new opportunities for generating more reliable insights into consumer sensory perceptions of food and beverages, contributing to the design and development of new products with optimised consumer benefits. These technologies also hold significant potential for improving the predictive validity of newly launched products within the marketplace

A Framework for Mobile Augmented Reality in Urban Maintenance

Mobile handheld devices such as smartphones have become increasingly powerful in modern times. Because of this, there has been a surge in 3D graphics-heavy mobile applications that aim to provide immersive experiences. An example of this phenomenon would be Augmented Reality (AR) applications, which have been increasingly popular and offer a wide array of use-cases. The ability to merge the real world with the virtual world seamlessly using the built-in camera of the smartphone brings a whole new world of possibilities, which makes it interesting to explore how such a technology could be used to solve real-world problems. This dissertation focuses on applying this technology in the field of urban maintenance. To do so, a mobile AR application was developed, designed to be used by urban maintenance workers as a field-assistance tool. Using any standard smartphone camera, the developed system can accurately detect any equipment and augment it with relevant information and step-by-step instructions on how to do any required maintenance jobs. Alongside this mobile application, a desktop application was also developed with the purposes of creating and authoring the data and augmentations that should be displayed during a given job, called Archer. Lastly, this dissertation proposes a novel approach to automatically detect and minimize the amount of points (checkpoints) at which the application will ask the user to perform a new equipment recognition, which are useful in order to maintain tracking stability as the user modifies the real-world object during the course of the job. The experiments and user tests conducted during the final stages of this dissertation demonstrate the accuracy and practicality of the developed systems, proving that they can effectively be used to greatly improve the workflow of urban maintenance workers.Dispositivos móveis tais como os smartphones têm-se tornado cada vez mais poderosos nos tempos modernos. Como tal, tem havido um grande aumento na quantidade de aplicações móveis 3D com o intuito de fornecer experiências imersivas. Um exemplo desse fenómeno são as aplicações de Realidade Aumentada (RA), as quais se têm tornado cada vez mais populares, oferecendo um vasto leque de casos de uso. A habilidade de fundir o mundo real com o mundo virtual através da câmara de um smartphone traz todo um novo mundo de possibilidades, o que torna interessante a exploração de como esta tecnologia pode ser usada para resolver problemas no mundo real. Esta dissertação foca-se na aplicação desta tecnologia na área da manutenção urbana. Nesse sentido, foi desenvolvida uma aplicação móvel de RA projetada para ser usada como uma ferramenta de assistência em campo por trabalhadores de manutenção urbana. Usando qualquer câmara de smartphone, este sistema consegue detetar qualquer equipamento de forma precisa e aumentá-lo digitalmente com informação relevante e instruções passo-a-passo de como fazer qualquer trabalho de manutenção. Juntamente com esta aplicação móvel, também foi desenvolvida uma aplicação para desktop — chamada Archer — com o intuito de criar e validar os dados e os objetos digitais que serão apresentados na aplicação mobile durante o curso de um trabalho de manutenção. Por fim, esta dissertação apresenta uma nova solução para a deteção e minimização automática dos pontos (checkpoints) em que a aplicação móvel deverá pedir ao utilizador para efetuar um novo reconhecimento do equipamento, os quais são úteis para manter um tracking fiável e estável à medida que o utilizador vai modificando o equipamento durante um trabalho. As experiências e testes com utilizadores efetuados na fase final desta dissertação demonstram a precisão e praticidade dos sistemas desenvolvidos, provando que estes podem efetivamente ser usados para melhorar o workflow dos trabalhadores de manutenção urbana

A Survey of Augmented Reality

© 2015 M. Billinghurst, A. Clark, and G. Lee. This survey summarizes almost 50 years of research and development in the field of Augmented Reality (AR). From early research in the 1960's until widespread availability by the 2010's there has been steady progress towards the goal of being able to seamlessly combine real and virtual worlds. We provide an overview of the common definitions of AR, and show how AR fits into taxonomies of other related technologies. A history of important milestones in Augmented Reality is followed by sections on the key enabling technologies of tracking, display and input devices. We also review design guidelines and provide some examples of successful AR applications. Finally, we conclude with a summary of directions for future work and a review of some of the areas that are currently being researched

Conception and development of a mobile mixed reality medium for environment-related storytelling – a novel approach to virtual heritage

Das Ziel dieser Arbeit ist die Entwicklung eines neuartigen Virtual Heritage Mediums das User mit Hilfe von interaktiven Mixed-Reality Umgebungen und raumbezogenem Erzählen nicht nur räumlich mitten in eine Geschichte hineinversetzt, sondern auch aktiv in diese einbezieht. Dies wird erreicht, indem das Videobild eines getrackten Smartphones mit perspektivisch stimmigen Echtzeit-3D Inhalten überlagert wird. Der User kann diese Mixed-Reality Umgebung erkunden, die Handlungen von 3D Charakteren beobachten sowie mit ihnen und virtuellen Artefakten interagieren. Dieses Medium bietet folglich die Möglichkeit mediale Geschichten in echten Räumen zu erzählen sowie ein immersives und user-involvierendes Medienerlebnis. Diese Arbeit wird den Einsatz dieses Mediums speziell für Kulturvermittlungszwecke fokussieren. Diese Arbeit wird zunächst die technischen Anforderungen und Umsetzungsmöglichkeiten dieses Vorhabens mittels Unity für iPhone / iOS 7 untersuchen. Die Belegung der Ergebnisse erfolgt durch die anschließende Realisierung eines Prototypen.The goal of this thesis is to develop a novel type of virtual heritage medium that utilises the combined immersive and engaging potentials of interactive mixed reality environments and spatial narratives. Concretely, this is achieved through depth-sensitive compositing of real-time 3D content into the live-video of a tracked smartphone. The user can explore this mixed reality environment, watch the actions of staged 3D characters as well as interact with them and virtual artifacts. This medium would therefore provide possibilities for telling stories in direct context with existing environments along with an immersive and engaging media experience. This work will mainly focus on how this medium can be used as an edutainment medium in sites of cultural heritage. This thesis will focus on establishing the technical requirements and realisation possibilities for implementation in Unity on iPhone 5 / iOS 7. Subsequently, a prototype is implemented in order to prove the research results

An Operating System for Augmented Reality Ubiquitous Computing Environments

Ph.DDOCTOR OF PHILOSOPH