Handheld AR for Collaborative Edutainment

Handheld Augmented Reality (AR) is expected to provide ergonomic, intuitive user interfaces for untrained users. Yet no comparative study has evaluated these assumptions against more traditional user interfaces for an education task. In this paper we compare the suitability of a handheld AR arts-history learning game against more traditional variants. We present results from a user study that demonstrate not only the effectiveness of AR for untrained users but also its fun-factor and suitability in environments such as public museums. Based on these results we provide design guidelines that can inform the design of future collaborative handheld AR applications

Presence and Communication in Hybrid Virtual and Augmented Reality Environments

The use of virtual reality (VR) and augmented reality (AR) in connected environments is rarely explored but may become a necessary channel of communication in the future. Such environments would allow multiple users to interact, engage, and share multi-dimensional data across devices and between the spectrum of realities. However, communication between the two realities within a hybrid environment is barely understood. We carried out an experiment with 52 participants in 26 pairs, within two environments of 3D cultural artifacts: 1) a Hybrid VR and AR environment (HVAR) and 2) a Shared VR environment (SVR). We explored the differences in perceived spatial presence, copresence, and social presence between the environments and between users. We demonstrated that greater presence is perceived in SVR when compared with HVAR, and greater spatial presence is perceived for VR users. Social presence is perceived greater for AR users, possibly because they have line of sight of their partners within HVAR. We found positive correlations between shared activity time and perceived social presence. While acquainted pairs reported significantly greater presence than unacquainted pairs in SVR, there were no significant differences in perceived presence between them in HVAR

One Reality: Augmenting How the Physical World is Experienced by combining Multiple Mixed Reality Modalities

International audienceMost of our daily activities take place in the physical world, which inherently imposes physical constraints. In contrast, the digital world is very flexible, but usually isolated from its physical counterpart. To combine these two realms, many Mixed Reality (MR) techniques have been explored, at different levels in the continuum. In this work we present an integrated Mixed Reality ecosystem that allows users to incrementally transition from pure physical to pure virtual experiences in a unique reality. This system stands on a conceptual framework composed of 6 levels. This paper presents these levels as well as the related interaction techniques

Multisensory instrumental dynamics as an emergent paradigm for digital musical creation

The nature of human/instrument interaction is a long-standing area of study, drawing interest from fields as diverse as philosophy, cognitive sciences, anthropology, human–computer-interaction, and artistic creation. In particular, the case of the interaction between performer and musical instrument provides an enticing framework for studying the instrumental dynamics that allow for embodiment, skill acquisition and virtuosity with (electro-)acoustical instruments, and questioning how such notions may be transferred into the realm of digital music technologies and virtual instruments. This paper offers a study of concepts and technologies allowing for instrumental dynamics with Digital Musical Instruments, through an analysis of haptic-audio creation centred on (a) theoretical and conceptual frameworks, (b) technological components—namely physical modelling techniques for the design of virtual mechanical systems and force-feedback technologies allowing mechanical coupling with them, and (c) a corpus of artistic works based on this approach. Through this retrospective, we argue that artistic works created in this field over the last 20 years—and those yet to come—may be of significant importance to the haptics community as new objects that question physicality, tangibility, and creativity from a fresh and rather singular angle. Following which, we discuss the convergence of efforts in this field, challenges still ahead, and the possible emergence of a new transdisciplinary community focused on multisensory digital art forms

Multiple-view product representation and development using augmented reality technology

Ph.DDOCTOR OF PHILOSOPH

A Survey of Augmented Reality

© 2015 M. Billinghurst, A. Clark, and G. Lee. This survey summarizes almost 50 years of research and development in the field of Augmented Reality (AR). From early research in the 1960's until widespread availability by the 2010's there has been steady progress towards the goal of being able to seamlessly combine real and virtual worlds. We provide an overview of the common definitions of AR, and show how AR fits into taxonomies of other related technologies. A history of important milestones in Augmented Reality is followed by sections on the key enabling technologies of tracking, display and input devices. We also review design guidelines and provide some examples of successful AR applications. Finally, we conclude with a summary of directions for future work and a review of some of the areas that are currently being researched

AN EXPLORATORY STUDY TO INVESTIGATE THE USE OF AUGMENTED REALITY IN SUPPORTING COLLABORATIVE LEARNING PROCESSES

Collaborative learning mediated by technology was proven as one ofthe efficient learning approaches which benefit in both academic and soft skills. Despite advantages offered by technologies, some obstacles were also created e.g. problem in supporting interaction and communication, disregard of physical and sharing objects' roles. Augmented Reality (AR) offers a unique learning experience by combining the physical and virtual object. The benefits of rich media were enduring and the role of physical material is also considered. However, the literature reveals that there is no design guideline specifically intended for AR based collaborative learning. Hence, this research aims to study and proposed a conceptual framework to guide the development of collaborative AR in learning

Proposition des modèles et de processus structurés pour le développement d’environnements collaboratifs synchrones : application aux réunions de revue de conception

Development of collaborative environment is a complex process. The complexity lies in the fact that collaborative environment development involves a lot of decision making. Several tradeoffs need to be made to satisfy current and future requirements from a potentially various set of user profiles. The handling of these complexities poses challenges for researcher, developers and companies. The knowledge required to make suitable design decisions and to rigorously evaluate those design decisions is usually broad, complex, and evolving. In Part-I of this thesis we investigate to formulate the general knowledge about: synchronous collaborative work which conceptualize the problem domain, synchronous collaborative environment which conceptualize the solution domain and synchronous collaborative environment evaluation which conceptualize the evaluation of whole or part of the proposed solution for the specified problem. This formulation has been done through literature study and leaded to the Concept Maps. The results generate three models: SyCoW (synchronous collaborative work), SyCoE (synchronous collaborative environment) and SyCoEE (synchronous collaborative environment evaluation). In Part-II of this thesis we proposed a process for selection/development of collaborative environment, where we demonstrate how SyCoW, SyCoE and SyCoEE support this process in different ways. Through the proposed process we present the development of new synchronous collaborative environment for design review meeting, named, MT-DT. MT-DT has been designed, developed and evaluated by the author in her PhD. MT-DT consist of a multi-touch table with specific 3D software application which support collaborative design review activities. The results of evaluation confirmed the usability of MT-DT and provide arguments for our choices which we made during development of MT-DT.Le développement d'un environnement collaboratif est un processus complexe. La complexité réside dans le fait que ce développement implique beaucoup de prise de décisions. De multiples compromis doivent être faits pour répondre aux exigences actuelles et futures d'utilisateurs aux profils variés. La prise en compte de cette complexité pose des problèmes aux chercheurs, développeurs et utilisateurs. Les informations et données requises pour prendre des décisions adéquates de conception et évaluer rigoureusement ces décisions sont nombreuses, parfois indéterminées et en constante évolution. Dans la partie-I de cette thèse, nous formulons les connaissances générales sur le travail collaboratif synchrone qui constituent l'état de l'art du domaine du problème. Nous pratiquons de même pour les environnements collaboratifs synchrones (domaine de la solution technique) et leur cette formulation s'appuie sur une étude de la littérature et conduit à la proposition de Schéma Conceptuel (Concept Maps). Nous en déduisons trois modèles: SyCoW (travail collaboratif synchrone), SyCoE (environnement collaboratif synchrone) et SyCoEE (évaluation environnement collaboratif synchrone). Dans la partie II de cette thèse, nous proposons un processus pour la sélection / développement d'un environnement collaboratif, où nous démontrons comment les modèles SyCoW, SyCoE et SyCoEE structurent ce processus. Grâce à la mise en œuvre de la démarche proposée, nous présentons le développement d'un nouvel environnement collaboratif synchrone pour une réunion de revue de conception nommé MT-DT. MT-DT a été conçu, développé et évalué par l'auteur dans sa thèse de doctorat. MT-DT est une application logicielle 3D spécifique à une table multi-touche qui assiste les activités de revue de conception collaborative. Les résultats de l'évaluation ont confirmé la convivialité de MT-DT et fournissent des éléments de validation des choix que nous avons faits au cours du développement de MT-DT

Supporting Multi-User Interaction in Co-Located and Remote Augmented Reality by Improving Reference Performance and Decreasing Physical Interference

One of the most fundamental components of our daily lives is social interaction, ranging from simple activities, such as purchasing a donut in a bakery on the way to work, to complex ones, such as instructing a remote colleague how to repair a broken automobile. While we interact with others, various challenges may arise, such as miscommunication or physical interference. In a bakery, a clerk may misunderstand the donut at which a customer was pointing due to the uncertainty of their finger direction. In a repair task, a technician may remove the wrong bolt and accidentally hit another user while replacing broken parts due to unclear instructions and lack of attention while communicating with a remote advisor. This dissertation explores techniques for supporting multi-user 3D interaction in augmented reality in a way that addresses these challenges. Augmented Reality (AR) refers to interactively overlaying geometrically registered virtual media on the real world. In particular, we address how an AR system can use overlaid graphics to assist users in referencing local objects accurately and remote objects efficiently, and prevent co-located users from physically interfering with each other. My thesis is that our techniques can provide more accurate referencing for co-located and efficient referencing for remote users and lessen interference among users. First, we present and evaluate an AR referencing technique for shared environments that is designed to improve the accuracy with which one user (the indicator) can point out a real physical object to another user (the recipient). Our technique is intended for use in otherwise unmodeled environments in which objects in the environment, and the hand of the indicator, are interactively observed by a depth camera, and both users wear tracked see-through displays. This technique allows the indicator to bring a copy of a portion of the physical environment closer and indicate a selection in the copy. At the same time, the recipient gets to see the indicator's live interaction represented virtually in another copy that is brought closer to the recipient, and is also shown the mapping between their copy and the actual portion of the physical environment. A formal user study confirms that our technique performs significantly more accurately than comparison techniques in situations in which the participating users have sufficiently different views of the scene. Second, we extend the idea of using a copy (virtual replica) of physical object to help a remote expert assist a local user in performing a task in the local user's environment. We develop an approach that uses Virtual Reality (VR) or AR for the remote expert, and AR for the local user. It allows the expert to create and manipulate virtual replicas of physical objects in the local environment to refer to parts of those physical objects and to indicate actions on them. The expert demonstrates actions in 3D by manipulating virtual replicas, supported by constraints and annotations. We performed a user study of a 6DOF alignment task, a key operation in many physical task domains. We compared our approach with another 3D approach that also uses virtual replicas, in which the remote expert identifies corresponding pairs of points to align on a pair of objects, and a 2D approach in which the expert uses a 2D tablet-based drawing system similar to sketching systems developed for prior work by others on remote assistance. The study shows the 3D demonstration approach to be faster than the others. Third, we present an interference avoidance technique (Redirected Motion) intended to lessen the chance of physical interference among users with tracked hand-held displays, while minimizing their awareness that the technique is being applied. This interaction technique warps virtual space by shifting the virtual location of a user's hand-held display. We conducted a formal user study to evaluate Redirected Motion against other approaches that either modify what a user sees or hears, or restrict the interaction capabilities users have. Our study was performed using a game we developed, in which two players moved their hand-held displays rapidly in the space around a shared gameboard. Our analysis showed that Redirected Motion effectively and imperceptibly kept players further apart physically than the other techniques. These interaction techniques were implemented using an extensible programming framework we developed for supporting a broad range of multi-user immersive AR applications. This framework, Goblin XNA, integrates a 3D scene graph with support for 6DOF tracking, rigid body physics simulation, networking, shaders, particle systems, and 2D user interface primitives. In summary, we showed that our referencing approaches can enhance multi-user AR by improving accuracy for co-located users and increasing efficiency for remote users. In addition, we demonstrated that our interference-avoidance approach can lessen the chance of unwanted physical interference between co-located users, without their being aware of its use