ARLearn: augmented reality meets augmented virtuality

Ternier, S., Klemke, R., Kalz, M., Van Ulzen, P., & Specht, M. (2012). ARLearn: augmented reality meets augmented virtuality [Special issue]. Journal of Universal Computer Science - Technology for learning across physical and virtual spaces, 18(15), 2143-2164.This article deals with educational opportunities for mixed reality games and related scenarios for learning. It discusses several issues and educational challenges to be tackled when linking augmented reality and augmented virtuality. Second, the paper describes the architecture of the ARLearn system which offers highly flexible support for different educational settings. Three prototypical use cases implemented based on the underlying ARLearn framework are discussed, which are a field trip system, an augmented Google StreetView client called StreetLearn, and a real time crisis intervention game. ARLearn combines real time notification and mixed reality games across Mobile Augmented Reality and Virtual Reality and the authors aim to use the underlying (open source) framework for further case studies and mixed reality applications for learning support

Novel Architecture of OneM2M-Based Convergence Platform for Mixed Reality and IoT

There have been numerous works proposed to merge augmented reality/mixed reality (AR/MR) and Internet of Things (IoT) in various ways. However, they have focused on their specific target applications and have limitations on interoperability or reusability when utilizing them to different domains or adding other devices to the system. This paper proposes a novel architecture of a convergence platform for AR/MR and IoT systems and services. The proposed architecture adopts the oneM2M IoT standard as the basic framework that converges AR/MR and IoT systems and enables the development of application services used in general-purpose environments without being subordinate to specific systems, domains, and device manufacturers. We implement the proposed architecture utilizing the open-source oneM2M-based IoT server and device platforms released by the open alliance for IoT standards (OCEAN) and Microsoft HoloLens as an MR device platform. We also suggest and demonstrate the practical use cases and discuss the advantages of the proposed architecture

IoT and Wearable Devices-Enhanced Information Provision of AR Glasses: A Multi-Modal Analysis in Aviation Industry

While Augmented Reality (AR) glasses are now instrumental in industries for delivering work-related information, the current one-size-fits-all information provision of AR glasses fails to cater to diverse workers’ needs and environmental conditions. We propose a framework for harnessing Internet of thing (IoT) and wearable technology to improve the adaptability and customization of information provision by AR. As a preliminary exploration, this short paper develops a multi-modal data processing system for work performance classification in the aviation industry. Using machine learning algorithms for multi-modal feature extraction and classifier construction, this framework provides a more objective and consistent evaluation of work performance compared to single-modal approaches. The proposed analytics architecture can provide valuable insights for other industries struggling to implement IoT and mixed reality

Mixed Reality Architecture: a dynamic architectural topology

Architecture can be shown to structure patterns of co-presence and in turn to be structured itself by the rules and norms of the society present within it. This two-way relationship exists in a surprisingly stable framework, as fundamental changes to buildings are slow and costly. At the same time, change within organisations is increasingly rapid and buildings are used to accommodate some of that change. This adaptation can be supported by the use of telecommunication technologies, overcoming the need for co-presence during social interaction. However, often this results in a loss of accountability or ‘civic legibility’, as the link between physical location and social activity is broken. In response to these considerations, Mixed Reality Architecture (MRA) was developed. MRA links multiple physical spaces across a shared 3D virtual world. We report on the design of MRA, including the key concept of the Mixed Reality Architectural Cell, a novel architectural interface between architectural spaces that are remote to each other. An in-depth study lasting one year and involving six office-based MRACells, used video recordings, the analysis of event logs, diaries and an interview survey. This produced a series of ethnographic vignettes describing social interaction within MRA in detail. In this paper we concentrate on the topological properties of MRA. It can be shown that the dynamic topology of MRA and social interaction taking place within it are fundamentally intertwined. We discuss how topological adjacencies across virtual space change the integration of the architectural spaces that MRA is installed in. We further reflect on how the placement of MRA technology in different parts of an office space (deep or shallow) impacts on the nature of that particular space. Both the above can be shown to influence movement through the building and social interaction taking place within it. These findings are directly relevant to new buildings that need to be designed to accommodate organisational change in future but also to existing building stock that might be very hard to adapt. We are currently expanding the system to new sites and are planning changes to the infrastructure of MRA as well as its interactional interface

Mixed Reality Architecture: Concept, Construction, Use

Mixed Reality Architecture (MRA) dynamically links and overlays physical and virtual spaces. This paper investigates the topology of and the relationships between the components of MRA. As a phenomenon, MRA takes its place in a long history of technologies that have influenced conditions for social interaction as well as the environment we build around us. However, by providing a flexible spatial topology spanning physical and virtual environments it presents new opportunities for social interaction across electronic media. An experimental MRA is described that allowed us to study some of the emerging issues in this field. It provided material for the development of a framework describing virtual and physical spaces, the links between those and the types of mixed reality structure that we can envisage it being possible to design using these elements. We propose that by re-introducing a level of spatiality into communication across physical and virtual environments MRA will support everyday social interaction, and may convert digital communication media from being socially conservative to a more generative form familiar from physical space

Component-based middleware for distributed augmented reality applications

International audienceThis paper describes the design and implementation of a middleware for a framework dedicated to Augmented Reality/Mixed Reality (AR/MR) applications. The goal is to offer an environment for the development of distributed applications running on mobile devices (wearable computers and/or smartphones). The paper first presents the main needs of an AR application and introduces the necessity of distribution in this field. Then we make a quick overview of existing distributed AR frameworks. The goal of this overview is to extract main features and strengths of each framework's architecture based on a set of defined criteria. This comparison being meant as a starting point to extend our own framework (ARCS: Augmented Reality Component System), the last section is about the design and implementation of our own software infrastructure for transparent distributed Augmented Reality taking in consideration our own goals and constraints and taking profit of the strengths of the studied existing frameworks

Mixed-methods research: a new approach to evaluating the motivation and satisfaction of university students using advanced visual technologies

The final publication is available at link.springer.comA mixed-methods study evaluating the motivation and satisfaction of Architecture degree students using interactive visualization methods is presented in this paper. New technology implementations in the teaching field have been largely extended to all types of levels and educational frameworks. However, these innovations require approval validation and evaluation by the final users, the students. In this paper, the advantages and disadvantages of applying mixed evaluation technology are discussed in a case study of the use of interactive and collaborative tools for the visualization of 3D architectonical models. The main objective was to evaluate Architecture and Building Science students’ the motivation to use and satisfaction with this type of technology and to obtain adequate feedback that allows for the optimization of this type of experiment in future iterations.Postprint (author’s final draft