Assessing mobile mixed reality affordances as a comparative visualization pedagogy for design communication

Spatial visualisation skills and interpretation are critical in the design professions but are difficult for novice designers. There is growing evidence that mixed reality visualisation improves learner outcomes, but often these studies are focused on a single media representation and not on a comparison between media and the underpinning learning outcomes. Results from recent studies highlight the use of comparative visualisation pedagogy in design through learner reflective blogs and pilot studies with experts, but these studies are limited by expense and designs familiar to the learner. With increasing interest in mobile pedagogy, more assessment is required in understanding learner interpretation of comparative mobile mixed reality pedagogy. The aim of this study is to do this by evaluating insights from a first-year architectural design classroom through studying the impact and use of a range of mobile comparative visualisation technologies. Using a design-based research methodology and a usability framework for accessing comparative visualisation, this paper will study the complexities of spatial design in the built environment. Outcomes from the study highlight the positives of the approach but also the improvements required in the delivery of the visualisations to improve on the visibility and visual errors caused by the lack of mobile processing

Tangible user interfaces : past, present and future directions

In the last two decades, Tangible User Interfaces (TUIs) have emerged as a new interface type that interlinks the digital and physical worlds. Drawing upon users' knowledge and skills of interaction with the real non-digital world, TUIs show a potential to enhance the way in which people interact with and leverage digital information. However, TUI research is still in its infancy and extensive research is required in or- der to fully understand the implications of tangible user interfaces, to develop technologies that further bridge the digital and the physical, and to guide TUI design with empirical knowledge. This paper examines the existing body of work on Tangible User In- terfaces. We start by sketching the history of tangible user interfaces, examining the intellectual origins of this field. We then present TUIs in a broader context, survey application domains, and review frame- works and taxonomies. We also discuss conceptual foundations of TUIs including perspectives from cognitive sciences, phycology, and philoso- phy. Methods and technologies for designing, building, and evaluating TUIs are also addressed. Finally, we discuss the strengths and limita- tions of TUIs and chart directions for future research

Augmented reality meeting table: a novel multi-user interface for architectural design

Immersive virtual environments have received widespread attention as providing possible replacements for the media and systems that designers traditionally use, as well as, more generally, in providing support for collaborative work. Relatively little attention has been given to date however to the problem of how to merge immersive virtual environments into real world work settings, and so to add to the media at the disposal of the designer and the design team, rather than to replace it. In this paper we report on a research project in which optical see-through augmented reality displays have been developed together with prototype decision support software for architectural and urban design. We suggest that a critical characteristic of multi user augmented reality is its ability to generate visualisations from a first person perspective in which the scale of rendition of the design model follows many of the conventions that designers are used to. Different scales of model appear to allow designers to focus on different aspects of the design under consideration. Augmenting the scene with simulations of pedestrian movement appears to assist both in scale recognition, and in moving from a first person to a third person understanding of the design. This research project is funded by the European Commission IST program (IST-2000-28559)

Visualisation of semantic architectural information within a game engine environment

Because of the importance of graphics and information within the domain of architecture, engineering and construction (AEC), an appropriate combination of visualisation technology and information management technology is of utter importance in the development of appropriately supporting design and construction applications. We therefore started an investigation of two of the newest developments in these domains, namely game engine technology and semantic web technology. This paper documents part of this research, containing a review and comparison of the most prominent game engines and documenting our architectural semantic web. A short test-case illustrates how both can be combined to enhance information visualisation for architectural design and construction

Discrete event simulation and virtual reality use in industry: new opportunities and future trends

This paper reviews the area of combined discrete event simulation (DES) and virtual reality (VR) use within industry. While establishing a state of the art for progress in this area, this paper makes the case for VR DES as the vehicle of choice for complex data analysis through interactive simulation models, highlighting both its advantages and current limitations. This paper reviews active research topics such as VR and DES real-time integration, communication protocols, system design considerations, model validation, and applications of VR and DES. While summarizing future research directions for this technology combination, the case is made for smart factory adoption of VR DES as a new platform for scenario testing and decision making. It is put that in order for VR DES to fully meet the visualization requirements of both Industry 4.0 and Industrial Internet visions of digital manufacturing, further research is required in the areas of lower latency image processing, DES delivery as a service, gesture recognition for VR DES interaction, and linkage of DES to real-time data streams and Big Data sets

Piloting Multimodal Learning Analytics using Mobile Mixed Reality in Health Education

© 2019 IEEE. Mobile mixed reality has been shown to increase higher achievement and lower cognitive load within spatial disciplines. However, traditional methods of assessment restrict examiners ability to holistically assess spatial understanding. Multimodal learning analytics seeks to investigate how combinations of data types such as spatial data and traditional assessment can be combined to better understand both the learner and learning environment. This paper explores the pedagogical possibilities of a smartphone enabled mixed reality multimodal learning analytics case study for health education, focused on learning the anatomy of the heart. The context for this study is the first loop of a design based research study exploring the acquisition and retention of knowledge by piloting the proposed system with practicing health experts. Outcomes from the pilot study showed engagement and enthusiasm of the method among the experts, but also demonstrated problems to overcome in the pedagogical method before deployment with learners

ViBe (Virtual Berlin) - Immersive Interactive 3D Urban Data Visualization - Immersive interactive 3D urban data visualization

The project investigates the possibility of visualizing open source data in a 3D interactive virtual environment. We propose a new tool, 'ViBe'. We programmed 'ViBe' using Unity for its compatibility with HTC VIVE glasses for virtual reality (VR). ViBe offers an abstract visualization of open source data in a 3D interactive environment. The ViBe environment entails three main topics a) inhabitants, b) environmental factors, and c) land-use; acting as representatives of parameters for cities and urban design. Berlin serves as a case study. The data sets used are divided according to Berlin's twelve administrative districts. The user immerses into the virtual environment where they can choose, using the HTC Vive controllers, which district (or Berlin as a whole) they want information for and which topics they want to be visualized, and they can also teleport back and forth between the different districts. The goal of this project is to represent different urban parameters an abstract simulation where we correlate the corresponding data sets. By experiencing the city through visualized data, ViBe aims to provide the user with a clearer perspective onto the city and the relationship between its urban parameters. ViBe is designed for adults and kids, urban planners, politicians and real estate developers alike

Virtual Reality Interactive Learning Environment

Open Building Manufacturing (ManuBuild) aims to promote the European construction industry beyond the state of the art. However, this requires the different stakeholders to be well informed of what ‘Open Building Manufacturing’ actually entails with respect to understanding the underlying concepts, benefits and risks. This is further challenged by the ‘traditional ways of learning’ which have been predominantly criticised for being entrenched in theories with little or no emphasis on practical issues. Experiential learning has long been suggested to overcome the problems associated with the traditional ways of learning. In this respect, it has the dual benefit of appealing to adult learner's experience base, as well as increasing the likelihood of performance change through training. On-the-job-training (OJT) is usually sought to enable ‘experiential’ learning; and it is argued to be particularly effective in complex tasks, where a great deal of independence is granted to the task performer. However, OJT has been criticised for being expensive, limited, and devoid of the actual training context. Consequently, in order to address the problems encountered with OJT, virtual reality (VR) solutions have been proposed to provide a risk free environment for learning without the ‘do-or-die’ consequences often faced on real construction projects. Since ManuBuild aims to promote the EU construction industry beyond the state of the art; training and education therefore needs also to go beyond the state of the art in order to meet future industry needs and expectations. Hence, a VR interactive learning environment was suggested for Open Building Manufacturing training to allow experiential learning to take place in a risk free environment, and consequently overcome the problems associated with OJT. This chapter discusses the development, testing, and validation of this prototype