Prototyping Immersive Analytics: Experiments with Design Students

International audienceImmersive analytics is an emerging field of research that explores the use of immersive technologies for data analysis. We argue that immersion is different from the simple use of 3D graphics and therefore requires new methods of representation and interaction with the data. We believe in the benefits of interdisciplinarity, especially with design, to help shape this new field. We describe two workshops that we have organized with design students, and we share lessons learned and key findings

A 3D immersive discrete event simulator for enabling prototyping of factory layouts

There is an increasing need to eliminate wasted time and money during factory layout design and subsequent construction. It is presently difficult for engineers to foresee if a certain layout is optimal for work and material flows. By exploiting modelling, simulation and visualisation techniques, this paper presents a tool concept called immersive WITNESS that combines the modelling strengths of Discrete Event Simulation (DES) with the 3D visualisation strengths of recent 3D low cost gaming technology to enable decision makers make informed design choices for future factories layouts. The tool enables engineers to receive immediate feedback on their design choices. Our results show that this tool has the potential to reduce rework as well as the associated costs of making physical prototypes

Past Precedent Reconciling Established Multimedia Principles in 3D Virtual Learning Environments

This design case documents the inception, development, and installation of a virtual exhibit on ethical use of learning analytics (LA) for the Museum of Instructional Design (MID), hosted in Mozilla Hubs. Tension emerged as the design team attempted to negotiate established principles of multimedia design theory (see Mayer, 2014; Mayer & Fiorella, 2021; Richardson, 2014) within an emerging learning environment. A rapid prototyping model, combined with elements of critical museology and dialectics, allowed for ongoing formative evaluation of design fidelity. Exhibit artifacts consisted of scenarios illustrating the ethical ambiguities of LA; a data justice timeline pairing recent peer-reviewed articles on LA with significant contemporaneous milestones in data privacy; audio zones highlighting the dialectical dialogue between those who support LA use and those who advise caution; and a response wall for museum visitors to extend the discussion. Beyond application of multimedia design principles to artifacts, 3D spaces also demand consideration of space and movement flow. Lacking precedent, this exhibit design was guided by the Smithsonian’s (2018) recommendations for in-person exhibits. It is the intention of the design team that this design case highlights the need for a reconsideration of established multimedia theory when designing for emerging learning environments

VRIA: A Web-based Framework for Creating Immersive Analytics Experiences

We present, a Web-based framework for creating Immersive Analytics (IA) experiences in Virtual Reality.is built upon WebVR, A-Frame, React and D3.js, and offers a visualization creation workflow which enables users, of different levels of expertise, to rapidly develop Immersive Analytics experiences for the Web. The use of these open-standards Web-based technologies allows us to implement VR experiences in a browser and offers strong synergies with popular visualization libraries, through the HTMLDocument Object Model (DOM). This makesubiquitous and platform-independent. Moreover, by using WebVR’s progressive enhancement, the experiencescreates are accessible on a plethora of devices. We elaborate on our motivation for focusing on open-standards Web technologies, present thecreation workflow and detail the underlying mechanics of our framework. We also report on techniques and optimizations necessary for implementing Immersive Analytics experiences on the Web, discuss scalability implications of our framework, and present a series of use case applications to demonstrate the various features of . Finally, we discuss current limitations of our framework, the lessons learned from its development, and outline further extensions

Grand Challenges in Immersive Analytics

The definitive version will be published in CHI 2021, May 8–13, 2021, Yokohama, JapanInternational audienceImmersive Analytics is a quickly evolving field that unites several areas such as visualisation, immersive environments, and humancomputer interaction to support human data analysis with emerging technologies. This research has thrived over the past years with multiple workshops, seminars, and a growing body of publications, spanning several conferences. Given the rapid advancement of interaction technologies and novel application domains, this paper aims toward a broader research agenda to enable widespread adoption. We present 17 key research challenges developed over multiple sessions by a diverse group of 24 international experts, initiated from a virtual scientific workshop at ACM CHI 2020. These challenges aim to coordinate future work by providing a systematic roadmap of current directions and impending hurdles to facilitate productive and effective applications for Immersive Analytics

One view is not enough: review of and encouragement for multiple and alternative representations in 3D and immersive visualisation

The opportunities for 3D visualisations are huge. People can be immersed inside their data, interface with it in natural ways, and see it in ways that are not possible on a traditional desktop screen. Indeed, 3D visualisations, especially those that are immersed inside head-mounted displays are becoming popular. Much of this growth is driven by the availability, popularity and falling cost of head-mounted displays and other immersive technologies. However, there are also challenges. For example, data visualisation objects can be obscured, important facets missed (perhaps behind the viewer), and the interfaces may be unfamiliar. Some of these challenges are not unique to 3D immersive technologies. Indeed, developers of traditional 2D exploratory visualisation tools would use alternative views, across a multiple coordinated view (MCV) system. Coordinated view interfaces help users explore the richness of the data. For instance, an alphabetical list of people in one view shows everyone in the database, while a map view depicts where they live. Each view provides a different task or purpose. While it is possible to translate some desktop interface techniques into the 3D immersive world, it is not always clear what equivalences would be. In this paper, using several case studies, we discuss the challenges and opportunities for using multiple views in immersive visualisation. Our aim is to provide a set of concepts that will enable developers to perform critical thinking, creative thinking and push the boundaries of what is possible with 3D and immersive visualisation. In summary developers should consider how to integrate many views, techniques and presentation styles, and one view is not enough when using 3D and immersive visualisations

Designing a novel virtual collaborative environment to support collaboration in design review meetings

Project review meetings are part of the project management process and are organised to assess progress and resolve any design conflicts to avoid delays in construction. One of the key challenges during a project review meeting is to bring the stakeholders together and use this time effectively to address design issues as quickly as possible. At present, current technology solutions based on BIM or CAD are information-centric and do not allow project teams to collectively explore the design from a range of perspectives and brainstorm ideas when design conflicts are encountered. This paper presents a system architecture that can be used to support multi-functional team collaboration more effectively during such design review meetings. The proposed architecture illustrates how information-centric BIM or CAD systems can be made human- and team-centric to enhance team communication and problem solving. An implementation of the proposed system architecture has been tested for its utility, likability and usefulness during design review meetings. The evaluation results suggest that the collaboration platform has the potential to enhance collaboration among multi-functional teams

Combining virtual reality enabled simulation with 3D scanning technologies towards smart manufacturing

Recent introduction of low-cost 3D sensing and affordable immersive virtual reality have lowered the barriers for creating and maintaining 3D virtual worlds. In this paper, we propose a way to combine these technologies with discrete-event simulation to improve the use of simulation in decision making in manufacturing. This work will describe how feedback is possible from real world systems directly into a simulation model to guide smart behaviors. Technologies included in the research include feedback from RGBD images of shop floor motion and human interaction within full immersive virtual reality that includes the latest headset technologies