Mixed reality with a collaborative information system

Abstract

In this paper, we present a mixed reality environment (MIXER) for immersive interactions. MIXER is an agent based collaborative information system displaying hybrid reality merging interactive computer graphics and real objects. MIXER is an agent based collaborative information system displaying hybrid reality merging interactive computer graphics and real objects. The system comprises a sensor subsystem, a network subsystem and an interaction subsystem. Related issues to the concept of mixed interaction, including human aware computing, mixed reality fusion, agent based systems, collaborative scalable learning in distributed systems, QoE-QoS balanced management and information security, are discussed. We propose a system architecture to perform networked mixed reality fusion for Ambient Interaction. The components of the mixed reality suit to perform human aware interaction are Interaction Space, Motion Monitoring, Action and Scenario Synthesisers, Script Generator, Knowledge Assistant Systems, Scenario Display, and a Mixed Reality Module. Thus, MIXER as an integrated system can provide a comprehensive human-centered mixed reality suite for advanced Virtual Reality and Augmented Reality applications such as therapy, training, and driving simulations.15 page(s