Developing interactions in augmented materiality: an enhancement method based on RGB-D segmentation

Knowledge and understanding of how Augmented Reality develops the illusion of an alternative reality that needs to be critically considered with philosophical and technical points of view. Researchers have been investigating exploring different techniques to generate enhanced experiences for the users. In this article, the technological reality scenarios embodied within several Augmented Reality techniques are explored and a classification scheme is proposed in detail. Additionally, for the purposes of enhancing the cohesion of augmented visual content to the actuality, an Augmented Reality software based on a segmentation using RGB-D camera system that handles the occlusion problem will also be explained and an enhancement method will be discussed

Dynamic HDR Environment Capture for Mixed Reality

Rendering accurate and convincing virtual content into mixed reality (MR) scenes requires detailed illumination information about the real environment. In existing MR systems, this information is often captured using light probes [1, 8, 9, 17, 19--21], or by reconstructing the real environment as a preprocess [31, 38, 54]. We present a method for capturing and updating a HDR radiance map of the real environment and tracking camera motion in real time using a self-contained camera system, without prior knowledge about the real scene. The method is capable of producing plausible results immediately and improving in quality as more of the scene is reconstructed. We demonstrate how this can be used to render convincing virtual objects whose illumination changes dynamically to reflect the changing real environment around them