BxDF material acquisition, representation, and rendering for VR and design

Photorealistic and physically-based rendering of real-world environments with high fidelity materials is important to a range of applications, including special effects, architectural modelling, cultural heritage, computer games, automotive design, and virtual reality (VR). Our perception of the world depends on lighting and surface material characteristics, which determine how the light is reflected, scattered, and absorbed. In order to reproduce appearance, we must therefore understand all the ways objects interact with light, and the acquisition and representation of materials has thus been an important part of computer graphics from early days. Nevertheless, no material model nor acquisition setup is without limitations in terms of the variety of materials represented, and different approaches vary widely in terms of compatibility and ease of use. In this course, we describe the state of the art in material appearance acquisition and modelling, ranging from mathematical BSDFs to data-driven capture and representation of anisotropic materials, and volumetric/thread models for patterned fabrics. We further address the problem of material appearance constancy across different rendering platforms. We present two case studies in architectural and interior design. The first study demonstrates Yulio, a new platform for the creation, delivery, and visualization of acquired material models and reverse engineered cloth models in immersive VR experiences. The second study shows an end-to-end process of capture and data-driven BSDF representation using the physically-based Radiance system for lighting simulation and rendering

Motion in place: a case study of archaeological reconstruction using motion capture

Human movement constitutes a fundamental part of the archaeological process, and of any interpretationof a site’s usage; yet there has to date been little or no consideration of how movement observed (incontemporary situations) and inferred (in archaeological reconstruction) can be documented. This paper reports on the Motion in Place Platform project, which seeks to use motion capture hardware and data totest human responses to Virtual Reality (VR) environments and their real-world equivalents using round houses of the Southern British Iron Age which have been both modelled in 3D and reconstructed in the present day as a case study. This allows us to frame questions about the assumptions which are implicitlyhardwired into VR presentations of archaeology and cultural heritage in new ways. In the future, this will lead to new insights into how VR models can be constructed, used and transmitted

Digitally interpreting traditional folk crafts

The cultural heritage preservation requires that objects persist throughout time to continue to communicate an intended meaning. The necessity of computer-based preservation and interpretation of traditional folk crafts is validated by the decreasing number of masters, fading technologies, and crafts losing economic ground. We present a long-term applied research project on the development of a mathematical basis, software tools, and technology for application of desktop or personal fabrication using compact, cheap, and environmentally friendly fabrication devices, including '3D printers', in traditional crafts. We illustrate the properties of this new modeling and fabrication system using several case studies involving the digital capture of traditional objects and craft patterns, which we also reuse in modern designs. The test application areas for the development are traditional crafts from different cultural backgrounds, namely Japanese lacquer ware and Norwegian carvings. Our project includes modeling existing artifacts, Web presentations of the models, automation of the models fabrication, and the experimental manufacturing of new designs and forms

Automated knowledge capture in 2D and 3D design environments

In Life Cycle Engineering, it is vital that the engineering knowledge for the product is captured throughout its life cycle in a formal and structured manner. This will allow the information to be referred to in the future by engineers who did not work on the original design but are wanting to understand the reasons that certain design decisions were made. In the past, attempts were made to try to capture this knowledge by having the engineer record the knowledge manually during a design session. However, this is not only time-consuming but is also disruptive to the creative process. Therefore, the research presented in this paper is concerned with capturing design knowledge automatically using a traditional 2D design environment and also an immersive 3D design environment. The design knowledge is captured by continuously and non-intrusively logging the user during a design session and then storing this output in a structured eXtensible Markup Language (XML) format. Next, the XML data is analysed and the design processes that are involved can be visualised by the automatic generation of IDEF0 diagrams. Using this captured knowledge, it forms the basis of an interactive online assistance system to aid future users who are carrying out a similar design task

Enabling Self-aware Smart Buildings by Augmented Reality

Conventional HVAC control systems are usually incognizant of the physical structures and materials of buildings. These systems merely follow pre-set HVAC control logic based on abstract building thermal response models, which are rough approximations to true physical models, ignoring dynamic spatial variations in built environments. To enable more accurate and responsive HVAC control, this paper introduces the notion of "self-aware" smart buildings, such that buildings are able to explicitly construct physical models of themselves (e.g., incorporating building structures and materials, and thermal flow dynamics). The question is how to enable self-aware buildings that automatically acquire dynamic knowledge of themselves. This paper presents a novel approach using "augmented reality". The extensive user-environment interactions in augmented reality not only can provide intuitive user interfaces for building systems, but also can capture the physical structures and possibly materials of buildings accurately to enable real-time building simulation and control. This paper presents a building system prototype incorporating augmented reality, and discusses its applications.Comment: This paper appears in ACM International Conference on Future Energy Systems (e-Energy), 201

Experimental archeology and serious games: challenges of inhabiting virtual heritage

Experimental archaeology has long yielded valuable insights into the tools and techniques that featured in past peoples’ relationship with the material world around them. However, experimental archaeology has, hitherto, confined itself to rigid, empirical and quantitative questions. This paper applies principles of experimental archaeology and serious gaming tools in the reconstructions of a British Iron Age Roundhouse. The paper explains a number of experiments conducted to look for quantitative differences in movement in virtual vs material environments using both “virtual” studio reconstruction as well as material reconstruction. The data from these experiments was then analysed to look for differences in movement which could be attributed to artefacts and/or environments. The paper explains the structure of the experiments, how the data was generated, what theories may make sense of the data, what conclusions have been drawn and how serious gaming tools can support the creation of new experimental heritage environments

A framework for realistic 3D tele-immersion

Meeting, socializing and conversing online with a group of people using teleconferencing systems is still quite differ- ent from the experience of meeting face to face. We are abruptly aware that we are online and that the people we are engaging with are not in close proximity. Analogous to how talking on the telephone does not replicate the experi- ence of talking in person. Several causes for these differences have been identified and we propose inspiring and innova- tive solutions to these hurdles in attempt to provide a more realistic, believable and engaging online conversational expe- rience. We present the distributed and scalable framework REVERIE that provides a balanced mix of these solutions. Applications build on top of the REVERIE framework will be able to provide interactive, immersive, photo-realistic ex- periences to a multitude of users that for them will feel much more similar to having face to face meetings than the expe- rience offered by conventional teleconferencing systems

Mixed reality participants in smart meeting rooms and smart home enviroments

Human–computer interaction requires modeling of the user. A user profile typically contains preferences, interests, characteristics, and interaction behavior. However, in its multimodal interaction with a smart environment the user displays characteristics that show how the user, not necessarily consciously, verbally and nonverbally provides the smart environment with useful input and feedback. Especially in ambient intelligence environments we encounter situations where the environment supports interaction between the environment, smart objects (e.g., mobile robots, smart furniture) and human participants in the environment. Therefore it is useful for the profile to contain a physical representation of the user obtained by multi-modal capturing techniques. We discuss the modeling and simulation of interacting participants in a virtual meeting room, we discuss how remote meeting participants can take part in meeting activities and they have some observations on translating research results to smart home environments

Reflectance Transformation Imaging (RTI) System for Ancient Documentary Artefacts

This tutorial summarises our uses of reflectance transformation imaging in archaeological contexts. It introduces the UK AHRC funded project reflectance Transformation Imaging for Anciant Documentary Artefacts and demonstrates imaging methodologies