Procedural Modeling and Physically Based Rendering for Synthetic Data Generation in Automotive Applications

We present an overview and evaluation of a new, systematic approach for generation of highly realistic, annotated synthetic data for training of deep neural networks in computer vision tasks. The main contribution is a procedural world modeling approach enabling high variability coupled with physically accurate image synthesis, and is a departure from the hand-modeled virtual worlds and approximate image synthesis methods used in real-time applications. The benefits of our approach include flexible, physically accurate and scalable image synthesis, implicit wide coverage of classes and features, and complete data introspection for annotations, which all contribute to quality and cost efficiency. To evaluate our approach and the efficacy of the resulting data, we use semantic segmentation for autonomous vehicles and robotic navigation as the main application, and we train multiple deep learning architectures using synthetic data with and without fine tuning on organic (i.e. real-world) data. The evaluation shows that our approach improves the neural network's performance and that even modest implementation efforts produce state-of-the-art results.Comment: The project web page at http://vcl.itn.liu.se/publications/2017/TKWU17/ contains a version of the paper with high-resolution images as well as additional materia

Impact of model fidelity in factory layout assessment using immersive discrete event simulation

Discrete Event Simulation (DES) can help speed up the layout design process. It offers further benefits when combined with Virtual Reality (VR). The latest technology, Immersive Virtual Reality (IVR), immerses users in virtual prototypes of their manufacturing plants to-be, potentially helping decision-making. This work seeks to evaluate the impact of visual fidelity, which refers to the degree to which objects in VR conforms to the real world, using an IVR visualisation of the DES model of an actual shop floor. User studies are performed using scenarios populated with low- and high-fidelity models. Study participant carried out four tasks representative of layout decision-making. Limitations of existing IVR technology was found to cause motion sickness. The results indicate with the particular group of naïve modellers used that there is no significant difference in benefits between low and high fidelity, suggesting that low fidelity VR models may be more cost-effective for this group

The Emergence of Agent-Based Technology as an Architectural Component of Serious Games

The evolution of games as an alternative to traditional simulations in the military context has been gathering momentum over the past five years, even though the exploration of their use in the serious sense has been ongoing since the mid-nineties. Much of the focus has been on the aesthetics of the visuals provided by the core game engine as well as the artistry provided by talented development teams to produce not only breathtaking artwork, but highly immersive game play. Consideration of game technology is now so much a part of the modeling and simulation landscape that it is becoming difficult to distinguish traditional simulation solutions from game-based approaches. But games have yet to provide the much needed interactive free play that has been the domain of semi-autonomous forces (SAF). The component-based middleware architecture that game engines provide promises a great deal in terms of options for the integration of agent solutions to support the development of non-player characters that engage the human player without the deterministic nature of scripted behaviors. However, there are a number of hard-learned lessons on the modeling and simulation side of the equation that game developers have yet to learn, such as: correlation of heterogeneous systems, scalability of both terrain and numbers of non-player entities, and the bi-directional nature of simulation to game interaction provided by Distributed Interactive Simulation (DIS) and High Level Architecture (HLA)

Building a Collaborative Online Literary Experience

Key Takeaways -Educators and students collaborated in constructing an immersive literary experience at the University of Richmond and then reenacted the narrative as a team. -Considerable planning goes into such simulations to make them effective collaboration spaces. -In creating a simulation of Edgar Allan Poe\u27s The Fall of the House of Usher, a team of distributed groups negotiated different approaches to believably embody Poe\u27s characters and period. -Despite limitations in the software and the planning process during and after a beta test, students experienced Poe\u27s story in a new and rewarding way. Effective virtual simulations can embed participants in imaginary worlds. Researchers working in virtual worlds and gaming often refer toimmersion, a state in which a participant or player loses track of time and becomes one with the simulation

Artificial intelligence in 3D virtual environments as technological support for pedagogy

This paper researches the opportunities available to use 3D Virtual learning Environments (3D VLEs), such as Second Life, to create e-learning Project Innovation for students using 3D Virtual Design concepts and programming. This entails the use of programming and coding to create bots (artificial intelligence robotic avatars) that can be used to direct interactive teaching and learning activities inside a 3D VLE. Moreover, through the creation and coding of holographic platforms (holodecks) inside 3D VLEs, diverse classroom and environmental settings can be created to aid in the elearning process and help the students themselves to use this technique to create immersive 3D projects e.g. 3D catalogues and exhibitions. This is in addition to the prospects of using these holodecks for educational role-play activities, modelling activities and interactive discussions and seminars

Exploring the Use of Virtual Worlds as a Scientific Research Platform: The Meta-Institute for Computational Astrophysics (MICA)

We describe the Meta-Institute for Computational Astrophysics (MICA), the first professional scientific organization based exclusively in virtual worlds (VWs). The goals of MICA are to explore the utility of the emerging VR and VWs technologies for scientific and scholarly work in general, and to facilitate and accelerate their adoption by the scientific research community. MICA itself is an experiment in academic and scientific practices enabled by the immersive VR technologies. We describe the current and planned activities and research directions of MICA, and offer some thoughts as to what the future developments in this arena may be.Comment: 15 pages, to appear in the refereed proceedings of "Facets of Virtual Environments" (FaVE 2009), eds. F. Lehmann-Grube, J. Sablating, et al., ICST Lecture Notes Ser., Berlin: Springer Verlag (2009); version with full resolution color figures is available at http://www.mica-vw.org/wiki/index.php/Publication

A Virtual Environment System for the Comparison of Dome and HMD Systems

For effective astronaut training applications, choosing the right display devices to present images is crucial. In order to assess what devices are appropriate, it is important to design a successful virtual environment for a comparison study of the display devices. We present a comprehensive system for the comparison of Dome and head-mounted display (HMD) systems. In particular, we address interactions techniques and playback environments

Emerging digital media, games and simulations: a challenge for open and distance learning

In this article we examine the state-of-the-art research related to digital media in education and evaluate the information concerning a new generation of students that are communityminded and technologically savvy, highlighting the innovative technology behind the new interaction and communication processes, and assessing the challenges for Open and Distance Learning (ODL). Where traditional distance education is based on the completion of carefully graded assignments and tests, today games, simulations and virtual environments may become safe platforms for trial and error experimentation. With games the chance of failure is high, but the cost is low and the lessons are learned immediately and with greater emotional impact. However, these conditions may become more difficult to address when the volume of users increases from small to medium, large or extra-large. Dealing effectively with tens or even hundreds of thousands of students in absentia requires following very sound organizational principles and good technical implementation, systematic monitoring of deviations from established norms, regular audition of users' comments and criticisms, careful analysis of final results. In this emerging scenario, involving digital media, games and simulations, ODL systems must have means of establishing rich connections with each member of the universe of users. In this sense we propose using a virtual space with multiple places, in ways that use the Internet, social applications, games and mobile devices to involve students in pedagogical activities