Disturbance and plausibility in a virtual rock concert: a pilot study

We present methods used to produce and study a first version of an attempt to reconstruct a 1983 live rock concert in virtual reality. An approximately 10 minute performance by the rock band Dire Straits was rendered in virtual reality, based on the use of computer vision techniques to extract the appearance and movements of the band, and crowd simulation for the audience. An online pilot study was conducted where participants experienced the scenario and freely wrote about their experience. The documents produced were analyzed using sentiment analysis, and groups of responses with similar sentiment scores were found and compared. The results showed that some participants were disturbed not by the band performance but by the accompanying virtual audience that surrounded them. The results point to a profound level of plausibility of the experience, though not in the way that the authors expected. The findings add to our understanding of plausibility of virtual environments.This work is funded by the European Research Council (ERC) Advanced Grant Moments in Time in Immersive Virtual Environments (MoTIVE) #742989.Peer ReviewedPostprint (author's final draft

Improving image-based rendering fo r crowds and perceptual evaluation

We propose some improvements for two imaged-based impostor techniques. We have also developed a module of software integrated in a prototyping framework for crowd simulation. Finally, in order to analyze the visual quality of these techniques we have carried out a perceptual experiment

A survey of real-time crowd rendering

In this survey we review, classify and compare existing approaches for real-time crowd rendering. We first overview character animation techniques, as they are highly tied to crowd rendering performance, and then we analyze the state of the art in crowd rendering. We discuss different representations for level-of-detail (LoD) rendering of animated characters, including polygon-based, point-based, and image-based techniques, and review different criteria for runtime LoD selection. Besides LoD approaches, we review classic acceleration schemes, such as frustum culling and occlusion culling, and describe how they can be adapted to handle crowds of animated characters. We also discuss specific acceleration techniques for crowd rendering, such as primitive pseudo-instancing, palette skinning, and dynamic key-pose caching, which benefit from current graphics hardware. We also address other factors affecting performance and realism of crowds such as lighting, shadowing, clothing and variability. Finally we provide an exhaustive comparison of the most relevant approaches in the field.Peer ReviewedPostprint (author's final draft

Virtually Being Lenin Enhances Presence and Engagement in a Scene From the Russian Revolution

Virtual Reality (VR) has been widely applied to cultural heritage such as the reconstruction of ancient sites and artifacts. It has hardly been applied to the reprise of specific important moments in history. On the other hand immersive journalism does attempt to recreate current events in VR, but such applications typically give the viewer a disembodied non-participatory role in the scene of interest. Here we show how VR was used to reconstruct a specific historical event, where a famous photograph was brought to life, showing Lenin, the leader of the 1917 October Russian Revolution, giving a speech to Red Army recruits in Moscow 1920. We carried out a between groups experimental study with three conditions: Embodied—where the participant was first embodied as Lenin and then later in the audience watching Lenin; Included—where the participant was not embodied as Lenin but was embodied as part of the audience; and Observing—where the participant mainly viewed the scene from a disembodied third person point of view. Twenty participants were assigned to each of the three conditions in a between-groups design. We found that the level of presence was greatest in the Embodied and Included conditions, and that participants were least likely to later follow up information about the Russian Revolution in the Observing condition. Our conclusion is that if the VR setup allows for a period of embodiment as a character in the scenario then this should be employed in order to maximize the chance of participant presence and engagement with the story

Efficient rendering of animated characters through optimized per-joint impostors

In this paper, we present a new impostor-based representation for 3D animated characters supporting real-time rendering of thousands of agents. We maximize rendering performance by using a collection of pre-computed impostors sampled from a discrete set of view directions. Our approach differs from previous work on view-dependent impostors in that we use per-joint rather than per-character impostors. Our characters are animated by applying the joint rotations directly to the impostors, instead of choosing a single impostor for the whole character from a set of pre-defined poses. This offers more flexibility in terms of animation clips, as our representation supports any arbitrary pose, and thus, the agent behavior is not constrained to a small collection of pre-defined clips. Because our impostors are intended to be valid for any pose, a key issue is to define a proper boundary for each impostor to minimize image artifacts while animating the agents. We pose this problem as a variational optimization problem and provide an efficient algorithm for computing a discrete solution as a pre-process. To the best of our knowledge, this is the first time a crowd rendering algorithm encompassing image-based performance, small graphics processing unit footprint, and animation independence is proposed.Peer Reviewe