A survey of real-time crowd rendering

In this survey we review, classify and compare existing approaches for real-time crowd rendering. We first overview character animation techniques, as they are highly tied to crowd rendering performance, and then we analyze the state of the art in crowd rendering. We discuss different representations for level-of-detail (LoD) rendering of animated characters, including polygon-based, point-based, and image-based techniques, and review different criteria for runtime LoD selection. Besides LoD approaches, we review classic acceleration schemes, such as frustum culling and occlusion culling, and describe how they can be adapted to handle crowds of animated characters. We also discuss specific acceleration techniques for crowd rendering, such as primitive pseudo-instancing, palette skinning, and dynamic key-pose caching, which benefit from current graphics hardware. We also address other factors affecting performance and realism of crowds such as lighting, shadowing, clothing and variability. Finally we provide an exhaustive comparison of the most relevant approaches in the field.Peer ReviewedPostprint (author's final draft

A perceptual comparison of empirical and predictive region-of-interest video

When viewing multimedia presentations, a user only attends to a relatively small part of the video display at any one point in time. By shifting allocation of bandwidth from peripheral areas to those locations where a user’s gaze is more likely to rest, attentive displays can be produced. Attentive displays aim to reduce resource requirements while minimizing negative user perception—understood in this paper as not only a user’s ability to assimilate and understand information but also his/her subjective satisfaction with the video content. This paper introduces and discusses a perceptual comparison between two region-of-interest display (RoID) adaptation techniques. A RoID is an attentive display where bandwidth has been preallocated around measured or highly probable areas of user gaze. In this paper, video content was manipulated using two sources of data: empirical measured data (captured using eye-tracking technology) and predictive data (calculated from the physical characteristics of the video data). Results show that display adaptation causes significant variation in users’ understanding of specific multimedia content. Interestingly, RoID adaptation and the type of video being presented both affect user perception of video quality. Moreover, the use of frame rates less than 15 frames per second, for any video adaptation technique, caused a significant reduction in user perceived quality, suggesting that although users are aware of video quality reduction, it does impact level of information assimilation and understanding. Results also highlight that user level of enjoyment is significantly affected by the type of video yet is not as affected by the quality or type of video adaptation—an interesting implication in the field of entertainment

Perceptually Driven Simulation

This dissertation describes, implements and analyzes a comprehensive system for perceptually-driven virtual reality simulation, based on algorithms which dynamically adjust level of detail (LOD) for entity simulation in order to maximize simulation realism as perceived by the viewer. First we review related work in simulation LOD, and describe the weaknesses of the analogy that has traditionally been drawn between simulation LOD and graphical LOD. We describe the process of perceptual criticality modeling for quantitatively estimating the relative importance of different entities in maintaining perceived realism and predicting the consequences of LOD transitions on perceived realism. We present heuristic cognitive models of human perception, memory, and attention to perform this modeling. We then propose the LOD Trader , a framework for perceptually driven LOD selection and an online approximation algorithm for efficiently identifying useful LOD transitions. We then describe alibi generation , a method of retroactively elaborating a human agent\u27s behavior to maintain its realism under prolonged scrutiny from the viewer, and discuss its integration into a heterogeneous perceptually driven simulation. We then present the Marketplace simulation system and describe how perceptually driven simulation techniques were used to maximize perceived realism, and evaluate their success in doing so. Finally, we summarize the dissertation work performed and its expected contributions to real-time modeling and simulation environments

Velocity-Based LOD Reduction in Virtual Reality: A Psychometric Approach

Virtual Reality headsets enable users to explore the environment by performing self-induced movements. The retinal velocity produced by such motion reduces the visual system's ability to resolve fine detail. We measured the impact of self-induced head rotations on the ability to detect quality changes of a realistic 3D model in an immersive virtual reality environment. We varied the Level-of-Detail (LOD) as a function of rotational head velocity with different degrees of severity. Using a psychophysical method, we asked 17 participants to identify which of the two presented intervals contained the higher quality model under two different maximum velocity conditions. After fitting psychometric functions to data relating the percentage of correct responses to the aggressiveness of LOD manipulations, we identified the threshold severity for which participants could reliably (75\%) detect the lower LOD model. Participants accepted an approximately four-fold LOD reduction even in the low maximum velocity condition without a significant impact on perceived quality, which suggests that there is considerable potential for optimisation when users are moving (increased range of perceptual uncertainty). Moreover, LOD could be degraded significantly more in the maximum head velocity condition, suggesting these effects are indeed speed dependent

Design and evaluation of a perceptually adaptive rendering system for immersive virtual reality environments

This thesis presents the design and evaluation of a perceptually adaptive rendering system for immersive virtual reality. Rendering realistic computer generated scenes can be computationally intensive. Perceptually adaptive rendering reduces the computational burden by rendering detail only where it is needed. A rendering system was designed to employ perceptually adaptive rendering techniques in environments running in immersive virtual reality. The rendering system combines lessons learned from psychology and computer science. Eccentricity from the user\u27s point of gaze is used to determine when to render detail in an immersive virtual environment, and when it can be omitted. A pilot study and a full study were carried out to evaluate the efficacy of the perceptually adaptive rendering system. The studies showed that frame rates can be improved without overly distracting the user when an eccentricity-based perceptually adaptive rendering technique is employed. Perceptually adaptive rendering techniques can be applied in older systems and enable them to display higher quality environments without reducing interactivity

Virtual Reality Games for Motor Rehabilitation

This paper presents a fuzzy logic based method to track user satisfaction without the need for devices to monitor users physiological conditions. User satisfaction is the key to any product’s acceptance; computer applications and video games provide a unique opportunity to provide a tailored environment for each user to better suit their needs. We have implemented a non-adaptive fuzzy logic model of emotion, based on the emotional component of the Fuzzy Logic Adaptive Model of Emotion (FLAME) proposed by El-Nasr, to estimate player emotion in UnrealTournament 2004. In this paper we describe the implementation of this system and present the results of one of several play tests. Our research contradicts the current literature that suggests physiological measurements are needed. We show that it is possible to use a software only method to estimate user emotion