A survey of real-time crowd rendering

In this survey we review, classify and compare existing approaches for real-time crowd rendering. We first overview character animation techniques, as they are highly tied to crowd rendering performance, and then we analyze the state of the art in crowd rendering. We discuss different representations for level-of-detail (LoD) rendering of animated characters, including polygon-based, point-based, and image-based techniques, and review different criteria for runtime LoD selection. Besides LoD approaches, we review classic acceleration schemes, such as frustum culling and occlusion culling, and describe how they can be adapted to handle crowds of animated characters. We also discuss specific acceleration techniques for crowd rendering, such as primitive pseudo-instancing, palette skinning, and dynamic key-pose caching, which benefit from current graphics hardware. We also address other factors affecting performance and realism of crowds such as lighting, shadowing, clothing and variability. Finally we provide an exhaustive comparison of the most relevant approaches in the field.Peer ReviewedPostprint (author's final draft

Developing and Evaluating Visual Analogies to Support Insight and Creative Problem Solving

The primary aim of this thesis is to gain a richer understanding of visual analogies for insight problem solving, and, in particular, how they can be better developed to ensure their effectiveness as hints. While much work has explored the role of visual analogies in problem solving and their facilitative role, only a few studies have analysed how they could be designed. This thesis employs a mixed method consisting of a practice-led approach for studying how visual analogies can be designed and developed and an experimental research approach for testing their effectiveness as hints for solving visual insight problems

Animating the evolution of software

The use and development of open source software has increased significantly in the last decade. The high frequency of changes and releases across a distributed environment requires good project management tools in order to control the process adequately. However, even with these tools in place, the nature of the development and the fact that developers will often work on many other projects simultaneously, means that the developers are unlikely to have a clear picture of the current state of the project at any time. Furthermore, the poor documentation associated with many projects has a detrimental effect when encouraging new developers to contribute to the software. A typical version control repository contains a mine of information that is not always obvious and not easy to comprehend in its raw form. However, presenting this historical data in a suitable format by using software visualisation techniques allows the evolution of the software over a number of releases to be shown. This allows the changes that have been made to the software to be identified clearly, thus ensuring that the effect of those changes will also be emphasised. This then enables both managers and developers to gain a more detailed view of the current state of the project. The visualisation of evolving software introduces a number of new issues. This thesis investigates some of these issues in detail, and recommends a number of solutions in order to alleviate the problems that may otherwise arise. The solutions are then demonstrated in the definition of two new visualisations. These use historical data contained within version control repositories to show the evolution of the software at a number of levels of granularity. Additionally, animation is used as an integral part of both visualisations - not only to show the evolution by representing the progression of time, but also to highlight the changes that have occurred. Previously, the use of animation within software visualisation has been primarily restricted to small-scale, hand generated visualisations. However, this thesis shows the viability of using animation within software visualisation with automated visualisations on a large scale. In addition, evaluation of the visualisations has shown that they are suitable for showing the changes that have occurred in the software over a period of time, and subsequently how the software has evolved. These visualisations are therefore suitable for use by developers and managers involved with open source software. In addition, they also provide a basis for future research in evolutionary visualisations, software evolution and open source development

Exploring the Potential of 3D Visualization Techniques for Usage in Collaborative Design

Best practice for collaborative design demands good interaction between its collaborators. The capacity to share common knowledge about design models at hand is a basic requirement. With current advancing technologies gathering collective knowledge is more straightforward, as the dialog between experts can be supported better. The potential for 3D visualization techniques to become the right support tool for collaborative design is explored. Special attention is put on the possible usage for remote collaboration. The opportunities for current state-of-the-art visualization techniques from stereoscopic vision to holographic displays are researched. A classification of the various systems is explored with respect to their tangible usage for augmented reality. Appropriate interaction methods can be selected based on the usage scenario

Anatomy: The Relationship Between Internal and External Visualizations

This dissertation explored the relationship between internal and external visualizations and the implications of this relationship for comprehending visuospatial anatomical information. External visualizations comprised different computer representations of anatomical structures, including: static, animated, non-interactive, interactive, non-stereoscopic, and stereoscopic visualizations. Internal visualizations involved examining participants’ ability to apprehend, encode, and manipulate mental representations (i.e., spatial visualization ability or Vz). Comprehension was measured with a novel spatial anatomy task that involved mental manipulation of anatomical structures in three-dimensions and two-dimensional cross-sections. It was hypothesized that performance on the spatial anatomy task would involve a trade-off between internal and external visualizations available to the learner. Results from experiments 1, 2, and 3 demonstrated that in the absence of computer visualizations, spatial visualization ability (Vz) was the main contributor to variation in spatial anatomy task performance. Subjects with high Vz scored higher, spent less time, and were more accurate than those with low Vz. In the presence of external computer visualizations, variation in task performance was attributed to both Vz and visuospatial characteristics of the computer visualization. While static representations improved performance of high- and low-Vz subjects equally, animations particularly benefited high Vz subjects, as their mean score on the SAT was significantly higher than the mean score of low Vz subjects. The addition of interactivity and stereopsis to the displays offered no additional advantages over non-interactive and non-stereoscopic visualizations. Interactive, non-interactive, stereoscopic and non-stereoscopic visualizations improved the performance of high- and low-Vz subjects equally. It was concluded that comprehension of visuospatial anatomical information involved a trade-off between the perception of external visualizations and the ability to maintain and manipulate internal visualizations. There is an inherent belief that increasing the educational effectiveness of computer visualizations is a mere question of making them dynamic, interactive, and/or realistic. However, experiments 1, 2, and 3 clearly demonstrate that this is not the case, and that the benefits of computer visualizations vary according to learner characteristics, particularly spatial visualization ability

Getting the message across : ten principles for web animation

The growing use of animation in Web pages testifies to the increasing ease with which such multimedia components can be created. This trend indicates a commitment to animation that is often unmatched by the skill of the implementers. The present paper details a set of ten commandments for web animation, intending to sensitise budding animators to key aspects that may impair the communicational effectiveness of their animation. These guidelines are drawn from an extensive literature survey coloured by personal experience of using Web animation packages. Our ten principles are further elucidated by a Web-based on-line tutorial

3D Cinemagraphy from a Single Image

We present 3D Cinemagraphy, a new technique that marries 2D image animation with 3D photography. Given a single still image as input, our goal is to generate a video that contains both visual content animation and camera motion. We empirically find that naively combining existing 2D image animation and 3D photography methods leads to obvious artifacts or inconsistent animation. Our key insight is that representing and animating the scene in 3D space offers a natural solution to this task. To this end, we first convert the input image into feature-based layered depth images using predicted depth values, followed by unprojecting them to a feature point cloud. To animate the scene, we perform motion estimation and lift the 2D motion into the 3D scene flow. Finally, to resolve the problem of hole emergence as points move forward, we propose to bidirectionally displace the point cloud as per the scene flow and synthesize novel views by separately projecting them into target image planes and blending the results. Extensive experiments demonstrate the effectiveness of our method. A user study is also conducted to validate the compelling rendering results of our method.Comment: Accepted by CVPR 2023. Project page: https://xingyi-li.github.io/3d-cinemagraphy