Stylised procedural animation

This thesis develops a stylised procedural paradigm for computer graphics animation. Cartoon effects animations - stylised representations of natural phenomena - have presented a long-standing, difficult challenge to computer animators. We propose a framework for achieving the intricacy of effects motion with minimal animator intervention.Our approach is to construct cartoon effects by simulating the hand-drawing process through synthetic, computational means. We create a system which emulates the stylish appearance, movements of cartoon effects in both 2D and 3D environments. Our computational models achieve this by capturing the essential characteristics common to all cartoon effects: structure modelling, dynamic controlling and stylised rendering.To validate our framework, we have implemented a cartoon effects system for a range of effects including water effects, fire, smoke, rain and snow. Each effect model has its own static structure such as how the different parts are related temporarily. The flexibility of our approach is suggested most evidently by the high-level controls on shape, colour, timing and rendering on the effects. Like their hand-drawn counterparts, they move consistently while retaining the hand-crafted look.Since the movements of cartoon effects are animated procedurally, their detailed motions need not be keyframed. This thesis therefore demonstrates a powerful approach to computer animation in which the animator plays the role of a high level controller, rather than the more conventional hand-drawing slave. Our work not only achieves cartoon effects animation of un-precedented complexity, but it also provides an interesting experimental domain for related research disciplines toward more creative and expressive image synthesis in animation

Exploiting the GPU power for intensive geometric and imaging data computation.

Wang Jianqing.Thesis (M.Phil.)--Chinese University of Hong Kong, 2004.Includes bibliographical references (leaves 81-86).Abstracts in English and Chinese.Chapter 1 --- Introduction --- p.1Chapter 1.1 --- Overview --- p.1Chapter 1.2 --- Thesis --- p.3Chapter 1.3 --- Contributions --- p.4Chapter 1.4 --- Organization --- p.6Chapter 2 --- Programmable Graphics Hardware --- p.8Chapter 2.1 --- Introduction --- p.8Chapter 2.2 --- Why Use GPU? --- p.9Chapter 2.3 --- Programmable Graphics Hardware Architecture --- p.11Chapter 2.4 --- Previous Work on GPU Computation --- p.15Chapter 3 --- Multilingual Virtual Performer --- p.17Chapter 3.1 --- Overview --- p.17Chapter 3.2 --- Previous Work --- p.18Chapter 3.3 --- System Overview --- p.20Chapter 3.4 --- Facial Animation --- p.22Chapter 3.4.1 --- Facial Animation using Face Space --- p.23Chapter 3.4.2 --- Face Set Selection for Lip Synchronization --- p.27Chapter 3.4.3 --- The Blending Weight Function Generation and Coartic- ulation --- p.33Chapter 3.4.4 --- Expression Overlay --- p.38Chapter 3.4.5 --- GPU Algorithm --- p.39Chapter 3.5 --- Character Animation --- p.44Chapter 3.5.1 --- Skeletal Animation Primer --- p.44Chapter 3.5.2 --- Mathematics of Kinematics --- p.46Chapter 3.5.3 --- Animating with Motion Capture Data --- p.48Chapter 3.5.4 --- Skeletal Subspace Deformation --- p.49Chapter 3.5.5 --- GPU Algorithm --- p.50Chapter 3.6 --- Integration of Skeletal and Facial Animation --- p.52Chapter 3.7 --- Result --- p.53Chapter 3.7.1 --- Summary --- p.58Chapter 4 --- Discrete Wavelet Transform On GPU --- p.60Chapter 4.1 --- Introduction --- p.60Chapter 4.1.1 --- Previous Works --- p.61Chapter 4.1.2 --- Our Solution --- p.61Chapter 4.2 --- Multiresolution Analysis with Wavelets --- p.62Chapter 4.3 --- Fragment Processor for Pixel Processing --- p.64Chapter 4.4 --- DWT Pipeline --- p.65Chapter 4.4.1 --- Convolution Versus Lifting --- p.65Chapter 4.4.2 --- DWT Pipeline --- p.67Chapter 4.5 --- Forward DWT --- p.68Chapter 4.6 --- Inverse DWT --- p.71Chapter 4.7 --- Results and Applications --- p.73Chapter 4.7.1 --- Geometric Deformation in Wavelet Domain --- p.73Chapter 4.7.2 --- Stylish Image Processing and Texture-illuminance De- coupling --- p.73Chapter 4.7.3 --- Hardware-Accelerated JPEG2000 Encoding --- p.75Chapter 4.8 --- Web Information --- p.78Chapter 5 --- Conclusion --- p.79Bibliography --- p.8

Implicit surfaces for interactive animated characters

Thesis (S.M.)--Massachusetts Institute of Technology, Program in Media Arts & Sciences, 1999.Includes bibliographical references (leaves 64-68).Implicit surface modeling in computer graphics is a powerful technique for representing smooth and organic shapes. Skeletal elements of an implicit surface blend to create a smooth, seamless skin which exhibits desired properties for animation such as squash and stretch. Because of their high computational cost to render, implicit surfaces have not been used extensively in the real-time graphics domain. This thesis discusses the problems and some solutions in the application of implicit surfaces to the domain of interactive character animation. A design process for an implicit surface-based character is proposed, from the modeling and texturing stages to animation and rendering.by Kenneth Bradley Russell.S.M

Analysis of Visualisation and Interaction Tools Authors

This document provides an in-depth analysis of visualization and interaction tools employed in the context of Virtual Museum. This analysis is required to identify and design the tools and the different components that will be part of the Common Implementation Framework (CIF). The CIF will be the base of the web-based services and tools to support the development of Virtual Museums with particular attention to online Virtual Museum.The main goal is to provide to the stakeholders and developers an useful platform to support and help them in the development of their projects, despite the nature of the project itself. The design of the Common Implementation Framework (CIF) is based on an analysis of the typical workflow ofthe V-MUST partners and their perceived limitations of current technologies. This document is based also on the results of the V-MUST technical questionnaire (presented in the Deliverable 4.1). Based on these two source of information, we have selected some important tools (mainly visualization tools) and services and we elaborate some first guidelines and ideas for the design and development of the CIF, that shall provide a technological foundation for the V-MUST Platform, together with the V-MUST repository/repositories and the additional services defined in the WP4. Two state of the art reports, one about user interface design and another one about visualization technologies have been also provided in this document

Image editing and interaction tools for visual expression

Digital photography is becoming extremely common in our daily life. However, images are difficult to edit and interact with. From a user's perspective, it is important to interact freely with the images on his/her smartphone or ipad. In this thesis we develop several image editing and interaction systems with this idea in mind. We aim for creating visual models with pre-computed internal structures such that interaction is readily supported. We demonstrate that such interactable models, driven by a user's hand, can render powerful visual expressiveness, and make static pixel arrays much more fun to play with. The first system harnesses the editing power of vector graphics. We convert raster images into a vector representation using Loop's subdivision surfaces. An image is represented by a multi-resolution feature-preserving sparse control mesh, with which image editing can be done at semantic level. A user can easily put a smile on a face image, or adjust the level of scene abstractness through a simple slider. The second system allows one to insert an object from image into a new scene. The key is to correct the shading on the object such that it goes consistently with the scene. Unlike traditional approach, we use a simple shape to capture gross shading effects and a set of shading detail images to account for visual complexities. The high-frequency nature of these detail images allows a moderate range of interactive composition effects without causing alarming visual artifacts. The third system is on video clips instead of a single image. We proposed a fully automated algorithm to creat

Production of 3D animated short films in Unity 5 : can game engines replace the traditional methods?

In 3D animation cinema, the elements of a scene are created by artists using computer software. To generate the final result, there must be a conversion (rendering) of the threedimensional models to two-dimensional images (frames) that will later be joined together and edited into a video format. 3D animation films have traditionally been rendered using pre-rendering engines, a time consuming and expensive process that usually requires the use of multiple computers rendering at the same time (render farms), renders which may need to be repeated if the results are not ideal. Videogames, on the other hand, are reactive applications where the player may have different possible courses of action that will generate distinct results. In those cases, it is necessary that the engine waits for the player’s input before it calculates the following frames. To allow for fast calculations in real time, 3D game developers use game engines that incorporate real time rendering methods which can generate images much faster than the prerendering engines mentioned above. To be able to generate a large number of frames per second, there must be an optimization of the entire scene, in order to reduce the number of necessary calculations. That optimization is created by using techniques, practices and tools that are not commonly used by animation cinema professionals. Due to that optimization necessity, videogames always had a lower graphic quality than that of animated films, where each frame is rendered separately and takes as long as necessary to obtain the required result. Physically Based Rendering (PBR) technology is one of the methods incorporated by some rendering engines for the generation of physically accurate results, using calculations that follow the laws of physics as it happens in the real world and creating more realistic images which require less effort, not only from the artist but also from the equipment. The incorporation of PBR in game engines allowed for high graphic quality generated results in real time, gradually closing the visual quality gap between videogames and animated cinema. Recently, game engines such as Unity and Unreal Engine started to be used – mostly by the companies that created the engine, as a proof of concept – for rendering 3D animated films. This could lead to changes in the animation cinema production methods by the studios that, until now, have used traditional pre-rendering methods.No cinema de animação 3D, os elementos de uma cena são criados por artistas através da utilização de programas de computador. Para gerar o resultado final, é necessário fazer-se uma conversão (render) dos modelos tri-dimensionais para imagens bi-dimensionais (frames), que posteriormente serão unidas e editadas para um formato de vídeo. Tradicionalmente, o rendering de filmes de animação 3D é feita através de motores de pre-rendering, um processo demorado e dispendioso que geralmente requer a utilização de múltiplos computadores a trabalhar em simultâneo (render farms), e que poderá ter que ser repetido caso os resultados obtidos não sejam ideais. Os videojogos, por outro lado, são aplicações reactivas, onde o jogador pode ter várias sequências de acções, que poderão gerar resultados distintos. Nesses casos, é necessário o motor de jogo esperar pela acção do jogador antes de calcular as imagens seguintes. Para possibilitar cálculos rápidos em tempo-real, os criadores de jogos 3D usam motores de jogo que incorporam métodos de renderização em tempo-real que conseguem gerar imagens muito mais rápido do que os motores de pre-rendering mencionados acima. Para conseguir gerar um grande número de imagens por segundo, é necessário existir uma optimização de toda a cena, para reduzir o número de cálculos necessários. Essa optimização é criada através da utilização de técnicas, práticas e ferramentas que, geralmente, não são utiliadas por profissionais da área de cinema de animação. Devido a essa necessidade de optimização, os videojogos sempre tiveram uma qualidade gráfica inferior à dos filmes de animação, onde o render de cada imagem é gerado separadamente e pode levar tanto tempo quanto for necessário para obter o resultado desejado. A tecnologia de Rendering Baseado em Física (Physically Based Rendering – PBR) é um dos métodos incorporados por alguns motores de rendering para a geração de resultados físicamente correctos, usando cálculos que seguem as leis da física, tal como acontece no mundo real e criando imagens mais realistas necessitando de menos esforço, não só da parte do artista mas também do equipamento. A incorporação de PBR em motores de jogo possibilitou resultados gerados em tempo-real com grande qualidade gráfica, o que gradualmente vai aproximando a qualidade visual dos videojogos à do cinema de animação. Recentemente, motores de jogo como o Unity e o Unreal Engine começaram a ser utilizados – maioritariamente pelas companhias que criaram o motor de jogo, como prova de conceito – para renderização de filmes de animação 3D. Este passo poderá levar a mudanças nos métodos de produção do cinema de animação em estúdios que, até agora, utilizaram métodos de pré-renderização tradicionais

Drawing from motion capture : developing visual languages of animation

The work presented in this thesis aims to explore novel approaches of combining motion capture with drawing and 3D animation. As the art form of animation matures, possibilities of hybrid techniques become more feasible, and crosses between traditional and digital media provide new opportunities for artistic expression. 3D computer animation is used for its keyframing and rendering advancements, that result in complex pipelines where different areas of technical and artistic specialists contribute to the end result. Motion capture is mostly used for realistic animation, more often than not for live-action filmmaking, as a visual effect. Realistic animated films depend on retargeting techniques, designed to preserve actors performances with a high degree of accuracy. In this thesis, we investigate alternative production methods that do not depend on retargeting, and provide animators with greater options for experimentation and expressivity. As motion capture data is a great source for naturalistic movements, we aim to combine it with interactive methods such as digital sculpting and 3D drawing. As drawing is predominately used in preproduction, in both the case of realistic animation and visual effects, we embed it instead to alternative production methods, where artists can benefit from improvisation and expression, while emerging in a three-dimensional environment. Additionally, we apply these alternative methods for the visual development of animation, where they become relevant for the creation of specific visual languages that can be used to articulate concrete ideas for storytelling in animation

Digital Alchemy: Matter and Metamorphosis in Contemporary Digital Animation and Interface Design

The recent proliferation of special effects in Hollywood film has ushered in an era of digital transformation. Among scholars, digital technology is hailed as a revolutionary moment in the history of communication and representation. Nevertheless, media scholars and cultural historians have difficulty finding a language adequate to theorizing digital artifacts because they are not just texts to be deciphered. Rather, digital media artifacts also invite critiques about the status of reality because they resurrect ancient problems of embodiment and transcendence.In contrast to scholarly approaches to digital technology, computer engineers, interface designers, and special effects producers have invented a robust set of terms and phrases to describe the practice of digital animation. In order to address this disconnect between producers of new media and scholars of new media, I argue that the process of digital animation borrows extensively from a set of preexisting terms describing materiality that were prominent for centuries prior to the scientific revolution. Specifically, digital animators and interface designers make use of the ancient science, art, and technological craft of alchemy. Both alchemy and digital animation share several fundamental elements: both boast the power of being able to transform one material, substance, or thing into a different material, substance, or thing. Both seek to transcend the body and materiality but in the process, find that this elusive goal (realism and gold) is forever receding onto the horizon.The introduction begins with a literature review of the field of digital media studies. It identifies a gap in the field concerning disparate arguments about new media technology. On the one hand, scholars argue that new technologies like cyberspace and digital technology enable radical new forms of engagement with media on individual, social, and economic levels. At the same time that media scholars assert that our current epoch is marked by a historical rupture, many other researchers claim that new media are increasingly characterized by ancient metaphysical problems like embodiment and transcendence. In subsequent chapters I investigate this disparity

Final Report to NSF of the Standards for Facial Animation Workshop

The human face is an important and complex communication channel. It is a very familiar and sensitive object of human perception. The facial animation field has increased greatly in the past few years as fast computer graphics workstations have made the modeling and real-time animation of hundreds of thousands of polygons affordable and almost commonplace. Many applications have been developed such as teleconferencing, surgery, information assistance systems, games, and entertainment. To solve these different problems, different approaches for both animation control and modeling have been developed