Doctor of Philosophy

dissertationReal-time global illumination is the next frontier in real-time rendering. In an attempt to generate realistic images, games have followed the film industry into physically based shading and will soon begin integrating global illumination techniques. Traditional methods require too much memory and too much time to compute for real-time use. With Modular and Delta Radiance Transfer we precompute a scene-independent, low-frequency basis that allows us to calculate complex indirect lighting calculations in a much lower dimensional subspace with a reduced memory footprint and real-time execution. The results are then applied as a light map on many different scenes. To improve the low frequency results, we also introduce a novel screen space ambient occlusion technique that allows us to generate a smoother result with fewer samples. These three techniques, low and high frequency used together, provide a viable indirect lighting solution that can be run in milliseconds on today's hardware, providing a useful new technique for indirect lighting in real-time graphics

Shading with Painterly Filtered Layers: A Process to Obtain Painterly Portraits

In this thesis, I study how color data from different styles of paintings can be extracted from photography with the end result maintaining the artistic integrity of the art style and having the look and feel of skin. My inspiration for this work came from the impasto style portraitures of painters such as Rembrandt and Greg Cartmell. I analyzed and studied the important visual characteristics of both Rembrandt’s and Cartmell’s styles of painting.These include how the artist develops shadow and shading, creates the illusion of subsurface scattering, and applies color to the canvas, which will be used as references to help develop the final renders in computer graphics. I also examined how color information can be extracted from portrait photography in order to gather accurate dark, medium, and light skin shades. Based on this analysis, I have developed a process for creating portrait paintings from 3D facial models. My process consists of four stages: (1) Modeling a 3D portrait of the subject, (2) data collection by photographing the subjects, (3) Barycentric shader development using photographs, and (4) Compositing with filtered layers. My contributions has been in stages (3) and (4) as follows: Development of an impasto-style Barycentric shader by extracting color information from gathered photographic images. This shader can result in realistic looking skin rendering. Development of a compositing technique that involves filtering layers of images that correspond to different effects such as diffuse, specular and ambient. To demonstrate proof-of-concept, I have created a few animations of the impasto style portrait painting for a single subject. For these animations, I have also sculpted high polygon count 3D model of the torso and head of my subject. Using my shading and compositing techniques, I have created rigid body animations that demonstrate the power of my techniques to obtain impasto style portraiture during animation under different lighting conditions

Master of Science in Computing

thesisThis document introduces the Soft Shadow Mip-Maps technique, which consists of three methods for overcoming the fundamental limitations of filtering-oriented soft shadows. Filtering-oriented soft shadowing techniques filter shadow maps with varying filter sizes determined by desired penumbra widths. Different varieties of this approach have been commonly applied in interactive and real-time applications. Nonetheless, they share some fundamental limitations. First, soft shadow filter size is not always guaranteed to be the correct size for producing the right penumbra width based on the light source size. Second, filtering with large kernels for soft shadows requires a large number of samples, thereby increasing the cost of filtering. Stochastic approximations for filtering introduce noise and prefiltering leads to inaccuracies. Finally, calculating shadows based on a single blocker estimation can produce significantly inaccurate penumbra widths when the shadow penumbras of different blockers overlap. We discuss three methods to overcome these limitations. First, we introduce a method for computing the soft shadow filter size for a receiver with a blocker distance. Then, we present a filtering scheme based on shadow mip-maps. Mipmap-based filtering uses shadow mip-maps to efficiently generate soft shadows using a constant size filter kernel for each layer, and linear interpolation between layers. Finally, we introduce an improved blocker estimation approach. With the improved blocker estimaiton, we explore the shadow contribution of every blocker by calculating the light occluded by potential blockers. Hence, the calculated penumbra areas correspond to the blockers correctly. Finally, we discuss how to select filter kernels for filtering. These approaches successively solve issues regarding shadow penumbra width calculation apparent in prior techniques. Our result shows that we can produce correct penumbra widths, as evident in our comparisons to ray-traced soft shadows. Nonetheless, the Soft Shadow Mip-Maps technique suffers from light bleeding issues. This is because our method only calculates shadows using the geometry that is available in the shadow depth map. Therefore, the occluded geometry is not taken into consideration, which leads to light bleeding. Another limitation of our method is that using lower resolution shadow mip-map layers limits the resolution of the shadow placement. As a result, when a blocker moves slowly, its shadow follows it with discrete steps, the size of which is determined by the corresponding mip-map layer resolution

3D Alchemy: a guide to 3D realistic computer graphics

Last year, many films and commercials took advantage of computer technology to create astonishing 3D animations. Examples such as the Listerine commercial series, the NBA logo on TV, and the Chip & Pepper TV cartoon, featured unique and vibrant computer images. Among the various animations, some were made by high end computer systems, but some simply by personal computers. Small, fast, and more capable personal computers are now performing professional-level video production roles and, in fact, they are a staple of many feature film productions and broadcast television facilities

Differentiable Shadow Mapping for Efficient Inverse Graphics

We show how shadows can be efficiently generated in differentiable rendering of triangle meshes. Our central observation is that pre-filtered shadow mapping, a technique for approximating shadows based on rendering from the perspective of a light, can be combined with existing differentiable rasterizers to yield differentiable visibility information. We demonstrate at several inverse graphics problems that differentiable shadow maps are orders of magnitude faster than differentiable light transport simulation with similar accuracy -- while differentiable rasterization without shadows often fails to converge.Comment: CVPR 2023, project page: https://mworchel.github.io/differentiable-shadow-mappin

Pattern changing clothing

People\u27s styles and characters are changed by their environment and their relationship throughout their lifetime. However, the garment that we wear has just one look without accessories because once we wear clothing its appearance doesn\u27t change, even though it is an essential medium to express ourselves. This thesis project\u27s main goal is to make a piece of responsive clothing and to provide users the pleasure of creating their own style. When the clothing is an active medium through interactive communication between a wearer and a garment, it will be a responsive living object for a user. By the use of the developing display technology of E ink, which is thin, rugged, flexible, and segmented, a wearer can change various styles that he/she wants anytime and anyplace. When this E ink clothing displays different pattern, users will be able to make various styles with just one garment. In addition, Pattern Changing Clothing will help wearers enjoy expressing their individuality through the activity of changing or creating styles and patterns as individual customization

Photorealistic physically based render engines: a comparative study

Pérez Roig, F. (2012). Photorealistic physically based render engines: a comparative study. http://hdl.handle.net/10251/14797.Archivo delegad

Implementation and performance analysis of several versions of a Realistic Ray Tracer (Python, CUDA and C++)

A ray tracer has been implemented using Python accelerated by Numba and Numba CUDA. The ray tracer renders 3D scenes that include shadows, reflections, refraction and other basic features. In addition, more advanced features like depth of field have been implemented. Finally, the performance of the ray tracer has been measured, and compared to a C++ implementation of a similar ray tracer.[ES] Un trazador de rayos ha sido implementado usando Python acelerado por Numba y Numba CUDA. El trazador de rayos hace escenas 3D que incluyen sombras, reflexiones, refracción y otras características básicas. Además, más avanzado características como la profundidad de campo se han implementado. Finalmente, el rendimiento del trazador de rayos se ha medido, y en comparación con una implementación de C++ de un trazador de rayos similar

Ray Tracing Gems

This book is a must-have for anyone serious about rendering in real time. With the announcement of new ray tracing APIs and hardware to support them, developers can easily create real-time applications with ray tracing as a core component. As ray tracing on the GPU becomes faster, it will play a more central role in real-time rendering. Ray Tracing Gems provides key building blocks for developers of games, architectural applications, visualizations, and more. Experts in rendering share their knowledge by explaining everything from nitty-gritty techniques that will improve any ray tracer to mastery of the new capabilities of current and future hardware. What you'll learn: The latest ray tracing techniques for developing real-time applications in multiple domains Guidance, advice, and best practices for rendering applications with Microsoft DirectX Raytracing (DXR) How to implement high-performance graphics for interactive visualizations, games, simulations, and more Who this book is for: Developers who are looking to leverage the latest APIs and GPU technology for real-time rendering and ray tracing Students looking to learn about best practices in these areas Enthusiasts who want to understand and experiment with their new GPU

Implementation and performance analysis of several versions of a Realistic Ray Tracer (Python, CUDA and C++)

A ray tracer has been implemented using Python accelerated by Numba and Numba CUDA. The ray tracer renders 3D scenes that include shadows, reflections, refraction and other basic features. In addition, more advanced features like depth of field have been implemented. Finally, the performance of the ray tracer has been measured, and compared to a C++ implementation of a similar ray tracer.[ES] Un trazador de rayos ha sido implementado usando Python acelerado por Numba y Numba CUDA. El trazador de rayos hace escenas 3D que incluyen sombras, reflexiones, refracción y otras características básicas. Además, más avanzado características como la profundidad de campo se han implementado. Finalmente, el rendimiento del trazador de rayos se ha medido, y en comparación con una implementación de C++ de un trazador de rayos similar