Painterly rendering techniques: A state-of-the-art review of current approaches

In this publication we will look at the different methods presented over the past few decades which attempt to recreate digital paintings. While previous surveys concentrate on the broader subject of non-photorealistic rendering, the focus of this paper is firmly placed on painterly rendering techniques. We compare different methods used to produce different output painting styles such as abstract, colour pencil, watercolour, oriental, oil and pastel. Whereas some methods demand a high level of interaction using a skilled artist, others require simple parameters provided by a user with little or no artistic experience. Many methods attempt to provide more automation with the use of varying forms of reference data. This reference data can range from still photographs, video, 3D polygonal meshes or even 3D point clouds. The techniques presented here endeavour to provide tools and styles that are not traditionally available to an artist. Copyright © 2012 John Wiley & Sons, Ltd

Ink-and-Ray: Bas-Relief Meshes for Adding Global Illumination Effects to Hand-Drawn Characters

We present a new approach for generating global illumination renderings of hand-drawn characters using only a small set of simple annotations. Our system exploits the concept of bas-relief sculptures, making it possible to generate 3D proxies suitable for rendering without requiring side-views or extensive user input. We formulate an optimization process that automatically constructs approximate geometry sufficient to evoke the impression of a consistent 3D shape. The resulting renders provide the richer stylization capabilities of 3D global illumination while still retaining the 2D handdrawn look-and-feel. We demonstrate our approach on a varied set of handdrawn images and animations, showing that even in comparison to ground truth renderings of full 3D objects, our bas-relief approximation is able to produce convincing global illumination effects, including self-shadowing, glossy reflections, and diffuse color bleeding

Digital Color Imaging

This paper surveys current technology and research in the area of digital color imaging. In order to establish the background and lay down terminology, fundamental concepts of color perception and measurement are first presented us-ing vector-space notation and terminology. Present-day color recording and reproduction systems are reviewed along with the common mathematical models used for representing these devices. Algorithms for processing color images for display and communication are surveyed, and a forecast of research trends is attempted. An extensive bibliography is provided

Hybridization of silhouette rendering and pen-and-ink illustration of non-photorealistic rendering technique for 3D object

This study proposes a hybrid of Non-photorealistic Rendering techniques. Nonphotorealistic Rendering (NPR) covers one part in computer graphics that caters towards generating many kinds of 2D digital art style from 3D data, for instance output that looks like painting and drawing. NPR includes the painterly, interpretative, expressive and artistic styles, among others. NPR research deal with different issues such as the stylization that are driven by human perception, the science and art that were brought together and being harmonized with techniques used. Some of approaches used in NPR were discussed such as cartoon rendering, watercolour painting, silhouette rendering, penand- ink illustration and so on. A plan for hybridization of NPR techniques is proposed between silhouette rendering techniques and pen-and-ink illustration for this study. The integration process of these rendering techniques takes on the lighting mapping and also the construction of colour region of the model in order to ensure the pen-and-ink illustration texture can be implemented into the object. The evaluation process is based on the visualization of the image from the hybridization process. Based on findings, the hybridization of NPR technique was able to create interesting results and considered as an alternative in producing new variety of visualization image in NPR

Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation

Large text-to-image diffusion models have exhibited impressive proficiency in generating high-quality images. However, when applying these models to video domain, ensuring temporal consistency across video frames remains a formidable challenge. This paper proposes a novel zero-shot text-guided video-to-video translation framework to adapt image models to videos. The framework includes two parts: key frame translation and full video translation. The first part uses an adapted diffusion model to generate key frames, with hierarchical cross-frame constraints applied to enforce coherence in shapes, textures and colors. The second part propagates the key frames to other frames with temporal-aware patch matching and frame blending. Our framework achieves global style and local texture temporal consistency at a low cost (without re-training or optimization). The adaptation is compatible with existing image diffusion techniques, allowing our framework to take advantage of them, such as customizing a specific subject with LoRA, and introducing extra spatial guidance with ControlNet. Extensive experimental results demonstrate the effectiveness of our proposed framework over existing methods in rendering high-quality and temporally-coherent videos.Comment: Accepted to SIGGRAPH Asia 2023. Project page: https://www.mmlab-ntu.com/project/rerender

Visualizing Diffusion Tensor Images of the Mouse Spinal Cord

Within biological systems water molecules undergo continuous stochastic Brownian motion. The rate of this diffusion can give clues to the structure of underlying tissues. In some tissues the rate is anisotropic - faster in some directions than others. Diffusion-rate images are second-order tensor fields and can be calculated from diffusion-weighted magnetic resonance images. A 2D diffusion tensor image (DTI) and an associated anatomical scalar field, created during the tensor calculation, define seven dependent values at each spatial location. Understanding the interrelationships among these values is necessary to understand the data. We present two new methods for visually representing DTIs. The first method displays an array of ellipsoids where the shape of each ellipsoid represents one tensor value. The novel aspect of this representation is that the ellipsoids are all normalized to approximately the same size so that they can be displayed in context. The second method uses concepts from oil painting to represent the seven-valued data with multiple layers of varying brush strokes. Both methods successfully display most or all of the information in DTIs and provide exploratory methods for understanding them. The ellipsoid method has a simpler interpretation and explanation than the painting-motivated method; the painting-motivated method displays more of the information and is easier to read quantitatively. We demonstrate the methods on images of the mouse spinal cord. The visualizations show significant differences between spinal cords from mice suffering from Experimental Allergic Encephalomyelitis (EAE) and spinal cords from wild-type mice. The differences are consistent with pathology differences shown histologically and suggest that our new non-invasive imaging methodology and visualization of the results could have early diagnostic value for neurodegenerative diseases

Towards photo watercolorization with artistic verisimilitude

published_or_final_versio

Minimization of Halftone Noise in FLAT Regions for Improved Print Quality

The work in this thesis proposes a novel algorithm for enhancing the quality of flat regions in printed color image documents. The algorithm is designed to identify the flat regions based on certain criteria and filter these regions to minimize the noise prior and post Halftoning so as to make the hard copy look visibly pleasing. Noise prior to halftone process is removed using a spatial Gaussian filter together with a Hamming window, concluded from results after implementing various filtering techniques. A clustered dithering is applied in each channel of the image as Halftoning process. Furthermore, to minimize the post halftone noise, the halftone structure of the image is manipulated according to the neighboring sub-cells in their respective channels. This is done to reduce the brightness variation (a cause for noise) between the neighboring subcells. Experimental results show that the proposed algorithm efficiently minimizes noise in flat regions of mirumal gradient change in color images