Artistic vision: painterly rendering using computer vision techniques

Journal ArticleWe present a method that takes a raster image as input and produces a painting-like image composed of strokes rather than pixels. Unlike previous automatic painting methods, we attempt to keep the number of brush-stroke small. This is accomplished by first segmenting the image into features, finding the medial axes points of these features, converting the medial axes points into ordered lists of image tokens, and finally rendering these lists as brush strokes. Our process creates images reminiscent of modern realist painters who often want an abstract or sketchy quality in their work

Multi-Dimensional Medial Geometry: Formulation, Computation, and Applications

Medial axis is a classical shape descriptor. It is a piece of geometry that lies in the middle of the original shape. Compared to the original shape representation, the medial axis is always one dimension lower and it carries many intrinsic shape properties explicitly. Therefore, it is widely used in a large amount of applications in various fields. However, medial axis is unstable to the boundary noise, often referred to as its instability. A small amount of change on the object boundary can cause a dramatic change in the medial axis. To tackle this problem, a significance measure is often associated with the medial axis, so that medial points with small significance are removed and only the stable part remains. In addition to this problem, many applications prefer even lower dimensional medial forms, e.g., shape centers of 2D shapes, and medial curves of 3D shapes. Unfortunately, good significance measures and good definitions of lower dimensional medial forms are still lacking. In this dissertation, we extended Blum\u27s grassfire burning to the medial axis in both 2D and 3D to define a significance measure as a distance function on the medial axis. We show that this distance function is well behaved and it has nice properties. In 2D, we also define a shape center based on this distance function. We then devise an iterative algorithm to compute the distance function and the shape center. We demonstrate usefulness of this distance function and shape center in various applications. Finally we point out the direction for future research based on this dissertation

Medial Axis Approximation and Regularization

Medial axis is a classical shape descriptor. Among many good properties, medial axis is thin, centered in the shape, and topology preserving. Therefore, it is constantly sought after by researchers and practitioners in their respective domains. However, two barriers remain that hinder wide adoption of medial axis. First, exact computation of medial axis is very difficult. Hence, in practice medial axis is approximated discretely. Though abundant approximation methods exist, they are either limited in scalability, insufficient in theoretical soundness, or susceptible to numerical issues. Second, medial axis is easily disturbed by small noises on its defining shape. A majority of current works define a significance measure to prune noises on medial axis. Among them, local measures are widely available due to their efficiency, but can be either too aggressive or conservative. While global measures outperform local ones in differentiating noises from features, they are rarely well-defined or efficient to compute. In this dissertation, we attempt to address these issues with sound, robust and efficient solutions. In Chapter 2, we propose a novel medial axis approximation called voxel core. We show voxel core is topologically and geometrically convergent to the true medial axis. We then describe a straightforward implementation as a result of our simple definition. In a variety of experiments, our method is shown to be efficient and robust in delivering topological promises on a wide range of shapes. In Chapter 3, we present Erosion Thickness (ET) to regularize instability. ET is the first global measure in 3D that is well-defined and efficient to compute. To demonstrate its usefulness, we utilize ET to generate a family of shape revealing and topology preserving skeletons. Finally, we point out future directions, and potential applications of our works in real world problems

Spline-based medial axis transform representation of binary images

Medial axes are well-known descriptors used for representing, manipulating, and compressing binary images. In this paper, we present a full pipeline for computing a stable and accurate piece-wise B-spline representation of Medial Axis Transforms (MATs) of binary images. A comprehensive evaluation on a benchmark shows that our method, called Spline-based Medial Axis Transform (SMAT), achieves very high compression ratios while keeping quality high. Compared with the regular MAT representation, the SMAT yields a much higher compression ratio at the cost of a slightly lower image quality. We illustrate our approach on a multi-scale SMAT representation, generating super-resolution images, and free-form binary image deformation

Symmetry sensitivities of Derivative-of-Gaussian filters

We consider the measurement of image structure using linear filters, in particular derivative-of-Gaussian (DtG) filters, which are an important model of V1 simple cells and widely used in computer vision, and whether such measurements can determine local image symmetry. We show that even a single linear filter can be sensitive to a symmetry, in the sense that specific responses of the filter can rule it out. We state and prove a necessary and sufficient, readily computable, criterion for filter symmetry-sensitivity. We use it to show that the six filters in a second order DtG family have patterns of joint sensitivity which are distinct for 12 different classes of symmetry. This rich symmetry-sensitivity adds to the properties that make DtG filters well-suited for probing local image structure, and provides a set of landmark responses suitable to be the foundation of a nonarbitrary system of feature categories

Robust and flexible multi-scale medial axis computation

The principle of the multi-scale medial axis (MMA) is important in that any object is detected at a blurring scale proportional to the size of the object. Thus it provides a sound balance between noise removal and preserving detail. The robustness of the MMA has been reflected in many existing applications in object segmentation, recognition, description and registration. This thesis aims to improve the computational aspects of the MMA. The MMA is obtained by computing ridges in a “medialness” scale-space derived from an image. In computing the medialness scale-space, we propose an edge-free medialness algorithm, the Concordance-based Medial Axis Transform (CMAT). It not only depends on the symmetry of the positions of boundaries, but also is related to the symmetry of the intensity contrasts at boundaries. Therefore it excludes spurious MMA branches arising from isolated boundaries. In addition, the localisation accuracy for the position and width of an object, as well as the robustness under noisy conditions, is preserved in the CMAT. In computing ridges in the medialness space, we propose the sliding window algorithm for extracting locally optimal scale ridges. It is simple and efficient in that it can readily separate the scale dimension from the search space but avoids the difficult task of constructing surfaces of connected maxima. It can extract a complete set of MMA for interfering objects in scale-space, e.g. embedded or adjacent objects. These algorithms are evaluated using a quantitative study of their performance for 1-D signals and qualitative testing on 2-D images

Doctor of Philosophy

dissertationThe medial axis of an object is a shape descriptor that intuitively presents the morphology or structure of the object as well as intrinsic geometric properties of the object’s shape. These properties have made the medial axis a vital ingredient for shape analysis applications, and therefore the computation of which is a fundamental problem in computational geometry. This dissertation presents new methods for accurately computing the 2D medial axis of planar objects bounded by B-spline curves, and the 3D medial axis of objects bounded by B-spline surfaces. The proposed methods for the 3D case are the first techniques that automatically compute the complete medial axis along with its topological structure directly from smooth boundary representations. Our approach is based on the eikonal (grassfire) flow where the boundary is offset along the inward normal direction. As the boundary deforms, different regions start intersecting with each other to create the medial axis. In the generic situation, the (self-) intersection set is born at certain creation-type transition points, then grows and undergoes intermediate transitions at special isolated points, and finally ends at annihilation-type transition points. The intersection set evolves smoothly in between transition points. Our approach first computes and classifies all types of transition points. The medial axis is then computed as a time trace of the evolving intersection set of the boundary using theoretically derived evolution vector fields. This dynamic approach enables accurate tracking of elements of the medial axis as they evolve and thus also enables computation of topological structure of the solution. Accurate computation of geometry and topology of 3D medial axes enables a new graph-theoretic method for shape analysis of objects represented with B-spline surfaces. Structural components are computed via the cycle basis of the graph representing the 1-complex of a 3D medial axis. This enables medial axis based surface segmentation, and structure based surface region selection and modification. We also present a new approach for structural analysis of 3D objects based on scalar functions defined on their surfaces. This approach is enabled by accurate computation of geometry and structure of 2D medial axes of level sets of the scalar functions. Edge curves of the 3D medial axis correspond to a subset of ridges on the bounding surfaces. Ridges are extremal curves of principal curvatures on a surface indicating salient intrinsic features of its shape, and hence are of particular interest as tools for shape analysis. This dissertation presents a new algorithm for accurately extracting all ridges directly from B-spline surfaces. The proposed technique is also extended to accurately extract ridges from isosurfaces of volumetric data using smooth implicit B-spline representations. Accurate ridge curves enable new higher-order methods for surface analysis. We present a new definition of salient regions in order to capture geometrically significant surface regions in the neighborhood of ridges as well as to identify salient segments of ridges

Computing global shape measures

Global shape measures are a convenient way to describe regions. They are generally simple and efficient to extract, and provide an easy means for high level tasks such as classification as well as helping direct low-level computer vision processes such as segmentation. In this chapter a large selection of global shape measures (some from the standard literature as well as other newer methods) are described and demonstrated