2D and 3D surface image processing algorithms and their applications

This doctoral dissertation work aims to develop algorithms for 2D image segmentation application of solar filament disappearance detection, 3D mesh simplification, and 3D image warping in pre-surgery simulation. Filament area detection in solar images is an image segmentation problem. A thresholding and region growing combined method is proposed and applied in this application. Based on the filament area detection results, filament disappearances are reported in real time. The solar images in 1999 are processed with this proposed system and three statistical results of filaments are presented. 3D images can be obtained by passive and active range sensing. An image registration process finds the transformation between each pair of range views. To model an object, a common reference frame in which all views can be transformed must be defined. After the registration, the range views should be integrated into a non-redundant model. Optimization is necessary to obtain a complete 3D model. One single surface representation can better fit to the data. It may be further simplified for rendering, storing and transmitting efficiently, or the representation can be converted to some other formats. This work proposes an efficient algorithm for solving the mesh simplification problem, approximating an arbitrary mesh by a simplified mesh. The algorithm uses Root Mean Square distance error metric to decide the facet curvature. Two vertices of one edge and the surrounding vertices decide the average plane. The simplification results are excellent and the computation speed is fast. The algorithm is compared with six other major simplification algorithms. Image morphing is used for all methods that gradually and continuously deform a source image into a target image, while producing the in-between models. Image warping is a continuous deformation of a: graphical object. A morphing process is usually composed of warping and interpolation. This work develops a direct-manipulation-of-free-form-deformation-based method and application for pre-surgical planning. The developed user interface provides a friendly interactive tool in the plastic surgery. Nose augmentation surgery is presented as an example. Displacement vector and lattices resulting in different resolution are used to obtain various deformation results. During the deformation, the volume change of the model is also considered based on a simplified skin-muscle model

Fast Simulation of Skin Sliding

Skin sliding is the phenomenon of the skin moving over underlying layers of fat, muscle and bone. Due to the complex interconnections between these separate layers and their differing elasticity properties, it is difficult to model and expensive to compute. We present a novel method to simulate this phenomenon at real--time by remeshing the surface based on a parameter space resampling. In order to evaluate the surface parametrization, we borrow a technique from structural engineering known as the force density method which solves for an energy minimizing form with a sparse linear system. Our method creates a realistic approximation of skin sliding in real--time, reducing texture distortions in the region of the deformation. In addition it is flexible, simple to use, and can be incorporated into any animation pipeline

Robust Algorithms for Registration of 3D Images of Human Brain

This thesis is concerned with the process of automatically aligning 3D medical images of human brain. It concentrates on rigid-body matching of Positron Emission Tomography images (PET) and Magnetic Resonance images (MR) within one patient and on non-linear matching of PET images of different patients. In recent years, mutual information has proved to be an excellent criterion for automatic registration of intra-individual images from different modalities. We propose and evaluate a method that combines a multi-resolution optimization of mutual information with an efficient segmentation of background voxels and a modified principal axes algorithm. We show that an acceleration factor of 6-7 can be achieved without loss of accuracy and that the method significantly reduces the rate of unsuccessful registrations. Emphasis was also laid on creation of an automatic registration system that could be used routinely in clinical environment. Non-linear registration tries to reduce the inter-individual variability of shape and structure between two brain images by deforming one image so that homologous regions in both images get aligned. It is an important step of many procedures in medical image processing and analysis. We present a novel algorithm for an automatic non-linear registration of PET images based on hierarchical volume subdivisions and local affine optimizations. It produces a C2-continuous deformation function and guarantees that the deformation is one-to-one. Performance of the algorithm was evaluated on more than 600 clinical PET images

Adaptive parameterization for Aerodynamic Shape Optimization in Aeronautical Applications

Cílem mé disertační práce je analyzovat a vyvinout parametrizační metodu pro 2D a 3D tvarové optimalizace v kontextu průmyslového aerodynamického návrhu letounu založeném na CFD simulacích. Aerodynamická tvarová optimalizace je efektivní nástroj, který si klade za cíl snížení nákladů na návrh letounů. Nástroj založený na automatickém hledání optimálního tvaru. Klíčovou částí úspěšného optimalizačního procesu je použití vhodné parametrizační metody, metody schopné garantovat možnost dosažení optimálního tvaru. Parametrizační metody obecně používané v oblasti aerodynamické tvarové optimalizace momentálně nejsou připravený na komplikované průmyslové aplikace vyskytující se u moderních dopravních letounů, které mají šípová zalomená křídla s winglety a motorovými gondolami, přechodové prvky spojující např. trup s křídlem atd.. Existuje tedy potřeba nalezení obecné parametrizační metody, která bude aplikovatelná na širokou škálu různých geometrických tvarů. Free-Form Deformation (FFD[1]) parametrizace může, vzhledem ke svým schopnostem při zacházení s geometrií, být odpovědí na tuto potřebu. Adaptivní parametrizace by se měla být schopna automaticky přizpůsobit danému tvaru tak, aby byly její kontrolní body vhodně rozmístěny. Což umožní dostatečnou kontrolu deformací objektu, která zaručí možnost vytvoření optimálního tvaru objektu a splnění geometrických omezení. Primární aplikací takové parametrizační metody je deformace tvaru objektu. Dalším navrhovaným cílem je modifikace FFD parametrizační metody pro současné deformace tvaru objektu a CFD výpočetní sítě, umožnující velké deformace objektu při zachování kvality výpočetní sítě.The goal of this doctoral thesis is to analyze and develop parameterization algorithms for 2D and 3D shape optimization in the context of industrial aircraft aerodynamic design based on simulations with CFD. Aerodynamic shape optimization is an efficient tool that aims at reducing the cost of the process of aircraft design. A tool that is based on automatization of the search for the optimum shape. Key part of successful aerodynamic shape optimization is the use of appropriate parameterization method, a method that should guarantee the possibility of reaching optimum shape. The parameterization methods used in aerodynamic shape optimizations are still not ready for complex industrial applications, which are present on modern passenger aircrafts with swept cranked wings with winglets and engine pylons, fuselage-wing interactions etc. So there is a need for general parameterization method that applies on wide variety of different geometries.The Free-Form Deformation (FFD[1]) parameterization can, thanks to its geometry handling qualities, be the answer to this need. Adaptive parameterization should automatically modify parameterization grid (lattice) to get appropriate lattice in regions of interest. Such that will allow sufficient control of deformations of the object with respect to reaching optimum shape and fulfilling optimization constraints. First application is in the surface deformation. The other proposed goal is development of the FFD parameterization that can do both surface deformations and CFD mesh deformations, while enabling large object deformations and preserving the level of mesh quality during the process.

A Survey of Morphing Techniques

Image morphing provides the tool to generate the flexible and powerful visual effect. Morphing depicts the transformation of one image into another image. The process of image morphing starts with the feature specification phase and then proceeds to warp generation phase, followed by the transition control phase. This paper surveys the various techniques available for all three stages of image morphing

Mesh modification using deformation gradients

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2005.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Includes bibliographical references (p. 117-131).Computer-generated character animation, where human or anthropomorphic characters are animated to tell a story, holds tremendous potential to enrich education, human communication, perception, and entertainment. However, current animation procedures rely on a time consuming and difficult process that requires both artistic talent and technical expertise. Despite the tremendous amount of artistry, skill, and time dedicated to the animation process, there are few techniques to help with reuse. Although individual aspects of animation are well explored, there is little work that extends beyond the boundaries of any one area. As a consequence, the same procedure must be followed for each new character without the opportunity to generalize or reuse technical components. This dissertation describes techniques that ease the animation process by offering opportunities for reuse and a more intuitive animation formulation. A differential specification of arbitrary deformation provides a general representation for adapting deformation to different shapes, computing semantic correspondence between two shapes, and extrapolating natural deformation from a finite set of examples.(cont.) Deformation transfer adds a general-purpose reuse mechanism to the animation pipeline by transferring any deformation of a source triangle mesh onto a different target mesh. The transfer system uses a correspondence algorithm to build a discrete many-to-many mapping between the source and target triangles that permits transfer between meshes of different topology. Results demonstrate retargeting both kinematic poses and non-rigid deformations, as well as transfer between characters of different topological and anatomical structure. Mesh-based inverse kinematics extends the idea of traditional skeleton-based inverse kinematics to meshes by allowing the user to pose a mesh via direct manipulation. The user indicates the dass of meaningful deformations by supplying examples that can be created automatically with deformation transfer, sculpted, scanned, or produced by any other means. This technique is distinguished from traditional animation methods since it avoids the expensive character setup stage. It is distinguished from existing mesh editing algorithms since the user retains the freedom to specify the class of meaningful deformations. Results demonstrate an intuitive interface for posing meshes that requires only a small amount of user effort.by Robert Walker Sumner.Ph.D

Mean value coordinates–based caricature and expression synthesis

We present a novel method for caricature synthesis based on mean value coordinates (MVC). Our method can be applied to any single frontal face image to learn a specified caricature face pair for frontal and 3D caricature synthesis. This technique only requires one or a small number of exemplar pairs and a natural frontal face image training set, while the system can transfer the style of the exemplar pair across individuals. Further exaggeration can be fulfilled in a controllable way. Our method is further applied to facial expression transfer, interpolation, and exaggeration, which are applications of expression editing. Additionally, we have extended our approach to 3D caricature synthesis based on the 3D version of MVC. With experiments we demonstrate that the transferred expressions are credible and the resulting caricatures can be characterized and recognized

A Survey of Spatial Deformation from a User-Centered Perspective

The spatial deformation methods are a family of modeling and animation techniques for indirectly reshaping an object by warping the surrounding space, with results that are similar to molding a highly malleable substance. They have the virtue of being computationally efficient (and hence interactive) and applicable to a variety of object representations. In this paper we survey the state of the art in spatial deformation. Since manipulating ambient space directly is infeasible, deformations are controlled by tools of varying dimension - points, curves, surfaces and volumes - and it is on this basis that we classify them. Unlike previous surveys that concentrate on providing a single underlying mathematical formalism, we use the user-centered criteria of versatility, ease of use, efficiency and correctness to compare techniques

Métamorphose de maillage 3D

Cette thèse de doctorat aborde spécifiquement le problème de la métamorphose entre différents maillages 3D, qui peut assurer un niveau élevé de qualité pour la séquence de transition, qui devrait être aussi lisse et progressive que possible, cohérente par rapport à la géométrie et la topologie, et visuellement agréable. Les différentes étapes impliquées dans le processus de transformation sont développées dans cette thèse. Nos premières contributions concernent deux approches différentes des paramétrisations: un algorithme de mappage barycentrique basé sur la préservation des rapports de longueur et une technique de paramétrisation sphérique, exploitant la courbure Gaussien. L'évaluation expérimentale, effectuées sur des modèles 3D de formes variées, démontré une amélioration considérable en termes de distorsion maillage pour les deux méthodes. Afin d aligner les caractéristiques des deux modèles d'entrée, nous avons considéré une technique de déformation basée sur la fonction radial CTPS C2a approprié pour déformer le mappage dans le domaine paramétrique et maintenir un mappage valide a travers le processus de mouvement. La dernière contribution consiste d une une nouvelle méthode qui construit un pseudo metamaillage qui évite l'exécution et le suivi des intersections d arêtes comme rencontrées dans l'état-of-the-art. En outre, notre méthode permet de réduire de manière drastique le nombre de sommets normalement nécessaires dans une structure supermesh. Le cadre générale de métamorphose a été intégré dans une application prototype de morphing qui permet à l'utilisateur d'opérer de façon interactive avec des modèles 3D et de contrôler chaque étape du processusThis Ph.D. thesis specifically deals with the issue of metamorphosis of 3D objects represented as 3D triangular meshes. The objective is to elaborate a complete 3D mesh morphing methodology which ensures high quality transition sequences, smooth and gradual, consistent with respect to both geometry and topology, and visually pleasant. Our first contributions concern the two different approaches of parameterization: a new barycentric mapping algorithm based on the preservation of the mesh length ratios, and a spherical parameterization technique, exploiting a Gaussian curvature criterion. The experimental evaluation, carried out on 3D models of various shapes, demonstrated a considerably improvement in terms of mesh distortion for both methods. In order to align the features of the two input models, we have considered a warping technique based on the CTPS C2a radial basis function suitable to deform the models embeddings in the parametric domain maintaining a valid mapping through the entire movement process. We show how this technique has to be adapted in order to warp meshes specified in the parametric domains. A final contribution consists of a novel algorithm for constructing a pseudo-metamesh that avoids the complex process of edge intersections encountered in the state-of-the-art. The obtained mesh structure is characterized by a small number of vertices and it is able to approximate both the source and target shapes. The entire mesh morphing framework has been integrated in an interactive application that allows the user to control and visualize all the stages of the morphing processEVRY-INT (912282302) / SudocSudocFranceF