A Survey of Spatial Deformation from a User-Centered Perspective

The spatial deformation methods are a family of modeling and animation techniques for indirectly reshaping an object by warping the surrounding space, with results that are similar to molding a highly malleable substance. They have the virtue of being computationally efficient (and hence interactive) and applicable to a variety of object representations. In this paper we survey the state of the art in spatial deformation. Since manipulating ambient space directly is infeasible, deformations are controlled by tools of varying dimension - points, curves, surfaces and volumes - and it is on this basis that we classify them. Unlike previous surveys that concentrate on providing a single underlying mathematical formalism, we use the user-centered criteria of versatility, ease of use, efficiency and correctness to compare techniques

Methods for 3D Geometry Processing in the Cultural Heritage Domain

This thesis presents methods for 3D geometry processing under the aspects of cultural heritage applications. After a short overview over the relevant basics in 3D geometry processing, the present thesis investigates the digital acquisition of 3D models. A particular challenge in this context are on the one hand difficult surface or material properties of the model to be captured. On the other hand, the fully automatic reconstruction of models even with suitable surface properties that can be captured with Laser range scanners is not yet completely solved. This thesis presents two approaches to tackle these challenges. One exploits a thorough capture of the object’s appearance and a coarse reconstruction for a concise and realistic object representation even for objects with problematic surface properties like reflectivity and transparency. The other method concentrates on digitisation via Laser-range scanners and exploits 2D colour images that are typically recorded with the range images for a fully automatic registration technique. After reconstruction, the captured models are often still incomplete, exhibit holes and/or regions of insufficient sampling. In addition to that, holes are often deliberately introduced into a registered model to remove some undesired or defective surface part. In order to produce a visually appealing model, for instance for visualisation purposes, for prototype or replica production, these holes have to be detected and filled. Although completion is a well-established research field in 2D image processing and many approaches do exist for image completion, surface completion in 3D is a fairly new field of research. This thesis presents a hierarchical completion approach that employs and extends successful exemplar-based 2D image processing approaches to 3D and fills in detail-equipped surface patches into missing surface regions. In order to identify and construct suitable surface patches, selfsimilarity and coherence properties of the surface context of the hole are exploited. In addition to the reconstruction and repair, the present thesis also investigates methods for a modification of captured models via interactive modelling. In this context, modelling is regarded as a creative process, for instance for animation purposes. On the other hand, it is also demonstrated how this creative process can be used to introduce human expertise into the otherwise automatic completion process. This way, reconstructions are feasible even of objects where already the data source, the object itself, is incomplete due to corrosion, demolition, or decay.Methoden zur 3D-Geometrieverarbeitung im Kulturerbesektor In dieser Arbeit werden Methoden zur Bearbeitung von digitaler 3D-Geometrie unter besonderer Berücksichtigung des Anwendungsbereichs im Kulturerbesektor vorgestellt. Nach einem kurzen Überblick über die relevanten Grundlagen der dreidimensionalen Geometriebehandlung wird zunächst die digitale Akquise von dreidimensionalen Objekten untersucht. Eine besondere Herausforderung stellen bei der Erfassung einerseits ungünstige Oberflächen- oder Materialeigenschaften der Objekte dar (wie z.B. Reflexivität oder Transparenz), andererseits ist auch die vollautomatische Rekonstruktion von solchen Modellen, die sich verhältnismäßig problemlos mit Laser-Range Scannern erfassen lassen, immer noch nicht vollständig gelöst. Daher bilden zwei neuartige Verfahren, die diesen Herausforderungen begegnen, den Anfang. Auch nach der Registrierung sind die erfassten Datensätze in vielen Fällen unvollständig, weisen Löcher oder nicht ausreichend abgetastete Regionen auf. Darüber hinaus werden in vielen Anwendungen auch, z.B. durch Entfernen unerwünschter Oberflächenregionen, Löcher gewollt hinzugefügt. Für eine optisch ansprechende Rekonstruktion, vor allem zu Visualisierungszwecken, im Bildungs- oder Unterhaltungssektor oder zur Prototyp- und Replik-Erzeugung müssen diese Löcher zunächst automatisch detektiert und anschließend geschlossen werden. Obwohl dies im zweidimensionalen Fall der Bildbearbeitung bereits ein gut untersuchtes Forschungsfeld darstellt und vielfältige Ansätze zur automatischen Bildvervollständigung existieren, ist die Lage im dreidimensionalen Fall anders, und die Übertragung von zweidimensionalen Ansätzen in den 3D stellt vielfach eine große Herausforderung dar, die bislang keine zufriedenstellenden Lösungen erlaubt hat. Nichtsdestoweniger wird in dieser Arbeit ein hierarchisches Verfahren vorgestellt, das beispielbasierte Konzepte aus dem 2D aufgreift und Löcher in Oberflächen im 3D unter Ausnutzung von Selbstähnlichkeiten und Kohärenzeigenschaften des Oberflächenkontextes schließt. Um plausible Oberflächen zu erzeugen werden die Löcher dabei nicht nur glatt gefüllt, sondern auch feinere Details aus dem Kontext rekonstruiert. Abschließend untersucht die vorliegende Arbeit noch die Modifikation der vervollständigten Objekte durch Freiformmodellierung. Dies wird dabei zum einen als kreativer Prozess z.B. zu Animationszwecken betrachtet. Zum anderen wird aber auch untersucht, wie dieser kreative Prozess benutzt werden kann, um etwaig vorhandenes Expertenwissen in die ansonsten automatische Vervollständigung mit einfließen zu lassen. Auf diese Weise werden auch Rekonstruktionen ermöglicht von Objekten, bei denen schon die Datenquelle, also das Objekt selbst z.B. durch Korrosion oder mutwillige Zerstörung unvollständig ist

Shape variation modelling, analysis and statistical control for assembly system with compliant parts

Modern competitive market demands frequent change in product variety, increased production volume and shorten product/process change over time. These market requirements point towards development of key enabling technologies (KETs) to shorten product and process development cycle, improved production quality and reduced time-to-launch. One of the critical prerequisite to develop the aforementioned KETs is efficient and accurate modelling of product and process dimensional errors. It is especially critical for assembly processes with compliant parts as used in automotive body, appliance or wing and fuselage assemblies. Currently, the assembly process is designed under the assumption of ideal (nominal) products and then check by using variation simulation analysis (VSA). However, the VSA simulations are oversimplified as they are unable to accurately model or predict the effects of geometric and dimensional variations of compliant parts, as well as variations of key characteristics related to fixturing and joining process. This results in product failures and/or reduced quality due to un-modelled interactions in assembly process. Therefore, modelling and prediction of the geometric shape errors of complex sheet metal parts are of tremendous importance for many industrial applications. Further, as production yield and product quality are determined for production volume of real parts, thus not only shape errors but also shape variation model is required for robust assembly system development. Currently, parts shape variation can be measured during production by using recently introduced non-contact gauges which are fast, in-line and can capture entire part surface information. However, current applications of non-contact scanners are limited to single part inspection or reverse engineering applications and cannot be used for monitoring and statistical process control of shape variation. Further, the product shape variation can be reduced through appropriate assembly fixture design. Current approaches for assembly fixture design seldom consider shape variation of production parts during assembly process which result in poor quality and yield. To address the aforementioned challenges, this thesis proposes the following two enablers focused on modelling of shape errors and shape variation of compliant parts applicable during assembly process design phase as well as production phase: (i) modelling and characterisation of shape errors of individual compliant part with capabilities to quantify fabrication errors at part level; and (ii) modelling and characterisation of shape variation of a batch of compliant parts with capabilities to quantify the shape variation at production level. The first enabler focuses on shape errors modelling and characterisation which includes developing a functional data analysis model for identification and characterisation of real part shape errors that can link design (CAD model) with manufacturing (shape errors). A new functional data analysis model, named Geometric Modal Analysis (GMA), is proposed to extract dominant shape error xixmodes from the fabricated part measurement data. This model is used to decompose shape errors of 3D sheet metal part into orthogonal shape error modes which can be used for product and process interactions. Further, the enabler can be used for statistical process control to monitor shape quality; fabrication process mapping and diagnosis; geometric dimensioning and tolerancing simulation with free form shape errors; or compact storage of shape information. The second enabler aims to model and characterise shape variation of a batch of compliant parts by extending the GMA approach. The developed functional model called Statistical Geometric Modal Analysis (SGMA) represents the statistical shape variation through modal characteristics and quantifies shape variation of a batch of sheet metal parts a single or a few composite parts. The composite part(s) represent major error modes induced by the production process. The SGMA model, further, can be utilised for assembly fixture optimisation, tolerance analysis and synthesis. Further, these two enablers can be applied for monitoring and reduction of shape variation from assembly process by developing: (a) efficient statistical process control technique (based on enabler ‘i’) to monitor part shape variation utilising the surface information captured using non-contact scanners; and (b) efficient assembly fixture layout optimisation technique (based on enabler ‘ii’) to obtain improved quality products considering shape variation of production parts. Therefore, this thesis proposes the following two applications: The first application focuses on statistical process control of part shape variation using surface data captured by in-process or off-line scanners as Cloud-of-Points (CoPs). The methodology involves obtaining reduced set of statistically uncorrelated and independent variables from CoPs (utilising GMA method) which are then used to develop integrated single bivariate T2-Q monitoring chart. The joint probability density estimation using non-parametric Kernel Density Estimator (KDE) has enhanced sensitivity to detect part shape variation. The control chart helps speedy detection of part shape errors including global or local shape defects. The second application determines optimal fixture layout considering production batch of compliant sheet metal parts. Fixtures control the position and orientation of parts in an assembly process and thus significantly contribute to process capability that determines production yield and product quality. A new approach is proposed to improve the probability of joining feasibility index by determining an N-2-1 fixture layout optimised for a production batch. The SGMA method has been utilised for fixture layout optimisation considering a batch of compliant sheet metal parts. All the above developed methodologies have been validated and verified with industrial case studies of automotive sheet metal door assembly process. Further, they are compared with state-of-the-art methodologies to highlight the boarder impact of the research work to meet the increasing market requirements such as improved in-line quality and increased productivity

Simulación dinámica y deformaciones de superfícies paramétricas

Se desarrolla un modelo basado en NURBS, BSplines4D, de representación de superficies parametrizadas en 4D. El objetivo es la representación y simulación dinámica de superficies deformables basadas en el modelo; se realiza un estudio de las ecuaciones del movimiento, asociando un funcional de energía para medir la deformación de objetos, realizando un estudio riguroso sobre los métodos de integración y de discretización, tanto temporal como espacial, determinando su adecuación para resolver el sistema de ecuaciones diferenciales generado. El movimiento y la simulación de la deformación se realizan exclusivamente usando los puntos de control 4D, obteniendo una eficiencia numérica y computacional excelentes. La determinación del modelo BSplines4D se realiza tras un estudio pormenorizado de los modelos existentes. También se ha utilizado para desarrollar un modelo, N-Scodef, de deformaciones de formas libres (FFD), utilizando deformaciones geométricas basadas en restricciones. Se han establecido las condiciones para aplicar restricciones con trayectorias no rectilíneas, representadas por curvas B-Spline 4D. La deformación se adapta de forma precisa a la forma descrita por las curvasEs desenvolupa un model basat en NURBS, Bsplines4D, de representació de superfícies parametritzades en 4D. L'objectiu és la representació i simulació dinàmica de superfícies deformables basades en el model; es realitza un estudi de les equacions del moviment, associant un funcional d'energia per mesurar la deformació d'objectes, realitzant un estudi rigorós sobre els mètodes d'integració i discretització, tant temporal com espacial, determinant la seva adequació per resoldre el sistema d'equacions diferencials generat. El moviment i la simulació de la deformació es realitzen exclusivament utilitzant els punts de control 4D, obtenint una eficiència numèrica i computacional excel·lents. La determinació del model Bsplines4D es realitza després d'un estudi detallat dels models existents. També s'ha utilitzat per desenvolupar un model, N-Scodef, de deformacions de formes lliures (FFD), utilitzant deformacions geomètriques basades en restriccions. S'han establert les condicions per aplicar restriccions amb trajectòries no rectilínies, representades per corbes B-Spline 4D. La deformació s'adapta de forma precisa a la forma descrita per les corbesBsplines4D, a NURBS based model, is presented. The model allows the representation of 4D parameterized surfaces. The objective is the representation and dynamic simulation of deformable surfaces based on this model; a study of the movement equations has been made, associating to them an energy functional to measure the objects' deformation. A rigorous study on the integration and discretization, both temporal and spatial, is made to evaluate its suitability to solve the system of differential equations generated. The movement and simulation of the deformation is performed only using the 4D control points. An excellent numeric and computational efficiency is achieved. The Bsplines4D model is obtained after a detailed study on the existent models. The model has been also used to develop a free-form deformable (FFD) model, N-Scodef, using geometric constraint-based deformations. The conditions to apply constraints with non rectilinear trajectories, based on 4D B-Spline curves, have been established. The deformations fit precisely to the curves form