GRASS: Generative Recursive Autoencoders for Shape Structures

We introduce a novel neural network architecture for encoding and synthesis of 3D shapes, particularly their structures. Our key insight is that 3D shapes are effectively characterized by their hierarchical organization of parts, which reflects fundamental intra-shape relationships such as adjacency and symmetry. We develop a recursive neural net (RvNN) based autoencoder to map a flat, unlabeled, arbitrary part layout to a compact code. The code effectively captures hierarchical structures of man-made 3D objects of varying structural complexities despite being fixed-dimensional: an associated decoder maps a code back to a full hierarchy. The learned bidirectional mapping is further tuned using an adversarial setup to yield a generative model of plausible structures, from which novel structures can be sampled. Finally, our structure synthesis framework is augmented by a second trained module that produces fine-grained part geometry, conditioned on global and local structural context, leading to a full generative pipeline for 3D shapes. We demonstrate that without supervision, our network learns meaningful structural hierarchies adhering to perceptual grouping principles, produces compact codes which enable applications such as shape classification and partial matching, and supports shape synthesis and interpolation with significant variations in topology and geometry.Comment: Corresponding author: Kai Xu ([email protected]

Shape theory and mathematical design of a general geometric kernel through regular stratified objects

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.This dissertation focuses on the mathematical design of a unified shape kernel for geometric computing, with possible applications to computer aided design (CAM) and manufacturing (CAM), solid geometric modelling, free-form modelling of curves and surfaces, feature-based modelling, finite element meshing, computer animation, etc. The generality of such a unified shape kernel grounds on a shape theory for objects in some Euclidean space. Shape does not mean herein only geometry as usual in geometric modelling, but has been extended to other contexts, e. g. topology, homotopy, convexity theory, etc. This shape theory has enabled to make a shape analysis of the current geometric kernels. Significant deficiencies have been then identified in how these geometric kernels represent shapes from different applications. This thesis concludes that it is possible to construct a general shape kernel capable of representing and manipulating general specifications of shape for objects even in higher-dimensional Euclidean spaces, regardless whether such objects are implicitly or parametrically defined, they have ‘incomplete boundaries’ or not, they are structured with more or less detail or subcomplexes, which design sequence has been followed in a modelling session, etc. For this end, the basic constituents of such a general geometric kernel, say a combinatorial data structure and respective Euler operators for n-dimensional regular stratified objects, have been introduced and discussed

Modeling and Inverse Controller Design for an Unmanned Aerial Vehicle Based on the Self-Organizing Map

The next generation of aircraft will have dynamics that vary considerably over the operating regime. A single controller will have difficulty to meet the design specifications. In this paper, a SOM-based local linear modeling scheme of an unmanned aerial vehicle (UAV) is developed to design a set of inverse controllers. The SOM selects the operating regime depending only on the embedded output space information and avoids normalization of the input data. Each local linear model is associated with a linear controller, which is easy to design. Switching of the controllers is done synchronously with the active local linear model that tracks the different operating conditions. The proposed multiple modeling and control strategy has been successfully tested in a simulator that models the LoFLYTE UAV