Representation Learning for Shape Decomposition, By Shape Decomposition

The ability to parse 3D objects into their constituent parts is essential for humans to understand and interact with the surrounding world. Imparting this skill in machines is important for various computer graphics, computer vision, and robotics tasks. Machines endowed with this skill can better interact with its surroundings, perform shape editing, texturing, recomposing, tracking, and animation. In this thesis, we ask two questions. First, how can machines decompose 3D shapes into their fundamental parts? Second, does the ability to decompose the 3D shape into these parts help learn useful 3D shape representations? In this thesis, we focus on parsing the shape into compact representations, such as parametric surface patches and Constructive Solid Geometry (CSG) primitives, which are also widely used representations in 3D modeling in computer graphics. Inspired by the advances in neural networks for 3D shape processing, we develop neural network approaches to tackle shape decomposition. First, we present CSGNet, a network architecture to parse shapes into CSG programs, which is trained using combination of supervised and reinforcement learning. Second, we present ParSeNet, a network architecture to decompose a shape into parametric surface patches (B-Spline) and geometric primitives (plane, cone, cylinder and sphere), trained on a large set of CAD models using supervised learning. The training of deep neural network architectures for 3D recognition and generation tasks requires a large amount of labeled datasets. We explore ways to alleviate this problem by relying on shape decomposition methods to guide the learning process. Towards that end, we first study the use of freely available metadata, albeit inconsistent, from shape repositories to learn 3D shape features. Later we show that learning to decompose a 3D shape into geometric primitives also helps in learning shape representations useful for semantic segmentation tasks. Finally, since most 3D shapes encountered in real life are textured, consisting of several fine-grained semantic parts, we propose a method to learn fine-grained representations for textured 3D shapes in a self-supervised manner by incorporating 3D geometric priors

Nonrigid reconstruction of 3D breast surfaces with a low-cost RGBD camera for surgical planning and aesthetic evaluation

Accounting for 26% of all new cancer cases worldwide, breast cancer remains the most common form of cancer in women. Although early breast cancer has a favourable long-term prognosis, roughly a third of patients suffer from a suboptimal aesthetic outcome despite breast conserving cancer treatment. Clinical-quality 3D modelling of the breast surface therefore assumes an increasingly important role in advancing treatment planning, prediction and evaluation of breast cosmesis. Yet, existing 3D torso scanners are expensive and either infrastructure-heavy or subject to motion artefacts. In this paper we employ a single consumer-grade RGBD camera with an ICP-based registration approach to jointly align all points from a sequence of depth images non-rigidly. Subtle body deformation due to postural sway and respiration is successfully mitigated leading to a higher geometric accuracy through regularised locally affine transformations. We present results from 6 clinical cases where our method compares well with the gold standard and outperforms a previous approach. We show that our method produces better reconstructions qualitatively by visual assessment and quantitatively by consistently obtaining lower landmark error scores and yielding more accurate breast volume estimates

An integrated magnetic susceptibility anisotropy (AMS) and structural geological study on Cenozoic clay rich sediments from the Transdanubian Range

Systematic structural and anisotropy of magnetic susceptibility (AMS) measurements were carried out on Cenozoic clay rich deposits from the Transdanubian Range, central part of the Alcapa Unit. The aim was to improve the knowledge on the Neogene tectonic evolution of the area and on the connection of the stress field and the magnetic fabric of the sediments. The measurements of AMS revealed dominant foliation with weak lineation for Middle Eocene-Lower Miocene sediments. The directions of AMS lineation are aligned either with the direction of NNE-SSW extension of a strike slip phase (30–19 Ma) or with the direction of NE-SW extension of the main rifting phase of the Pannonian Basin (19–14 Ma). The studied Late Miocene sediments have foliated AMS fabric, maximum and intermediate AMS directions are intermixed, and the AMS fabrics do not show any sign of tectonic deformation. In contrast, joints and faults were observed in the same rocks. Detailed structural analysis shows two extensional phases between ca. 10-4 Ma, with E-W to WNW-ESE and with NW-SE extension, respectively and the youngest neotectonic strike-slip phase. The contrast between the presence of markers of brittle deformation and the absence of tectonically induced AMS lineation is striking, since the same types of sediments in the South Pannonian basin show just the opposite. The explanation may be that northward moving and CCW rotating Adria caused strong compression in the southern Pannonian basin, resulting in ductile deformation of the clay-rich sediments and systematic reorganization of AMS texture while in our study area sediments of similar character and age were at a larger distance from the strongly deforming basin part

Strain Accommodation, Metamorphic Evolution, And 3d Kinematics Of Transpressional Flow Within The Lower Crust Of A Cretaceous Magmatic Arc In Fiordland, New Zealand

The George Sound Shear Zone (GSSZ) exposed in Bligh Sound within Fiordland, New Zealand allowed us to reconstruct the kinematics of transpressive flow in \u3e100 km2 of exhumed Cretaceous lower crust. We compare the three-dimensional characteristics of the deformation to theoretical models of transpression that assume steady-state flow in a homogeneous medium. This assumption is rarely the case for shear zones that experience metamorphism during deformation. We determined the three-dimensional kinematics of the GSSZ and evaluated the effects of metamorphism on strain accommodation and structural fabric evolution in the GSSZ to determine if metamorphism is an important parameter that transpressional models should account for. We found that metamorphism aided strain localization within the GSSZ and resulted in a style of structural fabric development that deviates from predictions made by theoretical models. We used foliation and lineation orientation data and field observations to determine GSSZ kinematics. Asymmetric pyroxene σ-porphyroclasts and hornblende fish show top-down-to-the-SW apparent normal shear sense with a sinistral component. The Z-axes of oblate SPO ellipsoids define the vorticity normal section and the moderately WNW-plunging vorticity vector. Foliation deflections relative to the shear zone boundaries yielded a vorticity magnitude (Wk) of ≥0.8. Our kinematic results suggest that the GSSZ records inclined, triclinic transpression with sinistral, top-down-to-the-SW simple shear-dominated flow. We used finite strain analysis and petrographic analysis to determine that metamorphism influences strain accommodation. Finite strain analyses were performed in 3D on 16 samples using the Rf/ɸ, Fry, and Intercept methods to determine the SPO fabric ellipsoids at different stages of deformation. Petrographic analysis was performed to identify metamorphic reactions using syn-kinematic minerals and constrain deformational temperatures using deformation mechanisms of plagioclase. Early deformation formed a ~13 km wide prolate fabric at granulite facies. Deformation later localized into a ~2-4.6 km wide oblate, mylonitic fabric at upper amphibolite facies. This fabric cross-cuts the prolate fabric and is characterized by metamorphic hornblende and biotite produced from retrogressive hydration reactions. Samples with syn-kinematic biotite contain more shear bands and display more grain size reduction of plagioclase than samples without this phase, suggesting these samples may have accommodated more strain. Changes in syn-kinematic metamorphic minerals were accompanied by steepening of stretching lineations and by changes in foliation orientation. Our analyses show that retrogressive hydration metamorphism aided strain localization within a cross-cutting oblate fabric, and the uneven distribution of biotite within this domain potentially influenced along strike variation in strain magnitude and fabric ellipsoid symmetry. Our results highlight the influence of fluid-induced metamorphism on shear zone evolution and call for new transpressional models to incorporate changes in rheology due to syn-kinematic metamorphism