181 research outputs found
Learning SO(3) Equivariant Representations with Spherical CNNs
We address the problem of 3D rotation equivariance in convolutional neural
networks. 3D rotations have been a challenging nuisance in 3D classification
tasks requiring higher capacity and extended data augmentation in order to
tackle it. We model 3D data with multi-valued spherical functions and we
propose a novel spherical convolutional network that implements exact
convolutions on the sphere by realizing them in the spherical harmonic domain.
Resulting filters have local symmetry and are localized by enforcing smooth
spectra. We apply a novel pooling on the spectral domain and our operations are
independent of the underlying spherical resolution throughout the network. We
show that networks with much lower capacity and without requiring data
augmentation can exhibit performance comparable to the state of the art in
standard retrieval and classification benchmarks.Comment: Camera-ready. Accepted to ECCV'18 as oral presentatio
CLOTH3D: Clothed 3D Humans
This work presents CLOTH3D, the first big scale synthetic dataset of 3D
clothed human sequences. CLOTH3D contains a large variability on garment type,
topology, shape, size, tightness and fabric. Clothes are simulated on top of
thousands of different pose sequences and body shapes, generating realistic
cloth dynamics. We provide the dataset with a generative model for cloth
generation. We propose a Conditional Variational Auto-Encoder (CVAE) based on
graph convolutions (GCVAE) to learn garment latent spaces. This allows for
realistic generation of 3D garments on top of SMPL model for any pose and
shape
Decision Support for Intoxication Prediction Using Graph Convolutional Networks
Every day, poison control centers (PCC) are called for immediate
classification and treatment recommendations if an acute intoxication is
suspected. Due to the time-sensitive nature of these cases, doctors are
required to propose a correct diagnosis and intervention within a minimal time
frame. Usually the toxin is known and recommendations can be made accordingly.
However, in challenging cases only symptoms are mentioned and doctors have to
rely on their clinical experience. Medical experts and our analyses of a
regional dataset of intoxication records provide evidence that this is
challenging, since occurring symptoms may not always match the textbook
description due to regional distinctions, inter-rater variance, and
institutional workflow. Computer-aided diagnosis (CADx) can provide decision
support, but approaches so far do not consider additional information of the
reported cases like age or gender, despite their potential value towards a
correct diagnosis. In this work, we propose a new machine learning based CADx
method which fuses symptoms and meta information of the patients using graph
convolutional networks. We further propose a novel symptom matching method that
allows the effective incorporation of prior knowledge into the learning process
and evidently stabilizes the poison prediction. We validate our method against
10 medical doctors with different experience diagnosing intoxication cases for
10 different toxins from the PCC in Munich and show our method's superiority in
performance for poison prediction.Comment: 10 pages, 3 figure
Intraoperative Liver Surface Completion with Graph Convolutional VAE
In this work we propose a method based on geometric deep learning to predict
the complete surface of the liver, given a partial point cloud of the organ
obtained during the surgical laparoscopic procedure. We introduce a new data
augmentation technique that randomly perturbs shapes in their frequency domain
to compensate the limited size of our dataset. The core of our method is a
variational autoencoder (VAE) that is trained to learn a latent space for
complete shapes of the liver. At inference time, the generative part of the
model is embedded in an optimisation procedure where the latent representation
is iteratively updated to generate a model that matches the intraoperative
partial point cloud. The effect of this optimisation is a progressive non-rigid
deformation of the initially generated shape. Our method is qualitatively
evaluated on real data and quantitatively evaluated on synthetic data. We
compared with a state-of-the-art rigid registration algorithm, that our method
outperformed in visible areas
Learning Graph-Convolutional Representations for Point Cloud Denoising
Point clouds are an increasingly relevant data type but they are often
corrupted by noise. We propose a deep neural network based on
graph-convolutional layers that can elegantly deal with the
permutation-invariance problem encountered by learning-based point cloud
processing methods. The network is fully-convolutional and can build complex
hierarchies of features by dynamically constructing neighborhood graphs from
similarity among the high-dimensional feature representations of the points.
When coupled with a loss promoting proximity to the ideal surface, the proposed
approach significantly outperforms state-of-the-art methods on a variety of
metrics. In particular, it is able to improve in terms of Chamfer measure and
of quality of the surface normals that can be estimated from the denoised data.
We also show that it is especially robust both at high noise levels and in
presence of structured noise such as the one encountered in real LiDAR scans.Comment: European Conference on Computer Vision (ECCV) 202
Deep Modeling of Growth Trajectories for Longitudinal Prediction of Missing Infant Cortical Surfaces
Charting cortical growth trajectories is of paramount importance for
understanding brain development. However, such analysis necessitates the
collection of longitudinal data, which can be challenging due to subject
dropouts and failed scans. In this paper, we will introduce a method for
longitudinal prediction of cortical surfaces using a spatial graph
convolutional neural network (GCNN), which extends conventional CNNs from
Euclidean to curved manifolds. The proposed method is designed to model the
cortical growth trajectories and jointly predict inner and outer cortical
surfaces at multiple time points. Adopting a binary flag in loss calculation to
deal with missing data, we fully utilize all available cortical surfaces for
training our deep learning model, without requiring a complete collection of
longitudinal data. Predicting the surfaces directly allows cortical attributes
such as cortical thickness, curvature, and convexity to be computed for
subsequent analysis. We will demonstrate with experimental results that our
method is capable of capturing the nonlinearity of spatiotemporal cortical
growth patterns and can predict cortical surfaces with improved accuracy.Comment: Accepted as oral presentation at IPMI 201
Latent Patient Network Learning for Automatic Diagnosis
Recently, Graph Convolutional Networks (GCNs) has proven to be a powerful
machine learning tool for Computer Aided Diagnosis (CADx) and disease
prediction. A key component in these models is to build a population graph,
where the graph adjacency matrix represents pair-wise patient similarities.
Until now, the similarity metrics have been defined manually, usually based on
meta-features like demographics or clinical scores. The definition of the
metric, however, needs careful tuning, as GCNs are very sensitive to the graph
structure. In this paper, we demonstrate for the first time in the CADx domain
that it is possible to learn a single, optimal graph towards the GCN's
downstream task of disease classification. To this end, we propose a novel,
end-to-end trainable graph learning architecture for dynamic and localized
graph pruning. Unlike commonly employed spectral GCN approaches, our GCN is
spatial and inductive, and can thus infer previously unseen patients as well.
We demonstrate significant classification improvements with our learned graph
on two CADx problems in medicine. We further explain and visualize this result
using an artificial dataset, underlining the importance of graph learning for
more accurate and robust inference with GCNs in medical applications
Analysis and Prediction of Deforming 3D Shapes using Oriented Bounding Boxes and LSTM Autoencoders
For sequences of complex 3D shapes in time we present a general approach to
detect patterns for their analysis and to predict the deformation by making use
of structural components of the complex shape. We incorporate long short-term
memory (LSTM) layers into an autoencoder to create low dimensional
representations that allow the detection of patterns in the data and
additionally detect the temporal dynamics in the deformation behavior. This is
achieved with two decoders, one for reconstruction and one for prediction of
future time steps of the sequence. In a preprocessing step the components of
the studied object are converted to oriented bounding boxes which capture the
impact of plastic deformation and allow reducing the dimensionality of the data
describing the structure. The architecture is tested on the results of 196 car
crash simulations of a model with 133 different components, where material
properties are varied. In the latent representation we can detect patterns in
the plastic deformation for the different components. The predicted bounding
boxes give an estimate of the final simulation result and their quality is
improved in comparison to different baselines
Institutionalisation of Social Movements: Co-option And Democratic Policy-making
Over the past 30 years, urban policy in Brazil has undergone a major transformation, both in terms of regulatory frameworks and the involvement of citizens in the process of policy-making. As an intense process of institutional innovation and mobilisation for decent publicservices took place, academics started to consider the impact of institutionalisation on the autonomy of social movements. Using empirical evidence from a city in the northeast of Brazil, this article addresses the wider literature on citizen participation and social movements to examine specifically the problem with co-optation. I examine the risks linked to co-optation, risks that can undermine the credibility of social movements as agents of change, and explore the tensions that go beyond the ‘co-optation versus autonomy’ divide, an issue frequently found in the practices of social movements, in their dealings with those in power. In particular, this article explores the learning processes and contentious relationships between mainly institutionally oriented urban movements and local government. This study found that the learning of deliberative skills not only led to changes in the objectives and repertoires of housing movements, but also to the inclusion of new components in their objectives that provide room for creative agency and which, in some cases, might allow them to maintain their autonomy from the state
- …