5,579 research outputs found
A convolutional autoencoder approach for mining features in cellular electron cryo-tomograms and weakly supervised coarse segmentation
Cellular electron cryo-tomography enables the 3D visualization of cellular
organization in the near-native state and at submolecular resolution. However,
the contents of cellular tomograms are often complex, making it difficult to
automatically isolate different in situ cellular components. In this paper, we
propose a convolutional autoencoder-based unsupervised approach to provide a
coarse grouping of 3D small subvolumes extracted from tomograms. We demonstrate
that the autoencoder can be used for efficient and coarse characterization of
features of macromolecular complexes and surfaces, such as membranes. In
addition, the autoencoder can be used to detect non-cellular features related
to sample preparation and data collection, such as carbon edges from the grid
and tomogram boundaries. The autoencoder is also able to detect patterns that
may indicate spatial interactions between cellular components. Furthermore, we
demonstrate that our autoencoder can be used for weakly supervised semantic
segmentation of cellular components, requiring a very small amount of manual
annotation.Comment: Accepted by Journal of Structural Biolog
The Spine of the Cosmic Web
We present the SpineWeb framework for the topological analysis of the Cosmic
Web and the identification of its walls, filaments and cluster nodes. Based on
the watershed segmentation of the cosmic density field, the SpineWeb method
invokes the local adjacency properties of the boundaries between the watershed
basins to trace the critical points in the density field and the separatrices
defined by them. The separatrices are classified into walls and the spine, the
network of filaments and nodes in the matter distribution. Testing the method
with a heuristic Voronoi model yields outstanding results. Following the
discussion of the test results, we apply the SpineWeb method to a set of
cosmological N-body simulations. The latter illustrates the potential for
studying the structure and dynamics of the Cosmic Web.Comment: Accepted for publication HIGH-RES version:
http://skysrv.pha.jhu.edu/~miguel/SpineWeb
Machine learning of hierarchical clustering to segment 2D and 3D images
We aim to improve segmentation through the use of machine learning tools
during region agglomeration. We propose an active learning approach for
performing hierarchical agglomerative segmentation from superpixels. Our method
combines multiple features at all scales of the agglomerative process, works
for data with an arbitrary number of dimensions, and scales to very large
datasets. We advocate the use of variation of information to measure
segmentation accuracy, particularly in 3D electron microscopy (EM) images of
neural tissue, and using this metric demonstrate an improvement over competing
algorithms in EM and natural images.Comment: 15 pages, 8 figure
Pointwise Convolutional Neural Networks
Deep learning with 3D data such as reconstructed point clouds and CAD models
has received great research interests recently. However, the capability of
using point clouds with convolutional neural network has been so far not fully
explored. In this paper, we present a convolutional neural network for semantic
segmentation and object recognition with 3D point clouds. At the core of our
network is pointwise convolution, a new convolution operator that can be
applied at each point of a point cloud. Our fully convolutional network design,
while being surprisingly simple to implement, can yield competitive accuracy in
both semantic segmentation and object recognition task.Comment: 10 pages, 6 figures, 10 tables. Paper accepted to CVPR 201
How to Extract the Geometry and Topology from Very Large 3D Segmentations
Segmentation is often an essential intermediate step in image analysis. A
volume segmentation characterizes the underlying volume image in terms of
geometric information--segments, faces between segments, curves in which
several faces meet--as well as a topology on these objects. Existing algorithms
encode this information in designated data structures, but require that these
data structures fit entirely in Random Access Memory (RAM). Today, 3D images
with several billion voxels are acquired, e.g. in structural neurobiology.
Since these large volumes can no longer be processed with existing methods, we
present a new algorithm which performs geometry and topology extraction with a
runtime linear in the number of voxels and log-linear in the number of faces
and curves. The parallelizable algorithm proceeds in a block-wise fashion and
constructs a consistent representation of the entire volume image on the hard
drive, making the structure of very large volume segmentations accessible to
image analysis. The parallelized C++ source code, free command line tools and
MATLAB mex files are avilable from
http://hci.iwr.uni-heidelberg.de/software.phpComment: C++ source code, free command line tools and MATLAB mex files are
avilable from http://hci.iwr.uni-heidelberg.de/software.ph
Cell Segmentation in 3D Confocal Images using Supervoxel Merge-Forests with CNN-based Hypothesis Selection
Automated segmentation approaches are crucial to quantitatively analyze
large-scale 3D microscopy images. Particularly in deep tissue regions,
automatic methods still fail to provide error-free segmentations. To improve
the segmentation quality throughout imaged samples, we present a new
supervoxel-based 3D segmentation approach that outperforms current methods and
reduces the manual correction effort. The algorithm consists of gentle
preprocessing and a conservative super-voxel generation method followed by
supervoxel agglomeration based on local signal properties and a postprocessing
step to fix under-segmentation errors using a Convolutional Neural Network. We
validate the functionality of the algorithm on manually labeled 3D confocal
images of the plant Arabidopis thaliana and compare the results to a
state-of-the-art meristem segmentation algorithm.Comment: 5 pages, 3 figures, 1 tabl
- …