17,228 research outputs found
Deep Projective 3D Semantic Segmentation
Semantic segmentation of 3D point clouds is a challenging problem with
numerous real-world applications. While deep learning has revolutionized the
field of image semantic segmentation, its impact on point cloud data has been
limited so far. Recent attempts, based on 3D deep learning approaches
(3D-CNNs), have achieved below-expected results. Such methods require
voxelizations of the underlying point cloud data, leading to decreased spatial
resolution and increased memory consumption. Additionally, 3D-CNNs greatly
suffer from the limited availability of annotated datasets.
In this paper, we propose an alternative framework that avoids the
limitations of 3D-CNNs. Instead of directly solving the problem in 3D, we first
project the point cloud onto a set of synthetic 2D-images. These images are
then used as input to a 2D-CNN, designed for semantic segmentation. Finally,
the obtained prediction scores are re-projected to the point cloud to obtain
the segmentation results. We further investigate the impact of multiple
modalities, such as color, depth and surface normals, in a multi-stream network
architecture. Experiments are performed on the recent Semantic3D dataset. Our
approach sets a new state-of-the-art by achieving a relative gain of 7.9 %,
compared to the previous best approach.Comment: Submitted to CAIP 201
SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentation
We introduce Similarity Group Proposal Network (SGPN), a simple and intuitive
deep learning framework for 3D object instance segmentation on point clouds.
SGPN uses a single network to predict point grouping proposals and a
corresponding semantic class for each proposal, from which we can directly
extract instance segmentation results. Important to the effectiveness of SGPN
is its novel representation of 3D instance segmentation results in the form of
a similarity matrix that indicates the similarity between each pair of points
in embedded feature space, thus producing an accurate grouping proposal for
each point. To the best of our knowledge, SGPN is the first framework to learn
3D instance-aware semantic segmentation on point clouds. Experimental results
on various 3D scenes show the effectiveness of our method on 3D instance
segmentation, and we also evaluate the capability of SGPN to improve 3D object
detection and semantic segmentation results. We also demonstrate its
flexibility by seamlessly incorporating 2D CNN features into the framework to
boost performance
- …