185 research outputs found
CherryPicker: Semantic Skeletonization and Topological Reconstruction of Cherry Trees
In plant phenotyping, accurate trait extraction from 3D point clouds of trees
is still an open problem. For automatic modeling and trait extraction of tree
organs such as blossoms and fruits, the semantically segmented point cloud of a
tree and the tree skeleton are necessary. Therefore, we present CherryPicker,
an automatic pipeline that reconstructs photo-metric point clouds of trees,
performs semantic segmentation and extracts their topological structure in form
of a skeleton. Our system combines several state-of-the-art algorithms to
enable automatic processing for further usage in 3D-plant phenotyping
applications. Within this pipeline, we present a method to automatically
estimate the scale factor of a monocular reconstruction to overcome scale
ambiguity and obtain metrically correct point clouds. Furthermore, we propose a
semantic skeletonization algorithm build up on Laplacian-based contraction. We
also show by weighting different tree organs semantically, our approach can
effectively remove artifacts induced by occlusion and structural size
variations. CherryPicker obtains high-quality topology reconstructions of
cherry trees with precise details.Comment: Accepted by CVPR 2023 Vision for Agriculture Worksho
Extracting curve-skeletons from digital shapes using occluding contours
Curve-skeletons are compact and semantically relevant shape descriptors, able to summarize both topology and pose of a wide range of digital objects. Most of the state-of-the-art algorithms for their computation rely on the type of geometric primitives used and sampling frequency. In this paper we introduce a formally sound and intuitive definition of curve-skeleton, then we propose a novel method for skeleton extraction that rely on the visual appearance of the shapes. To achieve this result we inspect the properties of occluding contours, showing how information about the symmetry axes of a 3D shape can be inferred by a small set of its planar projections. The proposed method is fast, insensitive to noise, capable of working with different shape representations, resolution insensitive and easy to implement
Occlusion Reasoning for Skeleton Extraction of Self-Occluded Tree Canopies
In this work, we present a method to extract the skeleton of a self-occluded
tree canopy by estimating the unobserved structures of the tree. A tree
skeleton compactly describes the topological structure and contains useful
information such as branch geometry, positions and hierarchy. This can be
critical to planning contact interactions for agricultural manipulation, yet is
difficult to gain due to occlusion by leaves, fruits and other branches. Our
method uses an instance segmentation network to detect visible trunk, branches,
and twigs. Then, based on the observed tree structures, we build a custom 3D
likelihood map in the form of an occupancy grid to hypothesize on the presence
of occluded skeletons through a series of minimum cost path searches. We show
that our method outperforms baseline methods in highly occluded scenes,
demonstrated through a set of experiments on a synthetic tree dataset.
Qualitative results are also presented on a real tree dataset collected from
the field.Comment: 7 pages, 10 figures, submitted to ICRA 202
- …