2,713 research outputs found
Accurate 3D maps from depth images and motion sensors via nonlinear Kalman filtering
This paper investigates the use of depth images as localisation sensors for
3D map building. The localisation information is derived from the 3D data
thanks to the ICP (Iterative Closest Point) algorithm. The covariance of the
ICP, and thus of the localization error, is analysed, and described by a Fisher
Information Matrix. It is advocated this error can be much reduced if the data
is fused with measurements from other motion sensors, or even with prior
knowledge on the motion. The data fusion is performed by a recently introduced
specific extended Kalman filter, the so-called Invariant EKF, and is directly
based on the estimated covariance of the ICP. The resulting filter is very
natural, and is proved to possess strong properties. Experiments with a Kinect
sensor and a three-axis gyroscope prove clear improvement in the accuracy of
the localization, and thus in the accuracy of the built 3D map.Comment: Submitted to IROS 2012. 8 page
Structured Light-Based 3D Reconstruction System for Plants.
Camera-based 3D reconstruction of physical objects is one of the most popular computer vision trends in recent years. Many systems have been built to model different real-world subjects, but there is lack of a completely robust system for plants. This paper presents a full 3D reconstruction system that incorporates both hardware structures (including the proposed structured light system to enhance textures on object surfaces) and software algorithms (including the proposed 3D point cloud registration and plant feature measurement). This paper demonstrates the ability to produce 3D models of whole plants created from multiple pairs of stereo images taken at different viewing angles, without the need to destructively cut away any parts of a plant. The ability to accurately predict phenotyping features, such as the number of leaves, plant height, leaf size and internode distances, is also demonstrated. Experimental results show that, for plants having a range of leaf sizes and a distance between leaves appropriate for the hardware design, the algorithms successfully predict phenotyping features in the target crops, with a recall of 0.97 and a precision of 0.89 for leaf detection and less than a 13-mm error for plant size, leaf size and internode distance
HeadOn: Real-time Reenactment of Human Portrait Videos
We propose HeadOn, the first real-time source-to-target reenactment approach
for complete human portrait videos that enables transfer of torso and head
motion, face expression, and eye gaze. Given a short RGB-D video of the target
actor, we automatically construct a personalized geometry proxy that embeds a
parametric head, eye, and kinematic torso model. A novel real-time reenactment
algorithm employs this proxy to photo-realistically map the captured motion
from the source actor to the target actor. On top of the coarse geometric
proxy, we propose a video-based rendering technique that composites the
modified target portrait video via view- and pose-dependent texturing, and
creates photo-realistic imagery of the target actor under novel torso and head
poses, facial expressions, and gaze directions. To this end, we propose a
robust tracking of the face and torso of the source actor. We extensively
evaluate our approach and show significant improvements in enabling much
greater flexibility in creating realistic reenacted output videos.Comment: Video: https://www.youtube.com/watch?v=7Dg49wv2c_g Presented at
Siggraph'1
- …