76 research outputs found
LabelFusion: A Pipeline for Generating Ground Truth Labels for Real RGBD Data of Cluttered Scenes
Deep neural network (DNN) architectures have been shown to outperform
traditional pipelines for object segmentation and pose estimation using RGBD
data, but the performance of these DNN pipelines is directly tied to how
representative the training data is of the true data. Hence a key requirement
for employing these methods in practice is to have a large set of labeled data
for your specific robotic manipulation task, a requirement that is not
generally satisfied by existing datasets. In this paper we develop a pipeline
to rapidly generate high quality RGBD data with pixelwise labels and object
poses. We use an RGBD camera to collect video of a scene from multiple
viewpoints and leverage existing reconstruction techniques to produce a 3D
dense reconstruction. We label the 3D reconstruction using a human assisted
ICP-fitting of object meshes. By reprojecting the results of labeling the 3D
scene we can produce labels for each RGBD image of the scene. This pipeline
enabled us to collect over 1,000,000 labeled object instances in just a few
days. We use this dataset to answer questions related to how much training data
is required, and of what quality the data must be, to achieve high performance
from a DNN architecture
Convex Optimization In Identification Of Stable Non-Linear State Space Models
A new framework for nonlinear system identification is presented in terms of
optimal fitting of stable nonlinear state space equations to input/output/state
data, with a performance objective defined as a measure of robustness of the
simulation error with respect to equation errors. Basic definitions and
analytical results are presented. The utility of the method is illustrated on a
simple simulation example as well as experimental recordings from a live
neuron.Comment: 9 pages, 2 figure, elaboration of same-title paper in 49th IEEE
Conference on Decision and Contro
Tracking objects with point clouds from vision and touch
We present an object-tracking framework that fuses point cloud information from an RGB-D camera with tactile information from a GelSight contact sensor. GelSight can be treated as a source of dense local geometric information, which we incorporate directly into a conventional point-cloud-based articulated object tracker based on signed-distance functions. Our implementation runs at 12 Hz using an online depth reconstruction algorithm for GelSight and a modified second-order update for the tracking algorithm. We present data from hardware experiments demonstrating that the addition of contact-based geometric information significantly improves the pose accuracy during contact, and provides robustness to occlusions of small objects by the robot's end effector
Automating Vehicles by Deep Reinforcement Learning using Task Separation with Hill Climbing
Within the context of autonomous driving a model-based reinforcement learning
algorithm is proposed for the design of neural network-parameterized
controllers. Classical model-based control methods, which include sampling- and
lattice-based algorithms and model predictive control, suffer from the
trade-off between model complexity and computational burden required for the
online solution of expensive optimization or search problems at every short
sampling time. To circumvent this trade-off, a 2-step procedure is motivated:
first learning of a controller during offline training based on an arbitrarily
complicated mathematical system model, before online fast feedforward
evaluation of the trained controller. The contribution of this paper is the
proposition of a simple gradient-free and model-based algorithm for deep
reinforcement learning using task separation with hill climbing (TSHC). In
particular, (i) simultaneous training on separate deterministic tasks with the
purpose of encoding many motion primitives in a neural network, and (ii) the
employment of maximally sparse rewards in combination with virtual velocity
constraints (VVCs) in setpoint proximity are advocated.Comment: 10 pages, 6 figures, 1 tabl
Optimization of the design of ducted-fan hovering micro air vehicles using finite element simulation and orthogonal design
The structural design and flight stability characteristics of micro air vehicles have received much attention due to its low Reynolds number. Compared with fixed-wing aircraft, hovering ducted-fan micro air vehicles with vertical takeoff and landing and hovering capabilities have promising prospect. In this article, a flexible membrane and inflatable structure has been used as the aerodynamic shape of an aircraft model. Its advantages have been analyzed and verified by fluid-structure interaction based on finite element method. The flight stability of hovering micro air vehicles has also been investigated based on the theory of motion of structure. In order to improve the flight stability of the designed hovering micro air vehicle model, the effects of geometrical parameters and materials have been analyzed through an orthogonal experimental design. Based on the optimized results, the aircraft prototype has been manufactured for experimental test. The elastic deformation produced on its flexible membrane structure is obtained by stroboscopic stereo imaging method and a purpose-built experimental environment. The numerical simulation results indicated that the thickness of membrane and material of vertical duct have significant effects on the micro air vehicle flight stability and disturbance resistance ability. The results have confirmed that the flexible aerodynamic mechanisms produced by the aeroelastic deformation of spherical membrane can enhance the micro air vehicle stability.This work was financially supported by Support Program of National Ministry of Education of China
(No. 625010110), National Natural Science Foundation of China (No. 61179043), and Specialized Research
Fund for the Doctoral Program (SRFDP) of Higher Education (No. 20070056085)
Sampling-based Algorithms for Optimal Motion Planning
During the last decade, sampling-based path planning algorithms, such as
Probabilistic RoadMaps (PRM) and Rapidly-exploring Random Trees (RRT), have
been shown to work well in practice and possess theoretical guarantees such as
probabilistic completeness. However, little effort has been devoted to the
formal analysis of the quality of the solution returned by such algorithms,
e.g., as a function of the number of samples. The purpose of this paper is to
fill this gap, by rigorously analyzing the asymptotic behavior of the cost of
the solution returned by stochastic sampling-based algorithms as the number of
samples increases. A number of negative results are provided, characterizing
existing algorithms, e.g., showing that, under mild technical conditions, the
cost of the solution returned by broadly used sampling-based algorithms
converges almost surely to a non-optimal value. The main contribution of the
paper is the introduction of new algorithms, namely, PRM* and RRT*, which are
provably asymptotically optimal, i.e., such that the cost of the returned
solution converges almost surely to the optimum. Moreover, it is shown that the
computational complexity of the new algorithms is within a constant factor of
that of their probabilistically complete (but not asymptotically optimal)
counterparts. The analysis in this paper hinges on novel connections between
stochastic sampling-based path planning algorithms and the theory of random
geometric graphs.Comment: 76 pages, 26 figures, to appear in International Journal of Robotics
Researc
- …