Dynamic Body VSLAM with Semantic Constraints

Image based reconstruction of urban environments is a challenging problem that deals with optimization of large number of variables, and has several sources of errors like the presence of dynamic objects. Since most large scale approaches make the assumption of observing static scenes, dynamic objects are relegated to the noise modeling section of such systems. This is an approach of convenience since the RANSAC based framework used to compute most multiview geometric quantities for static scenes naturally confine dynamic objects to the class of outlier measurements. However, reconstructing dynamic objects along with the static environment helps us get a complete picture of an urban environment. Such understanding can then be used for important robotic tasks like path planning for autonomous navigation, obstacle tracking and avoidance, and other areas. In this paper, we propose a system for robust SLAM that works in both static and dynamic environments. To overcome the challenge of dynamic objects in the scene, we propose a new model to incorporate semantic constraints into the reconstruction algorithm. While some of these constraints are based on multi-layered dense CRFs trained over appearance as well as motion cues, other proposed constraints can be expressed as additional terms in the bundle adjustment optimization process that does iterative refinement of 3D structure and camera / object motion trajectories. We show results on the challenging KITTI urban dataset for accuracy of motion segmentation and reconstruction of the trajectory and shape of moving objects relative to ground truth. We are able to show average relative error reduction by a significant amount for moving object trajectory reconstruction relative to state-of-the-art methods like VISO 2, as well as standard bundle adjustment algorithms

Unsupervised Learning of Depth and Ego-Motion from Video

We present an unsupervised learning framework for the task of monocular depth and camera motion estimation from unstructured video sequences. We achieve this by simultaneously training depth and camera pose estimation networks using the task of view synthesis as the supervisory signal. The networks are thus coupled via the view synthesis objective during training, but can be applied independently at test time. Empirical evaluation on the KITTI dataset demonstrates the effectiveness of our approach: 1) monocular depth performing comparably with supervised methods that use either ground-truth pose or depth for training, and 2) pose estimation performing favorably with established SLAM systems under comparable input settings.Comment: Accepted to CVPR 2017. Project webpage: https://people.eecs.berkeley.edu/~tinghuiz/projects/SfMLearner

Sudden Obstacle Appearance Detection by Analyzing Flow Field Vector for Small-Sized UAV

Achieving a reliable obstacle detection and avoidance system that can provide an effective safe avoidance path for small unmanned aerial vehicle (UAV) is very challenging due to its physical size and weight constraints. Prior works tend to employ the vision based-sensor as the main detection sensor but resulting to high dependency on texture appearance while not having a distance sensing capabilities. The previous system only focused on the detection of the static frontal obstacle without observing the environment which may have moving obstacles. On the other hand, most of the wide spectrum range sensors are heavy and expensive hence not suitable for small UAV. In this work, integration of different based sensors was proposed for a small UAV in detecting unpredictable obstacle appearance situation. The detection of the obstacle is accomplished by analysing the flow field vectors in the image frames sequence. The proposed system was evaluated by conducting the experiments in a real environment which consisted of different configuration of the obstacles. The results from the experiment show that the success rate for detecting unpredictable obstacle appearance is high which is 70% and above. Even though some of the introduced obstacles are considered to have poor texture appearances on their surface, the proposed obstacle detection system was still able to detect the correct appearance movement of the obstacles by detecting the edges