3D object detection with deep learning

Abstract

Finding an appropriate environment representation is a crucial problem in robotics. 3D data has been recently used thanks to the advent of low cost RGB-D cameras. We propose a new way to represent a 3D map based on the information provided by an expert. Namely, the expert is the output of a Convolutional Neural Network trained with deep learning techniques. Relying on such information, we propose the generation of 3D maps using individual semantic labels, which are associated with environment objects or semantic labels. So, for each label we are provided with a partial 3D map whose data belong to the 3D perceptions, namely point clouds, which have an associated probability above a given threshold. The final map is obtained by registering and merging all these partial maps. The use of semantic labels provide us a with way to build the map while recognizing objects.This work has been supported by the Spanish Government TIN2016-76515-R Grant, supported with Feder funds, and by grant of Vicerrectorado de Investigación y Transferencia de Conocimiento para el fomento de la I+D+i en la Universidad de Alicante 2016