Artificial Cognition for Social Human-Robot Interaction: An Implementation

© 2017 The Authors Human–Robot Interaction challenges Artificial Intelligence in many regards: dynamic, partially unknown environments that were not originally designed for robots; a broad variety of situations with rich semantics to understand and interpret; physical interactions with humans that requires fine, low-latency yet socially acceptable control strategies; natural and multi-modal communication which mandates common-sense knowledge and the representation of possibly divergent mental models. This article is an attempt to characterise these challenges and to exhibit a set of key decisional issues that need to be addressed for a cognitive robot to successfully share space and tasks with a human. We identify first the needed individual and collaborative cognitive skills: geometric reasoning and situation assessment based on perspective-taking and affordance analysis; acquisition and representation of knowledge models for multiple agents (humans and robots, with their specificities); situated, natural and multi-modal dialogue; human-aware task planning; human–robot joint task achievement. The article discusses each of these abilities, presents working implementations, and shows how they combine in a coherent and original deliberative architecture for human–robot interaction. Supported by experimental results, we eventually show how explicit knowledge management, both symbolic and geometric, proves to be instrumental to richer and more natural human–robot interactions by pushing for pervasive, human-level semantics within the robot's deliberative system

Verwaltung von Glaubenszuständen für Serviceroboter

In this thesis, the powerful paradigm of Unstructured Information Management is applied to the problem of robot perception. We present RoboSherlock, an open source software framework demonstrating the vast potential of the paradigm for real-world scene perception. A large number of existing and novel methods, from classical computer vision to probabilistic reasoning, are integrated into a highly flexible, extensible and capable system generating object descriptions of unparalleled information richness.In dieser Arbeit wird erstmalig das UIM-Prinzip (unstructured information management) für die Wahrnehmung von Servicerobotern eingesetzt. Es wird ein Open-Source Softwareframework vorgestellt, das das enorme Potential des Ansatzes für das Verstehen von menschlichen Umgebungen demonstriert. Eine Vielzahl von bestehenden und neuartigen Methoden, von klassischem Bildverstehen bis zu probabilistischen Schlussfolgerungsprozessen, sind in einem flexiblen, erweiterbaren und mächtigen System integriert, welches Objektbeschreibungen von beispielloser Informationsfülle erzeugt

Fast Point Feature Histograms (FPFH) for 3D Registration

Abstract — In our recent work [1], [2], we proposed Point Feature Histograms (PFH) as robust multi-dimensional features which describe the local geometry around a point p for 3D point cloud datasets. In this paper, we modify their mathematical expressions and perform a rigorous analysis on their robustness and complexity for the problem of 3D registration for overlapping point cloud views. More concretely, we present several optimizations that reduce their computation times drastically by either caching previously computed values or by revising their theoretical formulations. The latter results in a new type of local features, called Fast Point Feature Histograms (FPFH), which retain most of the discriminative power of the PFH. Moreover, we propose an algorithm for the online computation of FPFH features for realtime applications. To validate our results we demonstrate their efficiency for 3D registration and propose a new sample consensus based method for bringing two datasets into the convergence basin of a local non-linear optimizer: SAC-IA (SAmple Consensus Initial Alignment). I

Fast geometric point labeling using conditional random fields

Abstract — In this paper we present a new approach for labeling 3D points with different geometric surface primitives using a novel feature descriptor – the Fast Point Feature Histograms, and discriminative graphical models. To build informative and robust 3D feature point representations, our descriptors encode the underlying surface geometry around a point p using multi-value histograms. This highly dimensional feature space copes well with noisy sensor data and is not dependent on pose or sampling density. By defining classes of 3D geometric surfaces and making use of contextual information using Conditional Random Fields (CRFs), our system is able to successfully segment and label 3D point clouds, based on the type of surfaces the points are lying on. We validate and demonstrate the method’s efficiency by comparing it against similar initiatives as well as present results for table setting datasets acquired in indoor environments. I