Incorporating Human Expertise in Robot Motion Learning and Synthesis

With the exponential growth of robotics and the fast development of their advanced cognitive and motor capabilities, one can start to envision humans and robots jointly working together in unstructured environments. Yet, for that to be possible, robots need to be programmed for such types of complex scenarios, which demands significant domain knowledge in robotics and control. One viable approach to enable robots to acquire skills in a more flexible and efficient way is by giving them the capabilities of autonomously learn from human demonstrations and expertise through interaction. Such framework helps to make the creation of skills in robots more social and less demanding on programing and robotics expertise. Yet, current imitation learning approaches suffer from significant limitations, mainly about the flexibility and efficiency for representing, learning and reasoning about motor tasks. This thesis addresses this problem by exploring cost-function-based approaches to learning robot motion control, perception and the interplay between them. To begin with, the thesis proposes an efficient probabilistic algorithm to learn an impedance controller to accommodate motion contacts. The learning algorithm is able to incorporate important domain constraints, e.g., about force representation and decomposition, which are nontrivial to handle by standard techniques. Compliant handwriting motions are developed on an articulated robot arm and a multi-fingered hand. This work provides a flexible approach to learn robot motion conforming to both task and domain constraints. Furthermore, the thesis also contributes with techniques to learn from and reason about demonstrations with partial observability. The proposed approach combines inverse optimal control and ensemble methods, yielding a tractable learning of cost functions with latent variables. Two task priors are further incorporated. The first human kinematics prior results in a model which synthesizes rich and believable dynamical handwriting. The latter prior enforces dynamics on the latent variable and facilitates a real-time human intention cognition and an on-line motion adaptation in collaborative robot tasks. Finally, the thesis establishes a link between control and perception modalities. This work offers an analysis that bridges inverse optimal control and deep generative model, as well as a novel algorithm that learns cost features and embeds the modal coupling prior. This work contributes an end-to-end system for synthesizing arm joint motion from letter image pixels. The results highlight its robustness against noisy and out-of-sample sensory inputs. Overall, the proposed approach endows robots the potential to reason about diverse unstructured data, which is nowadays pervasive but hard to process for current imitation learning

Control and Learning of Compliant Manipulation Skills

Humans demonstrate an impressive capability to manipulate fragile objects without damaging them, graciously controlling the force and position of hands or tools. Traditionally, robotics has favored position control over force control to produce fast, accurate and repeatable motion. For extending the applicability of robotic manipulators outside the strictly controlled environments of industrial work cells, position control is inadequate. Tasks that involve contact with objects whose positions are not known with perfect certainty require a controller that regulates the relationship between positional deviations and forces on the robot. This problem is formalized in the impedance control framework, which focuses the robot control problem on the interaction between the robot and its environment. By adjusting the impedance parameters, the behavior of the robot can be adapted to the need of the task. However, it is often difficult to specify formally how the impedance should vary for best performance. Furthermore, fast it can be shown that careless variation of the impedance can lead to unstable regulation or tracking even in free motion. In the first part of the thesis, the problem of how to define a varying impedance for a task is addressed. A haptic human-robot interface that allows a human supervisor to teach impedance variations by physically interacting with the robot during task execution is introduced. It is shown that the interface can be used to enhance the performance in several manipulation tasks. Then, the problem of stable control with varying impedance is addressed. Along with a theoretical discussion on this topic, a sufficient condition for stable varying stiffness and damping is provided. In the second part of the thesis, we explore more complex manipulation scenarios via online generation of the robot trajectory. This is done along two axes 1) learning how to react to contact forces in insertion tasks which are crucial for assembly operations and 2) autonomous Dynamical Systems (DS) for motion representation with the capability to encode a family of trajectories rather than a fixed, time-dependent reference. A novel framework for task representation using DS is introduced, termed Locally Modulated Dynamical Systems (LMDS). LMDS differs from existing DS estimation algorithms in that it supports non-parametric and incremental learning all the while guaranteeing that the resulting DS is globally stable at an attractor point. To combine the advantages of DS motion generation with impedance control, a novel controller for tasks described by first order DS is proposed. The controller is passive, and has the properties of an impedance controller with the added flexibility of a DS motion representation instead of a time-indexed trajectory