Supervised Autonomous Locomotion and Manipulation for Disaster Response with a Centaur-like Robot

Mobile manipulation tasks are one of the key challenges in the field of search and rescue (SAR) robotics requiring robots with flexible locomotion and manipulation abilities. Since the tasks are mostly unknown in advance, the robot has to adapt to a wide variety of terrains and workspaces during a mission. The centaur-like robot Centauro has a hybrid legged-wheeled base and an anthropomorphic upper body to carry out complex tasks in environments too dangerous for humans. Due to its high number of degrees of freedom, controlling the robot with direct teleoperation approaches is challenging and exhausting. Supervised autonomy approaches are promising to increase quality and speed of control while keeping the flexibility to solve unknown tasks. We developed a set of operator assistance functionalities with different levels of autonomy to control the robot for challenging locomotion and manipulation tasks. The integrated system was evaluated in disaster response scenarios and showed promising performance.Comment: In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, October 201

High and low level control for an Unmanned ground vehicle.

Esta Investigación presenta el desarrollo de una metodología de control de alto y bajo nivel para robot móvil o vehículo terrestre no tripulados que opera en un entorno definido, la aplicación de métodos de control automático lineal y no lineal, junto con algoritmos de búsqueda y planificación, proporcionan la plataforma de autonomía

Learning to Segment and Represent Motion Primitives from Driving Data for Motion Planning Applications

Developing an intelligent vehicle which can perform human-like actions requires the ability to learn basic driving skills from a large amount of naturalistic driving data. The algorithms will become efficient if we could decompose the complex driving tasks into motion primitives which represent the elementary compositions of driving skills. Therefore, the purpose of this paper is to segment unlabeled trajectory data into a library of motion primitives. By applying a probabilistic inference based on an iterative Expectation-Maximization algorithm, our method segments the collected trajectories while learning a set of motion primitives represented by the dynamic movement primitives. The proposed method utilizes the mutual dependencies between the segmentation and representation of motion primitives and the driving-specific based initial segmentation. By utilizing this mutual dependency and the initial condition, this paper presents how we can enhance the performance of both the segmentation and the motion primitive library establishment. We also evaluate the applicability of the primitive representation method to imitation learning and motion planning algorithms. The model is trained and validated by using the driving data collected from the Beijing Institute of Technology intelligent vehicle platform. The results show that the proposed approach can find the proper segmentation and establish the motion primitive library simultaneously

Research on a semiautonomous mobile robot for loosely structured environments focused on transporting mail trolleys

In this thesis is presented a novel approach to model, control, and planning the motion of a nonholonomic wheeled mobile robot that applies stable pushes and pulls to a nonholonomic cart (York mail trolley) in a loosely structured environment. The method is based on grasping and ungrasping the nonholonomic cart, as a result, the robot changes its kinematics properties. In consequence, two robot configurations are produced by the task of grasping and ungrasping the load, they are: the single-robot configuration and the robot-trolley configuration. Furthermore, in order to comply with the general planar motion law of rigid bodies and the kinematic constraints imposed by the robot wheels for each configuration, the robot has been provided with two motorized steerable wheels in order to have a flexible platform able to adapt to these restrictions. [Continues.

The Mechanics and Control of Undulatory Robotic Locomotion

In this dissertation, we examine a formulation of problems of undulatory robotic locomotion within the context of mechanical systems with nonholonomic constraints and symmetries. Using tools from geometric mechanics, we study the underlying structure found in general problems of locomotion. In doing so, we decompose locomotion into two basic components: internal shape changes and net changes in position and orientation. This decomposition has a natural mathematical interpretation in which the relationship between shape changes and locomotion can be described using a connection on a trivial principal fiber bundle. We begin by reviewing the processes of Lagrangian reduction and reconstruction for unconstrained mechanical systems with Lie group symmetries, and present new formulations of this process which are easily adapted to accommodate external constraints. Additionally, important physical quantities such as the mechanical connection and reduced mass-inertia matrix can be trivially determined using this formulation. The presence of symmetries then allows us to reduce the necessary calculations to simple matrix manipulations. The addition of constraints significantly complicates the reduction process; however, we show that for invariant constraints, a meaningful connection can be synthesized by defining a generalized momentum representing the momentum of the system in directions allowed by the constraints. We then prove that the generalized momentum and its governing equation possess certain invariances which allows for a reduction process similar to that found in the unconstrained case. The form of the reduced equations highlights the synthesized connection and the matrix quantities used to calculate these equations. The use of connections naturally leads to methods for testing controllability and aids in developing intuition regarding the generation of various locomotive gaits. We present accessibility and controllability tests based on taking derivatives of the connection, and relate these tests to taking Lie brackets of the input vector fields. The theory is illustrated using several examples, in particular the examples of the snakeboard and Hirose snake robot. We interpret each of these examples in light of the theory developed in this thesis, and examine the generation of locomotive gaits using sinusoidal inputs and their relationship to the controllability tests based on Lie brackets

Vision-based methods for state estimation and control of robotic systems with application to mobile and surgical robots

For autonomous systems that need to perceive the surrounding environment for the accomplishment of a given task, vision is a highly informative exteroceptive sensory source. When gathering information from the available sensors, in fact, the richness of visual data allows to provide a complete description of the environment, collecting geometrical and semantic information (e.g., object pose, distances, shapes, colors, lights). The huge amount of collected data allows to consider both methods exploiting the totality of the data (dense approaches), or a reduced set obtained from feature extraction procedures (sparse approaches). This manuscript presents dense and sparse vision-based methods for control and sensing of robotic systems. First, a safe navigation scheme for mobile robots, moving in unknown environments populated by obstacles, is presented. For this task, dense visual information is used to perceive the environment (i.e., detect ground plane and obstacles) and, in combination with other sensory sources, provide an estimation of the robot motion with a linear observer. On the other hand, sparse visual data are extrapolated in terms of geometric primitives, in order to implement a visual servoing control scheme satisfying proper navigation behaviours. This controller relies on visual estimated information and is designed in order to guarantee safety during navigation. In addition, redundant structures are taken into account to re-arrange the internal configuration of the robot and reduce its encumbrance when the workspace is highly cluttered. Vision-based estimation methods are relevant also in other contexts. In the field of surgical robotics, having reliable data about unmeasurable quantities is of great importance and critical at the same time. In this manuscript, we present a Kalman-based observer to estimate the 3D pose of a suturing needle held by a surgical manipulator for robot-assisted suturing. The method exploits images acquired by the endoscope of the robot platform to extrapolate relevant geometrical information and get projected measurements of the tool pose. This method has also been validated with a novel simulator designed for the da Vinci robotic platform, with the purpose to ease interfacing and employment in ideal conditions for testing and validation. The Kalman-based observers mentioned above are classical passive estimators, whose system inputs used to produce the proper estimation are theoretically arbitrary. This does not provide any possibility to actively adapt input trajectories in order to optimize specific requirements on the performance of the estimation. For this purpose, active estimation paradigm is introduced and some related strategies are presented. More specifically, a novel active sensing algorithm employing visual dense information is described for a typical Structure-from-Motion (SfM) problem. The algorithm generates an optimal estimation of a scene observed by a moving camera, while minimizing the maximum uncertainty of the estimation. This approach can be applied to any robotic platforms and has been validated with a manipulator arm equipped with a monocular camera