Coordination of Multirobot Teams and Groups in Constrained Environments: Models, Abstractions, and Control Policies

Robots can augment and even replace humans in dangerous environments, such as search and rescue and reconnaissance missions, yet robots used in these situations are largely tele-operated. In most cases, the robots\u27 performance depends on the operator\u27s ability to control and coordinate the robots, resulting in increased response time and poor situational awareness, and hindering multirobot cooperation. Many factors impede extended autonomy in these situations, including the unique nature of individual tasks, the number of robots needed, the complexity of coordinating heterogeneous robot teams, and the need to operate safely. These factors can be partly addressed by having many inexpensive robots and by control policies that provide guarantees on convergence and safety. In this thesis, we address the problem of synthesizing control policies for navigating teams of robots in constrained environments while providing guarantees on convergence and safety. The approach is as follows. We first model the configuration space of the group (a space in which the robots cannot violate the constraints) as a set of polytopes. For a group with a common goal configuration, we reduce complexity by constructing a configuration space for an abstracted group state. We then construct a discrete representation of the configuration space, on which we search for a path to the goal. Based on this path, we synthesize feedback controllers, decentralized affine controllers for kinematic systems and nonlinear feedback controllers for dynamical systems, on the polytopes, sequentially composing controllers to drive the system to the goal. We demonstrate the use of this method in urban environments and on groups of dynamical systems such as quadrotors. We reduce the complexity of multirobot coordination by using an informed graph search to simultaneously build the configuration space and find a path in its discrete representation to the goal. Furthermore, by using an abstraction on groups of robots we dissociate complexity from the number of robots in the group. Although the controllers are designed for navigation in known environments, they are indeed more versatile, as we demonstrate in a concluding simulation of six robots in a partially unknown environment with evolving communication links, object manipulation, and stigmergic interactions

Data-Driven Methods for Geometric Systems

The tools of geometric mechanics provide a compact representation of locomotion dynamics as ``the reconstruction equation''. We have found this equation yields a convenient form for estimating models directly from observation data. This convenience draws from the method's relatively rare feature of providing high accuracy models with little effort. By little effort, we point to the modeling process's low data requirements and the property that nothing about the implementation changes when substituting robot kinematics, material properties, or environmental conditions, as long as some intuitive baseline features of the dynamics are shared. We have applied data-driven geometric mechanics models toward optimizing robot behaviors both physical and simulated, exploring robots' ability to recover from injury, and efficiently creating libraries of maneuvers to be used as building blocks for higher-level robot tasks. Our methods employed the tools of data-driven Floquet analysis, providing a phase that we used as a means of grouping related measurements, allowing us to estimate a reconstruction equation model as a function of phase in the neighborhood of an observed behavior. This tool allowed us to build models at unanticipated scales of complexity and speed. Our use of a perturbation expansion for the geometric terms led to an improved estimation procedure for highly damped systems containing nontrivial but non-dominating amounts of momentum. Analysis of the role of passivity in dissipative systems led to another extension of the estimation procedure to robots with high degrees of underactuation in their internal shape, such as soft robots. This thesis will cover these findings and results, simulated and physical, and the surprising practicality of data-driven geometric mechanics.PHDRoboticsUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/168033/1/babitt_1.pd

PLANNING FOR AUTOMATED OPTICAL MICROMANIPULATION OF BIOLOGICAL CELLS

Optical tweezers (OT) can be viewed as a robot that uses a highly focused laser beam for precise manipulation of biological objects and dielectric beads at micro-scale. Using holographic optical tweezers (HOT) multiple optical traps can be created to allow several operations in parallel. Moreover, due to the non-contact nature of manipulation OT can be potentially integrated with other manipulation techniques (e.g. microfluidics, acoustics, magnetics etc.) to ensure its high throughput. However, biological manipulation using OT suffers from two serious drawbacks: (1) slow manipulation due to manual operation and (2) severe effects on cell viability due to direct exposure of laser. This dissertation explores the problem of autonomous OT based cell manipulation in the light of addressing the two aforementioned limitations. Microfluidic devices are well suited for the study of biological objects because of their high throughput. Integrating microfluidics with OT provides precise position control as well as high throughput. An automated, physics-aware, planning approach is developed for fast transport of cells in OT assisted microfluidic chambers. The heuristic based planner employs a specific cost function for searching over a novel state-action space representation. The effectiveness of the planning algorithm is demonstrated using both simulation and physical experiments in microfluidic-optical tweezers hybrid manipulation setup. An indirect manipulation approach is developed for preventing cells from high intensity laser. Optically trapped inert microspheres are used for manipulating cells indirectly either by gripping or pushing. A novel planning and control approach is devised to automate the indirect manipulation of cells. The planning algorithm takes the motion constraints of the gripper or pushing formation into account to minimize the manipulation time. Two different types of cells (Saccharomyces cerevisiae and Dictyostelium discoideum) are manipulated to demonstrate the effectiveness of the indirect manipulation approach

Manipulability of Leader-Follower Networks with the Rigid-Link Approximation

© Elsevier. This is the author's version of a work that was accepted for publication in Automatica. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Automatica, Vol. 50, Issue 3, pp. 695-706, March 2014, doi: 10.1016/j.automatica.2013.11.041DOI: 10.1016/j.automatica.2013.11.041This paper introduces the notion of manipulability to mobile, multi-agent networks as a tool to analyze the instantaneous effectiveness of injecting control inputs at certain, so-called leader nodes in the network. Effectiveness is interpreted to characterize how the movements of the leader nodes translate into responses among the remaining follower nodes. This notion of effectiveness is a function of the interaction topologies, the agent configurations, and the particular choice of inputs used to influence the network. In fact, classic manipulability is an index used in robotics to analyze the singularity and efficiency of configurations of robot-arm manipulators. To define similar notions for leader-follower networks, we use a rigid-link approximation of the follower dynamics and, under this assumption, we prove that the instantaneous follower velocities can be uniquely determined from that of the leaders’, which allows us to define a meaningful and computable manipulability index for the leader-follower networks. This paper examines the property of the proposed index in simulation and with real mobile robots, and demonstrates how the index can be used to find effective interaction topologies

Percepção do ambiente urbano e navegação usando visão robótica : concepção e implementação aplicado à veículo autônomo

Orientadores: Janito Vaqueiro Ferreira, Alessandro Corrêa VictorinoTese (doutorado) - Universidade Estadual de Campinas, Faculdade de Engenharia MecânicaResumo: O desenvolvimento de veículos autônomos capazes de se locomover em ruas urbanas pode proporcionar importantes benefícios na redução de acidentes, no aumentando da qualidade de vida e também na redução de custos. Veículos inteligentes, por exemplo, frequentemente baseiam suas decisões em observações obtidas a partir de vários sensores tais como LIDAR, GPS e câmeras. Atualmente, sensores de câmera têm recebido grande atenção pelo motivo de que eles são de baixo custo, fáceis de utilizar e fornecem dados com rica informação. Ambientes urbanos representam um interessante mas também desafiador cenário neste contexto, onde o traçado das ruas podem ser muito complexos, a presença de objetos tais como árvores, bicicletas, veículos podem gerar observações parciais e também estas observações são muitas vezes ruidosas ou ainda perdidas devido a completas oclusões. Portanto, o processo de percepção por natureza precisa ser capaz de lidar com a incerteza no conhecimento do mundo em torno do veículo. Nesta tese, este problema de percepção é analisado para a condução nos ambientes urbanos associado com a capacidade de realizar um deslocamento seguro baseado no processo de tomada de decisão em navegação autônoma. Projeta-se um sistema de percepção que permita veículos robóticos a trafegar autonomamente nas ruas, sem a necessidade de adaptar a infraestrutura, sem o conhecimento prévio do ambiente e considerando a presença de objetos dinâmicos tais como veículos. Propõe-se um novo método baseado em aprendizado de máquina para extrair o contexto semântico usando um par de imagens estéreo, a qual é vinculada a uma grade de ocupação evidencial que modela as incertezas de um ambiente urbano desconhecido, aplicando a teoria de Dempster-Shafer. Para a tomada de decisão no planejamento do caminho, aplica-se a abordagem dos tentáculos virtuais para gerar possíveis caminhos a partir do centro de referencia do veículo e com base nisto, duas novas estratégias são propostas. Em primeiro, uma nova estratégia para escolher o caminho correto para melhor evitar obstáculos e seguir a tarefa local no contexto da navegação hibrida e, em segundo, um novo controle de malha fechada baseado na odometria visual e o tentáculo virtual é modelado para execução do seguimento de caminho. Finalmente, um completo sistema automotivo integrando os modelos de percepção, planejamento e controle são implementados e validados experimentalmente em condições reais usando um veículo autônomo experimental, onde os resultados mostram que a abordagem desenvolvida realiza com sucesso uma segura navegação local com base em sensores de câmeraAbstract: The development of autonomous vehicles capable of getting around on urban roads can provide important benefits in reducing accidents, in increasing life comfort and also in providing cost savings. Intelligent vehicles for example often base their decisions on observations obtained from various sensors such as LIDAR, GPS and Cameras. Actually, camera sensors have been receiving large attention due to they are cheap, easy to employ and provide rich data information. Inner-city environments represent an interesting but also very challenging scenario in this context, where the road layout may be very complex, the presence of objects such as trees, bicycles, cars might generate partial observations and also these observations are often noisy or even missing due to heavy occlusions. Thus, perception process by nature needs to be able to deal with uncertainties in the knowledge of the world around the car. While highway navigation and autonomous driving using a prior knowledge of the environment have been demonstrating successfully, understanding and navigating general inner-city scenarios with little prior knowledge remains an unsolved problem. In this thesis, this perception problem is analyzed for driving in the inner-city environments associated with the capacity to perform a safe displacement based on decision-making process in autonomous navigation. It is designed a perception system that allows robotic-cars to drive autonomously on roads, without the need to adapt the infrastructure, without requiring previous knowledge of the environment and considering the presence of dynamic objects such as cars. It is proposed a novel method based on machine learning to extract the semantic context using a pair of stereo images, which is merged in an evidential grid to model the uncertainties of an unknown urban environment, applying the Dempster-Shafer theory. To make decisions in path-planning, it is applied the virtual tentacle approach to generate possible paths starting from ego-referenced car and based on it, two news strategies are proposed. First one, a new strategy to select the correct path to better avoid obstacles and to follow the local task in the context of hybrid navigation, and second, a new closed loop control based on visual odometry and virtual tentacle is modeled to path-following execution. Finally, a complete automotive system integrating the perception, path-planning and control modules are implemented and experimentally validated in real situations using an experimental autonomous car, where the results show that the developed approach successfully performs a safe local navigation based on camera sensorsDoutoradoMecanica dos Sólidos e Projeto MecanicoDoutor em Engenharia Mecânic