Coordinated multi-arm motion planning: Reaching for moving objects in the face of uncertainty (RSS 2016 Best Student Paper Award)

Coordinated control strategies for multi-robot systems are necessary for tasks that cannot be executed by a single robot. This encompasses tasks where the workspace of the robot is too small or where the load is too heavy for one robot to handle. Using multiple robots makes the task feasible by extending the workspace and/or increase the payload of the overall robotic system. In this paper, we consider two instances of such task: a co-worker scenario in which a human hands over a large object to a robot; intercepting a large flying object. The problem is made difficult as the pick-up/intercept motions must take place while the object is in motion and because the object's motion is not deterministic. The challenge is then to adapt the motion of the robotic arms in coordination with one another and with the object. Determining the pick-up/intercept point is done by taking into account the workspace of the multi-arm system and is continuously recomputed to adapt to change in the object's trajectory. We propose a dynamical systems (DS) based control law to generate autonomous and synchronized motions for a multi-arm robot system in the task of reaching for a moving object. We show theoretically that the resulting DS coordinates the motion of the robots with each other and with the object, while the system remains stable. We validate our approach on a dual-arm robotic system and demonstrate that it can re-synchronize and adapt the motion of each arm in synchrony in a fraction of seconds, even when the motion of the object is fast and not accurately predictable

Coordinated multi-arm motion planning: Reaching for moving objects in the face of uncertainty

Sina Mirrazavi Salehian S, Figueroa N, Billard A. Coordinated multi-arm motion planning: Reaching for moving objects in the face of uncertainty. In: Proceedings of Robotics: Science and Systems. AnnArbor, Michigan; 2016

Optimal guidance and control in space technology

In this thesis, we deal with several optimal guidance and control problems of the spacecrafts arising from the study of lunar exploration. The research is composed of three parts: 1. Optimal guidance for the lunar module soft landing, 2. Spacecraft attitude control system design basing on double gimbal control moment gyroscopes (DGCMGs), and 3. Synchronization motion control for a class of nonlinear system.To achieve a precise pinpoint lunar module soft landing, we first derive a three dimensional dynamics to describe the motion of the module for the powered descent part by introducing three coordinate frames with consideration of the moon rotation. Then, we move on to construct an optimal guidance law to achieve the lunar module soft landing which is treated as a continuously powered descent process with a constraint on the angle of the module between its longitudinal axis and the moon surface. When the module reaches the landing target, the terminal attitude of the module should be within an allowable small deviation from being vertical with reference to lunar surface. The fuel consumption and the terminal time should also be minimized. The optimal descent trajectory of the lunar module is calculated by using the control parameterization technique in conjunction with a time scaling transform. By these two methods, the optimal control problem is approximated by a sequence of optimal parameter selection problems which can be solved by existing gradient-based optimization methods. MISER 3.3, a general purpose optimal control software package, was developed based on these methods. We make use of this optimal control software package to solve our problem. The optimal trajectory tracking problem, where a desired trajectory is to be tracked with the least fuel consumption in the minimum time, is also considered and solved.With the consideration of some unpredicted situations, such as initial point perturbations, we move on to construct a nonlinear optimal feedback control law for the powered deceleration phase of the lunar module soft landing. The motion of the lunar module is described in the three dimensional coordinate system. Based on the nonlinear dynamics of the module, we obtain the form of an optimal closed loop control law, where a feedback gain matrix is involved. It is then shown that this feedback gain matrix satisfies a Riccati-like matrix differential equation. The optimal control problem is first solved as an open loop optimal control problem by using the time scaling transform and the control parameterization method. By virtue of the relationship between the optimal open loop control and the optimal closed loop control along the optimal trajectory, we present a practical method to calculate an approximate optimal feedback gain matrix, without having to solve an optimal control problem involving the complex Riccati-like matrix differential equation coupled with the original system dynamics.To realize the spacecraft large angle attitude maneuvers, we derive an exact general mathematical description of spacecraft attitude motion driven by DGCMGs system. Then, a nonlinear control law is designed based on the second method of Lyapunov and the stability of the attitude control system is established during the design process. A singularity robustness plus null motion steering law is designed to realize the control law. Principle of DGCMGs’ singularity is proved, and the singularity analysis of the orthogonally mounted three DGCMGs system and that of the parallel mounted four DGCMGs system are presented.Finally, we consider a new class of nonlinear optimal tracking and synchronizing control problems subject to control constraints, where the motions of two distinct objects are required to achieve synchronization at the minimum time while achieving the optimal tracking of a reference target. We first provide a rigorous mathematical formulation for this class of optimal control problems. A new result ensuring the synchronization of the two distinct objects is obtained. On this basis, a computational method is developed for constructing an optimal switching control law under which the motions of the two distinct objects will achieve synchronization at the minimum time while achieving the optimal tracking of a reference target. This computational method is developed based on novel applications of the control parameterization method and a time scaling transform. A practical problem arising from the study of the angular velocity tracking and synchronization of two spacecrafts during their formation flight is formulated and solved by the method proposed

Compliant control of Uni/ Multi- robotic arms with dynamical systems

Accomplishment of many interactive tasks hinges on the compliance of humans. Humans demonstrate an impressive capability of complying their behavior and more particularly their motions with the environment in everyday life. In humans, compliance emerges from different facets. For example, many daily activities involve reaching for grabbing tasks, where compliance appears in a form of coordination. Humans comply their handsâ motions with each other and with that of the object not only to establish a stable contact and to control the impact force but also to overcome sensorimotor imprecisions. Even though compliance has been studied from different aspects in humans, it is primarily related to impedance control in robotics. In this thesis, we leverage the properties of autonomous dynamical systems (DS) for immediate re-planning and introduce active complaint motion generators for controlling robots in three different scenarios, where compliance does not necessarily mean impedance and hence it is not directly related to control in the force/velocity domain. In the first part of the thesis, we propose an active compliant strategy for catching objects in flight, which is less sensitive to the timely control of the interception. The soft catching strategy consists in having the robot following the object for a short period of time. This leaves more time for the fingers to close on the object at the interception and offers more robustness than a âhardâ catching method in which the hand waits for the object at the chosen interception point. We show theoretically that the resulting DS will intercept the object at the intercept point, at the right time with the desired velocity direction. Stability and convergence of the approach are assessed through Lyapunov stability theory. In the second part, we propose a unified compliant control architecture for coordinately reaching for grabbing a moving object by a multi-arm robotic system. Due to the complexity of the task and of the system, each arm complies not only with the objectâs motion but also with the motion of other arms, in both task and joint spaces. At the task-space level, we propose a unified dynamical system that endows the multi-arm system with both synchronous and asynchronous behaviors and with the capability of smoothly transitioning between the two modes. At the joint space level, the compliance between the arms is achieved by introducing a centralized inverse kinematics (IK) solver under self-collision avoidance constraints; formulated as a quadratic programming problem (QP) and solved in real-time. In the last part, we propose a compliant dynamical system for stably transitioning from free motions to contacts. In this part, by modulating the robot's velocity in three regions, we show theoretically and empirically that the robot can (I) stably touch the contact surface (II) at a desired location, and (III) leave the surface or stop on the surface at a desired point

Consensus control in robot networks and cooperative teleoperation : an operational space approach

An interesting approach in cooperative control is to design distributed control strategies which use only local information so that a multi-agent system achieves specified behaviors. A basic behavior in cooperative control is the consensus. Given a multi-agent system, like a multiple robot network, it is said that the agents reach a consensus if the state of each agent converges to a common state. Examples of cooperative tasks in which consensus algorithms are employed include formation control, flocking theory, rendezvous problems and synchronization. These cooperative tasks have several possible applications, like: transportation systems (intelligent highways, air-traffic control); military systems (formation flight, surveillance, reconnaissance, cooperative attack and rendezvous) and mobile sensor networks (space-based interferometers, environmental sampling). The solution to the consensus problems involves the design of control algorithms such that the agents can reach an agreement on their states. There are two main problems that are studied in consensus, the leader-follower consensus and the leaderless consensus. In the leader-follower consensus problem, there exists a leader that specifies the state for the whole group while in a leaderless consensus problem, there is not a priori reference state. The main goal of this thesis is the design of operational space controllers that solve the leader-follower and the leaderless consensus problems in networks composed of multiple heterogeneous robots. Furthermore, this document proposes novel operational space control schemes for bilateral teleoperation systems. In both scenarios, different conditions are studied, such as the absence of robot velocity measurements, constant and variable time-delays in the robot's interconnection, and uncertainty in the robot's physical parameters. Most of the previous consensus control algorithms, only work with the position or orientation but not with both. On the contrary, this dissertation deals with the entire pose of the robots that contains both the position and the orientation. Moreover, in order to render a singularity-free description of the orientation, the unit-quaternions are employed. The dissertation provides a rigorous stability analysis of the control algorithms and presents simulations and experiments that validate the effectiveness of the proposed controllers.Un enfoque interesante en el control cooperativo es el diseño de estrategias de control distribuido que requieran sólo información local para que un sistema multi-agente logre comportamientos específicos. Un comportamiento básico del control cooperativo es el consenso. Dado un sistema multi-agente, como una red de múltiples robots, se dice que los agentes llegan a un consenso si el estado de cada agente converge a un estado común. Algunos ejemplos de tareas cooperativas en las que los algoritmos de consenso son utilizados son los siguientes: el control de la formación, flocking, rendezvous y sincronización. Estas tareas cooperativas tienen varias aplicaciones posibles, como: sistemas de transporte (carreteras inteligentes , control de tráfico aéreo); sistemas militares (vuelo en formación, vigilancia, reconocimiento, ataque cooperativo) y redes de sensores móviles (interferómetros en el espacio, el muestreo del ambiente). La solución a los problemas de consenso implica el diseño de algoritmos de control de tal manera que los agentes pueden llegar a un acuerdo sobre sus estados. Hay dos problemas principales que se estudian en el consenso, el consenso líder-seguidor y el consenso sin líder. En el problema de consenso líder-seguidor, existe un líder que especifica el estado de todo el grupo, mientras que en un problema de consenso sin líder, no hay ningún estado de referencia definido a priori. El objetivo principal de esta tesis es el diseño de controladores en el espacio operacional que resuelvan los problemas de consenso líder-seguidor y sin líder en redes compuestas de múltiples robots heterogéneos. Además, este documento propone novedosos esquemas de control en el espacio operacional para sistemas de teleoperación bilateral. En ambos escenarios, se estudian diferentes condiciones, tales como la ausencia de medidas de velocidad de los robots, retardos constantes y variables en la interconexión de los robots y la incertidumbre en los parámetros físicos de los robots. La mayoría de los anteriores algoritmos de control que resuelven el consenso, sólo trabajan con la posición o la orientación, pero no con ambos. Por el contrario, esta tesis doctoral se ocupa de toda la pose de los robots que contiene tanto la posición y la orientación. Por otra parte, a fin de usar una representación de la orientación libre de singularidades, se emplean los cuaterniones unitarios. Esta tesis doctoral proporciona un análisis riguroso de la estabilidad de los algoritmos de control y presenta simulaciones y experimentos que validan la eficacia de los controladores propuesto

Computational intelligence approaches to robotics, automation, and control [Volume guest editors]

No abstract available

Task Allocation Strategies in Multi-Robot Environment

Multirobot systems (MRS) hold the promise of improved performance and increased fault tolerance for large-scale problems. A robot team can accomplish a given task more quickly than a single agent by executing them concurrently. A team can also make effective use of specialists designed for a single purpose rather than requiring that a single robot be a generalist. Multirobot coordination, however, is a complex problem. An empirical study is described in the thesis that sought general guidelines for task allocation strategies. Different strategies are identified, and demonstrated in the multi-robot environment.Robot selection is one of the critical issues in the design of robotic workcells. Robot selection for an application is generally done based on experience, intuition and at most using the kinematic considerations like workspace, manipulability, etc. This problem has become more difficult in recent years due to increasing complexity, available features, and facilities offered by different robotic products. A systematic procedure is developed for selection of robot manipulators based on their different pertinent attributes. The robot selection procedure allows rapid convergence from a very large number of candidate robots to a manageable shortlist of potentially suitable robots. Subsequently, the selection procedure proceeds to rank the alternatives in the shortlist by employing different attributes based specification methods. This is an attempt to create exhaustive procedure by identifying maximum possible number of attributes for robot manipulators.Availability of large number of robot configurations has made the robot workcell designers think over the issue of selecting the most suitable one for a given set of operations. The process of selection of the appropriate kind of robot must consider the various attributes of the robot manipulator in conjunction with the requirement of the various operations for accomplishing the task. The present work is an attempt to develop a systematic procedure for selection of robot based on an integrated model encompassing the manipulator attributes and manipulator requirements

Swarm Robotics

Collectively working robot teams can solve a problem more efficiently than a single robot, while also providing robustness and flexibility to the group. Swarm robotics model is a key component of a cooperative algorithm that controls the behaviors and interactions of all individuals. The robots in the swarm should have some basic functions, such as sensing, communicating, and monitoring, and satisfy the following properties

Computational intelligence approaches to robotics, automation, and control [Volume guest editors]

No abstract available