Coordinated multi-robot formation control

Tese de doutoramento. Engenharia Electrotécnica e de Computadores. Faculdade de Engenharia. Universidade do Porto. 201

Comprehensive review on controller for leader-follower robotic system

985-1007This paper presents a comprehensive review of the leader-follower robotics system. The aim of this paper is to find and elaborate on the current trends in the swarm robotic system, leader-follower, and multi-agent system. Another part of this review will focus on finding the trend of controller utilized by previous researchers in the leader-follower system. The controller that is commonly applied by the researchers is mostly adaptive and non-linear controllers. The paper also explores the subject of study or system used during the research which normally employs multi-robot, multi-agent, space flying, reconfigurable system, multi-legs system or unmanned system. Another aspect of this paper concentrates on the topology employed by the researchers when they conducted simulation or experimental studies

Fault-tolerant formation driving mechanism designed for heterogeneous MAVs-UGVs groups

A fault-tolerant method for stabilization and navigation of 3D heterogeneous formations is proposed in this paper. The presented Model Predictive Control (MPC) based approach enables to deploy compact formations of closely cooperating autonomous aerial and ground robots in surveillance scenarios without the necessity of a precise external localization. Instead, the proposed method relies on a top-view visual relative localization provided by the micro aerial vehicles flying above the ground robots and on a simple yet stable visual based navigation using images from an onboard monocular camera. The MPC based schema together with a fault detection and recovery mechanism provide a robust solution applicable in complex environments with static and dynamic obstacles. The core of the proposed leader-follower based formation driving method consists in a representation of the entire 3D formation as a convex hull projected along a desired path that has to be followed by the group. Such an approach provides non-collision solution and respects requirements of the direct visibility between the team members. The uninterrupted visibility is crucial for the employed top-view localization and therefore for the stabilization of the group. The proposed formation driving method and the fault recovery mechanisms are verified by simulations and hardware experiments presented in the paper

Navigation, localization and stabilization of formations of unmanned aerial and ground vehicles

A leader-follower formation driving algorithm developed for control of heterogeneous groups of unmanned micro aerial and ground vehicles stabilized under a top-view relative localization is presented in this paper. The core of the proposed method lies in a novel avoidance function, in which the entire 3D formation is represented by a convex hull projected along a desired path to be followed by the group. Such a representation of the formation provides non-collision trajectories of the robots and respects requirements of the direct visibility between the team members in environment with static as well as dynamic obstacles, which is crucial for the top-view localization. The algorithm is suited for utilization of a simple yet stable visual based navigation of the group (referred to as GeNav), which together with the on-board relative localization enables deployment of large teams of micro-scale robots in environments without any available global localization system. We formulate a novel Model Predictive Control (MPC) based concept that enables to respond to the changing environment and that provides a robust solution with team members' failure tolerance included. The performance of the proposed method is verified by numerical and hardware experiments inspired by reconnaissance and surveillance missions

Cooperative Control of Multiple Wheeled Mobile Robots: Normal and Faulty Situations

Recently, cooperative control of multiple unmanned vehicles has attracted a great deal of attention from scientific, industrial, and military aspects. Groups of unmanned ground, aerial, or marine vehicles working cooperatively lead to many advantages in a variety of applications such as: surveillance, search and exploration, cooperative reconnaissance, environmental monitoring, and cooperative manipulation, respectively. During mission execution, unmanned systems should travel autonomously between different locations, maintain a pre-defined formation shape, avoid collisions of obstacles and also other team members, and accommodate occurred faults and mitigate their negative effect on mission execution. The main objectives of this dissertation are to design novel algorithms for single wheeled mobile robots (WMRs) trajectory tracking, cooperative control and obstacle avoidance of WMRs in fault-free situations. In addition, novel algorithms are developed for fault-tolerant cooperative control (FTCC) with integration of fault detection and diagnosis (FDD) scheme. In normal/fault-free cases, an integrated approach combining input-output feedback linearization and distributed model predictive control (MPC) techniques is designed and implemented on a team of WMRs to accomplish the trajectory tracking as well as the cooperative task. An obstacle avoidance algorithm based on mechanical impedance principle is proposed to avoid potential collisions of surrounding obstacles. Moreover, the proposed control algorithm is implemented to a team of WMRs for pairing with a team of unmanned aerial vehicles (UAVs) for forest monitoring and fire detection applications. When actuator faults occur in one of the robots, two cases are explicitly considered: i) if the faulty robot cannot complete its assigned task due to a severe fault, then the faulty robot has to get out from the formation mission, and an FTCC strategy is designed such that the tasks of the WMRs team are re-assigned to the remaining healthy robots to complete the mission with graceful performance degradation. Two methods are used to investigate this case: the Graph Theory, and formulating the FTCC problem as an optimal assignment problem; and ii) if the faulty robot can continue the mission with degraded performance, then the other team members reconfigure the controllers considering the capability of the faulty robot. Thus, the FTCC strategy is designed to re-coordinate the motion of each robot in the team. Within the proposed scheme, an FDD unit using a two-stage Kalman filter (TSKF) to detect and diagnose actuator faults is presented. In case of using any other nonlinear controller in fault-free case rather than MPC, and in case of severe fault occurrence, another FTCC strategy is presented. First, the new reconfiguration is formulated by an optimal assignment problem where each healthy WMR is assigned to a unique place. Second, the new formation can be reconfigured, while the objective is to minimize the time to achieve the new formation within the constraints of the WMRs' dynamics and collision avoidance. A hybrid approach of control parametrization and time discretization (CPTD) and particle swarm optimization (PSO) is proposed to address this problem. Since PSO cannot solve the continuous control inputs, CPTD is adopted to provide an approximate piecewise linearization of the control inputs. Therefore, PSO can be adopted to find the global optimum solution. In all cases, formation operation of the robot team is based on a leader-follower approach, whilst the control algorithm is implemented in a distributed manner. The results of the numerical simulations and real experiments demonstrate the effectiveness of the proposed algorithms in various scenarios

Cooperative Control of Multiple Wheeled Mobile Robots: Normal and Faulty Situations

Recently, cooperative control of multiple unmanned vehicles has attracted a great deal of attention from scientific, industrial, and military aspects. Groups of unmanned ground, aerial, or marine vehicles working cooperatively lead to many advantages in a variety of applications such as: surveillance, search and exploration, cooperative reconnaissance, environmental monitoring, and cooperative manipulation, respectively. During mission execution, unmanned systems should travel autonomously between different locations, maintain a pre-defined formation shape, avoid collisions of obstacles and also other team members, and accommodate occurred faults and mitigate their negative effect on mission execution. The main objectives of this dissertation are to design novel algorithms for single wheeled mobile robots (WMRs) trajectory tracking, cooperative control and obstacle avoidance of WMRs in fault-free situations. In addition, novel algorithms are developed for fault-tolerant cooperative control (FTCC) with integration of fault detection and diagnosis (FDD) scheme. In normal/fault-free cases, an integrated approach combining input-output feedback linearization and distributed model predictive control (MPC) techniques is designed and implemented on a team of WMRs to accomplish the trajectory tracking as well as the cooperative task. An obstacle avoidance algorithm based on mechanical impedance principle is proposed to avoid potential collisions of surrounding obstacles. Moreover, the proposed control algorithm is implemented to a team of WMRs for pairing with a team of unmanned aerial vehicles (UAVs) for forest monitoring and fire detection applications. When actuator faults occur in one of the robots, two cases are explicitly considered: i) if the faulty robot cannot complete its assigned task due to a severe fault, then the faulty robot has to get out from the formation mission, and an FTCC strategy is designed such that the tasks of the WMRs team are re-assigned to the remaining healthy robots to complete the mission with graceful performance degradation. Two methods are used to investigate this case: the Graph Theory, and formulating the FTCC problem as an optimal assignment problem; and ii) if the faulty robot can continue the mission with degraded performance, then the other team members reconfigure the controllers considering the capability of the faulty robot. Thus, the FTCC strategy is designed to re-coordinate the motion of each robot in the team. Within the proposed scheme, an FDD unit using a two-stage Kalman filter (TSKF) to detect and diagnose actuator faults is presented. In case of using any other nonlinear controller in fault-free case rather than MPC, and in case of severe fault occurrence, another FTCC strategy is presented. First, the new reconfiguration is formulated by an optimal assignment problem where each healthy WMR is assigned to a unique place. Second, the new formation can be reconfigured, while the objective is to minimize the time to achieve the new formation within the constraints of the WMRs' dynamics and collision avoidance. A hybrid approach of control parametrization and time discretization (CPTD) and particle swarm optimization (PSO) is proposed to address this problem. Since PSO cannot solve the continuous control inputs, CPTD is adopted to provide an approximate piecewise linearization of the control inputs. Therefore, PSO can be adopted to find the global optimum solution. In all cases, formation operation of the robot team is based on a leader-follower approach, whilst the control algorithm is implemented in a distributed manner. The results of the numerical simulations and real experiments demonstrate the effectiveness of the proposed algorithms in various scenarios

Collaborative Trolley Transportation System with Autonomous Nonholonomic Robots

Cooperative object transportation using multiple robots has been intensively studied in the control and robotics literature, but most approaches are either only applicable to omnidirectional robots or lack a complete navigation and decision-making framework that operates in real time. This paper presents an autonomous nonholonomic multi-robot system and an end-to-end hierarchical autonomy framework for collaborative luggage trolley transportation. This framework finds kinematic-feasible paths, computes online motion plans, and provides feedback that enables the multi-robot system to handle long lines of luggage trolleys and navigate obstacles and pedestrians while dealing with multiple inherently complex and coupled constraints. We demonstrate the designed collaborative trolley transportation system through practical transportation tasks, and the experiment results reveal their effectiveness and reliability in complex and dynamic environments

A Distributed Model Predictive Control Framework for Road-Following Formation Control of Car-like Vehicles (Extended Version)

This work presents a novel framework for the formation control of multiple autonomous ground vehicles in an on-road environment. Unique challenges of this problem lie in 1) the design of collision avoidance strategies with obstacles and with other vehicles in a highly structured environment, 2) dynamic reconfiguration of the formation to handle different task specifications. In this paper, we design a local MPC-based tracking controller for each individual vehicle to follow a reference trajectory while satisfying various constraints (kinematics and dynamics, collision avoidance, \textit{etc.}). The reference trajectory of a vehicle is computed from its leader's trajectory, based on a pre-defined formation tree. We use logic rules to organize the collision avoidance behaviors of member vehicles. Moreover, we propose a methodology to safely reconfigure the formation on-the-fly. The proposed framework has been validated using high-fidelity simulations.Comment: Extended version of the conference paper submission on ICARCV'1