Adaptive consensus based formation control of unmanned vehicles

Over the past decade, the control research community has given significant attention to formation control of multiple unmanned vehicles due to a variety of commercial and defense applications. Consensus-based formation control is considered to be more robust and reliable when compared to other formation control methods due to scalability and inherent properties that enable the formation to continue even if one of the vehicles experiences a failure. In contrast to existing methods on formation control where the dynamics of the vehicles are neglected, this dissertation in the form of four papers presents consensus-based formation control of unmanned vehicles-both ground and aerial, by incorporating the vehicle dynamics. First, neural networks (NN)-based optimal adaptive consensus-based formation control over finite horizon is presented for networked mobile robots or agents in the presence of uncertain robot/agent dynamics and communication. In the second paper, a hybrid automaton is proposed to control the nonholonomic mobile robots in two discrete modes: a regulation mode and a formation keeping mode in order to overcome well-known stabilization problem. The third paper presents the design of a distributed consensus-based event-triggered formation control of networked mobile robots using NN in the presence of uncertain robot dynamics to minimize communication. All these papers assume state availability. Finally, the fourth paper extends the consensus effort by introducing the development of a novel nonlinear output feedback NN-based controller for a group of quadrotor UAVs --Abstract, page iv

Adaptive and learning-based formation control of swarm robots

Autonomous aerial and wheeled mobile robots play a major role in tasks such as search and rescue, transportation, monitoring, and inspection. However, these operations are faced with a few open challenges including robust autonomy, and adaptive coordination based on the environment and operating conditions, particularly in swarm robots with limited communication and perception capabilities. Furthermore, the computational complexity increases exponentially with the number of robots in the swarm. This thesis examines two different aspects of the formation control problem. On the one hand, we investigate how formation could be performed by swarm robots with limited communication and perception (e.g., Crazyflie nano quadrotor). On the other hand, we explore human-swarm interaction (HSI) and different shared-control mechanisms between human and swarm robots (e.g., BristleBot) for artistic creation. In particular, we combine bio-inspired (i.e., flocking, foraging) techniques with learning-based control strategies (using artificial neural networks) for adaptive control of multi- robots. We first review how learning-based control and networked dynamical systems can be used to assign distributed and decentralized policies to individual robots such that the desired formation emerges from their collective behavior. We proceed by presenting a novel flocking control for UAV swarm using deep reinforcement learning. We formulate the flocking formation problem as a partially observable Markov decision process (POMDP), and consider a leader-follower configuration, where consensus among all UAVs is used to train a shared control policy, and each UAV performs actions based on the local information it collects. In addition, to avoid collision among UAVs and guarantee flocking and navigation, a reward function is added with the global flocking maintenance, mutual reward, and a collision penalty. We adapt deep deterministic policy gradient (DDPG) with centralized training and decentralized execution to obtain the flocking control policy using actor-critic networks and a global state space matrix. In the context of swarm robotics in arts, we investigate how the formation paradigm can serve as an interaction modality for artists to aesthetically utilize swarms. In particular, we explore particle swarm optimization (PSO) and random walk to control the communication between a team of robots with swarming behavior for musical creation

Comprehensive review on controller for leader-follower robotic system

985-1007This paper presents a comprehensive review of the leader-follower robotics system. The aim of this paper is to find and elaborate on the current trends in the swarm robotic system, leader-follower, and multi-agent system. Another part of this review will focus on finding the trend of controller utilized by previous researchers in the leader-follower system. The controller that is commonly applied by the researchers is mostly adaptive and non-linear controllers. The paper also explores the subject of study or system used during the research which normally employs multi-robot, multi-agent, space flying, reconfigurable system, multi-legs system or unmanned system. Another aspect of this paper concentrates on the topology employed by the researchers when they conducted simulation or experimental studies

A survey on fractional order control techniques for unmanned aerial and ground vehicles

In recent years, numerous applications of science and engineering for modeling and control of unmanned aerial vehicles (UAVs) and unmanned ground vehicles (UGVs) systems based on fractional calculus have been realized. The extra fractional order derivative terms allow to optimizing the performance of the systems. The review presented in this paper focuses on the control problems of the UAVs and UGVs that have been addressed by the fractional order techniques over the last decade

Data-Driven Architecture to Increase Resilience In Multi-Agent Coordinated Missions

The rise in the use of Multi-Agent Systems (MASs) in unpredictable and changing environments has created the need for intelligent algorithms to increase their autonomy, safety and performance in the event of disturbances and threats. MASs are attractive for their flexibility, which also makes them prone to threats that may result from hardware failures (actuators, sensors, onboard computer, power source) and operational abnormal conditions (weather, GPS denied location, cyber-attacks). This dissertation presents research on a bio-inspired approach for resilience augmentation in MASs in the presence of disturbances and threats such as communication link and stealthy zero-dynamics attacks. An adaptive bio-inspired architecture is developed for distributed consensus algorithms to increase fault-tolerance in a network of multiple high-order nonlinear systems under directed fixed topologies. In similarity with the natural organisms’ ability to recognize and remember specific pathogens to generate its immunity, the immunity-based architecture consists of a Distributed Model-Reference Adaptive Control (DMRAC) with an Artificial Immune System (AIS) adaptation law integrated within a consensus protocol. Feedback linearization is used to modify the high-order nonlinear model into four decoupled linear subsystems. A stability proof of the adaptation law is conducted using Lyapunov methods and Jordan decomposition. The DMRAC is proven to be stable in the presence of external time-varying bounded disturbances and the tracking error trajectories are shown to be bounded. The effectiveness of the proposed architecture is examined through numerical simulations. The proposed controller successfully ensures that consensus is achieved among all agents while the adaptive law v simultaneously rejects the disturbances in the agent and its neighbors. The architecture also includes a health management system to detect faulty agents within the global network. Further numerical simulations successfully test and show that the Global Health Monitoring (GHM) does effectively detect faults within the network

A Survey on Aerial Swarm Robotics

The use of aerial swarms to solve real-world problems has been increasing steadily, accompanied by falling prices and improving performance of communication, sensing, and processing hardware. The commoditization of hardware has reduced unit costs, thereby lowering the barriers to entry to the field of aerial swarm robotics. A key enabling technology for swarms is the family of algorithms that allow the individual members of the swarm to communicate and allocate tasks amongst themselves, plan their trajectories, and coordinate their flight in such a way that the overall objectives of the swarm are achieved efficiently. These algorithms, often organized in a hierarchical fashion, endow the swarm with autonomy at every level, and the role of a human operator can be reduced, in principle, to interactions at a higher level without direct intervention. This technology depends on the clever and innovative application of theoretical tools from control and estimation. This paper reviews the state of the art of these theoretical tools, specifically focusing on how they have been developed for, and applied to, aerial swarms. Aerial swarms differ from swarms of ground-based vehicles in two respects: they operate in a three-dimensional space and the dynamics of individual vehicles adds an extra layer of complexity. We review dynamic modeling and conditions for stability and controllability that are essential in order to achieve cooperative flight and distributed sensing. The main sections of this paper focus on major results covering trajectory generation, task allocation, adversarial control, distributed sensing, monitoring, and mapping. Wherever possible, we indicate how the physics and subsystem technologies of aerial robots are brought to bear on these individual areas

Adaptive and Optimal Motion Control of Multi-UAV Systems

This thesis studies trajectory tracking and coordination control problems for single and multi unmanned aerial vehicle (UAV) systems. These control problems are addressed for both quadrotor and fixed-wing UAV cases. Despite the fact that the literature has some approaches for both problems, most of the previous studies have implementation challenges on real-time systems. In this thesis, we use a hierarchical modular approach where the high-level coordination and formation control tasks are separated from low-level individual UAV motion control tasks. This separation helps efficient and systematic optimal control synthesis robust to effects of nonlinearities, uncertainties and external disturbances at both levels, independently. The modular two-level control structure is convenient in extending single-UAV motion control design to coordination control of multi-UAV systems. Therefore, we examine single quadrotor UAV trajectory tracking problems to develop advanced controllers compensating effects of nonlinearities and uncertainties, and improving robustness and optimality for tracking performance. At fi rst, a novel adaptive linear quadratic tracking (ALQT) scheme is developed for stabilization and optimal attitude control of the quadrotor UAV system. In the implementation, the proposed scheme is integrated with Kalman based reliable attitude estimators, which compensate measurement noises. Next, in order to guarantee prescribed transient and steady-state tracking performances, we have designed a novel backstepping based adaptive controller that is robust to effects of underactuated dynamics, nonlinearities and model uncertainties, e.g., inertial and rotational drag uncertainties. The tracking performance is guaranteed to utilize a prescribed performance bound (PPB) based error transformation. In the coordination control of multi-UAV systems, following the two-level control structure, at high-level, we design a distributed hierarchical (leader-follower) 3D formation control scheme. Then, the low-level control design is based on the optimal and adaptive control designs performed for each quadrotor UAV separately. As particular approaches, we design an adaptive mixing controller (AMC) to improve robustness to varying parametric uncertainties and an adaptive linear quadratic controller (ALQC). Lastly, for planar motion, especially for constant altitude flight of fixed-wing UAVs, in 2D, a distributed hierarchical (leader-follower) formation control scheme at the high-level and a linear quadratic tracking (LQT) scheme at the low-level are developed for tracking and formation control problems of the fixed-wing UAV systems to examine the non-holonomic motion case. The proposed control methods are tested via simulations and experiments on a multi-quadrotor UAV system testbed

Motion Planning of UAV Swarm: Recent Challenges and Approaches

The unmanned aerial vehicle (UAV) swarm is gaining massive interest for researchers as it has huge significance over a single UAV. Many studies focus only on a few challenges of this complex multidisciplinary group. Most of them have certain limitations. This paper aims to recognize and arrange relevant research for evaluating motion planning techniques and models for a swarm from the viewpoint of control, path planning, architecture, communication, monitoring and tracking, and safety issues. Then, a state-of-the-art understanding of the UAV swarm and an overview of swarm intelligence (SI) are provided in this research. Multiple challenges are considered, and some approaches are presented. Findings show that swarm intelligence is leading in this era and is the most significant approach for UAV swarm that offers distinct contributions in different environments. This integration of studies will serve as a basis for knowledge concerning swarm, create guidelines for motion planning issues, and strengthens support for existing methods. Moreover, this paper possesses the capacity to engender new strategies that can serve as the grounds for future work