A Survey and Analysis of Cooperative Multi-Agent Robot Systems: Challenges and Directions

Research in the area of cooperative multi-agent robot systems has received wide attention among researchers in recent years. The main concern is to find the effective coordination among autonomous agents to perform the task in order to achieve a high quality of overall performance. Therefore, this paper reviewed various selected literatures primarily from recent conference proceedings and journals related to cooperation and coordination of multi-agent robot systems (MARS). The problems, issues, and directions of MARS research have been investigated in the literature reviews. Three main elements of MARS which are the type of agents, control architectures, and communications were discussed thoroughly in the beginning of this paper. A series of problems together with the issues were analyzed and reviewed, which included centralized and decentralized control, consensus, containment, formation, task allocation, intelligences, optimization and communications of multi-agent robots. Since the research in the field of multi-agent robot research is expanding, some issues and future challenges in MARS are recalled, discussed and clarified with future directions. Finally, the paper is concluded with some recommendations with respect to multi-agent systems

Estimator-based adaptive neural network control of leader-follower high-order nonlinear multiagent systems with actuator faults

The problem of distributed cooperative control for networked multiagent systems is investigated in this paper. Each agent is modeled as an uncertain nonlinear high-order system incorporating with model uncertainty, unknown external disturbance, and actuator fault. The communication network between followers can be an undirected or a directed graph, and only some of the follower agents can obtain the commands from the leader. To develop the distributed cooperative control algorithm, a prefilter is designed, which can derive the state-space representation to a newly constructed plant. Then, a set of distributed adaptive neural network controllers are designed by making certain modifications on traditional backstepping techniques with the aid of adaptive control, neural network control, and a second-order sliding mode estimator. Rigorous proving procedures are provided,which show that uniform ultimate boundedness of all the tracking errors can be achieved in a networked multiagent system. Finally, a numerical simulation is carried out to evaluate the theoretical results

Adaptive and learning-based formation control of swarm robots

Autonomous aerial and wheeled mobile robots play a major role in tasks such as search and rescue, transportation, monitoring, and inspection. However, these operations are faced with a few open challenges including robust autonomy, and adaptive coordination based on the environment and operating conditions, particularly in swarm robots with limited communication and perception capabilities. Furthermore, the computational complexity increases exponentially with the number of robots in the swarm. This thesis examines two different aspects of the formation control problem. On the one hand, we investigate how formation could be performed by swarm robots with limited communication and perception (e.g., Crazyflie nano quadrotor). On the other hand, we explore human-swarm interaction (HSI) and different shared-control mechanisms between human and swarm robots (e.g., BristleBot) for artistic creation. In particular, we combine bio-inspired (i.e., flocking, foraging) techniques with learning-based control strategies (using artificial neural networks) for adaptive control of multi- robots. We first review how learning-based control and networked dynamical systems can be used to assign distributed and decentralized policies to individual robots such that the desired formation emerges from their collective behavior. We proceed by presenting a novel flocking control for UAV swarm using deep reinforcement learning. We formulate the flocking formation problem as a partially observable Markov decision process (POMDP), and consider a leader-follower configuration, where consensus among all UAVs is used to train a shared control policy, and each UAV performs actions based on the local information it collects. In addition, to avoid collision among UAVs and guarantee flocking and navigation, a reward function is added with the global flocking maintenance, mutual reward, and a collision penalty. We adapt deep deterministic policy gradient (DDPG) with centralized training and decentralized execution to obtain the flocking control policy using actor-critic networks and a global state space matrix. In the context of swarm robotics in arts, we investigate how the formation paradigm can serve as an interaction modality for artists to aesthetically utilize swarms. In particular, we explore particle swarm optimization (PSO) and random walk to control the communication between a team of robots with swarming behavior for musical creation

Computational intelligence approaches to robotics, automation, and control [Volume guest editors]

No abstract available

Research on Information Flow Topology for Connected Autonomous Vehicles

Information flow topology plays a crucial role in connected autonomous vehicles (CAVs). It describes how CAVs communicate and exchange information with each other. It predominantly affects the platoon\u27s performance, including the convergence time, robustness, stability, and scalability. It also dramatically affects the controller design of CAVs. Therefore, studying information flow topology is necessary to ensure the platoon\u27s stability and improve its performance. Advanced sliding mode controllers and optimisation strategies for information flow topology are investigated in this project. Firstly, the impact of information flow topology on the platoon is studied regarding tracking ability, fuel economy and driving comfort. A Pareto optimal information flow topology offline searching approach is proposed using a non-dominated sorting genetic algorithm (NSGA-II) to improve the platoon\u27s overall performance while ensuring stability. Secondly, the concept of asymmetric control is introduced in the topological matrix. For a linear CAVs model with time delay, a sliding mode controller is designed to target the platoon\u27s tracking performance. Moreover, the Lyapunov analysis is used via Riccati inequality to guarantee the platoon\u27s internal stability and input-to-output string stability. Then NSGA-II is used to find the homogeneous Pareto optimal asymmetric degree to improve the platoon\u27s performance. A similar approach is designed for a nonlinear CAVs model to find the Pareto heterogeneous asymmetric degree and improve the platoon\u27s performance. Thirdly, switching topology is studied to better deal with the platoon\u27s communication problems. A two-step switching topology framework is introduced. In the first step, an offline Pareto optimal topology search with imperfect communication scenarios is applied. The platoon\u27s performance is optimised using a multi-objective evolutionary algorithm based on decomposition (MOEA/D). In the second step, the optimal topology is switched and selected from among the previously obtained Pareto optimal topology candidates in real-time to minimise the control cost. For a continuous nonlinear heterogeneous platoon with actuator faults, a sliding mode controller with an adaptive mechanism is developed. Then, the Lyapunov approach is applied to the platoon\u27s tracking error dynamics, ensuring the systems uniformly ultimately bounded stability and string stability. For a discrete nonlinear heterogeneous platoon with packet loss, a discrete sliding mode controller with a double power reaching law is designed, and a modified MOEA/D with two opposing adaptive mechanisms is applied in the two-step framework. Simulations verify all the proposed controllers and frameworks, and experiments also test some. The results show the proposed strategy\u27s effectiveness and superiority in optimising the platoon\u27s performance with multiple objectives

Planning And Control Of Swarm Motion As Continua

In this thesis, new algorithms for formation control of multi agent systems (MAS) based on continuum mechanics principles will be investigated. For this purpose agents of the MAS are treated as particles in a continuum, evolving in an n-D space, whose desired configuration is required to satisfy an admissible deformation function. Considered is a specific class of mappings that is called homogenous where the Jacobian of the mapping is only a function of time and is not spatially varying. The primary objectives of this thesis are to develop the necessary theory and its validation via simulation on a mobile-agent based swarm test bed that includes two primary tasks: 1) homogenous transformation of MAS and 2) deployment of a random distribution of agents on to a desired configuration. Developed will be a framework based on homogenous transformations for the evolution of a MAS in an n-D space (n=1, 2, and 3), under two scenarios: 1) no inter-agent communication (predefined motion plan); and 2) local inter-agent communication. Additionally, homogenous transformations based on communication protocols will be used to deploy an arbitrary distribution of a MAS on to a desired curve. Homogenous transformation with no communication: A homogenous transformation of a MAS, evolving in an space, under zero inter agent communication is first considered. Here the homogenous mapping, is characterized by an n x n Jacobian matrix ( ) and an n x 1 rigid body displacement vector ( ), that are based on positions of n+1 agents of the MAS, called leader agents. The designed Jacobian ( ) and rigid body displacement vector ( ) are passed onto rest of the agents of the MAS, called followers, who will then use that information to update their positions under a pre- iv defined motion plan. Consequently, the motion of MAS will evolve as a homogenous transformation of the initial configuration without explicit communication among agents. Homogenous Transformation under Local Communication: We develop a framework for homogenous transformation of MAS, evolving in , under a local inter agent communication topology. Here we assume that some agents are the leaders, that are transformed homogenously in an n-D space. In addition, every follower agent of the MAS communicates with some local agents to update its position, in order to grasp the homogenous mapping that is prescribed by the leader agents. We show that some distance ratios that are assigned based on initial formation, if preserved, lead to asymptotic convergence of the initial formation to a final formation under a homogenous mapping. Deployment of a Random Distribution on a Desired Manifold: Deployment of agents of a MAS, moving in a plane, on to a desired curve, is a task that is considered as an application of the proposed approach. In particular, a 2-D MAS evolution problem is considered as two 1-D MAS evolution problems, where x or y coordinates of the position of all agents are modeled as points confined to move on a straight line. Then, for every coordinate of MAS evolution, bulk motion is controlled by two agents considered leaders that move independently, with rest of the follower agents motions evolving through each follower agent communicating with two adjacent agents

Multi-Agent Systems

A multi-agent system (MAS) is a system composed of multiple interacting intelligent agents. Multi-agent systems can be used to solve problems which are difficult or impossible for an individual agent or monolithic system to solve. Agent systems are open and extensible systems that allow for the deployment of autonomous and proactive software components. Multi-agent systems have been brought up and used in several application domains