Assignment Algorithms for Multi-Robot Task Allocation in Uncertain and Dynamic Environments

Multi-robot task allocation is a general approach to coordinate a team of robots to complete a set of tasks collectively. The classical works adopt relevant theories from other disciplines (e.g., operations research, economics), but oftentimes they are not adequately rich to deal with the properties from the robotics domain such as perception that is local and communication which is limited. This dissertation reports the efforts on relaxing the assumptions, making problems simpler and developing new methods considering the constraints or uncertainties in robot problems. We aim to solve variants of classical multi-robot task allocation problems where the team of robots operates in dynamic and uncertain environments. In some of these problems, it is adequate to have a precise model of nondeterministic costs (e.g., time, distance) subject to change at run-time. In some other problems, probabilistic or stochastic approaches are adequate to incorporate uncertainties into the problem formulation. For these settings, we propose algorithms that model dynamics owing to robot interactions, new cost representations incorporating uncertainty, algorithms specialized for the representations, and policies for tasks arriving in an online manner. First, we consider multi-robot task assignment problems where costs for performing tasks are interrelated, and the overall team objective need not be a standard sum-of costs (or utilities) model, enabling straightforward treatment of the additional costs incurred by resource contention. In the model we introduce, a team may choose one of a set of shared resources to perform a task (e.g., several routes to reach a destination), and resource contention is modeled when multiple robots use the same resource. We propose efficient task assignment algorithms that model this contention with different forms of domain knowledge and compute an optimal assignment under such a model. Second, we address the problem of finding the optimal assignment of tasks to a team of robots when the associated costs may vary, which arises when robots deal with uncertain situations. We propose a region-based cost representation incorporating the cost uncertainty and modeling interrelationships among costs. We detail how to compute a sensitivity analysis that characterizes how much costs may change before optimality is violated. Using this analysis, robots are able to avoid unnecessary re-assignment computations and reduce global communication when costs change. Third, we consider multi-robot teams operating in probabilistic domains. We represent costs by distributions capturing the uncertainty in the environment. This representation also incorporates inter-robot couplings in planning the team’s coordination. We do not have the assumption that costs are independent, which is frequently used in probabilistic models. We propose algorithms that help in understanding the effects of different characterizations of cost distributions such as mean and Conditional Value-at-Risk (CVaR), in which the latter assesses the risk of the outcomes from distributions. Last, we study multi-robot task allocation in a setting where tasks are revealed sequentially and where it is possible to execute bundles of tasks. Particularly, we are interested in tasks that have synergies so that the greater the number of tasks executed together, the larger the potential performance gain. We provide an analysis of bundling, giving an understanding of the important bundle size parameter. Based on the qualitative basis, we propose multiple simple bundling policies that determine how many tasks the robots bundle for a batched planning and execution

Reducing Communication Delay Variability for a Group of Robots

A novel architecture is presented for reducing communication delay variability for a group of robots. This architecture relies on using three components: a microprocessor architecture that allows deterministic real-time tasks; an event-based communication protocol in which nodes transmit in a TDMA fashion, without the need of global clock synchronization techniques; and a novel communication scheme that enables deterministic communications by allowing senders to transmit without regard for the state of the medium or coordination with other senders, and receivers can tease apart messages sent simultaneously with a high probability of success. This approach compared to others, allows simultaneous communications without regard for the state of the transmission medium, it allows deterministic communications, and it enables ordered communications that can be a applied in a team of robots. Simulations and experimental results are also included

Task Variant Allocation in Distributed Robotics

This paper tackles the problem of allocating tasks to a distributed heterogeneous robotic system, where tasks---named *task variants* in the paper---can vary in terms of trade-off between resource requirements and quality of service provided. Three different methods (constraint programming, greedy, and metaheuristic) are proposed to solve such a problem and are evaluated both in simulation and in a real scenario, showing the goodness of the constraint programming method

Using multiple agents in uncertainty minimization of ablating target sources

The objective of this research effort is to provide an efficient methodology for a multi-agent robotic system to observe moving targets that are generated from an ablation process. An ablation process is a process where a larger mass is reduced in volume as a result of erosion; this erosion results in smaller, independent masses. An example of such a process is the natural process that gives rise to icebergs, which are generated through an ablation process referred to as ice calving. Ships that operate in polar regions continue to face the threat of floating ice sheets and icebergs generated from the ice ablation process. Although systems have been implemented to track these threats with varying degrees of success, many of these techniques require that the operations are conducted outside of some boundary where the icebergs are known not to drift. Since instances where polar operations must be conducted within such a boundary line do exist (e.g., resource exploration), methods for situational awareness of icebergs for these operations are necessary. In this research, efficacy of these methods is correlated to the initial acquisition time of observing newly ablated targets, as it provides for the ability to enact early countermeasures. To address the research objective, the iceberg tracking problem is defined such that it is re-cast within a class of robotic, multiagent target-observation problems. From this new definition, the primary contributions of this research are obtained: 1) A definition of the iceberg observation problem that extends an existing robotic observation problem to the requirements for the observation of floating ice masses; 2) A method for modeling the activity regions on an ablating source to extract ideal search regions to quickly acquire newly ablated targets; 3) A method for extracting metrics for this model that can be used to assess performance of observation algorithms and perform resource allocation. A robot controller is developed that implements the algorithms that result from these contributions and comparisons are made to existing target acquisition techniques.Ph.D

A Unified Framework for Solving Multiagent Task Assignment Problems

Multiagent task assignment problem descriptors do not fully represent the complex interactions in a multiagent domain, and algorithmic solutions vary widely depending on how the domain is represented. This issue is compounded as related research fields contain descriptors that similarly describe multiagent task assignment problems, including complex domain interactions, but generally do not provide the mechanisms needed to solve the multiagent aspect of task assignment. This research presents a unified approach to representing and solving the multiagent task assignment problem for complex problem domains. Ideas central to multiagent task allocation, project scheduling, constraint satisfaction, and coalition formation are combined to form the basis of the constrained multiagent task scheduling (CMTS) problem. Basic analysis reveals the exponential size of the solution space for a CMTS problem, approximated by O(2n(m+n)) based on the number of agents and tasks involved in a problem. The shape of the solution space is shown to contain numerous discontinuous regions due to the complexities involved in relational constraints defined between agents and tasks. The CMTS descriptor represents a wide range of classical and modern problems, such as job shop scheduling, the traveling salesman problem, vehicle routing, and cooperative multi-object tracking. Problems using the CMTS representation are solvable by a suite of algorithms, with varying degrees of suitability. Solution generating methods range from simple random scheduling to state-of-the-art biologically inspired approaches. Techniques from classical task assignment solvers are extended to handle multiagent task problems where agents can also multitask. Additional ideas are incorporated from constraint satisfaction, project scheduling, evolutionary algorithms, dynamic coalition formation, auctioning, and behavior-based robotics to highlight how different solution generation strategies apply to the complex problem space

Anonymous hedonic game for task allocation in a large-scale multiple agent system

This paper proposes a novel game-theoretical autonomous decision-making framework to address a task allocation problem for a swarm of multiple agents. We consider cooperation of self-interested agents, and show that our proposed decentralized algorithm guarantees convergence of agents with social inhibition to a Nash stable partition (i.e., social agreement) within polynomial time. The algorithm is simple and executable based on local interactions with neighbor agents under a strongly connected communication network and even in asynchronous environments. We analytically present a mathematical formulation for computing the lower bound of suboptimality of the outcome, and additionally show that at least 50% of suboptimality can be guaranteed if social utilities are nondecreasing functions with respect to the number of coworking agents. The results of numerical experiments confirm that the proposed framework is scalable, fast adaptable against dynamical environments, and robust even in a realistic situation

TOKEN-BASED APPROACH FOR SCALABLE TEAMCOORDINATION

To form a cooperative multiagent team, autonomous agents are required to harmonize activities and make the best use of exclusive resources to achieve their common goal. In addition, to handle uncertainty and quickly respond to external environmental events, they should share knowledge and sensor in formation. Unlike small team coordination, agents in scalable team must limit the amount of their communications while maximizing team performance. Communication decisions are critical to scalable-team coordination because agents should target their communications, but these decisions cannot be supported by a precise model or by complete team knowledge.The hypothesis of my thesis is: local routing of tokens encapsulating discrete elements of control, based only on decentralized local probability decision models, will lead to efficient scalable coordination with several hundreds of agents. In my research, coordination controls including all domain knowledge, tasks and exclusive resources are encapsulated into tokens. By passing tokens around, agents transfer team controls encapsulated in the tokens. The team benefits when a token is passed to an agent who can make use of it, but communications incur costs. Hence, no single agent has sole responsible over any shared decision. The key problem lies in how agents make the correct decisions to target communications and pass tokens so that they will potentially benefit the team most when considering communication costs.My research on token-based coordination algorithm starts from the investigation of random walk of token movement. I found a little increase of the probabilities that agents make the right decision to pass a token, the overall efficiency of the token movement could be greatly enhanced. Moreover, if token movements are modeled as a Markov chain, I found that the efficiency of passing tokens could be significantly varied based on different network topologies.My token-based algorithm starts at the investigation of each single decision theoretic agents. Although under the uncertainties that exist in large multiagent teams, agents cannot act optimal, it is still feasible to build a probability model for each agents to rationally pass tokens. Specifically, this decision only allow agent to pass tokens over an associate network where only a few of team members are considered as token receiver.My proposed algorithm will build each agent's individual decision model based on all of its previously received tokens. This model will not require the complete knowledge of the team. The key idea is that I will make use of the domain relationships between pairs of coordination controls. Previously received tokens will help the receiver to infer whether the sender could benefit the team if a related token is received. Therefore, each token is used to improve the routing of other tokens, leading to a dramatic performance improvement when more tokens are added. By exploring the relationships between different types of coordination controls, an integrated coordination algorithm will be built, and an improvement of one aspect of coordination will enhance the performance of the others

Computational intelligence approaches to robotics, automation, and control [Volume guest editors]

No abstract available

Planning Algorithms for Multi-Robot Active Perception

A fundamental task of robotic systems is to use on-board sensors and perception algorithms to understand high-level semantic properties of an environment. These semantic properties may include a map of the environment, the presence of objects, or the parameters of a dynamic field. Observations are highly viewpoint dependent and, thus, the performance of perception algorithms can be improved by planning the motion of the robots to obtain high-value observations. This motivates the problem of active perception, where the goal is to plan the motion of robots to improve perception performance. This fundamental problem is central to many robotics applications, including environmental monitoring, planetary exploration, and precision agriculture. The core contribution of this thesis is a suite of planning algorithms for multi-robot active perception. These algorithms are designed to improve system-level performance on many fronts: online and anytime planning, addressing uncertainty, optimising over a long time horizon, decentralised coordination, robustness to unreliable communication, predicting plans of other agents, and exploiting characteristics of perception models. We first propose the decentralised Monte Carlo tree search algorithm as a generally-applicable, decentralised algorithm for multi-robot planning. We then present a self-organising map algorithm designed to find paths that maximally observe points of interest. Finally, we consider the problem of mission monitoring, where a team of robots monitor the progress of a robotic mission. A spatiotemporal optimal stopping algorithm is proposed and a generalisation for decentralised monitoring. Experimental results are presented for a range of scenarios, such as marine operations and object recognition. Our analytical and empirical results demonstrate theoretically-interesting and practically-relevant properties that support the use of the approaches in practice