Sequential Single-Cluster Auctions for Multi-Robot Task Allocation

This thesis studies task allocation in multi-robot teams operating in dynamic environments. The multi-robot task allocation problem is a complex NP-Complete optimisation problem with globally optimal solutions often difficult to find. Because of this, the rapid generation of near optimal solutions to the problem that minimise task execution time and/or energy used by robots is highly desired. Our approach seeks to cluster together closely related tasks and then builds on existing distributed market-based auction architectures for distributing these sets of tasks among several autonomous robots. Dynamic environments introduce many challenges that are not found in closed systems. For instance, it is common for additional tasks to be inserted into a system after an initial solution to the task allocation problem is determined. Additionally, it is highly likely in long-term autonomous systems that individual robots may suffer some form of failure. The ability to alter plans to react to these types of challenges in a dynamic environment is required for the completion of all tasks. In our approach we allow the repeated formation and auctioning of task clusters with varying tasks. This allows us to react to and change the task allocation among robots during execution. Throughout this thesis we use empirical evaluation to study different approaches for forming clusters of tasks and the application of task clustering to distributed auctions for multi-robot task allocation problems. Our results show that allocating clusters of tasks to robots in solving these types of problems is a fast and effective method and produces near optimal solutions

DMRR: Dynamic Multi-Robot Routing for Evolving Missions

International audienceThe paper proposes Dynamic Multi Robot-Routing (DMRR), as a continuous adaptation of the multi-robot target allocation process (MRTA) to new discovered targets. There are few works addressing dynamic target allocation.Existing methods are lacking the continuous integration of new targets, handling its progressive effects, but also lacking dynamicity support (e.g. parallel allocations, participation of new robots). The present paper proposes a framework for dynamically adapting the existing robot missions to new discovered targets. Missions accumulate targets continuously, so the case of a saturation bound for the mission costs is also considered. Dynamic saturation-based auctioning (DSAT) is proposed for allocating targets, providing lower time complexities (due to parallelism in allocation). Comparison is made with algorithms ranging from greedy to auction-based methods with provable sub-optimality. The algorithms are tested on exhaustive sets of inputs, with random configurations of targets (for DMRR with and without a mission saturation bound).The results for DSAT show that it outperforms state-of-the-art methods, like standard sequential single-item auctioning (SSI) or SSI with regret clearing

Task Allocation and Collaborative Localisation in Multi-Robot Systems

To utilise multiple robots, it is fundamental to know what they should do, called task allocation, and to know where the robots are, called localisation. The order that tasks are completed in is often important, and makes task allocation difficult to solve (40 tasks have 1047 different ways of completing them). Algorithms in literature range from fast methods that provide reasonable allocations, to slower methods that can provide optimal allocations. These algorithms work well for systems with identical robots, but do not utilise robot differences for superior allocations when robots are non-identical. They also can not be applied to robots that can use different tools, where they must consider which tools to use for each task. Robot localisation is performed using sensors which are often assumed to always be available. This is not the case in GPS-denied environments such as tunnels, or on long-range missions where replacement sensors are not readily available. A promising method to overcome this is collaborative localisation, where robots observe one another to improve their location estimates. There has been little research on what robot properties make collaborative localisation most effective, or how to tune systems to make it as accurate as possible. Most task allocation algorithms do not consider localisation as part of the allocation process. If task allocation algorithms limited inter-robot distance, collaborative localisation can be performed during task completion. Such an algorithm could equally be used to ensure robots are within communication distance, and to quickly detect when a robot fails. While some algorithms for this exist in literature, they provide a weak guarantee of inter-robot distance, which is undesirable when applied to real robots. The aim of this thesis is to improve upon task allocation algorithms by increasing task allocation speed and efficiency, and supporting robot tool changes. Collaborative localisation parameters are analysed, and a task allocation algorithm that enables collaborative localisation on real robots is developed. This thesis includes a compendium of journal articles written by the author. The four articles forming the main body of the thesis discuss the multi-robot task allocation and localisation research during the author’s candidature. Two appendices are included, representing conference articles written by the author that directly relate to the thesis.Thesis (Ph.D.) -- University of Adelaide, School of Mechanical Engineering, 201

Multi-agent task allocation for harvest management

Multi-agent task allocation methods seek to distribute a set of tasks fairly amongst a set of agents. In real-world settings, such as soft fruit farms, human labourers undertake harvesting tasks. The harvesting workforce is typically organised by farm manager(s) who assign workers to the fields that are ready to be harvested and team leaders who manage the workers in the fields. Creating these assignments is a dynamic and complex problem, as the skill of the workforce and the yield (quantity of ripe fruit picked) are variable and not entirely predictable. The work presented here posits that multi-agent task allocation methods can assist farm managers and team leaders to manage the harvesting workforce effectively and efficiently. There are three key challenges faced when adapting multi-agent approaches to this problem: (i) staff time (and thus cost) should be minimised; (ii) tasks must be distributed fairly to keep staff motivated; and (iii) the approach must be able to handle incremental (incomplete) data as the season progresses. An adapted variation of Round Robin (RR) is proposed for the problem of assigning workers to fields, and market-based task allocation mechanisms are applied to the challenge of assigning tasks to workers within the fields. To evaluate the approach introduced here, experiments are performed based on data that was supplied by a large commercial soft fruit farm for the past two harvesting seasons. The results demonstrate that our approach produces appropriate worker-to-field allocations. Moreover, simulated experiments demonstrate that there is a “sweet spot” with respect to the ratio between two types of in-field workers

Mechanism Selection for Multi-Robot Task Allocation

There is increasing interest in fielding multi-robot teams for applications such as search and rescue, warehouse automation, and delivery of consumer goods. Task allocation is an important problem to solve in such multi-robot settings. Given a mission that can be decomposed into discrete tasks, the Multi-Robot Task Allocation (MRTA) problem looks for an assignment of tasks to robots that ultimately results in efficient execution of the mission. There is a range of approaches to this optimisation problem, from centralised solvers to fully distributed methods that involve no explicit coordination between team members. Somewhere in the middle of this range lie market-based approaches, where tasks can be treated as goods, robots as "buyers" who can compute and express their own preferences for tasks in a virtual marketplace, and some clearing mechanism exists to match tasks to robots according to these preferences. The most common type of market-based mechanism for multi-robot task allocation is an auction, in which tasks are announced to the team, robots compute and place bids that encode some measure of cost or utility of performing the tasks, and tasks are awarded to robots over a number of rounds, according to the particular rules of the mechanism. Many different auction mechanisms exist, and they vary in the trade-offs that they make between computation time and space on the one hand, and performance of the execution of the mission on the other. In addition, the performance that results from a mechanism's allocation can be greatly affected by properties of task environments---the spatial and temporal arrangements of tasks, as well as other properties like precedence constraints, whether tasks require the simultaneous cooperation of multiple robots, and so on---in which it is employed. A simple mechanism that is inexpensive to compute and scales well may perform well in some environments, but not in others. The work presented in this thesis focuses on this relationship between auction-based task allocation mechanisms and properties of task environments, with the goal of developing a method of selecting, from a portfolio, a mechanism that is appropriate for a given task environment. The first part of this work is an empirical performance evaluation of a range of mechanisms employed in a series of environments of increasing complexity. The second part of this work uses results from this evaluation to develop and train a data-driven method of mechanism selection using properties of environments that can be measured at the start of a mission. The results show that, under certain conditions, this method of mechanism selection can lead to significant performance improvements compared to using a single mechanism alone

Risk-Aware Planning for Sensor Data Collection

With the emergence of low-cost unmanned air vehicles, civilian and military organizations are quickly identifying new applications for affordable, large-scale collectives to support and augment human efforts via sensor data collection. In order to be viable, these collectives must be resilient to the risk and uncertainty of operating in real-world environments. Previous work in multi-agent planning has avoided planning for the loss of agents in environments with risk. In contrast, this dissertation presents a problem formulation that includes the risk of losing agents, the effect of those losses on the mission being executed, and provides anticipatory planning algorithms that consider risk. We conduct a thorough analysis of the effects of risk on path-based planning, motivating new solution methods. We then use hierarchical clustering to generate risk-aware plans for a variable number of agents, outperforming traditional planning methods. Next, we provide a mechanism for distributed negotiation of stable plans, utilizing coalitional game theory to provide cost allocation methods that we prove to be fair and stable. Centralized planning with redundancy is then explored, planning for parallel task completion to mitigate risk and provide further increased expected value. Finally, we explore the role of cost uncertainty as additional source of risk, using bi-objective optimization to generate sets of alternative plans. We demonstrate the capability of our algorithms on randomly generated problem instances, showing an improvement over traditional multi-agent planning methods as high as 500% on very large problem instances

Market_based Framework for Mobile Surveillance Systems

The active surveillance of public and private sites is increasingly becoming a very important and critical issue. It is therefore, imperative to develop mobile surveillance systems to protect these sites. Modern surveillance systems encompass spatially distributed mobile and static sensors in order to provide effective monitoring of persistent and transient objects and events in a given Area Of Interest (AOI). The realization of the potential of mobile surveillance requires the solution of different challenging problems such as task allocation, mobile sensor deployment, multisensor management, cooperative object detection and tracking, decentralized data fusion, and interoperability and accessibility of system nodes. This thesis proposes a market-based framework that can be used to handle different problems of mobile surveillance systems. Task allocation and cooperative target-tracking are studied using the proposed framework as two challenging problems of mobile surveillance systems. These challenges are addressed individually and collectively

On improving the performance of optimistic distributed simulations

This report investigates means of improving the performance of optimistic distributed simulations without affecting the simulation accuracy. We argue that existing clustering algorithms are not adequate for application in distributed simulations, and outline some characteristics of an ideal algorithm that could be applied in this field. This report is structured as follows. We start by introducing the area of distributed simulation. Following a comparison of the dominant protocols used in distributed simulation, we elaborate on the current approaches of improving the simulation performance, using computation efficient techniques, exploiting the hardware configuration of processors, optimizations that can be derived from the simulation scenario, etc. We introduce the core characteristics of clustering approaches and argue that these cannot be applied in real-life distributed simulation problems. We present a typical distributed simulation setting and elaborate on the reasons that existing clustering approaches are not expected to improve the performance of a distributed simulation. We introduce a prototype distributed simulation platform that has been developed in the scope of this research, focusing on the area of emergency response and specifically building evacuation. We continue by outlining our current work on this issue, and finally, we end this report by outlining next actions which could be made in this field

Constrained Task Assignment and Scheduling on Networks of Arbitrary Topology.

This dissertation develops a framework to address centralized and distributed constrained task assignment and task scheduling problems. This framework is used to prove properties of these problems that can be exploited, develop effective solution algorithms, and to prove important properties such as correctness, completeness and optimality. The centralized task assignment and task scheduling problem treated here is expressed as a vehicle routing problem with the goal of optimizing mission time subject to mission constraints on task precedence and agent capability. The algorithm developed to solve this problem is able to coordinate vehicle (agent) timing for task completion. This class of problems is NP-hard and analytical guarantees on solution quality are often unavailable. This dissertation develops a technique for determining solution quality that can be used on a large class of problems and does not rely on traditional analytical guarantees. For distributed problems several agents must communicate to collectively solve a distributed task assignment and task scheduling problem. The distributed task assignment and task scheduling algorithms developed here allow for the optimization of constrained military missions in situations where the communication network may be incomplete and only locally known. Two problems are developed. The distributed task assignment problem incorporates communication constraints that must be satisfied; this is the Communication-Constrained Distributed Assignment Problem. A novel distributed assignment algorithm, the Stochastic Bidding Algorithm, solves this problem. The algorithm is correct, probabilistically complete, and has linear average-case time complexity. The distributed task scheduling problem addressed here is to minimize mission time subject to arbitrary predicate mission constraints; this is the Minimum-time Arbitrarily-constrained Distributed Scheduling Problem. The Optimal Distributed Non-sequential Backtracking Algorithm solves this problem. The algorithm is correct, complete, outputs time optimal schedules, and has low average-case time complexity. Separation of the task assignment and task scheduling problems is exploited here to ameliorate the effects of an incomplete communication network. The mission-modeling conditions that allow this and the benefits gained are discussed in detail. It is shown that the distributed task assignment and task scheduling algorithms developed here can operate concurrently and maintain their correctness, completeness, and optimality properties.Ph.D.Aerospace EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/91527/1/jpjack_1.pd

A survey of task allocation techniques in MAS

Multi-agent systems and especially unmanned vehicles, are a crucial part of the solution to a lot of real world problems, making essential the improvement of task allocation techniques. In this review, we present the main techniques used for task allocation algorithms, categorising them based on the techniques used, focusing mainly on recent works. We also analyse these methods, focusing mainly on their complexity, optimality and scalability. We also refer to common communication schemes used in task allocation methods, as well as to the role of uncertainty in task allocation. Finally, we compare them based on the above criteria, trying to find gaps in the literature and to propose the most promising ones