Evolutionary algorithms for robot path planning, task allocation and collision avoidance in an automated warehouse

Thesis (PhD)--Stellenbosch University, 2022.ENGLISH ABSTRACT: Research with regard to path planning, task allocation and collision avoidance is important for improving the field of warehouse automation. The dissertation addresses the topic of routing warehouse picking and binning robots. The purpose of this dissertation is to develop a single objective and multi-objective algorithm framework that can sequence products to be picked or binned, allocate the products to robots and optimise the routing through the warehouse. The sequence of the picking and binning tasks ultimately determines the total time for picking and binning all of the parts. The objectives of the algorithm framework are to minimise the total time for travelling as well as the total time idling, given the number of robots available to perform the picking and binning functions. The algorithm framework incorporates collision avoidance since the aisle width does not allow two robots to pass each other. The routing problem sets the foundation for solving the sequencing and allocation problem. The best heuristic from the routing problem is used as the strategy for routing the robots in the sequencing and allocation problem. The routing heuristics used to test the framework in this dissertation include the return heuristic, the s-shape heuristic, the midpoint heuristic and the largest gap heuristic. The metaheuristic solution strategies for single objective part sequencing and allocating problem include the covariance matrix adaptation evolution strategy (CMA-ES) algorithm, the genetic algorithm (GA), the guaranteed convergence particle swarm optimisation (GCPSO) algorithm, and the self-adaptive differential evolution algorithm with neighbourhood search (SaNSDE). The evolutionary multi-objective algorithms considered in this dissertation are the non-dominated sorting genetic algorithm III (NSGA-III), the multi-objective evolutionary algorithm based on decomposition (MOEAD), the multiple objective particle swarm optimisation (MOPSO), and the multi-objective covariance matrix adaptation evolution strategy (MO-CMA-ES). Solving the robot routing problem showed that the return routing heuristic outperformed the s-shape, largest gap and midpoint heuristics with a significant margin. The return heuristic was thus used for solving the routing of robots in the part sequencing and allocation problem. The framework was able to create feasible real-world solutions for the part sequencing and allocation problem. The results from the single objective problem showed that the CMA-ES algorithm outperformed the other metaheuristics on the part sequencing and allocation problem. The second best performing metaheuristic was the SaNSDE. The GA was the third best metaheuristic and the worst performing metaheuristic was the GCPSO. The multi-objective framework was able to produce feasible trade-off solutions and MOPSO was shown to be the best EMO algorithm to use for accuracy. If a large spread and number of Pareto solutions are the most important concern, MOEAD should be used. The research contributions include the incorporation of collision avoidance in the robot routing problem when using single and multi-objective algorithms as solution strategies. This dissertation contributes to the research relating to the performance of metaheuristics and evolutionary multi-objective algorithms on routing, sequencing, and allocation problems. To the best of the author’s knowledge, this dissertation is the first where these four metaheuristics and evolutionary multi-objective algorithms have been tested for solving the robot picking and binning problem, given that all collisions must be avoided. It is also the first time that this specific variation of the part sequencing and allocation problem has been solved using metaheuristics and evolutionary multi-objective algorithms, taking into account that all collisions must be avoided.AFRIKAANSE OPSOMMING: Navorsing in verband met roete beplanning, part allokasie en botsing vermyding is belangrik vir die bevordering van die pakhuis automatisering veld. Die verhandeling handel oor die onderwerp van parte wat gestoor en gehaal moet word en die verkillende parte moet ook gealokeer word aan ’n spesifieke robot. Die doel van hierdie verhandeling is om ’n enkele doelwit en ’n multidoelwit algoritme raamwerk te ontwikkel wat parte in ’n volgorde rangskik en ook die parte aan ’n robot alokeer. Die roete wat die robot moet volg deur die pakhuis moet ook geoptimeer word om die minste tyd te verg. Die volgorde van die parte bepaal uiteindelik die totale tyd wat dit neem vir die robot om al die parte te stoor en te gaan haal. Die doelwitte van die algoritme raamwerk is om die totale reistyd en die totale ledige tyd te minimeer, gegewe die aantal beskikbare robotte in die sisteem om die stoor en gaan haal funksies uit te voer. Die algoritme raamwerk bevat botsingsvermyding, aangesien die gangbreedte van die pakhuis nie toelaat dat twee robotte mekaar kan verbygaan nie. Die roete probleem lˆe die grondslag vir die oplossing van die volgorde en allokerings probleem. Die beste heuristiek vir die roete probleem word verder gebruik in die volgorde en allokerings probleem. Die verskillende roete heuristieke wat in hierdie verhandeling oorweeg was, sluit in die terugkeer heuristiek, die s-vorm heuristiek, die middelpunt heuristiek en die grootste gaping heuristiek. Die metaheuristieke vir die volgorde en allokerings probleem sluit die volgende algoritmes in: die kovariansie matriks aanpassing evolusie algoritme (CMA-ES), die genetiese algoritme (GA), die gewaarborgde konvergerende deeltjie swermoptimerings (GCPSO) algoritme, en laastens die selfaanpassende differensi¨ele evolusie algoritme met die teenwoordigheid van buurtsoek (SaNSDE). Die evolusionêre multidoelwit algoritmes wat oorweeg was vir die volgorde en allokerings probleem sluit die volgende algoritmes in: die multidoelwit kovariansie matriks aanpassing evolusie algoritme (MO-CMA-ES), die nie-dominerende sortering genetiese algoritme III (NSGA-III), die multidoelwit evolusionˆere algoritme gebaseer op ontbinding (MOEAD) en laastens die multidoelwit deeltjie swermoptimering algoritme (MOPSO) Oplossings van die robot roete probleem het gewys dat die terugkeer heuristiek die s-vorm, grootste gaping en middelpunt heuristiek met ’n beduidende marge oortref het. Die terugkeer heuristiek is dus gebruik vir die oplossing van die roete beplanning van robotte in die volgorde en allokasie probleem. Die raamwerk was doeltreffend en die resultate het getoon, vir die enkel doelwit probleem, dat die CMA-ES algoritme beter gevaar het as die ander metaheuristieke vir die volgorde en allokasie probleem. Die SaNSDE was die naas beste presterende metaheuristiek. Die GA was die derde beste metaheuristiek, en die metaheuristiek wat die slegste gevaar het, was die GCPSO. Vir die multidoelwit probleem het die MOPSO die beste gevaar, as akkuraatheid die belangrikste doelwit is. As ’n grootter verskeidenheid die belangrikste is, is die MOEAD meer geskik om ’n oplossing te vind. Die navorsingsbydraes sluit in dat vermyding van botsings in ag geneem word in die robot roete probleem. Hierdie verhandeling dra by tot die navorsing oor die oplossing van roete beplanning, volgorde en allokasie probleme met metaheuristieke. Na die beste van die outeur se kennis is hierdie die eerste keer dat al vier metaheuristieke getoets was om die robot stoor-en-gaan haal probleem op te los, onder die kondisie dat alle botsings vermy moet word. Dit is ook die eerste keer dat hierdie spesifieke variant, enkel-en-multidoelwit probleem van die volgorde en allokasie van parte met behulp van metaheuristieke en multidoelwit evolusionˆere algoritmes opgelos was, met die inagneming dat alle botsings vermy moet word.Doctora

Adaptive Multiagent Traffic Management for Autonomous Robotic Systems

There is growing commercial interest in the use of unmanned aerial vehicles (UAVs) in urban environments, specifically for package delivery applications. However, the size, complexity and sheer numbers of expected UAVs makes conventional air traffic management that relies on human air traffic controllers infeasible. To enable UAVs to safely and efficiently operate in congested environments, it is essential to develop autonomous UAV management strategies. We introduce a dynamic hierarchical traffic control model that reacts to traffic conditions instantaneously to reduce congestion in the airspace. An obstacle-filled airspace lends itself to a modelling as a graph structure similar to a road network. We introduce controller agents, which set costs across the airspace. These agents control traffic similarly to adaptive metering lights in highway traffic. UAVs then plan their paths based on the costs (e.g. conflicts, or delays) they see for traversing particular parts of the airspace. This provides us a decentralized method for reducing traffic in an airspace Our hierarchical structure allows us to separate the traffic reduction problem from the individual robot navigation problem. Each robot does not explicitly coordinate with others in the airspace. Instead, robots execute their own individual internal cost-based planner to travel between locations. We then use neuro-evolution to provide incentives to these cost-based planners to reduce traffic in the environment. Traffic quality can be expressed in several different ways. We first evaluate traffic our traffic reduction policies in terms of `conflicts', which characterizes situations where an aircraft comes too close to another for safety in a physical space. We then examine traffic in terms of the amount of `delay' that all agents incur, which assumes that there is a structure to ensure only a safe number of UAVs occupy the same area. Finally, we look at the total travel time that a UAV can expect to take from the moment it enters the airspace until the time it gets to its destination. To facilitate an exploration of the UTM problem without waiting for a full simulation of UAVS running with A* , we develop an abstraction of the UTM domain that preserves the core UTM problem. We then investigate performance under differing levels of traffic, a well as two different agent structures. Our results show similar performance for both agent definitions, with delay reduction of up to 68% in high traffic cases. With a fast version of the UTM problem, we explore the effect of redefining the control structure such that links, or edges of the UTM graph, set costs individually. This shifts the control paradigm toward controlling directional travel rather than areas in the space, as was the case with sector agents used in previous approaches. Due to our graph structure, we find that there are far more control elements in the link agent approach than in the sector agent approach. We identify a tradeoff; link agents give finer control, but the coordination problem for the sector agents is easier because there are fewer sector agents. This indicates that we can improve performance out of a more distributed link-based setup if we address the challenges of multiagent coordination. However, the UAV traffic management domain presents a uniquely difficult coordination problem; each agent's action can affect the perceived value of every other agent's actions. This means that there is an excessive amount of noise in the system, as another agent's action can have a lot of impact on the reward an agent receives. We reduce the amount of multiagent noise by reducing the number of agents that are capable of learning. We identify that some agents have more ability to influence traffic based on the topology and traffic profile of the graph. This metric we call impactfulness. We use this metric to improve the learning by removing less impactful agents from the learning process, making a more stationary system in which the impactful agents can learn. The contributions of this work are to: - Introduce a cost-based traffic management approach that is platform-agnostic and fast to implement. - Develop a multiagent approach to setting costs in this traffic management system that is adaptive to traffic conditions and learns long-term effects of management decisions. - Create an abstraction of UAV traffic that captures key physical attributes, creating a fast and flexible simulation method. - Quantify agent contributions to system performance by experimenting with single agent learning, single agent exclusion, and a sliding number of agents learning in the system.Keywords: Planning, UAV, Multiagen

A Probabilistic Eulerian Traffic Model for the Coordination of Multiple AGVs in Automatic Warehouses

The co-ordination of multiple automated guided vehicles (AGVs) is one of the main issues to address for the implementation of an efficient autonomous warehouse. Traffic jams are highly undesirable and, therefore, the motion of the AGVs should be planned by considering the current and future state of the fleet. This letter proposes a probabilistic model of the traffic in an autonomous warehouse to predict the evolution of possibly congested areas. Such a model is then exploited for building a predictive planner that is embedded in the traffic manager recently proposed in [1] to explicitely consider the evolution of the traffic up to a given horizon and to increase the efficiency of the fleet of AGVs in terms of delivery time. The proposed traffic manager is validated by means of comparative simulations on real plants

Optimization of Operation Sequencing in CAPP Using Hybrid Genetic Algorithm and Simulated Annealing Approach

In any CAPP system, one of the most important process planning functions is selection of the operations and corresponding machines in order to generate the optimal operation sequence. In this paper, the hybrid GA-SA algorithm is used to solve this combinatorial optimization NP (Non-deterministic Polynomial) problem. The network representation is adopted to describe operation and sequencing flexibility in process planning and the mathematical model for process planning is described with the objective of minimizing the production time. Experimental results show effectiveness of the hybrid algorithm that, in comparison with the GA and SA standalone algorithms, gives optimal operation sequence with lesser computational time and lesser number of iterations

Optimization of Operation Sequencing in CAPP Using Hybrid Genetic Algorithm and Simulated Annealing Approach

In any CAPP system, one of the most important process planning functions is selection of the operations and corresponding machines in order to generate the optimal operation sequence. In this paper, the hybrid GA-SA algorithm is used to solve this combinatorial optimization NP (Non-deterministic Polynomial) problem. The network representation is adopted to describe operation and sequencing flexibility in process planning and the mathematical model for process planning is described with the objective of minimizing the production time. Experimental results show effectiveness of the hybrid algorithm that, in comparison with the GA and SA standalone algorithms, gives optimal operation sequence with lesser computational time and lesser number of iterations

Autonomous Navigation of Automated Guided Vehicle Using Monocular Camera

This paper presents a hybrid control algorithm for Automated Guided Vehicle (AGV) consisting of two independent control loops: Position Based Control (PBC) for global navigation within manufacturing environment and Image Based Visual Servoing (IBVS) for fine motions needed for accurate steering towards loading/unloading point. The proposed hybrid control separates the initial transportation task into global navigation towards the goal point, and fine motion from the goal point to the loading/unloading point. In this manner, the need for artificial landmarks or accurate map of the environment is bypassed. Initial experimental results show the usefulness of the proposed approach.COBISS.SR-ID 27383808