Genetic Algorithms with Chaotic Population Dynamics

In this thesis I demonstrate a novel application of chaotic dynamics to evolutionary algorithms, specifically in population size management. Typical evolutionary algorithms require a population size to be set as a parameter, which remains constant throughout execution. I created a new algorithm that can vary the population size chaotically or periodically, and do a series of performance tests comparing static, periodic, and chaotic population control. The problems targeted in these tests are chosen from both continuous and discrete multi-dimensional domains. I find that both chaotic and static population control perform well in certain situations; my evidence suggests that periodic population control is rarely a good choice. I also present additional analysis on the effects of the population dynamics and how they relate to mean population size and variance in the performance results

Ant Colony Optimization With Local Search for Dynamic Traveling Salesman Problems

For a dynamic traveling salesman problem (DTSP), the weights (or traveling times) between two cities (or nodes) may be subject to changes. Ant colony optimization (ACO) algorithms have proved to be powerful methods to tackle such problems due to their adaptation capabilities. It has been shown that the integration of local search operators can significantly improve the performance of ACO. In this paper, a memetic ACO algorithm, where a local search operator (called unstring and string) is integrated into ACO, is proposed to address DTSPs. The best solution from ACO is passed to the local search operator, which removes and inserts cities in such a way that improves the solution quality. The proposed memetic ACO algorithm is designed to address both symmetric and asymmetric DTSPs. The experimental results show the efficiency of the proposed memetic algorithm for addressing DTSPs in comparison with other state-of-the-art algorithms

The Application of Ant Colony Optimization

The application of advanced analytics in science and technology is rapidly expanding, and developing optimization technics is critical to this expansion. Instead of relying on dated procedures, researchers can reap greater rewards by utilizing cutting-edge optimization techniques like population-based metaheuristic models, which can quickly generate a solution with acceptable quality. Ant Colony Optimization (ACO) is one the most critical and widely used models among heuristics and meta-heuristics. This book discusses ACO applications in Hybrid Electric Vehicles (HEVs), multi-robot systems, wireless multi-hop networks, and preventive, predictive maintenance

Design of Heuristic Algorithms for Hard Optimization

This open access book demonstrates all the steps required to design heuristic algorithms for difficult optimization. The classic problem of the travelling salesman is used as a common thread to illustrate all the techniques discussed. This problem is ideal for introducing readers to the subject because it is very intuitive and its solutions can be graphically represented. The book features a wealth of illustrations that allow the concepts to be understood at a glance. The book approaches the main metaheuristics from a new angle, deconstructing them into a few key concepts presented in separate chapters: construction, improvement, decomposition, randomization and learning methods. Each metaheuristic can then be presented in simplified form as a combination of these concepts. This approach avoids giving the impression that metaheuristics is a non-formal discipline, a kind of cloud sculpture. Moreover, it provides concrete applications of the travelling salesman problem, which illustrate in just a few lines of code how to design a new heuristic and remove all ambiguities left by a general framework. Two chapters reviewing the basics of combinatorial optimization and complexity theory make the book self-contained. As such, even readers with a very limited background in the field will be able to follow all the content

Mixed Integer Programming Approaches to Novel Vehicle Routing Problems

This thesis explores two main topics. The first is how to incorporate data on meteorological forecasts, traffic patterns, and road network topology to utilize deicing resources more efficiently. Many municipalities throughout the United States find themselves unable to treat their road networks fully during winter snow events. Further, as the global climate continues to change, it is expected that both the number and severity of extreme winter weather events will increase for large portions of the US.We propose to use network flows, resource allocation, and vehicle routing mixed integer programming approaches to be able to incorporate all of these data in a winter road maintenance framework. We also show that solution approaches which have proved useful in network flows and vehicle routing problems can be adapted to construct high-quality solutions to this new problem quickly. These approaches are validated on both random and real-world instances using data from Knoxville, TN.In addition to showing that these approaches can be used to allocate resources effectively given a certain deicing budget, we also show that these same approaches can be used to help determine a resource budget given some allocation utility score. As before, we validate these approaches using random and real-world instances in Knoxville, TN.The second topic considered is formulating mixed integer programming models which can be used to route automated electric shuttles. We show that these models can also be used to determine fleet composition and optimal vehicle characteristics to accommodate various demand scenarios. We adapt popular vehicle routing solution techniques to these models, showing that these strategies continue to be relevant and robust. Lastly, we validate these techniques by looking at a case study in Greenville, SC, which recently received a grant from the Federal Highway Administration to deploy a fleet of automated electric shuttles in three neighborhoods

Controlling the mobility and enhancing the performance of multiple message ferries in delay tolerant networks

In einem drahtlosen Netzwerk mit isolierten und stationären Knoten können Adhoc und verzögerungstolerante Netzwerk Routing-Protokolle nicht verwendet werden. Message Ferry Netzwerke sind die Lösung für diese Fälle, in denen ein (oder mehrere) Message Ferry Knoten den store-carry-forward Mechanismus verwendet und zwischen den Knoten reist, um Nachrichten auszutauschen. In diesem Fall erfahren die Nachrichten für gewöhnlich eine lange Verzögerung. Um die Performance der Message Ferry Netzwerke zu verbessern, kann die Mobilität der Message Ferry Knoten gesteuert werden. In dieser Doktorarbeit werden zwei Strategien zur Steuerung der Mobilität der Message Ferry Knoten studiert. Die Strategien sind das on-the-fly Entscheidungsverfahren in Ferry Knoten und die offline Wegplanung für Ferry Knoten. Für die on-the-fly Strategie untersucht diese Arbeit Decision-maker in Ferry Knoten, der die Entscheidung auf Grundlage der lokalen Observation eines Ferry Knoten trifft. Zur Koordinierung mehrerer Ferry Knoten, die keine globale Kenntnis über das Netzwerk haben, wird eine indirekte Signalisierung zwischen Ferry Knoten vorgeschlagen. Zur Kooperation der Ferry Knoten für die Zustellung der Nachrichten werden einige Ansätze zum Nachrichtenaustausch zwischen Ferry Knoten vorgeschlagen, in denen der Decision-maker eines Ferry Knotens seine Information mit dem verzögerungstoleranten Router des Ferry Knoten teilt, um die Effizienz des Nachrichtenaustauschs zwischen Ferry Knoten zu verbessern. Umfangreiche Simulationsstudien werden zur Untersuchung der vorgeschlagenen Ansätze und des Einflusses verschiedener Nachrichtenverkehrsszenarien vorgenommen. Außerdem werden verschiedene Szenarien mit unterschiedlicher Anzahl von Ferry Knoten, verschiedener Geschwindigkeit der Ferry Knoten und verschiedener Ansätze zum Nachrichtenaustausch zwischen Ferry Knoten studiert. Zur Evaluierung der offline Wegplanungsstrategie wird das Problem als Multiple Traveling Salesmen Problem (mTSP) modelliert und ein genetischer Algorithmus zur Approximation der Lösung verwendet. Es werden verschiedene Netzwerkarchitekturen zur Pfadplanung der Ferry Knoten vorgestellt und studiert. Schließlich werden die Strategien zur Steuerung der Mobilität der Ferry Knoten verglichen. Die Ergebnisse zeigen, dass die Performance der Strategien in Bezug auf die Ende-zu-Ende-Verzögerung von dem Szenario des Nachrichtenverkehrs abhängt. In Szenarien, wie Nachrichtenverkehr in Sensor-Netzwerken, in denen ein Knoten die Nachrichten zu allen anderen Knoten sendet oder von allen anderen Knoten empfängt, zeigt die offline Wegplanung, basierend auf der mTSP Lösung, bessere Performance als die on-the-fly Strategie. Andererseits ist die on-the-fly Stratgie eine bessere Wahl in Szenarien wie Nachrichtenaustausch zwischen Rettungskräften während einer Katastrophe, in denen alle drahtlose Knoten die Nachrichten austauschen müssen. Zudem ist die on-the-fly Strategie flexibler, robuster als offline Wegplanung und benötigt keine Initialisierungszeit.In a wireless network with isolated and stationary nodes, ad hoc and delay tolerant routing approaches fail to deliver messages. Message ferry networks are the solution for such networks where one or multiple mobile nodes, i.e. message ferry, apply the store-carry-forward mechanism and travel between nodes to exchange their messages. Messages usually experience a long delivery delay in this type of network. To improve the performance of message ferry networks, the mobility of ferries can be controlled. In this thesis, two main strategies to control mobility of multiple message ferries are studied. The strategies are the on-the-fly mobility decision making in ferries and the offline path planning for ferries. To apply the on-the-fly strategy, this work proposes a decision maker in ferries which makes mobility decisions based on the local observations of ferries. To coordinate multiple ferries, which have no global view from the network, an indirect signaling of ferries is proposed. For cooperation of ferries in message delivery, message forwarding and replication schemes are proposed where the mobility decision maker shares its information with the delay tolerant router of ferries to improve the efficiency of message exchange between ferries. An extensive simulation study is performed to investigate the performance of the proposed schemes and the impact of different traffic scenarios in a network. Moreover, different scenarios with different number of ferries, different speed of ferries and different message exchange approaches between ferries are studied. To study the offline path planning strategy, the problem is modeled as multiple traveling salesmen problem (mTSP) and a genetic algorithm is applied to approximate the solution. Different network architectures are proposed and studied where the path of ferries are planned in advance. Finally, the strategies to control the mobility of ferries are compared. The results show that the performance of each strategy, in terms of the average end-to-end delay of messages, depends on the traffic scenario in a network. In traffic scenarios same as the traffic in sensor networks, where only a single node generates messages to all nodes or receives messages from all node, the offline path planning based on mTSP solution performs better than the on-the-fly decision making. On the other hand, in traffic scenarios same as the traffic in disaster scenarios, where all nodes in a network may send and receive messages, the on-the-fly decision making provides a better performance. Moreover, the on-thy-fly decision making is always more flexible, more robust and does not need any initialization time

Meta-learning computational intelligence architectures

In computational intelligence, the term \u27memetic algorithm\u27 has come to be associated with the algorithmic pairing of a global search method with a local search method. In a sociological context, a \u27meme\u27 has been loosely defined as a unit of cultural information, the social analog of genes for individuals. Both of these definitions are inadequate, as \u27memetic algorithm\u27 is too specific, and ultimately a misnomer, as much as a \u27meme\u27 is defined too generally to be of scientific use. In this dissertation the notion of memes and meta-learning is extended from a computational viewpoint and the purpose, definitions, design guidelines and architecture for effective meta-learning are explored. The background and structure of meta-learning architectures is discussed, incorporating viewpoints from psychology, sociology, computational intelligence, and engineering. The benefits and limitations of meme-based learning are demonstrated through two experimental case studies -- Meta-Learning Genetic Programming and Meta- Learning Traveling Salesman Problem Optimization. Additionally, the development and properties of several new algorithms are detailed, inspired by the previous case-studies. With applications ranging from cognitive science to machine learning, meta-learning has the potential to provide much-needed stimulation to the field of computational intelligence by providing a framework for higher order learning --Abstract, page iii

Exploration autonome et efficiente de chantiers miniers souterrains inconnus avec un drone filaire

Abstract: Underground mining stopes are often mapped using a sensor located at the end of a pole that the operator introduces into the stope from a secure area. The sensor emits laser beams that provide the distance to a detected wall, thus creating a 3D map. This produces shadow zones and a low point density on the distant walls. To address these challenges, a research team from the Université de Sherbrooke is designing a tethered drone equipped with a rotating LiDAR for this mission, thus benefiting from several points of view. The wired transmission allows for unlimited flight time, shared computing, and real-time communication. For compatibility with the movement of the drone after tether entanglements, the excess length is integrated into an onboard spool, contributing to the drone payload. During manual piloting, the human factor causes problems in the perception and comprehension of a virtual 3D environment, as well as the execution of an optimal mission. This thesis focuses on autonomous navigation in two aspects: path planning and exploration. The system must compute a trajectory that maps the entire environment, minimizing the mission time and respecting the maximum onboard tether length. Path planning using a Rapidly-exploring Random Tree (RRT) quickly finds a feasible path, but the optimization is computationally expensive and the performance is variable and unpredictable. Exploration by the frontier method is representative of the space to be explored and the path can be optimized by solving a Traveling Salesman Problem (TSP) but existing techniques for a tethered drone only consider the 2D case and do not optimize the global path. To meet these challenges, this thesis presents two new algorithms. The first one, RRT-Rope, produces an equal or shorter path than existing algorithms in a significantly shorter computation time, up to 70% faster than the next best algorithm in a representative environment. A modified version of RRT-connect computes a feasible path, shortened with a deterministic technique that takes advantage of previously added intermediate nodes. The second algorithm, TAPE, is the first 3D cavity exploration method that focuses on minimizing mission time and unwound tether length. On average, the overall path is 4% longer than the method that solves the TSP, but the tether remains under the allowed length in 100% of the simulated cases, compared to 53% with the initial method. The approach uses a 2-level hierarchical architecture: global planning solves a TSP after frontier extraction, and local planning minimizes the path cost and tether length via a decision function. The integration of these two tools in the NetherDrone produces an intelligent system for autonomous exploration, with semi-autonomous features for operator interaction. This work opens the door to new navigation approaches in the field of inspection, mapping, and Search and Rescue missions.La cartographie des chantiers miniers souterrains est souvent réalisée à l’aide d’un capteur situé au bout d’une perche que l’opérateur introduit dans le chantier, depuis une zone sécurisée. Le capteur émet des faisceaux laser qui fournissent la distance à un mur détecté, créant ainsi une carte en 3D. Ceci produit des zones d’ombres et une faible densité de points sur les parois éloignées. Pour relever ces défis, une équipe de recherche de l’Université de Sherbrooke conçoit un drone filaire équipé d’un LiDAR rotatif pour cette mission, bénéficiant ainsi de plusieurs points de vue. La transmission filaire permet un temps de vol illimité, un partage de calcul et une communication en temps réel. Pour une compatibilité avec le mouvement du drone lors des coincements du fil, la longueur excédante est intégrée dans une bobine embarquée, qui contribue à la charge utile du drone. Lors d’un pilotage manuel, le facteur humain entraîne des problèmes de perception et compréhension d’un environnement 3D virtuel, et d’exécution d’une mission optimale. Cette thèse se concentre sur la navigation autonome sous deux aspects : la planification de trajectoire et l’exploration. Le système doit calculer une trajectoire qui cartographie l’environnement complet, en minimisant le temps de mission et en respectant la longueur maximale de fil embarquée. La planification de trajectoire à l’aide d’un Rapidly-exploring Random Tree (RRT) trouve rapidement un chemin réalisable, mais l’optimisation est coûteuse en calcul et la performance est variable et imprévisible. L’exploration par la méthode des frontières est représentative de l’espace à explorer et le chemin peut être optimisé en résolvant un Traveling Salesman Problem (TSP), mais les techniques existantes pour un drone filaire ne considèrent que le cas 2D et n’optimisent pas le chemin global. Pour relever ces défis, cette thèse présente deux nouveaux algorithmes. Le premier, RRT-Rope, produit un chemin égal ou plus court que les algorithmes existants en un temps de calcul jusqu’à 70% plus court que le deuxième meilleur algorithme dans un environnement représentatif. Une version modifiée de RRT-connect calcule un chemin réalisable, raccourci avec une technique déterministe qui tire profit des noeuds intermédiaires préalablement ajoutés. Le deuxième algorithme, TAPE, est la première méthode d’exploration de cavités en 3D qui minimise le temps de mission et la longueur du fil déroulé. En moyenne, le trajet global est 4% plus long que la méthode qui résout le TSP, mais le fil reste sous la longueur autorisée dans 100% des cas simulés, contre 53% avec la méthode initiale. L’approche utilise une architecture hiérarchique à 2 niveaux : la planification globale résout un TSP après extraction des frontières, et la planification locale minimise le coût du chemin et la longueur de fil via une fonction de décision. L’intégration de ces deux outils dans le NetherDrone produit un système intelligent pour l’exploration autonome, doté de fonctionnalités semi-autonomes pour une interaction avec l’opérateur. Les travaux réalisés ouvrent la porte à de nouvelles approches de navigation dans le domaine des missions d’inspection, de cartographie et de recherche et sauvetage

A machine learning optimization approach for last-mile delivery and third-party logistics

Third-party logistics is now an essential component of efficient delivery systems, enabling companies to purchase carrier services instead of an expensive fleet of vehicles. However, carrier contracts have to be booked in advance without exact knowledge of what orders will be available for dispatch. The model describing this problem is the variable cost and size bin packing problem with stochastic items. Since it cannot be solved for realistic instances by means of exact solvers, in this paper, we present a new heuristic algorithm able to do so based on machine learning techniques. Several numerical experiments show that the proposed heuristics achieve good performance in a short computational time, thus enabling its real-world usage. Moreover, the comparison against a new and efficient version of progressive hedging proves that the proposed heuristic achieves better results. Finally, we present managerial insights for a case study on parcel delivery in Turin, Italy