Human-Machine Collaborative Optimization via Apprenticeship Scheduling

Coordinating agents to complete a set of tasks with intercoupled temporal and resource constraints is computationally challenging, yet human domain experts can solve these difficult scheduling problems using paradigms learned through years of apprenticeship. A process for manually codifying this domain knowledge within a computational framework is necessary to scale beyond the ``single-expert, single-trainee" apprenticeship model. However, human domain experts often have difficulty describing their decision-making processes, causing the codification of this knowledge to become laborious. We propose a new approach for capturing domain-expert heuristics through a pairwise ranking formulation. Our approach is model-free and does not require enumerating or iterating through a large state space. We empirically demonstrate that this approach accurately learns multifaceted heuristics on a synthetic data set incorporating job-shop scheduling and vehicle routing problems, as well as on two real-world data sets consisting of demonstrations of experts solving a weapon-to-target assignment problem and a hospital resource allocation problem. We also demonstrate that policies learned from human scheduling demonstration via apprenticeship learning can substantially improve the efficiency of a branch-and-bound search for an optimal schedule. We employ this human-machine collaborative optimization technique on a variant of the weapon-to-target assignment problem. We demonstrate that this technique generates solutions substantially superior to those produced by human domain experts at a rate up to 9.5 times faster than an optimization approach and can be applied to optimally solve problems twice as complex as those solved by a human demonstrator.Comment: Portions of this paper were published in the Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI) in 2016 and in the Proceedings of Robotics: Science and Systems (RSS) in 2016. The paper consists of 50 pages with 11 figures and 4 table

An auction for collaborative vehicle routing: Models and algorithms

Increasing competition and expectations from customers pressures carriers to further improve efficiency. Forming collaborations is essential for carriers to reach their targeted efficiency levels. In this study, we investigate an auction mechanism to facilitate collaboration amongst carriers while maintaining autonomy for the individual carriers. Multiple auction implementations are evaluated. As the underlying decision problem (which is a traditional vehicle routing problem) is known to be NP-hard, this auction mechanism has an important inherent complexity. Therefore, we use fast and efficient algorithms for the vehicle routing problem to ensure that the auction can be used in operational decision making. Numerical results are presented, indicating that the auction achieves a savings potential better than the thus far reported approaches in the literature. Managerial insights are discussed, particularly related to the properties of the auction and value of the information

Optimisation of Mobile Communication Networks - OMCO NET

The mini conference “Optimisation of Mobile Communication Networks” focuses on advanced methods for search and optimisation applied to wireless communication networks. It is sponsored by Research & Enterprise Fund Southampton Solent University. The conference strives to widen knowledge on advanced search methods capable of optimisation of wireless communications networks. The aim is to provide a forum for exchange of recent knowledge, new ideas and trends in this progressive and challenging area. The conference will popularise new successful approaches on resolving hard tasks such as minimisation of transmit power, cooperative and optimal routing

Simheuristics to support efficient and sustainable freight transportation in smart city logistics

La logística urbana intel·ligent constitueix un factor crucial en la creació de sistemes de transport urbà eficients i sostenibles. Entre altres factors, aquests sistemes es centren en la incorporació de dades en temps real i en la creació de models de negoci col·laboratius en el transport urbà de mercaderies, considerant l’augment dels habitants en les ciutats, la creixent complexitat de les demandes dels clients i els mercats altament competitius. Això permet als que planifiquen el transport minimitzar els costos monetaris i ambientals del transport de mercaderies a les àrees metropolitanes. Molts problemes de presa de decisions en aquest context es poden formular com a problemes d’optimació combinatòria. Tot i que hi ha diferents enfocaments de resolució exacta per a trobar solucions òptimes a aquests problemes, la seva complexitat i grandària, a més de la necessitat de prendre decisions instantànies pel que fa a l’encaminament de vehicles, la programació o la situació d’instal·lacions, fa que aquestes metodologies no s’apliquin a la pràctica. A causa de la seva capacitat per a trobar solucions pseudoòptimes en gairebé temps real, els algorismes metaheurístics reben una atenció creixent dels investigadors i professionals com a alternatives eficients i fiables per a resoldre nombrosos problemes d’optimació en la creació de la logística de les ciutats intel·ligents. Malgrat el seu èxit, les tècniques metaheurístiques tradicionals no representen plenament la complexitat dels sistemes més realistes. En assumir entrades (inputs) i restriccions de problemes deterministes, la incertesa i el dinamisme experimentats en els escenaris de transport urbà queden sense explicar. Els algorismes simheurístics persegueixen superar aquests inconvenients mitjançant la integració de qualsevol tipus de simulació en processos metaheurístics per a explicar la incertesa inherent a la majoria de les aplicacions de la vida real. Aquesta tesi defineix i investiga l’ús d’algorismes simheurístics com el mètode més adequat per a resoldre problemes d’optimació derivats de la logística de les ciutats. Alguns algorismes simheurístics s’apliquen a una sèrie de problemes complexos, com la recollida de residus urbans, els problemes de disseny de la cadena de subministrament integrada i els models de transport innovadors relacionats amb la col·laboració horitzontal entre els socis de la cadena de subministrament. A més de les discussions metodològiques i la comparació d’algorismes desenvolupats amb els referents de la bibliografia acadèmica, es mostra l’aplicabilitat i l’eficiència dels algorismes simheurístics en diferents casos de gran escala.Las actividades de logística en ciudades inteligentes constituyen un factor crucial en la creación de sistemas de transporte urbano eficientes y sostenibles. Entre otros factores, estos sistemas se centran en la incorporación de datos en tiempo real y la creación de modelos empresariales colaborativos en el transporte urbano de mercancías, al tiempo que consideran el aumento del número de habitantes en las ciudades, la creciente complejidad de las demandas de los clientes y los mercados altamente competitivos. Esto permite minimizar los costes monetarios y ambientales del transporte de mercancías en las áreas metropolitanas. Muchos de los problemas de toma de decisiones en este contexto se pueden formular como problemas de optimización combinatoria. Si bien existen diferentes enfoques de resolución exacta para encontrar soluciones óptimas a tales problemas, su complejidad y tamaño, además de la necesidad de tomar decisiones instantáneas con respecto al enrutamiento, la programación o la ubicación de las instalaciones, hacen que dichas metodologías sean inaplicables en la práctica. Debido a su capacidad para encontrar soluciones pseudoóptimas casi en tiempo real, los algoritmos metaheurísticos reciben cada vez más atención por parte de investigadores y profesionales como alternativas eficientes y fiables para resolver numerosos problemas de optimización en la creación de la logística de ciudades inteligentes. A pesar de su éxito, las técnicas metaheurísticas tradicionales no representan completamente la complejidad de los sistemas más realistas. Al asumir insumos y restricciones de problemas deterministas, se ignora la incertidumbre y el dinamismo experimentados en los escenarios de transporte urbano. Los algoritmos simheurísticos persiguen superar estos inconvenientes integrando cualquier tipo de simulación en procesos metaheurísticos con el fin de considerar la incertidumbre inherente en la mayoría de las aplicaciones de la vida real. Esta tesis define e investiga el uso de algoritmos simheurísticos como método adecuado para resolver problemas de optimización que surgen en la logística de ciudades inteligentes. Se aplican algoritmos simheurísticos a una variedad de problemas complejos, incluyendo la recolección de residuos urbanos, problemas de diseño de la cadena de suministro integrada y modelos de transporte innovadores relacionados con la colaboración horizontal entre los socios de la cadena de suministro. Además de las discusiones metodológicas y la comparación de los algoritmos desarrollados con los de referencia de la bibliografía académica, se muestra la aplicabilidad y la eficiencia de los algoritmos simheurísticos en diferentes estudios de casos a gran escala.Smart city logistics are a crucial factor in the creation of efficient and sustainable urban transportation systems. Among other factors, they focus on incorporating real-time data and creating collaborative business models in urban freight transportation concepts, whilst also considering rising urban population numbers, increasingly complex customer demands, and highly competitive markets. This allows transportation planners to minimize the monetary and environmental costs of freight transportation in metropolitan areas. Many decision-making problems faced in this context can be formulated as combinatorial optimization problems. While different exact solving approaches exist to find optimal solutions to such problems, their complexity and size, in addition to the need for instantaneous decision-making regarding vehicle routing, scheduling, or facility location, make such methodologies inapplicable in practice. Due to their ability to find pseudo-optimal solutions in almost real time, metaheuristic algorithms have received increasing attention from researchers and practitioners as efficient and reliable alternatives in solving numerous optimization problems in the creation of smart city logistics. Despite their success, traditional metaheuristic techniques fail to fully represent the complexity of most realistic systems. By assuming deterministic problem inputs and constraints, the uncertainty and dynamism experienced in urban transportation scenarios are left unaccounted for. Simheuristic frameworks try to overcome these drawbacks by integrating any type of simulation into metaheuristic-driven processes to account for the inherent uncertainty in most real-life applications. This thesis defines and investigates the use of simheuristics as a method of first resort for solving optimization problems arising in smart city logistics concepts. Simheuristic algorithms are applied to a range of complex problem settings including urban waste collection, integrated supply chain design, and innovative transportation models related to horizontal collaboration among supply chain partners. In addition to methodological discussions and the comparison of developed algorithms to state-of-the-art benchmarks found in the academic literature, the applicability and efficiency of simheuristic frameworks in different large-scaled case studies are shown

The Bi-objective Periodic Closed Loop Network Design Problem

© 2019 Elsevier Ltd. This manuscript is made available under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International licence (CC BY-NC-ND 4.0). For further details please see: https://creativecommons.org/licenses/by-nc-nd/4.0/Reverse supply chains are becoming a crucial part of retail supply chains given the recent reforms in the consumers’ rights and the regulations by governments. This has motivated companies around the world to adopt zero-landfill goals and move towards circular economy to retain the product’s value during its whole life cycle. However, designing an efficient closed loop supply chain is a challenging undertaking as it presents a set of unique challenges, mainly owing to the need to handle pickups and deliveries at the same time and the necessity to meet the customer requirements within a certain time limit. In this paper, we model this problem as a bi-objective periodic location routing problem with simultaneous pickup and delivery as well as time windows and examine the performance of two procedures, namely NSGA-II and NRGA, to solve it. The goal is to find the best locations for a set of depots, allocation of customers to these depots, allocation of customers to service days and the optimal routes to be taken by a set of homogeneous vehicles to minimise the total cost and to minimise the overall violation from the customers’ defined time limits. Our results show that while there is not a significant difference between the two algorithms in terms of diversity and number of solutions generated, NSGA-II outperforms NRGA when it comes to spacing and runtime.Peer reviewedFinal Accepted Versio

Adaptive large neighborhood search algorithm – performance evaluation under parallel schemes & applications

Adaptive Large Neighborhood Search (ALNS) is a fairly recent yet popular single-solution heuristic for solving discrete optimization problems. Even though the heuristic has been a popular choice for researchers in recent times, the parallelization of this algorithm is not widely studied in the literature compared to the other classical metaheuristics. To extend the existing literature, this study proposes several different parallel schemes to parallelize the basic/sequential ALNS algorithm. More specifically, seven different parallel schemes are employed to target different characteristics of the ALNS algorithm and the capability of the local computers. The schemes of this study are implemented in a master-slave architecture to manage and assign loads in processors of the local computers. The overall goal is to simultaneously explore different areas of the search space in an attempt to escape the local minima, taking effective steps toward the optimal solution and, to the end, accelerating the convergence of the ALNS algorithm. The performance of the schemes is tested by solving a capacitated vehicle routing problem (CVRP) with available wellknown test instances. Our computational results indicate that all the parallel schemes are capable of providing a competitive optimality gap in solving CVRP within our investigated test instances. However, the parallel scheme (scheme 1), which runs the ALNS algorithm independently within different slave processors (e.g., without sharing any information with other slave processors) until the synchronization occurs only when one of the processors meets its predefined termination criteria and reports the solution to the master processor, provides the best running time with solving the instances approximately 10.5 times faster than the basic/sequential ALNS algorithm. These findings are applied in a real-life fulfillment process using mixed-mode delivery with trucks and drones. Complex but optimized routes are generated in a short time that is applicable to perform last-mile delivery to customers