Reinforcement learning based local search for grouping problems: A case study on graph coloring

Grouping problems aim to partition a set of items into multiple mutually disjoint subsets according to some specific criterion and constraints. Grouping problems cover a large class of important combinatorial optimization problems that are generally computationally difficult. In this paper, we propose a general solution approach for grouping problems, i.e., reinforcement learning based local search (RLS), which combines reinforcement learning techniques with descent-based local search. The viability of the proposed approach is verified on a well-known representative grouping problem (graph coloring) where a very simple descent-based coloring algorithm is applied. Experimental studies on popular DIMACS and COLOR02 benchmark graphs indicate that RLS achieves competitive performances compared to a number of well-known coloring algorithms

A Tabu Search Based Metaheuristic for Dynamic Carpooling Optimization

International audienceThe carpooling problem consists in matching a set of riders' requests with a set of drivers' offers by synchronizing their origins, destinations and time windows. The paper presents the so-called Dynamic Carpooling Optimization System (DyCOS), a system which supports the automatic and optimal ridematching process between users on very short notice or even en-route. Nowadays, there are numerous research contributions that revolve around the carpooling problem, notably in the dynamic context. However, the problem's high complexity and the real time aspect are still challenges to overcome when addressing dynamic carpooling. To counter these issues, DyCOS takes decisions using a novel Tabu Search based metaheuristic. The proposed algorithm employs an explicit memory system and several original searching strategies developed to make optimal decisions automatically. To increase users' satisfaction, the proposed metaheuristic approach manages the transfer process and includes the possibility to drop off the passenger at a given walking distance from his destination or at a transfer node. In addition, the detour concept is used as an original aspiration process, to avoid the entrapment by local solutions and improve the generated solution. For a rigorous assessment of generated solutions , while considering the importance and interaction among the optimization criteria, the algorithm adopts the Choquet integral operator as an aggregation approach. To measure the effectiveness of the proposed method, we develop a simulation environment based on actual carpooling demand data from the metropolitan area of Lille in the north of France

Métaheuristiques pour la résolution de problème de covoiturage régulier de grande taille et d'une extension

La dispersion spatiale de l'habitat et des activités de ces dernières décennies a fortement contribué à un allongement des distances et des temps de trajets domicile-travail. Cela a pour conséquence un accroissement de l'utilisation des voitures particulières, notamment au sein et aux abords des grandes agglomérations. Afin de réduire les impacts dus à l'augmentation du trafic routier, des services de covoiturage, où des usagers ayant la même destination se regroupent en équipage pour se déplacer, ont été mis en place partout dans le monde. Nous présentons ici nos travaux sur le problème de covoiturage régulier. Dans cette thèse, le problème de covoiturage régulier a été modélisé et plusieurs métaheuristiques de résolution ont été implémentées, testées et comparées. La thèse est organisée de la façon suivante: tout d'abord, nous commençons par présenter la définition et la description du problème ainsi que le modèle mathématique associé. Ensuite, plusieurs métaheuristiques pour résoudre le problème sont présentées. Ces approches sont au nombre de quatre: un algorithme de recherche locale à voisinage variable, un algorithme à base de colonies de fourmis, un algorithme génétique guidée et un système multi-agents génétiques auto-adaptatif. Des expériences ont été menées pour démontrer l'efficacité de nos approches. Nous continuons ensuite avec la présentation et la résolution d'une extension du problème de covoiturage occasionel comportant plusieurs destinations. Pour terminer, une plate-forme de test et d'analyse pour évaluer nos approches et une plate-forme de covoiturage sont présentées dans l'annexe.Nowadays, the increased human mobility combined with high use of private cars increases the load on environment and raises issues about quality of life. The extensive use of private cars lends to high levels of air pollution, parking problem, traffic congestion and low transfer velocity. In order to ease these shortcomings, the car pooling program, where sets of car owners having the same travel destination share their vehicles, has emerged all around the world. We present here our research on the long-term car pooling problem. In this thesis, the long-term car pooling problem is modeled and metaheuristics for solving the problem are investigated. The thesis is organized as follows. First, the definition and description of the problem as well as its mathematical model are introduced. Then, several metaheuristics to effectively and efficiently solve the problem are presented. These approaches include a Variable Neighborhood Search Algorithm, a Clustering Ant Colony Algorithm, a Guided Genetic Algorithm and a Multi-agent Self-adaptive Genetic Algorithm. Experiments have been conducted to demonstrate the effectiveness of these approaches on solving the long-term car pooling problem. Afterwards, we extend our research to a multi-destination daily car pooling problem, which is introduced in detail manner along with its resolution method. At last, an algorithm test and analysis platform for evaluating the algorithms and a car pooling platform are presented in the appendix.ARRAS-Bib.electronique (620419901) / SudocSudocFranceF

Real-Time Optimization for Dynamic Ride-Sharing

Throughout the last decade, the advent of novel mobility services such as ride-hailing, car-sharing, and ride-sharing has shaped urban mobility. While these types of services offer flexible on-demand transportation for customers, they may also increase the load on the, already strained, road infrastructure and exacerbate traffic congestion problems. One potential way to remedy this problem is the increased usage of dynamic ride-sharing services. In this type of service, multiple customer trips are combined into share a vehicle simultaneously. This leads to more efficient vehicle utilization, reduced prices for customers, and less traffic congestion at the cost of slight delays compared to direct transportation in ride-hailing services. In this thesis, we consider the planning and operation of such dynamic ride-sharing services. We present a wider look at the planning context of dynamic ride-sharing and discuss planning problems on the strategical, tactical, and operational level. Subsequently, our focus is on two operational planning problems: dynamic vehicle routing, and idle vehicle repositioning. Regarding vehicle routing, we introduce the vehicle routing problem for dynamic ridesharing and present a solution procedure. Our algorithmic approach consists of two phases: a fast insertion heuristic, and a local search improvement phase. The former handles incoming trip requests and quickly assigns them to suitable vehicles while the latter is responsible for continuously improving the current routing plan. This way, we enable fast response times for customers while simultaneously effectively utilizing available computational resources. Concerning the idle vehicle repositioning problem, we propose a mathematical model that takes repositioning decisions and adequately reflects available vehicle resources as well as a forecast of the upcoming trip request demand. This model is embedded into a real-time planning algorithm that regularly re-optimizes the movement of idle vehicles. Through an adaptive parameter calculation process, our algorithm dynamically adapts to changes in the current system state. To evaluate our algorithms, we present a modular simulation-based evaluation framework. We envision that this framework may also be used by other researchers and developers. In this thesis, we perform computational evaluations on a variety of scenarios based on real-world data from Chengdu, New York City, and Hamburg. The computational results show that we are able to produce high-quality solutions in real-time, enabling the usage in high-demand settings. In addition, our algorithms perform robustly in a variety of settings and are quickly adapted to new application settings, such as the deployment in a new city

The multi-vehicle dial-a-ride problem with interchange and perceived passenger travel times

The Dial-a-Ride Problem (DARP) introduced in the early 1980s is the NP-Hard optimization problem of developing the most cost-efficient vehicle schedules for a number of available vehicles that have to start from a depot, pick up and deliver a set of passengers, and return back to the same depot. DARP has been used in many modern applications, including the scheduling of demand-responsive transit and car pooling. This study departs from the original definition of DARP and it extends it by considering an interchange point where vehicles can exchange their picked-up passengers with other vehicles in order to shorten their delivery routes and reduce their running times. In addition to that, this study introduces the concept of generalized passenger travel times in the DARP formulation which translates the increased in-vehicle crowdedness to increased perceived passenger travel times. This addresses a key issue because the perceived in-vehicle travel times of passengers might increase when the vehicle becomes more crowded (i.e., passengers might feel that their travel time is higher when they are not able to find a seat or they are too close to each other increasing the risk of virus transmission or accidents). Given these considerations, this study introduces the Dial-a-Ride Problem with interchange and perceived travel times (DARPi) and models it as a nonlinear programming problem. DARPi is then reformulated to a MILP with the use of linearizations and its search space is tightened with the addition of valid inequalities that are employed when solving the problem to global optimality with Branch-and-Cut. For large problem instances, this study introduces a tabu search-based metaheuristic and performs experiments in benchmark instances used in past literature demonstrating the computation times and solution stability of our approach. The effect of the perceived passenger travel times to the vehicle running costs is also explored in extensive numerical experiments.</p

Simheuristics to support efficient and sustainable freight transportation in smart city logistics

La logística urbana intel·ligent constitueix un factor crucial en la creació de sistemes de transport urbà eficients i sostenibles. Entre altres factors, aquests sistemes es centren en la incorporació de dades en temps real i en la creació de models de negoci col·laboratius en el transport urbà de mercaderies, considerant l’augment dels habitants en les ciutats, la creixent complexitat de les demandes dels clients i els mercats altament competitius. Això permet als que planifiquen el transport minimitzar els costos monetaris i ambientals del transport de mercaderies a les àrees metropolitanes. Molts problemes de presa de decisions en aquest context es poden formular com a problemes d’optimació combinatòria. Tot i que hi ha diferents enfocaments de resolució exacta per a trobar solucions òptimes a aquests problemes, la seva complexitat i grandària, a més de la necessitat de prendre decisions instantànies pel que fa a l’encaminament de vehicles, la programació o la situació d’instal·lacions, fa que aquestes metodologies no s’apliquin a la pràctica. A causa de la seva capacitat per a trobar solucions pseudoòptimes en gairebé temps real, els algorismes metaheurístics reben una atenció creixent dels investigadors i professionals com a alternatives eficients i fiables per a resoldre nombrosos problemes d’optimació en la creació de la logística de les ciutats intel·ligents. Malgrat el seu èxit, les tècniques metaheurístiques tradicionals no representen plenament la complexitat dels sistemes més realistes. En assumir entrades (inputs) i restriccions de problemes deterministes, la incertesa i el dinamisme experimentats en els escenaris de transport urbà queden sense explicar. Els algorismes simheurístics persegueixen superar aquests inconvenients mitjançant la integració de qualsevol tipus de simulació en processos metaheurístics per a explicar la incertesa inherent a la majoria de les aplicacions de la vida real. Aquesta tesi defineix i investiga l’ús d’algorismes simheurístics com el mètode més adequat per a resoldre problemes d’optimació derivats de la logística de les ciutats. Alguns algorismes simheurístics s’apliquen a una sèrie de problemes complexos, com la recollida de residus urbans, els problemes de disseny de la cadena de subministrament integrada i els models de transport innovadors relacionats amb la col·laboració horitzontal entre els socis de la cadena de subministrament. A més de les discussions metodològiques i la comparació d’algorismes desenvolupats amb els referents de la bibliografia acadèmica, es mostra l’aplicabilitat i l’eficiència dels algorismes simheurístics en diferents casos de gran escala.Las actividades de logística en ciudades inteligentes constituyen un factor crucial en la creación de sistemas de transporte urbano eficientes y sostenibles. Entre otros factores, estos sistemas se centran en la incorporación de datos en tiempo real y la creación de modelos empresariales colaborativos en el transporte urbano de mercancías, al tiempo que consideran el aumento del número de habitantes en las ciudades, la creciente complejidad de las demandas de los clientes y los mercados altamente competitivos. Esto permite minimizar los costes monetarios y ambientales del transporte de mercancías en las áreas metropolitanas. Muchos de los problemas de toma de decisiones en este contexto se pueden formular como problemas de optimización combinatoria. Si bien existen diferentes enfoques de resolución exacta para encontrar soluciones óptimas a tales problemas, su complejidad y tamaño, además de la necesidad de tomar decisiones instantáneas con respecto al enrutamiento, la programación o la ubicación de las instalaciones, hacen que dichas metodologías sean inaplicables en la práctica. Debido a su capacidad para encontrar soluciones pseudoóptimas casi en tiempo real, los algoritmos metaheurísticos reciben cada vez más atención por parte de investigadores y profesionales como alternativas eficientes y fiables para resolver numerosos problemas de optimización en la creación de la logística de ciudades inteligentes. A pesar de su éxito, las técnicas metaheurísticas tradicionales no representan completamente la complejidad de los sistemas más realistas. Al asumir insumos y restricciones de problemas deterministas, se ignora la incertidumbre y el dinamismo experimentados en los escenarios de transporte urbano. Los algoritmos simheurísticos persiguen superar estos inconvenientes integrando cualquier tipo de simulación en procesos metaheurísticos con el fin de considerar la incertidumbre inherente en la mayoría de las aplicaciones de la vida real. Esta tesis define e investiga el uso de algoritmos simheurísticos como método adecuado para resolver problemas de optimización que surgen en la logística de ciudades inteligentes. Se aplican algoritmos simheurísticos a una variedad de problemas complejos, incluyendo la recolección de residuos urbanos, problemas de diseño de la cadena de suministro integrada y modelos de transporte innovadores relacionados con la colaboración horizontal entre los socios de la cadena de suministro. Además de las discusiones metodológicas y la comparación de los algoritmos desarrollados con los de referencia de la bibliografía académica, se muestra la aplicabilidad y la eficiencia de los algoritmos simheurísticos en diferentes estudios de casos a gran escala.Smart city logistics are a crucial factor in the creation of efficient and sustainable urban transportation systems. Among other factors, they focus on incorporating real-time data and creating collaborative business models in urban freight transportation concepts, whilst also considering rising urban population numbers, increasingly complex customer demands, and highly competitive markets. This allows transportation planners to minimize the monetary and environmental costs of freight transportation in metropolitan areas. Many decision-making problems faced in this context can be formulated as combinatorial optimization problems. While different exact solving approaches exist to find optimal solutions to such problems, their complexity and size, in addition to the need for instantaneous decision-making regarding vehicle routing, scheduling, or facility location, make such methodologies inapplicable in practice. Due to their ability to find pseudo-optimal solutions in almost real time, metaheuristic algorithms have received increasing attention from researchers and practitioners as efficient and reliable alternatives in solving numerous optimization problems in the creation of smart city logistics. Despite their success, traditional metaheuristic techniques fail to fully represent the complexity of most realistic systems. By assuming deterministic problem inputs and constraints, the uncertainty and dynamism experienced in urban transportation scenarios are left unaccounted for. Simheuristic frameworks try to overcome these drawbacks by integrating any type of simulation into metaheuristic-driven processes to account for the inherent uncertainty in most real-life applications. This thesis defines and investigates the use of simheuristics as a method of first resort for solving optimization problems arising in smart city logistics concepts. Simheuristic algorithms are applied to a range of complex problem settings including urban waste collection, integrated supply chain design, and innovative transportation models related to horizontal collaboration among supply chain partners. In addition to methodological discussions and the comparison of developed algorithms to state-of-the-art benchmarks found in the academic literature, the applicability and efficiency of simheuristic frameworks in different large-scaled case studies are shown

Modeling Framework and Solution Methodologies for On-Demand Mobility Services With Ridesharing and Transfer Options

The growing complexity of the urban travel pattern and its related traffic congestion, along with the extensive usage of mobile phones, invigorated On-Demand Mobility Services (ODMS) and opened the door to the emergence of Transportation Network Companies (TNC). By adopting the shared economy paradigm, TNCs enable private car owners to provide transportation services to passengers by providing user-friendly mobile phone applications that efficiently match passengers to service providers. Considering the high level of flexibility, convenience, and reliability of ODMS, compared to those offered by traditional public transportation systems, many metropolitan areas in the United States and abroad have reported rapid growth of such services. This dissertation presents a modeling framework to study the operation of on-demand mobility services (ODMS) in urban areas. The framework can analyze the operation of ODMS while representing emerging services such as ridesharing and transfer. The problem is formulated as a mixed-integer program and an efficient decomposition-based methodology is developed for its solution. This solution methodology aims at solving the offline version of the problem, in which the passengers’ demand is assumed to be known ii for the entire planning horizon. The presented approach adopts a modified column generation algorithm, which integrates iterative decomposition and network augmentation techniques to analyze networks with moderate size. Besides, a novel methodology for integrated ride-matching and vehicle routing for dynamic (online) ODMS with ridesharing and transfer options is developed to solve the problem in real-time. The methodology adopts a hybrid heuristic approach, which enables solving large problem instances in near real-time, where the passengers’ demand is not known a priori. The heuristic allows to (1) promptly respond to individual ride requests and (2) periodically re-evaluate the generated solutions and recommend modifications to enhance the overall solution quality by increasing the number of served passengers and total profit of the system. The outcomes of experiments considering hypothetical and real-world networks are presented. The results show that the modified column generation approach provides a good quality solution in less computation time than the CPLEX solver. Additionally, the heuristic approach can provide an efficient solution for large networks while satisfying the real-time execution requirements. Additionally, investigation of the results of the experiments shows that increasing the number of passengers willing to rideshare and/or transfer increases the general performance of ODMS by increasing the number of served passengers and associated revenue and reducing the number of needed vehicles

A multimodal network flow problem with product quality preservation, transshipment, and asset management

In this paper, we present an optimization model for a transportation planning problem with multiple transportation modes, highly perishable products, demand and supply dynamics, and management of the reusable transport units (RTIs). Such a problem arises in the European horticultural chain, for example. As a result of geographic dispersion of production and market, a reliable transportation solutions ensures long-term success in the European market. The model is an extension to the network ow problem. We integrate dynamic allocation, ow, and repositioning of the RTIs in order to nd the trade-o between quality requirements and operational considerations and costs. We also present detailed computational results and analysis

A multimodal network flow problem with product quality preservation, transshipment, and asset management

In this paper, we present an optimization model for a transportation planning problem with multiple transportation modes, highly perishable products, demand and supply dynamics, and management of the reusable transport units (RTIs). Such a problem arises in the European horticultural chain, for example. As a result of geographic dispersion of production and market, a reliable transportation solutions ensures long-term success in the European market. The model is an extension to the network ow problem. We integrate dynamic allocation, ow, and repositioning of the RTIs in order to nd the trade-o between quality requirements and operational considerations and costs. We also present detailed computational results and analysis