On the Value and Challenge of Real-Time Information in Dynamic Dispatching of Service Vehicles

Ubiquitous computing technologies and information systems pave the way for real-time planning and management. In the process of dynamic vehicle dispatching, the adherent challenge is to develop decision support systems using real-time information in an appropriate quality and at the right moment in order to improve their value creation. As real-time information enables replanning at any point in time, the question arises when replanning should be triggered. Frequent replanning may lead to efficient routing decisions due to vehicles’ diversions from current routes while less frequent replanning may enable effective assignments due to gained information. In this paper, the authors analyze and quantify the impact of the three main triggers from the literature, exogenous customer requests, endogenous vehicle statuses, and replanning in fixed intervals, for a dynamic vehicle routing problem with stochastic service requests. To this end, the authors generalize the Markov-model of an established dynamic routing problem and embed the different replanning triggers in an existing anticipatory assignment and routing policy. They particularly analyze under which conditions each trigger is advantageous. The results indicate that fixed interval triggers are inferior and dispatchers should focus either on the exogenous customer process or the endoge- nous vehicle process. It is further shown that the exogenous trigger is advantageous for widely spread customers with long travel durations and few dynamic requests while the endogenous trigger performs best for many dynamic requests and when customers are accumulated in clusters

A Multistage Stochastic Programming Approach to the Dynamic and Stochastic VRPTW - Extended version

We consider a dynamic vehicle routing problem with time windows and stochastic customers (DS-VRPTW), such that customers may request for services as vehicles have already started their tours. To solve this problem, the goal is to provide a decision rule for choosing, at each time step, the next action to perform in light of known requests and probabilistic knowledge on requests likelihood. We introduce a new decision rule, called Global Stochastic Assessment (GSA) rule for the DS-VRPTW, and we compare it with existing decision rules, such as MSA. In particular, we show that GSA fully integrates nonanticipativity constraints so that it leads to better decisions in our stochastic context. We describe a new heuristic approach for efficiently approximating our GSA rule. We introduce a new waiting strategy. Experiments on dynamic and stochastic benchmarks, which include instances of different degrees of dynamism, show that not only our approach is competitive with state-of-the-art methods, but also enables to compute meaningful offline solutions to fully dynamic problems where absolutely no a priori customer request is provided.Comment: Extended version of the same-name study submitted for publication in conference CPAIOR201

Dynamic Stochastic Electric Vehicle Routing with Safe Reinforcement Learning

Dynamic routing of electric commercial vehicles can be a challenging problem since besides the uncertainty of energy consumption there are also random customer requests. This paper introduces the Dynamic Stochastic Electric Vehicle Routing Problem (DS-EVRP). A Safe Reinforcement Learning method is proposed for solving the problem. The objective is to minimize expected energy consumption in a safe way, which means also minimizing the risk of battery depletion while en route by planning charging whenever necessary. The key idea is to learn offline about the stochastic customer requests and energy consumption using Monte Carlo simulations, to be able to plan the route predictively and safely online. The method is evaluated using simulations based on energy consumption data from a realistic traffic model for the city of Luxembourg and a high-fidelity vehicle model. The results indicate that it is possible to save energy at the same time maintaining reliability by planning the routes and charging in an anticipative way. The proposed method has the potential to improve transport operations with electric commercial vehicles capitalizing on their environmental benefit

Adaptive State Space Partitioning for Dynamic Decision Processes

With the rise of newbusiness processes that require real-time decision making, anticipatory decision making becomes necessary to use the available resources wisely. Dynamic real-time problems occur in many business fields, for example in vehicle routing applications with stochastic customer service requests expecting a fast response. For anticipatory decision making, offline simulation-based optimization methods like value function approximation are promising solution approaches. However, these methods require a suitable approximation architecture to store the value information for the problem states. In this paper, an approach is proposed that finds and adapts this architecture iteratively during the approximation process. A computational proof of concept is presented for a dynamic vehicle routing problem. In comparison to conventional architectures, the proposed method is able to improve the solution quality and reduces the required architecture size significantly

Job Selection in a Network of Autonomous UAVs for Delivery of Goods

This article analyzes two classes of job selection policies that control how a network of autonomous aerial vehicles delivers goods from depots to customers. Customer requests (jobs) occur according to a spatio-temporal stochastic process not known by the system. If job selection uses a policy in which the first job (FJ) is served first, the system may collapse to instability by removing just one vehicle. Policies that serve the nearest job (NJ) first show such threshold behavior only in some settings and can be implemented in a distributed manner. The timing of job selection has significant impact on delivery time and stability for NJ while it has no impact for FJ. Based on these findings we introduce a methodological approach for decision-making support to set up and operate such a system, taking into account the trade-off between monetary cost and service quality. In particular, we compute a lower bound for the infrastructure expenditure required to achieve a certain expected delivery time. The approach includes three time horizons: long-term decisions on the number of depots to deploy in the service area, mid-term decisions on the number of vehicles to use, and short-term decisions on the policy to operate the vehicles

Un modelo para resolver el problema dinámico de despacho de vehículos con incertidumbre de clientes y con tiempos de viaje en arcos

Indexación: Web of Science; ScieloIn a real world case scenario, customer demands are requested at any time of the day requiring services that are not known in advance such as delivery or repairing equipment. This is called Dynamic Vehicle Routing (DVR) with customer uncertainty environment. The link travel time for the roadway network varies with time as traffic fluctuates adding an additional component to the dynamic environment. This paper presents a model for solving the DVR problem while combining these two dynamic aspects (customer uncertainty and link travel time). The proposed model employs Greedy, Insertion, and Ant Colony Optimization algorithms. The Greedy algorithm is utilized for constructing new routes with existing customers, and the remaining two algorithms are employed for rerouting as new customer demands appear. A real world application is presented to simulate vehicle routing in a dynamic environment for the city of Taipei, Taiwan. The simulation shows that the model can successfully plan vehicle routes to satisfy all customer demands and help managers in the decision making process.En un escenario real, los pedidos de los clientes son solicitados a cualquier hora del día requiriendo servicios que no han sido planificados con antelación tales como los despachos o la reparación de equipos. Esto es llamado ruteo dinámico de vehículos (RDV) considerando un ambiente con incertidumbre de clientes. El tiempo de viaje en una red vial varía con el tiempo a medida que el tráfico vehicular fluctúa agregando una componente adicional al ambiente dinámico. Este artículo propone un modelo para resolver el problema RDV combinando estos dos aspectos dinámicos. El modelo propuesto utiliza los algoritmos Greedy, Inserción y optimización basada en colonias de hormigas. El algoritmo Greedy es utilizado para construir nuevas rutas con los clientes existentes y los otros dos algoritmos son usados para rutear vehículos a medida que surjan nuevos clientes con sus respectivos pedidos. Además, se presenta una aplicación real para simular el ruteo vehicular en un ambiente dinámico para la ciudad de Taipei, Taiwán. Esta simulación muestra que el modelo es capaz de planificar exitosamente las rutas vehiculares satisfaciendo los pedidos de los clientes y de ayudar los gerentes en el proceso de toma de decisiones.http://ref.scielo.org/3ryfh

Towards a Testbed for Dynamic Vehicle Routing Algorithms

Since modern transport services are becoming more flexible, demand-responsive, and energy/cost efficient, there is a growing demand for large-scale microscopic simulation platforms in order to test sophisticated routing algorithms. Such platforms have to simulate in detail, not only the dynamically changing demand and supply of the relevant service, but also traffic flow and other relevant transport services. This paper presents the DVRP extension to the open-source MATSim simulator. The extension is designed to be highly general and customizable to simulate a wide range of dynamic rich vehicle routing problems. The extension allows plugging in of various algorithms that are responsible for continuous re-optimisation of routes in response to changes in the system. The DVRP extension has been used in many research and commercial projects dealing with simulation of electric and autonomous taxis, demand-responsive transport, personal rapid transport, free-floating car sharing and parking search

On green routing and scheduling problem

The vehicle routing and scheduling problem has been studied with much interest within the last four decades. In this paper, some of the existing literature dealing with routing and scheduling problems with environmental issues is reviewed, and a description is provided of the problems that have been investigated and how they are treated using combinatorial optimization tools