Fuzzy linear assignment problem: an approach to vehicle fleet deployment

This paper proposes and examines a new approach using fuzzy logic to vehicle fleet deployment. Fleet deployment is viewed as a fuzzy linear assignment problem. It assigns each travel request to an available service vehicle through solving a linear assignment matrix of defuzzied cost entries. Each cost entry indicates the cost value of a travel request that "fuzzily aggregates" multiple criteria in simple rules incorporating human dispatching expertise. The approach is examined via extensive simulations anchored in a representative scenario of taxi deployment, and compared to the conventional case of using only distances (each from the taxi position to the source point and finally destination point of a travel request) as cost entries. Discussion in the context of related work examines the performance and practicality of the proposed approach

CoRide: Joint Order Dispatching and Fleet Management for Multi-Scale Ride-Hailing Platforms

How to optimally dispatch orders to vehicles and how to tradeoff between immediate and future returns are fundamental questions for a typical ride-hailing platform. We model ride-hailing as a large-scale parallel ranking problem and study the joint decision-making task of order dispatching and fleet management in online ride-hailing platforms. This task brings unique challenges in the following four aspects. First, to facilitate a huge number of vehicles to act and learn efficiently and robustly, we treat each region cell as an agent and build a multi-agent reinforcement learning framework. Second, to coordinate the agents from different regions to achieve long-term benefits, we leverage the geographical hierarchy of the region grids to perform hierarchical reinforcement learning. Third, to deal with the heterogeneous and variant action space for joint order dispatching and fleet management, we design the action as the ranking weight vector to rank and select the specific order or the fleet management destination in a unified formulation. Fourth, to achieve the multi-scale ride-hailing platform, we conduct the decision-making process in a hierarchical way where a multi-head attention mechanism is utilized to incorporate the impacts of neighbor agents and capture the key agent in each scale. The whole novel framework is named as CoRide. Extensive experiments based on multiple cities real-world data as well as analytic synthetic data demonstrate that CoRide provides superior performance in terms of platform revenue and user experience in the task of city-wide hybrid order dispatching and fleet management over strong baselines.Comment: CIKM 201

A dynamic ridesharing dispatch and idle vehicle repositioning strategy with integrated transit transfers

We propose a ridesharing strategy with integrated transit in which a private on-demand mobility service operator may drop off a passenger directly door-to-door, commit to dropping them at a transit station or picking up from a transit station, or to both pickup and drop off at two different stations with different vehicles. We study the effectiveness of online solution algorithms for this proposed strategy. Queueing-theoretic vehicle dispatch and idle vehicle relocation algorithms are customized for the problem. Several experiments are conducted first with a synthetic instance to design and test the effectiveness of this integrated solution method, the influence of different model parameters, and measure the benefit of such cooperation. Results suggest that rideshare vehicle travel time can drop by 40-60% consistently while passenger journey times can be reduced by 50-60% when demand is high. A case study of Long Island commuters to New York City (NYC) suggests having the proposed operating strategy can substantially cut user journey times and operating costs by up to 54% and 60% each for a range of 10-30 taxis initiated per zone. This result shows that there are settings where such service is highly warranted

Optimization of job shop scheduling with material handling by automated guided vehicle

Job Shop Scheduling with Material Handling has attracted increasing attention in both industry and academia, especially with the inception of Industry 4.0 and smart manufacturing. A smart manufacturing system calls for efficient and effective production planning. On a typical modern shop floor, jobs of various types follow certain processing routes through machines or work centers, and automated guided vehicles (AGVs) are utilized to handle the jobs. In this research, the optimization of a shop floor with AGV is carried out, and we also consider the planning scenario under variable processing time of jobs. The goal is to minimize the shop floor production makespan or other specific criteria correlated with makespan, by scheduling the operations of job processing and routing the AGVs. This dissertation includes three research studies that will constitute my doctoral work. In the first study, we discuss a simplified case in which the scheduling problem is reformulated into a vehicle dispatching (assignment) problem. A few AGV dispatching strategies are proposed based on the deterministic optimization of network assignment problems. The AGV dispatching strategies take future transportation requests into consideration and optimally configure transportation resources such that material handling can be more efficient than those adopting classic AGV assignment rules in which only the current request is considered. The strategies are demonstrated and validated with a case study based on a shop floor in literature and compared to classic AGV assignment rules. The results show that AGV dispatching with adoption of the proposed strategy has better performance on some specific criterions like minimizing job waiting time. In the second study, an efficient heuristic algorithm for classic Job Shop Scheduling with Material Handling is proposed. Typically, the job shop scheduling problem and material handling problem are studied separately due to the complexity of both problems. However, considering these two types of decisions in the same model offers benefits since the decisions are related to each other. In this research, we aim to study the scheduling of job operations together with the AGV routing/scheduling, and a formulation as well as solution techniques are proposed. The proposed heuristic algorithm starts from an optimal job shop scheduling solution without limiting the size of AGV fleet, and iteratively reduces the number of available vehicles until the fleet size is equal to the original requirements. The computational experiments suggest that compared to existing solution techniques in literature, the proposed algorithm can achieve comparable solution quality on makespan with much higher computational efficiency. In the third study, we take the variability of processing time into consideration in optimizing job shop scheduling with material handling. Variability caused by random effects and deterioration is discussed, and a series of models are developed to accommodate random and deteriorating processing time respectively. With random processing time, the model is formulated as a Stochastic Programming Job Shop Scheduling with Material Handling model, and with deteriorating processing time the model can be nonlinear under specific deteriorating functions. Based on a widely adopted dataset in existing literature, the stochastic programming model were solved with Pyomo, and models with deterioration were linearized and solved with CPLEX. By considering variable processing time, the JSSMH models can better adapt to real production scenarios

Deep reinforcement learning for the dynamic vehicle dispatching problem: An event-based approach

The dynamic vehicle dispatching problem corresponds to deciding which vehicles to assign to requests that arise stochastically over time and space. It emerges in diverse areas, such as in the assignment of trucks to loads to be transported; in emergency systems; and in ride-hailing services. In this paper, we model the problem as a semi-Markov decision process, which allows us to treat time as continuous. In this setting, decision epochs coincide with discrete events whose time intervals are random. We argue that an event-based approach substantially reduces the combinatorial complexity of the decision space and overcomes other limitations of discrete-time models often proposed in the literature. In order to test our approach, we develop a new discrete-event simulator and use double deep q-learning to train our decision agents. Numerical experiments are carried out in realistic scenarios using data from New York City. We compare the policies obtained through our approach with heuristic policies often used in practice. Results show that our policies exhibit better average waiting times, cancellation rates and total service times, with reduction in average waiting times of up to 50% relative to the other tested heuristic policies.Comment: 42 pages, 22 figure

The delivery dispatching problem with time windows for urban consolidation centers

This paper addresses the dispatching problem faced by an urban consolidation center. The center receives orders according to a stochastic arrival process and dispatches them in batches for the last-mile distribution. The operator of the center aims to find the cost-minimizing consolidation policy, depending on the orders at hand, preannounced orders, and stochastic arrivals. We present this problem as a variant of the delivery dispatching problem that includes dispatch windows and define a corresponding Markov decision model. Larger instances of the problem suffer from intractably large state-, outcome-, and action spaces. We propose an approximate dynamic programming (ADP) algorithm that can handle such instances, using a linear value function approximation to estimate the downstream costs. To design the value function approximation, we construct various sets of basis functions, numerically evaluate their suitability, and discuss the properties of good basis functions for the dispatching problem. Numerical experiments on toy-sized instances show that the best set of basis functions approximates the optimal values with an error of less than 3%. To cope with large action spaces, we formulate an integer linear program to be used within our ADP algorithm. We evaluate the performance of ADP policies against four benchmark policies: two heuristic policies, a direct cost minimization policy, and a post-decision rollout policy. We test the performance of ADP on a variety of networks. ADP consistently outperforms the benchmark policies, performing particularly well when there is sufficient flexibility in dispatch times