Agent-based transportation planning compared with scheduling heuristics

Here we consider the problem of dynamically assigning vehicles to transportation orders that have di¤erent time windows and should be handled in real time. We introduce a new agent-based system for the planning and scheduling of these transportation networks. Intelligent vehicle agents schedule their own routes. They interact with job agents, who strive for minimum transportation costs, using a Vickrey auction for each incoming order. We use simulation to compare the on-time delivery percentage and the vehicle utilization of an agent-based planning system to a traditional system based on OR heuristics (look-ahead rules, serial scheduling). Numerical experiments show that a properly designed multi-agent system may perform as good as or even better than traditional methods

A Better Match for Drivers and Riders: Reinforcement Learning at Lyft

To better match drivers to riders in our ridesharing application, we revised Lyft's core matching algorithm. We use a novel online reinforcement learning approach that estimates the future earnings of drivers in real time and use this information to find more efficient matches. This change was the first documented implementation of a ridesharing matching algorithm that can learn and improve in real time. We evaluated the new approach during weeks of switchback experimentation in most Lyft markets, and estimated how it benefited drivers, riders, and the platform. In particular, it enabled our drivers to serve millions of additional riders each year, leading to more than $30 million per year in incremental revenue. Lyft rolled out the algorithm globally in 2021

A Review Of Design And Control Of Automated Guided Vehicle Systems

This paper presents a review on design and control of automated guided vehicle systems. We address most key related issues including guide-path design, estimating the number of vehicles, vehicle scheduling, idle-vehicle positioning, battery management, vehicle routing, and conflict resolution. We discuss and classify important models and results from key publications in literature on automated guided vehicle systems, including often-neglected areas, such as idle-vehicle positioning and battery management. In addition, we propose a decision framework for design and implementation of automated guided vehicle systems, and suggest some fruitful research directions

Intelligent Control of Vehicle-Based Internal Transport Systems

“Intelligent control of vehicle-based internal transport (VBIT) systems” copes with real-time dispatching and scheduling of internal-transport vehicles, such as forklifts and guided vehicles. VBIT systems can be found in warehouses, distribution centers, manufacturing plants, airport and transshipment terminals. Using simulation of two realworld environments, dispatching rules described in literature and several newly introduced rules are compared on performance. The performance evaluation suggests that in environments where queue space is not a restriction, distance-based dispatching rules such as shortest-travel-distance-first outperform time-based dispatching rules such as modified-first-come-first-served and using load prearrival information has a significant positive impact on reducing the average load waiting time. Experimental results also reveal that multi-attribute dispatching rules combining distance and time aspects of vehicles and loads are robust to variations in working conditions. In addition, multi-attribute rules which take vehicle empty travel distance and vehicle requirement at a station into account perform very well in heavy-traffic VBIT systems such as baggage handling systems. Besides dispatching rules, the potential contribution of dynamic vehicle scheduling for VBIT systems is investigated. Experiments using simulation in combination with optimization show that when sufficient pre-arrival information is available a dynamic scheduling approach outperforms the dispatching approach. This thesis also evaluates the impact of guide-path layout, load arrival rate and variance, and the amount of load pre-arrival information on different vehicle control approaches (scheduling and dispatching). Based on experimental results, recommendations for selecting appropriate vehicle control approaches for specific situations are presented

A Microscopic Simulation Laboratory for Evaluation of Off-street Parking Systems

The parking industry produces an enormous amount of data every day that, properly analyzed, will change the way the industry operates. The collected data form patterns that, in most cases, would allow parking operators and property owners to better understand how to maximize revenue and decrease operating expenses and support the decisions such as how to set specific parking policies (e.g. electrical charging only parking space) to achieve the sustainable and eco-friendly parking. However, there lacks an intelligent tool to assess the layout design and operational performance of parking lots to reduce the externalities and increase the revenue. To address this issue, this research presents a comprehensive agent-based framework for microscopic off-street parking system simulation. A rule-based parking simulation logic programming model is formulated. The proposed simulation model can effectively capture the behaviors of drivers and pedestrians as well as spatial and temporal interactions of traffic dynamics in the parking system. A methodology for data collection, processing, and extraction of user behaviors in the parking system is also developed. A Long-Short Term Memory (LSTM) neural network is used to predict the arrival and departure of the vehicles. The proposed simulator is implemented in Java and a Software as a Service (SaaS) graphic user interface is designed to analyze and visualize the simulation results. This study finds the active capacity of the parking system, which is defined as the largest number of actively moving vehicles in the parking system under the facility layout. In the system application of the real world testbed, the numerical tests show (a) the smart check-in device has marginal benefits in vehicle waiting time; (b) the flexible pricing policy may increase the average daily revenue if the elasticity of the price is not involved; (c) the number of electrical charging only spots has a negative impact on the performance of the parking facility; and (d) the rear-in only policy may increase the duration of parking maneuvers and reduce the efficiency during the arrival rush hour. Application of the developed simulation system using a real-world case demonstrates its capability of providing informative quantitative measures to support decisions in designing, maintaining, and operating smart parking facilities

PEV Charging Infrastructure Integration into Smart Grid

Plug-in electric vehicles (PEVs) represent a huge step forward in a green transportation system, contribute to the reduction of greenhouse gas emission, and reduce the dependence on fossil fuel. With the increasing popularity of PEVs, public electric-vehicle charging infrastructure (EVCI) becomes indispensable to meet the PEV user requirements. EVCI can consist of various types of charging technologies, offering multiple charging services for PEV users. Proper integration of the charging infrastructure into smart grid is key to promote widespread adoption of PEVs. Planning and operation of EVCI are technically challenging, since PEVs are characterized by their limited driving range, long charging duration, and high charging power, in addition to the randomness in driving patterns and charging decisions of PEV users. EVCI planning involves both the siting and capacity planning of charging facilities. Charging facility siting must ensure not only a satisfactory charging service for PEV users but also a high utilization and profitability for the chosen facility locations. Thus, the various types of charging facilities should be located based on an accurate location estimation of the potential PEV charging demand. Capacity planning of charging facilities must ensure a satisfactory charging service for PEV users in addition to a reliable operation of the power grid. During the operation of EVCI, price-based coordination mechanisms can be leveraged to dynamically preserve the quality-of-service (QoS) requirements of charging facilities and ensure the profitability of the charging service. This research is to investigate and develop solutions for integrating the EVCI into the smart grid. It consists of three research topics: First, we investigate PEV charging infrastructure siting. We propose a spatial-temporal flow capturing location model. This model determines the locations of various types of charging facilities based on the spatial-temporal distribution of traffic flows. In the proposed model, we consider transportation network dynamics and congestion, in addition to different characteristics and usage patterns of each charging facility type. Second, we propose a QoS aware capacity planning of EVCI. The proposed framework accounts for the link between the charging QoS and the power distribution network (PDN) capability. Towards this end, we firstly optimize charging facility sizes to achieve a targeted QoS level. Then, we minimize the integration cost for the PDN by attaining the most cost-effective allocation of the energy storage systems and/or upgrading the PDN substation and feeders. Additionally, we capture the correlation between the occupation levels of neighboring charging facilities and the blocked PEV user behaviors. Lastly, we investigate the coordination of PEV charging demands. We develop a differentiated pricing mechanism for a multiservice EVCI using deep reinforcement learning (RL). The proposed framework enhances the performance of charging facilities by motivating PEV users to avoid over-usage of particular service classes. Since customer-side information is stochastic, non-stationary, and expensive to collect at scale, the proposed pricing mechanism utilizes the model-free deep RL approach. In the proposed RL approach, deep neural networks are trained to determine a pricing policy while interacting with the dynamically changing environment. The neural networks take the current EVCI state as input and generate pricing signals that coordinate the anticipated PEV charging demand

Implementation of the Delta/Start Model.

This working paper outlines the steps undertaken to develop a dynamic land use transport model. The model is based around an existing transport modelling suite, called START, which has been applied to many urban areas in the UK and abroad. However, its integration with an explicit land use model (called DELTA) was new, and this paper describes the first implementation of the combined dynamic land use transport model for the study area of Fife and Lothian region. The model was used in a PhD thesis and an EPSRC ‘Sustainable Cities’ research project at the Institute for Transport Studies. The paper discusses the processes involved in the full implementation of this model, involving both software development, modification to existing software, and implementation. However, it focuses in particular upon the data requirements and calibration of the various submodels in DELTA. In general the model dataset has been generated using existing study area data from past START applications, plus data from the 1991 Census of population and employment. Not all the disaggregations of data required by the model were available from published, or on-line, sources, and so several disaggregations were undertaken. A feature of the model is that the calibration is undertaken for each submodel individually. In general, the model made use of past research into the relationships that it represents, combined with the judgement of the model developers where no other data was available. The implementation of the location model is discussed in detail, including the use of environmental variables in location choice. This fulfils the main aim of this paper; to provide the technical background for the research projects that make use of this model implementation

Architecting Efficient Data Centers.

Data center power consumption has become a key constraint in continuing to scale Internet services. As our society’s reliance on “the Cloud” continues to grow, companies require an ever-increasing amount of computational capacity to support their customers. Massive warehouse-scale data centers have emerged, requiring 30MW or more of total power capacity. Over the lifetime of a typical high-scale data center, power-related costs make up 50% of the total cost of ownership (TCO). Furthermore, the aggregate effect of data center power consumption across the country cannot be ignored. In total, data center energy usage has reached approximately 2% of aggregate consumption in the United States and continues to grow. This thesis addresses the need to increase computational efficiency to address this grow- ing problem. It proposes a new classes of power management techniques: coordinated full-system idle low-power modes to increase the energy proportionality of modern servers. First, we introduce the PowerNap server architecture, a coordinated full-system idle low- power mode which transitions in and out of an ultra-low power nap state to save power during brief idle periods. While effective for uniprocessor systems, PowerNap relies on full-system idleness and we show that such idleness disappears as the number of cores per processor continues to increase. We expose this problem in a case study of Google Web search in which we demonstrate that coordinated full-system active power modes are necessary to reach energy proportionality and that PowerNap is ineffective because of a lack of idleness. To recover full-system idleness, we introduce DreamWeaver, architectural support for deep sleep. DreamWeaver allows a server to exchange latency for full-system idleness, allowing PowerNap-enabled servers to be effective and provides a better latency- power savings tradeoff than existing approaches. Finally, this thesis investigates workloads which achieve efficiency through methodical cluster provisioning techniques. Using the popular memcached workload, this thesis provides examples of provisioning clusters for cost-efficiency given latency, throughput, and data set size targets.Ph.D.Computer Science & EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/91499/1/meisner_1.pd

Smart Sustainable Mobility: Analytics and Algorithms for Next-Generation Mobility Systems

To this date, mobility ecosystems around the world operate on an uncoordinated, inefficient and unsustainable basis. Yet, many technology-enabled solutions that have the potential to remedy these societal negatives are already at our disposal or just around the corner. Innovations in vehicle technology, IoT devices, mobile connectivity and AI-powered information systems are expected to bring about a mobility system that is connected, autonomous, shared and electric (CASE). In order to fully leverage the sustainability opportunities afforded by CASE, system-level coordination and management approaches are needed. This Thesis sets out an agenda for Information Systems research to shape the future of CASE mobility through data, analytics and algorithms (Chapter 1). Drawing on causal inference, (spatial) machine learning, mathematical programming and reinforcement learning, three concrete contributions toward this agenda are developed. Chapter 2 demonstrates the potential of pervasive and inexpensive sensor technology for policy analysis. Connected sensing devices have significantly reduced the cost and complexity of acquiring high-resolution, high-frequency data in the physical world. This affords researchers the opportunity to track temporal and spatial patterns of offline phenomena. Drawing on a case from the bikesharing sector, we demonstrate how geo-tagged IoT data streams can be used for tracing out highly localized causal effects of large-scale mobility policy interventions while offering actionable insights for policy makers and practitioners. Chapter 3 sets out a solution approach to a novel decision problem faced by operators of shared mobility fleets: allocating vehicle inventory optimally across a network when competition is present. The proposed three-stage model combines real-time data analytics, machine learning and mixed integer non-linear programming into an integrated framework. It provides operational decision support for fleet managers in contested shared mobility markets by generating optimal vehicle re-positioning schedules in real time. Chapter 4 proposes a method for leveraging data-driven digital twin (DT) frameworks for large multi-stage stochastic design problems. Such problem classes are notoriously difficult to solve with traditional stochastic optimization. Drawing on the case of Electric Vehicle Charging Hubs (EVCHs), we show how high-fidelity, data-driven DT simulation environments fused with reinforcement learning (DT-RL) can achieve (close-to) arbitrary scalability and high modeling flexibility. In benchmark experiments we demonstrate that DT-RL-derived designs result in superior cost and service-level performance under real-world operating conditions

Understanding the effects of travel demand management on metro commuters’ behavioural loyalty: a hybrid choice modelling approach

As part of efforts to promote sustainable mobility, many cities are currently experiencing the rapid expansion of their metro network. The consequent growth in ridership motivates a broad range of travel demand management (TDM) policies, both in terms of passenger flow control and dynamic pricing strategies. This work aims to reveal the impact of TDM on metro commuters’ behavioural loyalty using stated-preference data collected in Guangzhou, China. Commuters’ behavioural response to TDM strategies is investigated in terms of the possible shift in departure time and travel mode. A hybrid choice model framework is used to incorporate four latent variables of interest, i.e., service quality, overall impression, external attractiveness and switching cost, into the discrete choice model and thereby capture the relationships between the attitudinal factors and observed variables. The model estimation results indicate that the four latent variables all prove useful in interpreting commuters’ behavioural loyalty. Commuters’ perceived service quality and overall impression both show a positive effect on their willingness to continue travelling by metro and are thus instructive for ridership retention. External attractiveness is found to be significant only in the case of the tendency to shift to a private car. Switching costs reveal commuters’ emotional attachment to their already developed commuting habit. These insights into commuters’ behavioural change intention enable metro operators to enhance commuters’ loyalty to their service and develop more effective TDM strategies in future practice