Task Assignment and Path Planning for Autonomous Mobile Robots in Stochastic Warehouse Systems

The material handling industry is in the middle of a transformation from manual operations to automation due to the rapid growth in e-commerce. Autonomous mobile robots (AMRs) are being widely implemented to replace manually operated forklifts in warehouse systems to fulfil large shipping demand, extend warehouse operating hours, and mitigate safety concerns. Two open questions in AMR management are task assignment and path planning. This dissertation addresses the task assignment and path planning (TAPP) problem for autonomous mobile robots (AMR) in a warehouse environment. The goals are to maximize system productivity by avoiding AMR traffic and reducing travel time. The first topic in this dissertation is the development of a discrete event simulation modeling framework that can be used to evaluate alternative traffic control rules, task assignment methods, and path planning algorithms. The second topic, Risk Interval Path Planning (RIPP), is an algorithm designed to avoid conflicts among AMRs considering uncertainties in robot motion. The third topic is a deep reinforcement learning (DRL) model that is developed to solve task assignment and path planning problems, simultaneously. Experimental results demonstrate the effectiveness of these methods in stochastic warehouse systems

Design and Simulation Analysis of Deep Learning Based Approaches and Multi-Attribute Algorithms for Warehouse Task Selection

With the growth and adoption of global supply chains and internet technologies, warehouse operations have become more demanding. Particularly, the number of orders being processed over a given time frame is drastically increasing, leading to more work content. This makes operational tasks, such as material retrieval and storage, done manually more inefficient. To improve system-level warehouse efficiency, collaborating Autonomous Vehicles (AVs) are needed. Several design challenges encompass an AV, some critical aspects are navigation, path planning, obstacle avoidance, task selection decisions, communication, and control systems. The current study addresses the warehouse task selection problem given a dynamic pending task list and considering multiple attributes: distance, traffic, collaboration, and due date, using situational decision-making approaches. The study includes the design and analysis of two situational decision-making approaches for multi-attribute dynamic warehouse task selection: Deep Learning Approach for Multi-Attribute Task Selection (DLT) and Situation based Greedy (SGY) algorithm that uses a traditional algorithmic approach. The two approaches are designed and analyzed in the current work. Further, they are evaluated using a simulation-based experiment. The results show that both the DLT and SGY have potential and are effective in comparison to the earliest due date first and shortest travel distance-based rules in addressing the multi-attribute task selection needs of a warehouse operation under the given experimental conditions and trade-offs

The importance of information flows temporal attributes for the efficient scheduling of dynamic demand responsive transport services

The operation of a demand responsive transport service usually involves the management of dynamic requests. The underlying algorithms are mainly adaptations of procedures carefully designed to solve static versions of the problem, in which all the requests are known in advance. However there is no guarantee that the effectiveness of an algorithm stays unchanged when it is manipulated to work in a dynamic environment. On the other hand, the way the input is revealed to the algorithm has a decisive role on the schedule quality. We analyze three characteristics of the information flow (percentage of real-time requests, interval between call-in and requested pickup time and length of the computational cycle time), assessing their influence on the effectiveness of the scheduling proces

Optimization of job shop scheduling with material handling by automated guided vehicle

Job Shop Scheduling with Material Handling has attracted increasing attention in both industry and academia, especially with the inception of Industry 4.0 and smart manufacturing. A smart manufacturing system calls for efficient and effective production planning. On a typical modern shop floor, jobs of various types follow certain processing routes through machines or work centers, and automated guided vehicles (AGVs) are utilized to handle the jobs. In this research, the optimization of a shop floor with AGV is carried out, and we also consider the planning scenario under variable processing time of jobs. The goal is to minimize the shop floor production makespan or other specific criteria correlated with makespan, by scheduling the operations of job processing and routing the AGVs. This dissertation includes three research studies that will constitute my doctoral work. In the first study, we discuss a simplified case in which the scheduling problem is reformulated into a vehicle dispatching (assignment) problem. A few AGV dispatching strategies are proposed based on the deterministic optimization of network assignment problems. The AGV dispatching strategies take future transportation requests into consideration and optimally configure transportation resources such that material handling can be more efficient than those adopting classic AGV assignment rules in which only the current request is considered. The strategies are demonstrated and validated with a case study based on a shop floor in literature and compared to classic AGV assignment rules. The results show that AGV dispatching with adoption of the proposed strategy has better performance on some specific criterions like minimizing job waiting time. In the second study, an efficient heuristic algorithm for classic Job Shop Scheduling with Material Handling is proposed. Typically, the job shop scheduling problem and material handling problem are studied separately due to the complexity of both problems. However, considering these two types of decisions in the same model offers benefits since the decisions are related to each other. In this research, we aim to study the scheduling of job operations together with the AGV routing/scheduling, and a formulation as well as solution techniques are proposed. The proposed heuristic algorithm starts from an optimal job shop scheduling solution without limiting the size of AGV fleet, and iteratively reduces the number of available vehicles until the fleet size is equal to the original requirements. The computational experiments suggest that compared to existing solution techniques in literature, the proposed algorithm can achieve comparable solution quality on makespan with much higher computational efficiency. In the third study, we take the variability of processing time into consideration in optimizing job shop scheduling with material handling. Variability caused by random effects and deterioration is discussed, and a series of models are developed to accommodate random and deteriorating processing time respectively. With random processing time, the model is formulated as a Stochastic Programming Job Shop Scheduling with Material Handling model, and with deteriorating processing time the model can be nonlinear under specific deteriorating functions. Based on a widely adopted dataset in existing literature, the stochastic programming model were solved with Pyomo, and models with deterioration were linearized and solved with CPLEX. By considering variable processing time, the JSSMH models can better adapt to real production scenarios

Improving just-in-time delivery performance of IoT-enabled flexible manufacturing systems with AGV based material transportation

Autonomous guided vehicles (AGVs) are driverless material handling systems used for transportation of pallets and line side supply of materials to provide flexibility and agility in shop-floor logistics. Scheduling of shop-floor logistics in such systems is a challenging task due to their complex nature associated with the multiple part types and alternate material transfer routings. This paper presents a decision support system capable of supporting shop-floor decision-making activities during the event of manufacturing disruptions by automatically adjusting both AGV and machine schedules in Flexible Manufacturing Systems (FMSs). The proposed system uses discrete event simulation (DES) models enhanced by the Internet-of-Things (IoT) enabled digital integration and employs a nonlinear mixed integer programming Genetic Algorithm (GA) to find near-optimal production schedules prioritising the just-in-time (JIT) material delivery performance and energy efficiency of the material transportation. The performance of the proposed system is tested on the Integrated Manufacturing and Logistics (IML) demonstrator at WMG, University of Warwick. The results showed that the developed system can find the near-optimal solutions for production schedules subjected to production anomalies in a negligible time, thereby supporting shop-floor decision-making activities effectively and rapidly

Improving just-in-time delivery performance of IoT-enabled flexible manufacturing systems with AGV based material transportation

© 2020 by the authors. Licensee MDPI, Basel, Switzerland. Autonomous guided vehicles (AGVs) are driverless material handling systems used for transportation of pallets and line side supply of materials to provide flexibility and agility in shop-floor logistics. Scheduling of shop-floor logistics in such systems is a challenging task due to their complex nature associated with the multiple part types and alternate material transfer routings. This paper presents a decision support system capable of supporting shop-floor decision-making activities during the event of manufacturing disruptions by automatically adjusting both AGV and machine schedules in Flexible Manufacturing Systems (FMSs). The proposed system uses discrete event simulation (DES) models enhanced by the Internet-of-Things (IoT) enabled digital integration and employs a nonlinear mixed integer programming Genetic Algorithm (GA) to find near-optimal production schedules prioritising the just-in-time (JIT) material delivery performance and energy efficiency of the material transportation. The performance of the proposed system is tested on the Integrated Manufacturing and Logistics (IML) demonstrator at WMG, University of Warwick. The results showed that the developed system can find the near-optimal solutions for production schedules subjected to production anomalies in a negligible time, thereby supporting shop-floor decision-making activities effectively and rapidly

Data-driven Methodologies and Applications in Urban Mobility

The world is urbanizing at an unprecedented rate where urbanization goes from 39% in 1980 to 58% in 2019 (World Bank, 2019). This poses more and more transportation demand and pressure on the already at or over-capacity old transport infrastructure, especially in urban areas. Along the same timeline, more data generated as a byproduct of daily activity are being collected via the advancement of the internet of things, and computers are getting more and more powerful. These are shown by the statistics such as 90% of the world’s data is generated within the last two years and IBM’s computer is now processing at the speed of 120,000 GPS points per second. Thus, this dissertation discusses the challenges and opportunities arising from the growing demand for urban mobility, particularly in cities with outdated infrastructure, and how to capitalize on the unprecedented growth in data in solving these problems by ways of data-driven transportation-specific methodologies. The dissertation identifies three primary challenges and/or opportunities, which are (1) optimally locating dynamic wireless charging to promote the adoption of electric vehicles, (2) predicting dynamic traffic state using an enormously large dataset of taxi trips, and (3) improving the ride-hailing system with carpooling, smart dispatching, and preemptive repositioning. The dissertation presents potential solutions/methodologies that have become available only recently thanks to the extraordinary growth of data and computers with explosive power, and these methodologies are (1) bi-level optimization planning frameworks for locating dynamic wireless charging facilities, (2) Traffic Graph Convolutional Network for dynamic urban traffic state estimation, and (3) Graph Matching and Reinforcement Learning for the operation and management of mixed autonomous electric taxi fleets. These methodologies are then carefully calibrated, methodically scrutinized under various performance metrics and procedures, and validated with previous research and ground truth data, which is gathered directly from the real world. In order to bridge the gap between scientific discoveries and practical applications, the three methodologies are applied to the case study of (1) Montgomery County, MD, (2) the City of New York, and (3) the City of Chicago and from which, real-world implementation are suggested. This dissertation’s contribution via the provided methodologies, along with the continual increase in data, have the potential to significantly benefit urban mobility and work toward a sustainable transportation system

Combining Reinforcement Learning With Genetic Algorithm for Many-To-Many Route Optimization of Autonomous Vehicles

This study introduces an approach for route optimization of many-to-many Demand-Responsive Transport (DRT) services. In contrast to conventional fixed-route transit systems, DRT provides dynamic, flexible, and cost-effective alternatives. We present an algorithm that integrates DRT with the autonomous shuttles at Korea National University of Transportation (KNUT), allowing dynamic route modifications in real-time to accommodate incoming service calls. The algorithm is designed to take into account the shuttle's current position, the destinations of passengers already on board, the current locations and destinations of individuals who have requested shuttle services, and the remaining capacity of the shuttle. The algorithm has been developed to combine genetic algorithms and reinforcement learning. The performance evaluation was conducted using a simulation model that emulates KNUT's campus and the adjoining local community area. The simulation results show significant improvements in two key metrics, specifically the 'Request to Pick-up Time' and 'Request to Drop-off Time' during high-demand periods over the single-shuttle operation. Additional simulation test with random service requests and stochastic passenger walking distances showed the potential adaptability across different settings

A Review Of Design And Control Of Automated Guided Vehicle Systems

This paper presents a review on design and control of automated guided vehicle systems. We address most key related issues including guide-path design, estimating the number of vehicles, vehicle scheduling, idle-vehicle positioning, battery management, vehicle routing, and conflict resolution. We discuss and classify important models and results from key publications in literature on automated guided vehicle systems, including often-neglected areas, such as idle-vehicle positioning and battery management. In addition, we propose a decision framework for design and implementation of automated guided vehicle systems, and suggest some fruitful research directions