Human-Machine Collaborative Optimization via Apprenticeship Scheduling

Coordinating agents to complete a set of tasks with intercoupled temporal and resource constraints is computationally challenging, yet human domain experts can solve these difficult scheduling problems using paradigms learned through years of apprenticeship. A process for manually codifying this domain knowledge within a computational framework is necessary to scale beyond the ``single-expert, single-trainee" apprenticeship model. However, human domain experts often have difficulty describing their decision-making processes, causing the codification of this knowledge to become laborious. We propose a new approach for capturing domain-expert heuristics through a pairwise ranking formulation. Our approach is model-free and does not require enumerating or iterating through a large state space. We empirically demonstrate that this approach accurately learns multifaceted heuristics on a synthetic data set incorporating job-shop scheduling and vehicle routing problems, as well as on two real-world data sets consisting of demonstrations of experts solving a weapon-to-target assignment problem and a hospital resource allocation problem. We also demonstrate that policies learned from human scheduling demonstration via apprenticeship learning can substantially improve the efficiency of a branch-and-bound search for an optimal schedule. We employ this human-machine collaborative optimization technique on a variant of the weapon-to-target assignment problem. We demonstrate that this technique generates solutions substantially superior to those produced by human domain experts at a rate up to 9.5 times faster than an optimization approach and can be applied to optimally solve problems twice as complex as those solved by a human demonstrator.Comment: Portions of this paper were published in the Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI) in 2016 and in the Proceedings of Robotics: Science and Systems (RSS) in 2016. The paper consists of 50 pages with 11 figures and 4 table

Minimizing sum of completion times on a single machine with sequence-dependent family setup times

This paper presents a branch-and-bound (B&B) algorithm for minimizing the sum of completion times in a singlemachine scheduling setting with sequence-dependent family setup times. The main feature of the B&B algorithm is a new lower bounding scheme that is based on a networkformulation of the problem. With extensive computational tests, we demonstrate that the B&B algorithm can solve problems with up to 60 jobs and 12 families, where setup and processing times are uniformly distributed in various combinations of the [1,50] and [1,100] ranges

Intelligent systems in manufacturing: current developments and future prospects

Global competition and rapidly changing customer requirements are demanding increasing changes in manufacturing environments. Enterprises are required to constantly redesign their products and continuously reconfigure their manufacturing systems. Traditional approaches to manufacturing systems do not fully satisfy this new situation. Many authors have proposed that artificial intelligence will bring the flexibility and efficiency needed by manufacturing systems. This paper is a review of artificial intelligence techniques used in manufacturing systems. The paper first defines the components of a simplified intelligent manufacturing systems (IMS), the different Artificial Intelligence (AI) techniques to be considered and then shows how these AI techniques are used for the components of IMS

On green routing and scheduling problem

The vehicle routing and scheduling problem has been studied with much interest within the last four decades. In this paper, some of the existing literature dealing with routing and scheduling problems with environmental issues is reviewed, and a description is provided of the problems that have been investigated and how they are treated using combinatorial optimization tools

Working Notes from the 1992 AAAI Spring Symposium on Practical Approaches to Scheduling and Planning

The symposium presented issues involved in the development of scheduling systems that can deal with resource and time limitations. To qualify, a system must be implemented and tested to some degree on non-trivial problems (ideally, on real-world problems). However, a system need not be fully deployed to qualify. Systems that schedule actions in terms of metric time constraints typically represent and reason about an external numeric clock or calendar and can be contrasted with those systems that represent time purely symbolically. The following topics are discussed: integrating planning and scheduling; integrating symbolic goals and numerical utilities; managing uncertainty; incremental rescheduling; managing limited computation time; anytime scheduling and planning algorithms, systems; dependency analysis and schedule reuse; management of schedule and plan execution; and incorporation of discrete event techniques

Planning and reconfigurable control of a fleet of unmanned vehicles for taxi operations in airport environment

The optimization of airport operations has gained increasing interest by the aeronautical community, due to the substantial growth in the number of airport movements (landings and take-offs) experienced in the past decades all over the world. Forecasts have confirmed this trend also for the next decades. The result of the expansion of air traffic is an increasing congestion of airports, especially in taxiways and runways, leading to additional amount of fuel burnt by airplanes during taxi operations, causing additional pollution and costs for airlines. In order to reduce the impact of taxi operations, different solutions have been proposed in literature; the solution which this dissertation refers to uses autonomous electric vehicles to tow airplanes between parking lots and runways. Although several analyses have been proposed in literature, showing the feasibility and the effectiveness of this approach in reducing the environmental impact, at the beginning of the doctoral activity no solutions were proposed, on how to manage the fleet of unmanned vehicles inside the airport environment. Therefore, the research activity has focused on the development of algorithms able to provide pushback tractor (also referred as tugs) autopilots with conflict-free schedules. The main objective of the optimization algorithms is to minimize the tug energy consumption, while performing just-in-time runway operations: departing airplanes are delivered only when they can take-off and the taxi-in phase starts as soon as the aircraft clears the runway and connects to the tractor. Two models, one based on continuous time and one on discrete time evolution, were developed to simulate the taxi phases within the optimization scheme. A piecewise-linear model has also been proposed to evaluate the energy consumed by the tugs during the assigned missions. Furthermore, three optimization algorithms were developed: two hybrid versions of the particle swarm optimization and a tree search heuristic. The following functional requirements for the management algorithm were defined: the optimization model must be easily adapted to different airports with different layout (reconfigurability); the generated schedule must always be conflict-free; and the computational time required to process a time horizon of 1h must be less than 15min. In order to improve its performance, the particle swarm optimization was hybridized with a hill-climb meta-heuristic; a second hybridization was performed by means of the random variable search, an algorithm of the family of the variable neighborhood search. The neighborhood size for the random variable search was considered varying with inverse proportionality to the distance between the actual considered solution and the optimal one found so far. Finally, a tree search heuristic was developed to find the runway sequence, among all the possible sequences of take-offs and landings for a given flight schedule, which can be realized with a series of taxi trajectories that require minimum energy consumption. Given the taxi schedule generated by the aforementioned optimization algorithms a tug dispatch algorithm, assigns a vehicle to each mission. The three optimization schemes and the two mathematical models were tested on several test cases among three airports: the Turin-Caselle airport, the Milan-Malpensa airport, and the Amsterdam airport Schiphol. The cost required to perform the generated schedules using the autonomous tugs was compared to the cost required to perform the taxi using the aircraft engines. The proposed approach resulted always more convenient than the classical one

Integrated and joint optimisation of runway-taxiway-apron operations on airport surface

Airports are the main bottlenecks in the Air Traffic Management (ATM) system. The predicted 84% increase in global air traffic in the next two decades has rendered the improvement of airport operational efficiency a key issue in ATM. Although the operations on runways, taxiways, and aprons are highly interconnected and interdependent, the current practice is not integrated and piecemeal, and overly relies on the experience of air traffic controllers and stand allocators to manage operations, which has resulted in sub-optimal performance of the airport surface in terms of operational efficiency, capacity, and safety. This thesis proposes a mixed qualitative-quantitative methodology for integrated and joint optimisation of runways, taxiways, and aprons, aiming to improve the efficiency of airport surface operations by integrating the operations of all three resources and optimising their coordination. This is achieved through a two-stage optimisation procedure: (1) the Integrated Apron and Runway Assignment (IARA) model, which optimises the apron and runway allocations for individual aircraft on a pre-tactical level, and (2) the Integrated Dynamic Routing and Off-block (IDRO) model, which generates taxiing routes and off-block timing decisions for aircraft on an operational (real-time) level. This two-stage procedure considers the interdependencies of the operations of different airport resources, detailed network configurations, air traffic flow characteristics, and operational rules and constraints. The proposed framework is implemented and assessed in a case study at Beijing Capital International Airport. Compared to the current operations, the proposed apron-runway assignment reduces total taxiing distance, average taxiing time, taxiing conflicts, runway queuing time and fuel consumption respectively by 15.5%, 15.28%, 45.1%, [58.7%, 35.3%, 16%] (RWY01, RWY36R, RWY36L) and 6.6%; gated assignment is increased by 11.8%. The operational feasibility of this proposed framework is further validated qualitatively by subject matter experts (SMEs). The potential impact of the integrated apron-runway-taxiway operation is explored with a discussion of its real-world implementation issues and recommendations for industrial and academic practice.Open Acces