Approximate Algorithms for the Combined arrival-Departure Aircraft Sequencing and Reactive Scheduling Problems on Multiple Runways

The problem addressed in this dissertation is the Aircraft Sequencing Problem (ASP) in which a schedule must be developed to determine the assignment of each aircraft to a runway, the appropriate sequence of aircraft on each runway, and their departing or landing times. The dissertation examines the ASP over multiple runways, under mixed mode operations with the objective of minimizing the total weighted tardiness of aircraft landings and departures simultaneously. To prevent the dangers associated with wake-vortex effects, separation times enforced by Aviation Administrations (e.g., FAA) are considered, adding another level of complexity given that such times are sequence-dependent. Due to the problem being NP-hard, it is computationally difficult to solve large scale instances in a reasonable amount of time. Therefore, three greedy algorithms, namely the Adapted Apparent Tardiness Cost with Separation and Ready Times (AATCSR), the Earliest Ready Time (ERT) and the Fast Priority Index (FPI) are proposed. Moreover, metaheuristics including Simulated Annealing (SA) and the Metaheuristic for Randomized Priority Search (Meta-RaPS) are introduced to improve solutions initially constructed by the proposed greedy algorithms. The performance (solution quality and computational time) of the various algorithms is compared to the optimal solutions and to each other. The dissertation also addresses the Aircraft Reactive Scheduling Problem (ARSP) as air traffic systems frequently encounter various disruptions due to unexpected events such as inclement weather, aircraft failures or personnel shortages rendering the initial plan suboptimal or even obsolete in some cases. This research considers disruptions including the arrival of new aircraft, flight cancellations and aircraft delays. ARSP is formulated as a multi-objective optimization problem in which both the schedule\u27s quality and stability are of interest. The objectives consist of the total weighted start times (solution quality), total weighted start time deviation, and total weighted runway deviation (instability measures). Repair and complete regeneration approximate algorithms are developed for each type of disruptive events. The algorithms are tested against difficult benchmark problems and the solutions are compared to optimal solutions in terms of solution quality, schedule stability and computational time

Aircraft route recovery based on distributed integer programming method

In order to further promote the application and development of unmanned aviation in the manned field, and reduce the difficulty that airlines cannot avoid due to unexpected factors such as bad weather, aircraft failure, and so on, the problem of restoring aircraft routes has been studied. To reduce the economic losses caused by flight interruption, this paper divides the repair problem of aircraft operation plans into two sub problems, namely, the generation of flight routes and the reallocation of aircraft. Firstly, the existing fixed-point iteration method proposed by Dang is used to solve the feasible route generation model based on integer programming. To calculate quickly and efficiently, a segmentation method that divides the solution space into mutually independent segments is proposed as the premise of distributed computing. The feasible route is then allocated to the available aircraft to repair the flight plan. The experimental results of two examples of aircraft fault grounding and airport closure show that the method proposed in this paper is effective for aircraft route restoration

강화학습을 이용한 공항 임시폐쇄 상황에서의 항공 일정계획 복원

학위논문 (석사) -- 서울대학교 대학원 : 공과대학 산업공학과, 2021. 2. 문일경.An airline scheduler plans flight schedules with efficient resource utilization. However, unpredictable events, such as the temporary closure of an airport, disrupt planned flight schedules. Therefore, recovering disrupted flight schedules is essential for airlines. We propose Q-learning and Double Q-learning algorithms using reinforcement learning approach for the aircraft recovery problem (ARP) in cases of temporary closures of airports. We use two recovery options: delaying departures of flights and swapping aircraft. We present an artificial environment of daily flight schedules and the Markov decision process (MDP) for the ARP. We evaluate the proposed approach on a set of experiments carried out on a real-world case of a Korean domestic airline. Computational experiments show that reinforcement learning algorithms recover disrupted flight schedules effectively, and that our approaches flexibly adapt to various objectives and realistic conditions.항공사는 보유하고 있는 자원을 최대한 효율적으로 사용하여 항공 일정계획을 수립하기 위해 비용과 시간을 많이 소모하게 된다. 하지만 공항 임시폐쇄와 같은 긴급 상황이 발생하면 항공편의 비정상 운항이 발생하게 된다. 따라서 이러한 상황이 발생하였을 때, 피해를 최대한 줄이기 위해 항공 일정계획을 복원하게 된다. 본 연구는 강화학습을 이용하여 공항 임시폐쇄 상황에서 항공 일정계획 복원 문제를 푼다. 본 연구에서는 항공기 복원 방법으로 항공편 지연과 항공기 교체의 두 가지 방법을 채택하였으며, 항공 일정계획 복원 문제에 강화학습을 적용하기 위해서 마르코프 결정 과정과 강화학습 환경을 구축하였다. 본 실험을 위해 대한민국 항공사의 실제 국내선 항공 일정계획을 사용하였다. 강화학습 알고리즘을 사용하여 기존의 연구에 비해 항공 일정계획을 효율적으로 복원하였으며, 여러 현실적인 조건과 다양한 목적함수에 유연하게 적용하였다.Abstract i Contents iv List of Tables v List of Figures vi Chapter 1 Introduction 1 Chapter 2 Literature Review 7 Chapter 3 Problem statement 11 3.1 Characteristics of aircraft, flights, and flight schedule requirements 11 3.2 Definitions of disruptions and recovery options and objectives of the problem 13 3.3 Assumptions 16 3.4 Mathematical formulations 19 Chapter 4 Reinforcement learning for aircraft recovery 24 4.1 Principles of reinforcement learning 24 4.2 Environment 27 4.3 Markov decision process 29 Chapter 5 Reinforcement learning algorithms 33 5.1 Q-learning algorithm 33 5.2 Overestimation bias and Double Q-learning algorithm 36 Chapter 6 Computational experiments 38 6.1 Comparison between reinforcement learning and existing algorithms 39 6.2 Performance of the TLN varying the size of delay arcs 46 6.3 Aircraft recovery for a complex real-world case: a Korean domestic airline 48 6.4 Validation for different objectives 54 6.5 Managerial insights 57 Chapter 7 Conclusions 59 Bibliography 61 국문초록 69Maste

Multi-objective airline schedule recovery

Master'sMASTER OF ENGINEERIN

A Hybrid Tabu/Scatter Search Algorithm for Simulation-Based Optimization of Multi-Objective Runway Operations Scheduling

As air traffic continues to increase, air traffic flow management is becoming more challenging to effectively and efficiently utilize airport capacity without compromising safety, environmental and economic requirements. Since runways are often the primary limiting factor in airport capacity, runway operations scheduling emerge as an important problem to be solved to alleviate flight delays and air traffic congestion while reducing unnecessary fuel consumption and negative environmental impacts. However, even a moderately sized real-life runway operations scheduling problem tends to be too complex to be solved by analytical methods, where all mathematical models for this problem belong to the complexity class of NP-Hard in a strong sense due to combinatorial nature of the problem. Therefore, it is only possible to solve practical runway operations scheduling problem by making a large number of simplifications and assumptions in a deterministic context. As a result, most analytical models proposed in the literature suffer from too much abstraction, avoid uncertainties and, in turn, have little applicability in practice. On the other hand, simulation-based methods have the capability to characterize complex and stochastic real-life runway operations in detail, and to cope with several constraints and stakeholders’ preferences, which are commonly considered as important factors in practice. This dissertation proposes a simulation-based optimization (SbO) approach for multi-objective runway operations scheduling problem. The SbO approach utilizes a discrete-event simulation model for accounting for uncertain conditions, and an optimization component for finding the best known Pareto set of solutions. This approach explicitly considers uncertainty to decrease the real operational cost of the runway operations as well as fairness among aircraft as part of the optimization process. Due to the problem’s large, complex and unstructured search space, a hybrid Tabu/Scatter Search algorithm is developed to find solutions by using an elitist strategy to preserve non-dominated solutions, a dynamic update mechanism to produce high-quality solutions and a rebuilding strategy to promote solution diversity. The proposed algorithm is applied to bi-objective (i.e., maximizing runway utilization and fairness) runway operations schedule optimization as the optimization component of the SbO framework, where the developed simulation model acts as an external function evaluator. To the best of our knowledge, this is the first SbO approach that explicitly considers uncertainties in the development of schedules for runway operations as well as considers fairness as a secondary objective. In addition, computational experiments are conducted using real-life datasets for a major US airport to demonstrate that the proposed approach is effective and computationally tractable in a practical sense. In the experimental design, statistical design of experiments method is employed to analyze the impacts of parameters on the simulation as well as on the optimization component’s performance, and to identify the appropriate parameter levels. The results show that the implementation of the proposed SbO approach provides operational benefits when compared to First-Come-First-Served (FCFS) and deterministic approaches without compromising schedule fairness. It is also shown that proposed algorithm is capable of generating a set of solutions that represent the inherent trade-offs between the objectives that are considered. The proposed decision-making algorithm might be used as part of decision support tools to aid air traffic controllers in solving the real-life runway operations scheduling problem

UAS in the Airspace: A Review on Integration, Simulation, Optimization, and Open Challenges

Air transportation is essential for society, and it is increasing gradually due to its importance. To improve the airspace operation, new technologies are under development, such as Unmanned Aircraft Systems (UAS). In fact, in the past few years, there has been a growth in UAS numbers in segregated airspace. However, there is an interest in integrating these aircraft into the National Airspace System (NAS). The UAS is vital to different industries due to its advantages brought to the airspace (e.g., efficiency). Conversely, the relationship between UAS and Air Traffic Control (ATC) needs to be well-defined due to the impacts on ATC capacity these aircraft may present. Throughout the years, this impact may be lower than it is nowadays because the current lack of familiarity in this relationship contributes to higher workload levels. Thereupon, the primary goal of this research is to present a comprehensive review of the advancements in the integration of UAS in the National Airspace System (NAS) from different perspectives. We consider the challenges regarding simulation, final approach, and optimization of problems related to the interoperability of such systems in the airspace. Finally, we identify several open challenges in the field based on the existing state-of-the-art proposals

Multi-fidelity modelling approach for airline disruption management using simulation

Disruption to airline schedules is a key issue for the industry. There are various causes for disruption, ranging from weather events through to technical problems grounding aircraft. Delays can quickly propagate through a schedule, leading to high financial and reputational costs. Mitigating the impact of a disruption by adjusting the schedule is a high priority for the airlines. The problem involves rearranging aircraft, crew and passengers, often with large fleets and many uncertain elements. The multiple objectives, cost, delay and minimising schedule alterations, create a trade-off. In addition, the new schedule should be achievable without over-promising. This thesis considers the rescheduling of aircraft, the Aircraft Recovery Problem. The Aircraft Recovery Problem is well studied, though the literature mostly focusses on deterministic approaches, capable of modelling the complexity of the industry but with limited ability to capture the inherent uncertainty. Simulation offers a natural modelling framework, handling both the complexity and variability. However, the combinatorial aircraft allocation constraints are difficult for many simulation optimisation approaches, suggesting that a more tailored approach is required. This thesis proposes a two-stage multi-fidelity modelling approach, combining a low-fidelity Integer Program and a simulation. The deterministic Integer Program allocates aircraft to flights and gives an initial estimate of the delay of each flight. By solving in a multi-objective manner, it can quickly produce a set of promising solutions representing different trade-offs between disruption costs, total delay and the number of schedule alterations. The simulation is used to evaluate the candidate solutions and look for further local improvement. The aircraft allocation is fixed whilst a local search is performed over the flight delays, a continuous valued problem, aiming reduce costs. This is done by developing an adapted version of STRONG, a stochastic trust-region approach. The extension incorporates experimental design principles and projected gradient steps into STRONG to enable it to handle bound constraints. This method is demonstrated and evaluated with computational experiments on a set of disruptions with different fleet sizes and different numbers of disrupted aircraft. The results suggest that this multi-fidelity combination can produce good solutions to the Aircraft Recovery Problem. A more theoretical treatment of the extended trust-region simulation optimisation is also presented. The conditions under which a guarantee of the algorithm's asymptotic performance may be possible and a framework for proving these guarantees is presented. Some of the work towards this is discussed and we highlight where further work is required. This multi-fidelity approach could be used to implement a simulation-based decision support system for real-time disruption handling. The use of simulation for operational decisions raises the issue of how to evaluate a simulation-based tool and its predictions. It is argued that this is not a straightforward question of the real-world result being good or bad, as natural system variability can mask the results. This problem is formalised and a method is proposed for detecting systematic errors that could lead to poor decision making. The method is based on the Probability Integral Transformation using the simulation Empirical Cumulative Distribution Function and goodness of fit hypothesis tests for uniformity. This method is tested by applying it to the airline disruption problem previously discussed. Another simulation acts as a proxy real world, which deviates from the simulation in the runway service times. The results suggest that the method has high power when the deviations have a high impact on the performance measure of interest (more than 20%), but low power when the impact is less than 5%