무인항공기 운영을 위한 덮개 모델 기반의 대규모 최적화 기법

학위논문 (박사) -- 서울대학교 대학원 : 공과대학 산업공학과, 2021. 2. 문일경.There is increasing interest in the unmanned aerial vehicle (UAV) in various fields of the industry, starting from the surveillance to the logistics. After introducing the smart city, there are attempts to utilize UAVs in the public service sector by connecting individual components of the system with both information and physical goods. In this dissertation, the UAV operation problems in the public service sector is modeled in the set covering approach. There is a vast literature on the facility location and set covering problems. However, when operating UAVs in the system, the plan has to make the most of the flexibility of the UAV, but also has to consider its physical limitation. We noticed a gap between the related, existing approaches and the technologies required in the field. That is, the new characteristics of the UAV hinder the existing solution algorithms, or a brand-new approach is required. In this dissertation, two operation problems to construct an emergency wireless network in a disaster situation by UAV and one location-allocation problem of the UAV emergency medical service (EMS) facility are proposed. The reformulation to the extended formulation and the corresponding branch-and-price algorithm can overcome the limitations and improve the continuous or LP relaxation bounds, which are induced by the UAV operation. A brief explanation of the UAV operation on public service, the related literature, and the brief explanation of the large-scale optimization techniques are introduced in Chapter 1, along with the research motivations and contributions, and the outline of the dissertations. In Chapter 2, the UAV set covering problem is defined. Because the UAV can be located without predefined candidate positions, more efficient operation becomes feasible, but the continuous relaxation bound of the standard formulation is weakened. The large-scale optimization techniques, including the Dantzig-Wolfe decomposition and the branch-and-price algorithm, could improve the continuous relaxation bound and reduce the symmetries of the branching tree and solve the realistic-scaled problems within practical computation time. To avoid numerical instability, two approximation models are proposed, and their approximation ratios are analyzed. In Chapter 3, UAV variable radius set covering problem is proposed with an extra decision on the coverage radius. While implementing the branch-and-price algorithm to the problem, a solvable equivalent formulation of the pricing subproblem is proposed. A heuristic based on the USCP is designed, and the proposed algorithm outperformed the benchmark genetic algorithm proposed in the literature. In Chapter 4, the facility location-allocation problem for UAV EMS is defined. The quadratic variable coverage constraint is reformulated to the linear equivalent formulation, and the nonlinear problem induced by the robust optimization approach is linearized. While implementing the large-scale optimization techniques, the structure of the subproblem is analyzed, and two solution approaches for the pricing subproblem are proposed, along with a heuristic. The results of the research can be utilized when implementing in the real applications sharing the similar characteristics of UAVs, but also can be used in its abstract formulation.현재, 지역 감시에서 물류까지, 무인항공기의 다양한 산업에의 응용이 주목받고 있다. 특히, 스마트 시티의 개념이 대두된 이후, 무인항공기를 공공 서비스 영역에 활용하여 개별 사회 요소를 연결, 정보와 물자를 교환하고자 하는 시도가 이어지고 있다. 본 논문에서는 공공 서비스 영역에서의 무인항공기 운영 문제를 집합덮개문제 관점에서 모형화하였다. 설비위치결정 및 집합덮개문제 영역에 많은 연구가 진행되어 있으나, 무인항공기를 운영하는 시스템의 경우 무인항공기가 갖는 자유도를 충분히 활용하면서도 무인항공기의 물리적 한계를 고려한 운영 계획을 필요로 한다. 우리는 본 문제와 관련된 기존 연구와 현장이 필요로 하는 기술의 괴리를 인식하였다. 이는 다시 말해, 무인항공기가 가지는 새로운 특성을 고려하면 기존의 문제 해결 방법을 통해 풀기 어렵거나, 혹은 새로운 관점에서의 문제 접근이 필요하다는 것이다. 본 논문에서는 재난이 발생한 지역에 무인항공기를 이용하여 긴급무선네트워크를 구성하는 두가지 문제와, 무인항공기를 이용하여 응급의료서비스를 제공하는 시설의 위치설정 및 할당문제를 제안한다. 확장문제로의 재공식화와 분지평가법을 활용하여, 무인항공기의 활용으로 인해 발생하는 문제 해결 방법의 한계를 극복하고 완화한계를 개선하였다. 공공 서비스 영역에서의 무인항공기 운영, 관련된 기존 연구와 본 논문에서 사용하는 대규모 최적화 기법에 대한 개괄적인 설명, 연구 동기 및 기여와 논문의 구성을 1장에서 소개한다. 2장에서는 무인항공기 집합덮개문제를 정의한다. 무인항공기는 미리 정해진 위치 없이 자유롭게 비행할 수 있기 때문에 더 효율적인 운영이 가능하나, 약한 완화한계를 갖게 된다. Dantzig-Wolfe 분해와 분지평가법을 포함한 대규모 최적화 기법을 통해 완화한계를 개선할 수 있으며, 분지나무의 대칭성을 줄여 실제 규모의 문제를 실용적인 시간 안에 해결할 수 있었다. 수치적 불안정성을 피하기 위하여, 두 가지 선형 근사 모형이 제안되었으며, 이들의 근사 비율을 분석하였다. 3장에서는 무인항공기 집합덮개문제를 일반화하여 무인항공기 가변반경 집합덮개문제를 정의한다. 분지평가법을 적용하면서 해결 가능한 평가 부문제를 제안하였으며, 휴리스틱을 설계하였다. 제안한 풀이 방법들이 기존 연구에서 제안한 벤치마크 유전 알고리즘을 능가하는 결과를 나타내었다. 4장에서는 무인항공기 응급의료서비스를 운영하는 시설의 위치설정 및 할당문제를 정의하였다. 2차 가변반경 범위제약이 선형의 동치인 수식으로 재공식화되었으며, 강건최적화 기법으로 인해 발생하는 비선형 문제를 선형화하였다. 대규모 최적화 기법을 적용하면서, 평가 부문제의 구조를 분석하여 두 가지 풀이 기법과 휴리스틱을 제안하였다. 본 연구의 결과는 무인항공기와 비슷한 특징을 가지는 실제 사례에 적용될 수 있으며, 추상적인 문제로써 다양한 분야에 그대로 활용될 수도 있다.Abstract i Contents vii List of Tables ix List of Figures xi Chapter 1 Introduction 1 1.1 Unmanned aerial vehicle operation on public services 1 1.2 Facility location problems 3 1.3 Large-scale optimization techniques 4 1.4 Research motivations and contributions 6 1.5 Outline of the dissertation 12 Chapter 2 Unmanned aerial vehicle set covering problem considering fixed-radius coverage constraint 14 2.1 Introduction 14 2.2 Problem definition 20 2.2.1 Problem description 22 2.2.2 Mathematical formulation 23 2.2.3 Discrete approximation model 26 2.3 Branch-and-price approach for the USCP 28 2.3.1 An extended formulation of the USCP 29 2.3.2 Branching strategies 34 2.3.3 Pairwise-conflict constraint approximation model based on Jung's theorem 35 2.3.4 Comparison of the approximation models 40 2.3.5 Framework of the solution algorithm for the PCBP model 42 2.4 Computational experiments 44 2.4.1 Datasets used in the experiments 44 2.4.2 Algorithmic performances 46 2.5 Solutions and related problems of the USCP 61 2.6 Summary 64 Chapter 3 Unmanned aerial vehicle variable radius set covering problem 66 3.1 Introduction 66 3.2 Problem definition 70 3.2.1 Mathematical model 72 3.3 Branch-and-price approach to the UVCP 76 3.4 Minimum covering circle-based approach 79 3.4.1 Formulation of the pricing subproblem II 79 3.4.2 Equivalence of the subproblem 82 3.5 Fixed-radius heuristic 84 3.6 Computational experiments 86 3.6.1 Datasets used in the experiments 88 3.6.2 Solution algorithms 91 3.6.3 Algorithmic performances 94 3.7 Summary 107 Chapter 4 Facility location-allocation problem for unmanned aerial vehicle emergency medical service 109 4.1 Introduction 109 4.2 Related literature 114 4.3 Location-allocation model for UEMS facility 117 4.3.1 Problem definition 118 4.3.2 Mathematical formulation 120 4.3.3 Linearization of the quadratic variable coverage distance function 124 4.3.4 Linear reformulation of standard formulation 125 4.4 Solution algorithms 126 4.4.1 An extended formulation of the ULAP 126 4.4.2 Branching strategy 129 4.4.3 Robust disjunctively constrained integer knapsack problem 131 4.4.4 MILP reformulation approach 132 4.4.5 Decomposed DP approach 133 4.4.6 Restricted master heuristic 136 4.5 Computational experiments 137 4.5.1 Datasets used in the experiments 137 4.5.2 Algorithmic performances 140 4.5.3 Analysis of the branching strategy and the solution approach of the pricing subproblem 150 4.6 Summary 157 Chapter 5 Conclusions and future research 160 5.1 Summary 160 5.2 Future research 163 Appendices 165 A Comparison of the computation times and objective value of the proposed algorithms 166 Bibliography 171 국문초록 188 감사의 글 190Docto

Towards Thompson Sampling for Complex Bayesian Reasoning

Paper III, IV, and VI are not available as a part of the dissertation due to the copyright.Thompson Sampling (TS) is a state-of-art algorithm for bandit problems set in a Bayesian framework. Both the theoretical foundation and the empirical efficiency of TS is wellexplored for plain bandit problems. However, the Bayesian underpinning of TS means that TS could potentially be applied to other, more complex, problems as well, beyond the bandit problem, if suitable Bayesian structures can be found. The objective of this thesis is the development and analysis of TS-based schemes for more complex optimization problems, founded on Bayesian reasoning. We address several complex optimization problems where the previous state-of-art relies on a relatively myopic perspective on the problem. These includes stochastic searching on the line, the Goore game, the knapsack problem, travel time estimation, and equipartitioning. Instead of employing Bayesian reasoning to obtain a solution, they rely on carefully engineered rules. In all brevity, we recast each of these optimization problems in a Bayesian framework, introducing dedicated TS based solution schemes. For all of the addressed problems, the results show that besides being more effective, the TS based approaches we introduce are also capable of solving more adverse versions of the problems, such as dealing with stochastic liars.publishedVersio

Holistic, data-driven, service and supply chain optimisation: linked optimisation.

The intensity of competition and technological advancements in the business environment has made companies collaborate and cooperate together as a means of survival. This creates a chain of companies and business components with unified business objectives. However, managing the decision-making process (like scheduling, ordering, delivering and allocating) at the various business components and maintaining a holistic objective is a huge business challenge, as these operations are complex and dynamic. This is because the overall chain of business processes is widely distributed across all the supply chain participants; therefore, no individual collaborator has a complete overview of the processes. Increasingly, such decisions are automated and are strongly supported by optimisation algorithms - manufacturing optimisation, B2B ordering, financial trading, transportation scheduling and allocation. However, most of these algorithms do not incorporate the complexity associated with interacting decision-making systems like supply chains. It is well-known that decisions made at one point in supply chains can have significant consequences that ripple through linked production and transportation systems. Recently, global shocks to supply chains (COVID-19, climate change, blockage of the Suez Canal) have demonstrated the importance of these interdependencies, and the need to create supply chains that are more resilient and have significantly reduced impact on the environment. Such interacting decision-making systems need to be considered through an optimisation process. However, the interactions between such decision-making systems are not modelled. We therefore believe that modelling such interactions is an opportunity to provide computational extensions to current optimisation paradigms. This research study aims to develop a general framework for formulating and solving holistic, data-driven optimisation problems in service and supply chains. This research achieved this aim and contributes to scholarship by firstly considering the complexities of supply chain problems from a linked problem perspective. This leads to developing a formalism for characterising linked optimisation problems as a model for supply chains. Secondly, the research adopts a method for creating a linked optimisation problem benchmark by linking existing classical benchmark sets. This involves using a mix of classical optimisation problems, typically relating to supply chain decision problems, to describe different modes of linkages in linked optimisation problems. Thirdly, several techniques for linking supply chain fragmented data have been proposed in the literature to identify data relationships. Therefore, this thesis explores some of these techniques and combines them in specific ways to improve the data discovery process. Lastly, many state-of-the-art algorithms have been explored in the literature and these algorithms have been used to tackle problems relating to supply chain problems. This research therefore investigates the resilient state-of-the-art optimisation algorithms presented in the literature, and then designs suitable algorithmic approaches inspired by the existing algorithms and the nature of problem linkages to address different problem linkages in supply chains. Considering research findings and future perspectives, the study demonstrates the suitability of algorithms to different linked structures involving two sub-problems, which suggests further investigations on issues like the suitability of algorithms on more complex structures, benchmark methodologies, holistic goals and evaluation, processmining, game theory and dependency analysis

Markowitz Theory–Based Asset Allocation Strategies with Special Regard to Private Wealth Management

This dissertation concentrates on portfolio optimization problems in asset allocation strategies with special focus on Private Wealth Management. The research is incorporated in the framework of both utility theory and the Markowitz model. Using monthly returns of ten different indices from seven asset classes recorded from 1996 to 2007, this dissertation shows that utility maximization for portfolio optimization problems based on quadratic utility and other popular but more difficult utility functions leads to similar results

Optimal Communication Structures for Concurrent Computing

This research focuses on communicative solvers that run concurrently and exchange information to improve performance. This “team of solvers” enables individual algorithms to communicate information regarding their progress and intermediate solutions, and allows them to synchronize memory structures with more “successful” counterparts. The result is that fewer nodes spend computational resources on “struggling” processes. The research is focused on optimization of communication structures that maximize algorithmic efficiency using the theoretical framework of Markov chains. Existing research addressing communication between the cooperative solvers on parallel systems lacks generality: Most studies consider a limited number of communication topologies and strategies, while the evaluation of different configurations is mostly limited to empirical testing. Currently, there is no theoretical framework for tuning communication between cooperative solvers to match the underlying hardware and software. Our goal is to provide such functionality by mapping solvers’ dynamics to Markov processes, and formulating the automatic tuning of communication as a well-defined optimization problem with an objective to maximize solvers’ performance metrics

Multi-stage stochastic optimization and reinforcement learning for forestry epidemic and covid-19 control planning

This dissertation focuses on developing new modeling and solution approaches based on multi-stage stochastic programming and reinforcement learning for tackling biological invasions in forests and human populations. Emerald Ash Borer (EAB) is the nemesis of ash trees. This research introduces a multi-stage stochastic mixed-integer programming model to assist forest agencies in managing emerald ash borer insects throughout the U.S. and maximize the public benets of preserving healthy ash trees. This work is then extended to present the first risk-averse multi-stage stochastic mixed-integer program in the invasive species management literature to account for extreme events. Significant computational achievements are obtained using a scenario dominance decomposition and cutting plane algorithm.The results of this work provide crucial insights and decision strategies for optimal resource allocation among surveillance, treatment, and removal of ash trees, leading to a better and healthier environment for future generations. This dissertation also addresses the computational difficulty of solving one of the most difficult classes of combinatorial optimization problems, the Multi-Dimensional Knapsack Problem (MKP). A novel 2-Dimensional (2D) deep reinforcement learning (DRL) framework is developed to represent and solve combinatorial optimization problems focusing on MKP. The DRL framework trains different agents for making sequential decisions and finding the optimal solution while still satisfying the resource constraints of the problem. To our knowledge, this is the first DRL model of its kind where a 2D environment is formulated, and an element of the DRL solution matrix represents an item of the MKP. Our DRL framework shows that it can solve medium-sized and large-sized instances at least 45 and 10 times faster in CPU solution time, respectively, with a maximum solution gap of 0.28% compared to the solution performance of CPLEX. Applying this methodology, yet another recent epidemic problem is tackled, that of COVID-19. This research investigates a reinforcement learning approach tailored with an agent-based simulation model to simulate the disease growth and optimize decision-making during an epidemic. This framework is validated using the COVID-19 data from the Center for Disease Control and Prevention (CDC). Research results provide important insights into government response to COVID-19 and vaccination strategies

Applied (Meta)-Heuristic in Intelligent Systems

Engineering and business problems are becoming increasingly difficult to solve due to the new economics triggered by big data, artificial intelligence, and the internet of things. Exact algorithms and heuristics are insufficient for solving such large and unstructured problems; instead, metaheuristic algorithms have emerged as the prevailing methods. A generic metaheuristic framework guides the course of search trajectories beyond local optimality, thus overcoming the limitations of traditional computation methods. The application of modern metaheuristics ranges from unmanned aerial and ground surface vehicles, unmanned factories, resource-constrained production, and humanoids to green logistics, renewable energy, circular economy, agricultural technology, environmental protection, finance technology, and the entertainment industry. This Special Issue presents high-quality papers proposing modern metaheuristics in intelligent systems

Decomposition methods for large scale stochastic and robust optimization problems

Thesis (Ph. D.)--Massachusetts Institute of Technology, Sloan School of Management, Operations Research Center, 2011.Cataloged from PDF version of thesis.Includes bibliographical references (p. 107-112).We propose new decomposition methods for use on broad families of stochastic and robust optimization problems in order to yield tractable approaches for large-scale real world application. We introduce a new type of a Markov decision problem named the Generalized Rest less Bandits Problem that encompasses a broad generalization of the restless bandit problem. For this class of stochastic optimization problems, we develop a nested policy heuristic which iteratively solves a series of sub-problems operating on smaller bandit systems. We also develop linear-optimization based bounds for the Generalized Restless Bandit problem and demonstrate promising computational performance of the nested policy heuristic on a large-scale real world application of search term selection for sponsored search advertising. We further study the distributionally robust optimization problem with known mean, covariance and support. These optimization models are attractive in their real world applications as they require the model consumer to only rely on those statistics of uncertainty that are known with relative confidence rather than making arbitrary assumptions about the exact dynamics of the underlying distribution of uncertainty. Known to be AP - hard, current approaches invoke tractable but often weak relaxations for real-world applications. We develop a decomposition method for this family of problems which recursively derives sub-policies along projected dimensions of uncertainty and provides a sequence of bounds on the value of the derived policy. In the development of this method, we prove that non-convex quadratic optimization in n-dimensions over a box in two-dimensions is efficiently solvable. We also show that this same decomposition method yields a promising heuristic for the MAXCUT problem. We then provide promising computational results in the context of a real world fixed income portfolio optimization problem. The decomposition methods developed in this thesis recursively derive sub-policies on projected dimensions of the master problem. These sub-policies are optimal on relaxations which admit "tight" projections of the master problem; that is, the projection of the feasible region for the relaxation is equivalent to the projection of that of master problem along the dimensions of the sub-policy. Additionally, these decomposition strategies provide a hierarchical solution structure that aids in solving large-scale problems.by Adrian Bernard Druke Becker.Ph.D

Proceedings of the XIII Global Optimization Workshop: GOW'16

[Excerpt] Preface: Past Global Optimization Workshop shave been held in Sopron (1985 and 1990), Szeged (WGO, 1995), Florence (GO’99, 1999), Hanmer Springs (Let’s GO, 2001), Santorini (Frontiers in GO, 2003), San José (Go’05, 2005), Mykonos (AGO’07, 2007), Skukuza (SAGO’08, 2008), Toulouse (TOGO’10, 2010), Natal (NAGO’12, 2012) and Málaga (MAGO’14, 2014) with the aim of stimulating discussion between senior and junior researchers on the topic of Global Optimization. In 2016, the XIII Global Optimization Workshop (GOW’16) takes place in Braga and is organized by three researchers from the University of Minho. Two of them belong to the Systems Engineering and Operational Research Group from the Algoritmi Research Centre and the other to the Statistics, Applied Probability and Operational Research Group from the Centre of Mathematics. The event received more than 50 submissions from 15 countries from Europe, South America and North America. We want to express our gratitude to the invited speaker Panos Pardalos for accepting the invitation and sharing his expertise, helping us to meet the workshop objectives. GOW’16 would not have been possible without the valuable contribution from the authors and the International Scientific Committee members. We thank you all. This proceedings book intends to present an overview of the topics that will be addressed in the workshop with the goal of contributing to interesting and fruitful discussions between the authors and participants. After the event, high quality papers can be submitted to a special issue of the Journal of Global Optimization dedicated to the workshop. [...