AO* and penalty based algorithms for the Canadian traveler problem

Tezin basılısı İstanbul Şehir Üniversitesi Kütüphanesi'ndedir.The Canadian Traveler Problem (CTP) is a challenging path planning problem on stochastic graphs where some edges are blocked with certain probabilities and status of edges can be disambiguated only upon reaching an end vertex. The goal is to devise a traversal policy that results in the shortest expected traversal length between a given starting vertex and a termination vertex. The organization of this thesis is as follows: In the first chapter we define CTP and its variant SOSP and present an extensive literature review related to these problems. In the second chapter, we introduce an optimal algorithm for the problem, based on an MDP formulation which is a new improvement on AO* search that takes advantage of the special problem structure in CTP. The new algorithm is called CAO*, which stands for AO* with Caching. CAO* uses a caching mechanism and makes use of admissible upper bounds for dynamic state-space pruning. CAO* is not polynomial-time, but it can dramatically shorten the execution time needed to find an exact solution for moderately sized instances. We present computational experiments on a realistic variant of the problem involving an actual maritime minefield data set. In the third chapter, we introduce a simple, yet fast and effective penalty-based heuristic for CTP that can be used in an online fashion. We present computational experiments involving real-world and synthetic data that suggest our algorithm finds near-optimal policies in very short execution times. Another efficient method for sub-optimally solving CTP, rollout-based algorithms, have also been shown to provide high quality policies for CTP. In the final chapter, we com- pare the two algorithmic frameworks via computational experiments involving Delaunay and grid graphs using one specific penalty-based algorithm and four rollout-based algo- rithms. Our results indicate that the penalty-based algorithm executes several orders of magnitude faster than rollout-based ones while also providing better policies, suggest- ing that penalty-based algorithms stand as a prominent candidate for fast and efficient sub-optimal solution of CTP.Declaration of Authorship ii Abstract iii Öz iv Acknowledgments v List of Figures viii List of Tables ix Abbreviations x 1 Introduction 1 1.1 Overview .................................... 1 1.2 The Canadian Traveler Problem ........................ 1 1.2.1 The Discrete Stochastic Obstacle Scene Problem .......... 2 1.3 Literature Review ................................ 3 1.4 Organization of the Thesis ........................... 4 2 An AO* Based Exact Algorithm for the Canadian Traveler Problem 5 2.1 Introduction ................................... 5 2.2 MDP and POMDP Formulations ....................... 6 2.2.1 MDP Formulation and The Bellman Equation ............ 7 2.2.2 Deterministic POMDP Formulation ................. 9 2.3 The CAO* Algorithm ............................. 11 2.3.1 AO Trees ................................ 11 2.3.2 The AO* Algorithm .......................... 14 2.3.3 The CAO* Algorithm ......................... 16 2.4 Computational Experiments .......................... 19 2.4.1 The BAO* and PAO* Algorithms ................... 19 2.4.2 Experimental Setup .......................... 21 2.4.3 Simulation Environment A ...................... 21 2.4.4 Simulation Environment B ....................... 22 2.4.5 Simulation Environment C....................... 24 2.4.6 Simulation Environment D ...................... 25 2.5 Summary and Conclusions ........................... 26 3 A Fast and Effective Online Algorithm for the Canadian Traveler Prob- lem 29 3.1 Introduction ................................... 29 3.2 The DT Algorithm ............................... 30 3.3 Computational Experiments .......................... 32 3.3.1 Environment 1 ............................. 32 3.3.2 Environment 2 ............................. 34 3.4 Conclusions and Future Research ....................... 34 3.4.1 Conclusions ............................... 34 3.4.2 Limitations and Future Research ................... 35 4 A Comparison of Penalty and Rollout-Based Policies for the Canadian Traveler Problem 36 4.1 Introduction ................................... 36 4.2 Algorithms for CTP .............................. 37 4.2.1 Optimism (OMT) ........................... 37 4.2.2 Hindsight Optimization (HOP) .................... 38 4.2.3 Optimistic Rollout (ORO) ....................... 39 4.2.4 Blind UCT (UCTB) .......................... 39 4.2.5 Optimistic UCT (UCTO) ....................... 40 4.3 Computational Experiments .......................... 41 4.3.1 Delaunay Graph Results ........................ 43 4.3.2 Grid Graph Results .......................... 45 4.4 Conclusions and Future Research ....................... 46 4.4.1 Conclusions ............................... 46 4.4.2 Limitations and Future Research ................... 46 A Problem Instances in Simulation Environments C and D 48 Bibliography 5

EFFECT OF GEOMETRY UPON COOLING CHARACTERISTICS OF WAFER BLOCK COOLERS

The product formed after the cream is spread between the wafer sheets is called a wafer block. The wafer block can have a minimum of 3 layers (2 sheets, 1 cream) and a maximum of 9 layers (5 sheets, 4 creams). The temperature of the wafer block before entering the cooling tower is 30- 35℃. After the cooling process is completed, it cannot be reduced to the outlet temperature (16℃) and the temperature is not homogeneously distributed. Especially the middle regions are hot. In this paper, the homogeneous temperature distribution is aimed at by using the CFD method. CFD analysis of three predetermined designs was performed using Solidworks / Flow Simulation software. The first design is the one currently used. In the second design, a design improvement has been made to reduce the effect of vortices in dead zones. In the third design, a design improvement was made to positively affect the flow rate in the upper region where the evaporator and fan are located. In the second design, the temperature difference on the wafer block is reduced by 0.02℃ compared to the current design. The third design decreases by 0.13℃ compared to the second design

Akbaba Dergisi (1955-65)

Ankara : İhsan Doğramacı Bilkent Üniversitesi İktisadi, İdari ve Sosyal Bilimler Fakültesi, Tarih Bölümü, 2014.This work is a student project of the The Department of History, Faculty of Economics, Administrative and Social Sciences, İhsan Doğramacı Bilkent University.by Ünsal, Mehmet Süha

Otelcilikte bir devrim : Dedeman Otelleri

Ankara : İhsan Doğramacı Bilkent Üniversitesi İktisadi, İdari ve Sosyal Bilimler Fakültesi, Tarih Bölümü, 2018.This work is a student project of the Department of History, Faculty of Economics, Administrative and Social Sciences, İhsan Doğramacı Bilkent University.The History of Turkey course (HIST200) is a requirement for all Bilkent undergraduates. It is designed to encourage students to work in groups on projects concerning any topic of their choice that relates to the history of Turkey. It is designed as an interactive course with an emphasis on research and the objective of investigating events, chronologically short historical periods, as well as historic representations. Students from all departments prepare and present final projects for examination by a committee, with 10 projects chosen to receive awards.Includes bibliographical references (page 12).by Merve Biçer