Scheduling of data-intensive workloads in a brokered virtualized environment

Providing performance predictability guarantees is increasingly important in cloud platforms, especially for data-intensive applications, for which performance depends greatly on the available rates of data transfer between the various computing/storage hosts underlying the virtualized resources assigned to the application. With the increased prevalence of brokerage services in cloud platforms, there is a need for resource management solutions that consider the brokered nature of these workloads, as well as the special demands of their intra-dependent components. In this paper, we present an offline mechanism for scheduling batches of brokered data-intensive workloads, which can be extended to an online setting. The objective of the mechanism is to decide on a packing of the workloads in a batch that minimizes the broker's incurred costs, Moreover, considering the brokered nature of such workloads, we define a payment model that provides incentives to these workloads to be scheduled as part of a batch, which we analyze theoretically. Finally, we evaluate the proposed scheduling algorithm, and exemplify the fairness of the payment model in practical settings via trace-based experiments

Novel approaches to container loading: from heuristics to hybrid tabu search

A thesis submitted for the degree of Doctor of Philosophy of the University ofBedford shireThis work investigates new approaches to the container loading problem which address the issue of how to load three-dimensional, rectangular items (e.g. boxes) into the container in such a way that maximum utilisation is made of the container space. This problem occurs in several industry sectors where the loading approach places cargo effectively into aeroplanes, ships, trailers or trucks in order to save considerable cost. In carrying out this work, the investigation starts by developing a new heuristic approach to the two-dimensional bin packing problem, which has lower complexity than container loading in the aspects of constraints and geometry. A novel approach, including the heuristic strategies and handling method for remaining areas, is developed that can produce good results when testing with benchmark and real world data. Based on the research for two-dimensional bin packing, a novel heuristic approach is developed to deal with the container loading problem with some practical constraints. The heuristic approach to container loading also includes heuristic strategies and the handling of remaining spaces. The heuristic strategies construct effective loading arrangements where combinations of identical or different box types are loaded in blocks. The handling method for remaining spaces further improves the loading arrangements through the representation, partitioning and merging of remaining spaces. The heuristic approach obtains better volume utilisation and the highest stability compared with other published heuristic approaches. However, it does not achieve as high a volume utilisation as metaheuristic approaches, e.g. genetic algorithms and tabu search.To improve volume utilisation, a new hybrid heuristic approach to the container loading problem is further developed based on the tabu search technique which covers the encoding, evaluation criterion and configuration of neighbourhood and candidate solutions. The heuristic strategies as well as the handling method for remaining spaces developed in the heuristic approach are used in this new hybrid tabu search approach. It is shown that the hybrid approach has better volume utilisation than the published approaches under the condition that all loaded boxes with one hundred per cent support from below. In addition, the experimental results show that both the heuristic and hybrid tabu search approaches can also be applied to the multiple container loading problem

Optimization Models and Algorithms for Spatial Scheduling

Spatial scheduling problems involve scheduling a set of activities or jobs that each require a certain amount of physical space in order to be carried out. In these problems space is a limited resource, and the job locations, orientations, and start times must be simultaneously determined. As a result, spatial scheduling problems are a particularly difficult class of scheduling problems. These problems are commonly encountered in diverse industries including shipbuilding, aircraft assembly, and supply chain management. Despite its importance, there is a relatively scarce amount of research in the area of spatial scheduling. In this dissertation, spatial scheduling problems are studied from a mathematical and algorithmic perspective. Optimization models based on integer programming are developed for several classes of spatial scheduling problems. While the majority of these models address problems having an objective of minimizing total tardiness, the models are shown to contain a core set of constraints that are common to most spatial scheduling problems. As a result, these constraints form the basis of the models given in this dissertation and many other spatial scheduling problems with different objectives as well. The complexity of these models is shown to be at least NP-complete, and spatial scheduling problems in general are shown to be NP-hard. A lower bound for the total tardiness objective is shown, and a polynomial-time algorithm for computing this lower bound is given. The computational complexity inherent to spatial scheduling generally prevents the use of optimization models to find solutions to larger, realistic problems in a reasonable time. Accordingly, two classes of approximation algorithms were developed: greedy heuristics for finding fast, feasible solutions; and hybrid meta-heuristic algorithms to search for near-optimal solutions. A flexible hybrid algorithm framework was developed, and a number of hybrid algorithms were devised from this framework that employ local search and several varieties of simulated annealing. Extensive computational experiments showed these hybrid meta-heuristic algorithms to be effective in finding high-quality solutions over a wide variety of problems. Hybrid algorithms based on local search generally provided both the best-quality solutions and the greatest consistency

2차원 2단계 배낭문제에 대한 정수계획모형 및 최적해법

학위논문 (석사) -- 서울대학교 대학원 : 공과대학 산업공학과, 2021. 2. 이경식.In this thesis, we study integer programming models and exact algorithms for the two-dimensional two-staged knapsack problems, which maximizes the profit by cutting a single rectangular plate into smaller rectangular items by two-staged guillotine cuts. We first introduce various integer programming models, including the strip-packing model, the staged-pattern model, the level-packing model, and the arc-flow model for the problem. Then, a hierarchy of the strength of the upper bounds provided by the LP-relaxations of the models is established based on theoretical analysis. We also show that there exists a polynomial-size model that has not been proven yet as far as we know. Exact methods, including branch-and-price algorithms using the strip-packing model and the staged-pattern model, are also devised. Computational experiments on benchmark instances are conducted to examine the strength of upper bounds obtained by the LP-relaxations of the models and evaluate the performance of exact methods. The results show that the staged-pattern model gives a competitive theoretical and computational performance.본 논문은 2단계 길로틴 절단(two-staged guillotine cut)을 사용하여 이윤을 최대화하는 2차원 2단계 배낭 문제(two-dimensional two-staged knapsack problem: 이하 2TDK)에 대한 정수최적화 모형과 최적해법을 다룬다. 우선, 본 연구에서는 스트립패킹모형, 단계패턴모형, 레벨패킹모형, 그리고 호-흐름모형과 같은 정수최적화 모형들을 소개한다. 그 뒤, 각각의 모형의 선형계획완화문제에 대해 상한강도를 이론적으로 분석하여 상한강도 관점에서 모형들 간 위계를 정립한다. 또한, 본 연구에서는 2TDK의 다항크기(polynomial-size) 모형의 존재성을 처음으로 증명한다. 다음으로 본 연구는 2TDK의 최적해를 구하는 알고리즘으로써 패턴기반모형들에 대한 분지평가 알고리즘과 레벨패킹모형을 기반으로 한 분지절단 알고리즘을 제안한다. 단계패턴모형이 이론적으로도 가장 좋은 상한강도를 보장할 뿐만 아니라, 계산 분석을 통해 단계패턴모형을 기반으로 한 분지평가 알고리즘이 제한된 시간 내 좋은 품질의 가능해를 찾음을 확인하였다.Abstract i Contents iv List of Tables vi List of Figures vii Chapter 1 Introduction 1 1.1 Problem Description . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 1.2 Literature Review . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.3 Contributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 1.4 Organization of the Thesis . . . . . . . . . . . . . . . . . . . . . . . . 8 Chapter 2 Integer Programming Models for 2TDK 9 2.1 Pattern-based Model . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2.2 Arc-flow Model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 2.3 Level Packing Model . . . . . . . . . . . . . . . . . . . . . . . . . . . 17 Chapter 3 Theoretical Analysis of Integer Programming Models 20 3.1 Upper Bounds of AF and SM(1;1) . . . . . . . . . . . . . . . . . . 20 3.2 Upper Bounds of ML, PM(d), and SM(d; d) . . . . . . . . . . . . . . 21 3.3 Polynomial-size Model . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Chapter 4 Exact Methods 33 4.1 Branch-and-price Algorithm for the Strip Packing Model . . . . . . . 34 4.2 Branch-and-price Algorithm for the Staged-pattern Model . . . . . . 39 4.2.1 The Standard Scheme . . . . . . . . . . . . . . . . . . . . . . 39 4.2.2 The Height-aggregated Scheme . . . . . . . . . . . . . . . . . 40 4.3 Branch-and-cut Algorithm for the Modified Level Packing Model . . 44 Chapter 5 Computational Experiments 46 5.1 Instances . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 5.2 Upper Bounds Comparison . . . . . . . . . . . . . . . . . . . . . . . 49 5.2.1 A Group of Small Instances . . . . . . . . . . . . . . . . . . . 49 5.2.2 A Group of Large Instances . . . . . . . . . . . . . . . . . . . 55 5.2.3 Class 5 Instances . . . . . . . . . . . . . . . . . . . . . . . . . 61 5.3 Solving Instances to Optimality . . . . . . . . . . . . . . . . . . . . . 65 5.3.1 A Group of Small Instances . . . . . . . . . . . . . . . . . . . 65 5.3.2 A Group of Large Instances . . . . . . . . . . . . . . . . . . . 69 5.3.3 Class 5 Instances . . . . . . . . . . . . . . . . . . . . . . . . . 72 Chapter 6 Conclusion 77 Bibliography 79 국문초록 83Maste

Parallel ACO algorithms for 2D Strip Packing

In this paper we present a study of a parallel Ant Colony System (ACS) for the two-dimensional strip packing problem. In our computational study, we emphasize the in uence of the incorporation of the received information in the target subcolony. Colonies send their best solutions instead of sending information from the matrix of pheromones, as happens in traditional parallel ACS. The solution arriving to a colony can provide further exploitation around promising solutions as this arrived solution can be used in both, the local update of the pheromone trail and the construction solution process of an ant. The aim of the paper is to report experimental results on the behavior of different types of parallel ACS algorithms, regarding solution qualities and parallel performance.Presentado en XI Workshop Agentes y Sistemas Inteligentes (WASI)Red de Universidades con Carreras en Informática (RedUNCI

Greedy seeding procedure for GAs solving a strip packing problem

In this paper, the two-dimensional strip packing problem with 3-stage level patterns is tackled using genetic algorithms (GAs). We evaluate the usefulness of a greedy seeding procedure for creating the initial population, incorporating problem knowledge. This is motivated by the expectation that the seeding will speed up the GA by starting the search in promising regions of the search space. An analysis of the impact of the seeded initial population is offered, together with a complete study of the influence of these modifications on the genetic search. The results show that the use of an appropriate seeding of the initial population outperforms existing GA approaches on all the used problem instances, for all the metrics used, and in fact it represents the new state of the art for this problem.Red de Universidades con Carreras en Informática (RedUNCI

Greedy seeding procedure for GAs solving a strip packing problem

In this paper, the two-dimensional strip packing problem with 3-stage level patterns is tackled using genetic algorithms (GAs). We evaluate the usefulness of a greedy seeding procedure for creating the initial population, incorporating problem knowledge. This is motivated by the expectation that the seeding will speed up the GA by starting the search in promising regions of the search space. An analysis of the impact of the seeded initial population is offered, together with a complete study of the influence of these modifications on the genetic search. The results show that the use of an appropriate seeding of the initial population outperforms existing GA approaches on all the used problem instances, for all the metrics used, and in fact it represents the new state of the art for this problem.Red de Universidades con Carreras en Informática (RedUNCI

An anytime tree search algorithm for two-dimensional two- and three-staged guillotine packing problems

[libralesso_anytime_2020] proposed an anytime tree search algorithm for the 2018 ROADEF/EURO challenge glass cutting problem (https://www.roadef.org/challenge/2018/en/index.php). The resulting program was ranked first among 64 participants. In this article, we generalize it and show that it is not only effective for the specific problem it was originally designed for, but is also very competitive and even returns state-of-the-art solutions on a large variety of Cutting and Packing problems from the literature. We adapted the algorithm for two-dimensional Bin Packing, Multiple Knapsack, and Strip Packing Problems, with two- or three-staged exact or non-exact guillotine cuts, the orientation of the first cut being imposed or not, and with or without item rotation. The combination of efficiency, ability to provide good solutions fast, simplicity and versatility makes it particularly suited for industrial applications, which require quickly developing algorithms implementing several business-specific constraints. The algorithm is implemented in a new software package called PackingSolver