Design and architecture of a stochastic programming modelling system

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.Decision making under uncertainty is an important yet challenging task; a number of alternative paradigms which address this problem have been proposed. Stochastic Programming (SP) and Robust Optimization (RO) are two such modelling ap-proaches, which we consider; these are natural extensions of Mathematical Pro-gramming modelling. The process that goes from the conceptualization of an SP model to its solution and the use of the optimization results is complex in respect to its deterministic counterpart. Many factors contribute to this complexity: (i) the representation of the random behaviour of the model parameters, (ii) the interfac-ing of the decision model with the model of randomness, (iii) the difficulty in solving (very) large model instances, (iv) the requirements for result analysis and perfor-mance evaluation through simulation techniques. An overview of the software tools which support stochastic programming modelling is given, and a conceptual struc-ture and the architecture of such tools are presented. This conceptualization is pre-sented as various interacting modules, namely (i) scenario generators, (ii) model generators, (iii) solvers and (iv) performance evaluation. Reflecting this research, we have redesigned and extended an established modelling system to support modelling under uncertainty. The collective system which integrates these other-wise disparate set of model formulations within a common framework is innovative and makes the resulting system a powerful modelling tool. The introduction of sce-nario generation in the ex-ante decision model and the integration with simulation and evaluation for the purpose of ex-post analysis by the use of workflows is novel and makes a contribution to knowledge

International Conference on Continuous Optimization (ICCOPT) 2019 Conference Book

The Sixth International Conference on Continuous Optimization took place on the campus of the Technical University of Berlin, August 3-8, 2019. The ICCOPT is a flagship conference of the Mathematical Optimization Society (MOS), organized every three years. ICCOPT 2019 was hosted by the Weierstrass Institute for Applied Analysis and Stochastics (WIAS) Berlin. It included a Summer School and a Conference with a series of plenary and semi-plenary talks, organized and contributed sessions, and poster sessions. This book comprises the full conference program. It contains, in particular, the scientific program in survey style as well as with all details, and information on the social program, the venue, special meetings, and more

A Polyhedral Study of Mixed 0-1 Set

We consider a variant of the well-known single node fixed charge network flow set with constant capacities. This set arises from the relaxation of more general mixed integer sets such as lot-sizing problems with multiple suppliers. We provide a complete polyhedral characterization of the convex hull of the given set

Design and architecture of a stochastic programming modelling system

Decision making under uncertainty is an important yet challenging task; a number of alternative paradigms which address this problem have been proposed. Stochastic Programming (SP) and Robust Optimization (RO) are two such modelling ap-proaches, which we consider; these are natural extensions of Mathematical Pro-gramming modelling. The process that goes from the conceptualization of an SP model to its solution and the use of the optimization results is complex in respect to its deterministic counterpart. Many factors contribute to this complexity: (i) the representation of the random behaviour of the model parameters, (ii) the interfac-ing of the decision model with the model of randomness, (iii) the difficulty in solving (very) large model instances, (iv) the requirements for result analysis and perfor-mance evaluation through simulation techniques. An overview of the software tools which support stochastic programming modelling is given, and a conceptual struc-ture and the architecture of such tools are presented. This conceptualization is pre-sented as various interacting modules, namely (i) scenario generators, (ii) model generators, (iii) solvers and (iv) performance evaluation. Reflecting this research, we have redesigned and extended an established modelling system to support modelling under uncertainty. The collective system which integrates these other-wise disparate set of model formulations within a common framework is innovative and makes the resulting system a powerful modelling tool. The introduction of sce-nario generation in the ex-ante decision model and the integration with simulation and evaluation for the purpose of ex-post analysis by the use of workflows is novel and makes a contribution to knowledge.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Scalable Learning of Bayesian Networks Using Feedback Arc Set-Based Heuristics

Bayesianske nettverk er en viktig klasse av probabilistiske grafiske modeller. De består av en struktur (en rettet asyklisk graf) som beskriver betingede uavhengighet mellom stokastiske variabler og deres parametere (lokale sannsynlighetsfordelinger). Med andre ord er Bayesianske nettverk generative modeller som beskriver simultanfordelingene på en kompakt form. Den største utfordringen med å lære et Bayesiansk nettverk skyldes selve strukturen, og på grunn av den kombinatoriske karakteren til asyklisitetsegenskapen er det ingen overraskelse at strukturlæringsproblemet generelt er NP-hardt. Det eksisterer algoritmer som løser dette problemet eksakt: dynamisk programmering og heltalls lineær programmering er de viktigste kandidatene når man ønsker å finne strukturen til små til mellomstore Bayesianske nettverk fra data. På den annen side er heuristikk som bakkeklatringsvarianter ofte brukt når man forsøker å lære strukturen til større nettverk med tusenvis av variabler, selv om disse heuristikkene vanligvis ikke har teoretiske garantier og ytelsen i praksis kan bli uforutsigbar når man arbeider med storskala læring. Denne oppgaven tar for seg utvikling av skalerbare metoder som takler det strukturlæringsproblemet av Bayesianske nettverk, samtidig som det forsøkes å opprettholde et nivå av teoretisk kontroll. Dette ble oppnådd ved bruk av relaterte kombinatoriske problemer, nemlig det maksimale asykliske subgrafproblemet (maximum acyclic subgraph) og det duale problemet (feedback arc set). Selv om disse problemene er NP-harde i seg selv, er de betydelig mer håndterbare i praksis. Denne oppgaven utforsker måter å kartlegge Bayesiansk nettverksstrukturlæring til maksimale asykliske subgrafforekomster og trekke ut omtrentlige løsninger for det første problemet, basert på løsninger oppnådd for det andre. Vår forskning tyder på at selv om økt skalerbarhet kan oppnås på denne måten, er det adskillig mer utfordrende å opprettholde den teoretisk forståelsen med denne tilnærmingen. Videre fant vi ut at å lære strukturen til Bayesianske nettverk basert på maksimal asyklisk subgraf kanskje ikke er den beste metoden generelt, men vi identifiserte en kontekst - lineære strukturelle ligningsmodeller - der vi eksperimentelt kunne validere fordelene med denne tilnærmingen, som fører til rask og skalerbar identifisering av strukturen og med mulighet til å lære komplekse strukturer på en måte som er konkurransedyktig med moderne metoder.Bayesian networks form an important class of probabilistic graphical models. They consist of a structure (a directed acyclic graph) expressing conditional independencies among random variables, as well as parameters (local probability distributions). As such, Bayesian networks are generative models encoding joint probability distributions in a compact form. The main difficulty in learning a Bayesian network comes from the structure itself, owing to the combinatorial nature of the acyclicity property; it is well known and does not come as a surprise that the structure learning problem is NP-hard in general. Exact algorithms solving this problem exist: dynamic programming and integer linear programming are prime contenders when one seeks to recover the structure of small-to-medium sized Bayesian networks from data. On the other hand, heuristics such as hill climbing variants are commonly used when attempting to approximately learn the structure of larger networks with thousands of variables, although these heuristics typically lack theoretical guarantees and their performance in practice may become unreliable when dealing with large scale learning. This thesis is concerned with the development of scalable methods tackling the Bayesian network structure learning problem, while attempting to maintain a level of theoretical control. This was achieved via the use of related combinatorial problems, namely the maximum acyclic subgraph problem and its dual problem the minimum feedback arc set problem. Although these problems are NP-hard themselves, they exhibit significantly better tractability in practice. This thesis explores ways to map Bayesian network structure learning into maximum acyclic subgraph instances and extract approximate solutions for the first problem, based on the solutions obtained for the second. Our research suggests that although increased scalability can be achieved this way, maintaining theoretical understanding based on this approach is much more challenging. Furthermore, we found that learning the structure of Bayesian networks based on maximum acyclic subgraph/minimum feedback arc set may not be the go-to method in general, but we identified a setting - linear structural equation models - in which we could experimentally validate the benefits of this approach, leading to fast and scalable structure recovery with the ability to learn complex structures in a competitive way compared to state-of-the-art baselines.Doktorgradsavhandlin

Integration of production, maintenance and quality : Modelling and solution approaches

Dans cette thèse, nous analysons le problème de l'intégration de la planification de production et de la maintenance préventive, ainsi que l'élaboration du système de contrôle de la qualité. Premièrement, on considère un système de production composé d'une machine et de plusieurs produits dans un contexte incertain, dont les prix et le coût changent d'une période à l'autre. La machine se détériore avec le temps et sa probabilité de défaillance, ainsi que le risque de passage à un état hors contrôle augmentent. Le taux de défaillance dans un état dégradé est plus élevé et donc, des coûts liés à la qualité s’imposent. Lorsque la machine tombe en panne, une maintenance corrective ou une réparation minimale seront initiées pour la remettre en marche sans influer ses conditions ou le processus de détérioration. L'augmentation du nombre de défaillances de la machine se traduit par un temps d'arrêt supérieur et un taux de disponibilité inférieur. D'autre part, la réalisation des plans de production est fortement influencée par la disponibilité et la fiabilité de la machine. Les interactions entre la planification de la maintenance et celle de la production sont incorporées dans notre modèle mathématique. Dans la première étape, l'effet de maintenance sur la qualité est pris en compte. La maintenance préventive est considérée comme imparfaite. La condition de la machine est définie par l’âge actuel, et la machine dispose de plusieurs niveaux de maintenance avec des caractéristiques différentes (coûts, délais d'exécution et impacts sur les conditions du système). La détermination des niveaux de maintenance préventive optimaux conduit à un problème d’optimisation difficile. Un modèle de maximisation du profit est développé, dans lequel la vente des produits conformes et non conformes, les coûts de la production, les stocks tenus, la rupture de stock, la configuration de la machine, la maintenance préventive et corrective, le remplacement de la machine et le coût de la qualité sont considérés dans la fonction de l’objectif. De plus, un système composé de plusieurs machines est étudié. Dans cette extension, les nombres optimaux d’inspections est également considéré. La fonction de l’objectif consiste à minimiser le coût total qui est la somme des coûts liés à la maintenance, la production et la qualité. Ensuite, en tenant compte de la complexité des modèles préposés, nous développons des méthodes de résolution efficaces qui sont fondées sur la combinaison d'algorithmes génétiques avec des méthodes de recherches locales. On présente un algorithme mimétique qui emploi l’algorithme Nelder-Mead, avec un logiciel d'optimisation pour déterminer les valeurs exactes de plusieurs variables de décisions à chaque évaluation. La méthode de résolution proposée est comparée, en termes de temps d’exécution et de qualités des solutions, avec plusieurs méthodes Métaheuristiques. Mots-clés : Planification de la production, Maintenance préventive imparfaite, Inspection, Qualité, Modèles intégrés, MétaheuristiquesIn this thesis, we study the integrated planning of production, maintenance, and quality in multi-product, multi-period imperfect systems. First, we consider a production system composed of one machine and several products in a time-varying context. The machine deteriorates with time and so, the probability of machine failure, or the risk of a shift to an out-of-control state, increases. The defective rate in the shifted state is higher and so, quality related costs will be imposed. When the machine fails, a corrective maintenance or a minimal repair will be initiated to bring the machine in operation without influencing on its conditions or on the deterioration process. Increasing the expected number of machine failures results in a higher downtime and a lower availability rate. On the other hand, realization of the production plans is significantly influenced by the machine availability and reliability. The interactions between maintenance scheduling and production planning are incorporated in the mathematical model. In the first step, the impact of maintenance on the expected quality level is addressed. The maintenance is also imperfect and the machine conditions after maintenance can be anywhere between as-good-as-new and as-bad-as-old situations. Machine conditions are stated by its effective age, and the machine has several maintenance levels with different costs, execution times, and impacts on the system conditions. High level maintenances on the one hand have greater influences on the improvement of the system state and on the other hand, they occupy more the available production time. The optimal determination of such preventive maintenance levels to be performed at each maintenance intrusion is a challenging problem. A profit maximization model is developed, where the sale of conforming and non-conforming products, costs of production, inventory holding, backorder, setup, preventive and corrective maintenance, machine replacement, and the quality cost are addressed in the objective function. Then, a system with multiple machines is taken into account. In this extension, the number of quality inspections is involved in the joint model. The objective function minimizes the total cost which is the sum of maintenance, production and quality costs. In order to reduce the gap between the theory and the application of joint models, and taking into account the complexity of the integrated problems, we have developed an efficient solution method that is based on the combination of genetic algorithms with local search and problem specific methods. The proposed memetic algorithm employs Nelder-Mead algorithm along with an optimization package for exact determination of the values of several decision variables in each chromosome evolution. The method extracts not only the positive knowledge in good solutions, but also the negative knowledge in poor individuals to determine the algorithm transitions. The method is compared in terms of the solution time and quality to several heuristic methods. Keywords : Multi-period production planning, Imperfect preventive maintenance, Inspection, Quality, Integrated model, Metaheuristic