Distributionally Robust Optimization: A Review

The concepts of risk-aversion, chance-constrained optimization, and robust optimization have developed significantly over the last decade. Statistical learning community has also witnessed a rapid theoretical and applied growth by relying on these concepts. A modeling framework, called distributionally robust optimization (DRO), has recently received significant attention in both the operations research and statistical learning communities. This paper surveys main concepts and contributions to DRO, and its relationships with robust optimization, risk-aversion, chance-constrained optimization, and function regularization

판매촉진을 도입한 수요 불확실성 재고관리 모형

학위논문 (박사) -- 서울대학교 대학원 : 공과대학 산업공학과, 2020. 8. 문일경.As the globalization of markets accelerates competition among companies, sales promotion, which refers to short-term incentives promoting sales of products or services, plays a prominent role. Although there are various types of sales promotions, such as price reduction, buy-x-get-y-free, and trade-in program, the common purpose is to induce the purchase of customers by offering benefits. This successful strategy has caught the attention of researchers, including operations management and supply chain management. Thus, various studies have been conducted to examine strategies for ongoing operations and to demonstrate the effects of the sales promotion, which are based on the strategic level. However, research at the tactical or operational level has been conducted insufficiently. This dissertation examines the inventory models considering (i) markdown sale, (ii) buy one get one free (BOGO), and (iii) trade-in program. First, the newsvendor model is considered. By introducing the decision variable, which represents the start time of markdown sale, the retailer can obtain the optimal combination of the start time of a markdown sale and an order quantity. Under certain conditions in a decentralized system, however, the start time of a markdown sale where the retailer obtains the highest profit is the least profitable for the manufacturer. To avoid irrational ordering behavior by a retailer against a manufacturer, a revenue-sharing contract is proposed. Second, the mobile application, ``My Own Refrigerator'', is considered in the inventory model. It enables customers to store BOGO products in their virtual storage for later use. That is, customers can drop by the store to pick up the extra freebies in the future. The promotion involves a high degree of uncertainty regarding the revisiting date because customers who buy the product do not need to take both products on the day of purchase. To deal with this uncertainty, we propose a robust multiperiod inventory model by addressing the approximation of a multistage stochastic optimization model. Third, the trade-in program is considered. It is one of the sales promotions that companies collect used old-generation products from customers and provide them with new-generation products at a discount price. It also helps to acquire the additional products which are required for the refurbishment service. A multiperiod stochastic inventory model based on the closed-loop supply chain system is proposed by incorporating the trade-in program and refurbishment service simultaneously. The stochastic optimization model is approximated to the robust counterpart, which features a deterministic second-order cone program.시장의 세계화에 따른 기업 간의 경쟁이 가속화됨에 따라, 단기 인센티브를 통해 고객의 제품 또는 서비스 구매를 유도하는 판매촉진의 역할이 중요해졌다. 가격 인하, 행사상품 증정, 트레이드인프로그램과 같은 다양한 유형의 판매촉진 전략이 존재하지만, 공통된 주요 목적은 기업이 고객에게 혜택을 제공하여 고객의 수요를 증대시키는 것이다. 판매촉진의 성공적인 전략은 경영과학 또는 공급망관리 분야를 포함한 관련 학계의 관심을 이끌었다. 지속적인 운영을 위한 전략을 검토하고 전략적 수준 계획을 기반으로 하는 판매 촉진의 효과를 입증하기 위한 다양한 연구가 수행되었습니다. 하지만 운영 수준의 소매업체 입장에서의 연구는 미흡한 실정이다. 본 논문에서는 (i) 마크 다운 (ii) buy one get one free (BOGO), 및 (iii) 트레이드인프로그램을 고려한 재고관리모형을 다룬다. 먼저, 신문가판원 모형에 마크 다운 시작 시점을 나타내는 결정 변수를 도입하여 최적의 마크 다운 시작 시점과 주문량의 조합을 제공하는 모형을 제안한다. 분산 시스템의 특정 조건에서는 소매업자가 가장 높은 이익을 얻는 시점이 제조업자에게 낮은 수익성을 야기할 수 있다. 따라서 본 연구는 제조업자에 대한 소매업자의 비합리적 주문을 막기 위한 이익분배계약을 제안한다. 이익분배계약을 통한 중앙집권화 시스템은 분산 시스템에서 얻은 이익에 비해 소매업자와 제조업자의 이익을 향상시킴을 수치실험을 통해 확인하였다. 둘째, 모바일 어플리케이션 ``나만의 냉장고''를 고려한 재고모형을 고려한다. 이 앱을 통해 BOGO 행사제품을 구매한 고객은 증정품을 구매 당일 날 가져가지 않고 미래에 재방문하여 수령할 수 있는 혜택을 받는다. 하지만 소매업자 입장에서는 고객이 증정품을 언제 수령해 갈 지에 대한 불확실성이 존재하며 이는 기존의 재고관리 운영방식에는 한계점이 있음을 시사한다. 본 연구에서는 고객의 재방문에 대한 불확실성을 고려한 복수기간 추계계획 재고모형을 수립하며 이를 효율적으로 계산하기 위한 강건최적화 모형으로 근사화하였다. 셋째, 리퍼서비스와 트레이드인프로그램을 고려한 폐회로 공급망 시스템 기반의 복수기간 재고관리모형을 제안한다. 신세대 제품, 리퍼서비스 및 트레이드인프로그램에 대한 세 가지 유형의 불확실한 수요에 대한 상관관계를 반영함에 따라 복수기간 추계계획 재고모형이 수립된다. 복수기간 추계계획 재고모형의 계산이 어렵다는 한계를 극복하고자 강건최적화 모형으로 근사화하였다.Chapter 1 Introduction 1 1.1 Sales promotion 1 1.2 Inventory management 3 1.3 Research motivations 6 1.4 Research contents and contributions 8 1.5 Outline of the dissertation 10 Chapter 2 Optimal Start Time of a Markdown Sale Under a Two-Echelon Inventory System 11 2.1 Introduction and literature review 11 2.2 Problem description 17 2.3 Analysis of the decentralized system 21 2.3.1 Newsvendor model for a retailer 21 2.3.2 Solution procedure for an optimal combination of the start time of the markdown sale and the order quantity 25 2.3.3 Profi t function of a manufacturer 25 2.3.4 Numerical experiments of the decentralized system 27 2.4 Analysis of a centralized system 35 2.4.1 Revenue-sharing contract 35 2.4.2 Numerical experiments of the centralized system 38 2.5 Summary 40 2.5.1 Managerial insights 41 Chapter 3 Robust Multiperiod Inventory Model with a New Type of Buy One Get One Promotion: "My Own Refrigerator" 43 3.1 Introduction and literature review 43 3.2 Problem description 51 3.2.1 Demand modeling 52 3.2.2 Sequences of the ordering decision 54 3.3 Mathematical formulation of the IMMOR 56 3.3.1 Mathematical formulation of the IMMOR under the deterministic demand 58 3.3.2 Mathematical formulation of the IMMOR under the stochastic demand 58 3.3.3 Distributionally robust optimization approach for the IMMOR 60 3.4 Computational experiments 76 3.4.1 Experiment 1: tractability of the RIMMOR 77 3.4.2 Experiment 2: robustness of the RIMMOR 78 3.4.3 Experiment 3: e ect of duration of the expiry date under the different customers' revisiting propensities 78 3.5 Summary 83 3.5.1 Managerial insights 83 Chapter 4 Robust Multiperiod Inventory Model Considering Refurbishment Service and Trade-in Program 85 4.1 Introduction 85 4.2 Literature review 91 4.2.1 Effects of the trade-in program and strategic-level decisions for the trade-in program 91 4.2.2 Inventory or lot-sizing model in a closed-loop supply chain system 94 4.2.3 Distinctive features of this research 97 4.3 Problem description 100 4.3.1 Demand modeling 103 4.3.2 Decision of the inventory manager 105 4.4 Mathematical formulation 108 4.4.1 Mathematical formulation of the IMRSTIP under the deterministic demand model 108 4.4.2 Mathematical formulation of the IMRSTIP under the stochastic demand model 110 4.4.3 Distributionally robust optimization approach for the IMRSTIP 111 4.5 Computational experiments 125 4.5.1 Demand process 125 4.5.2 Experiment 1: tractability of the RIMRSTIP 128 4.5.3 Experiment 2: approximation error from the expected value given perfect information 129 4.5.4 Experiment 3: protection against realized uncertain factors 130 4.5.5 Experiment 4: di erences between modeling demands from VARMA and ARMA 131 4.5.6 Experiments 5 and 6: comparisons of backlogged refurbishment service with or without trade-in program 133 4.6 Summary 136 Chapter 5 Conclusions 138 5.1 Summary 138 5.2 Future research 140 Bibliography 142 Chapter A 160 A.1 160 A.2 163 A.3 163 A.4 164 A.5 165 A.6 166 Chapter B 168 B.1 168 B.2 171 B.3 172 Chapter C 174 C.1 174 C.2 174 국문초록 179Docto

AI alignment and generalization in deep learning

This thesis covers a number of works in deep learning aimed at understanding and improving generalization abilities of deep neural networks (DNNs). DNNs achieve unrivaled performance in a growing range of tasks and domains, yet their behavior during learning and deployment remains poorly understood. They can also be surprisingly brittle: in-distribution generalization can be a poor predictor of behavior or performance under distributional shifts, which typically cannot be avoided in practice. While these limitations are not unique to DNNs -- and indeed are likely to be challenges facing any AI systems of sufficient complexity -- the prevalence and power of DNNs makes them particularly worthy of study. I frame these challenges within the broader context of "AI Alignment": a nascent field focused on ensuring that AI systems behave in accordance with their user's intentions. While making AI systems more intelligent or capable can help make them more aligned, it is neither necessary nor sufficient for alignment. However, being able to align state-of-the-art AI systems (e.g. DNNs) is of great social importance in order to avoid undesirable and unsafe behavior from advanced AI systems. Without progress in AI Alignment, advanced AI systems might pursue objectives at odds with human survival, posing an existential risk (``x-risk'') to humanity. A core tenet of this thesis is that the achieving high performance on machine learning benchmarks if often a good indicator of AI systems' capabilities, but not their alignment. This is because AI systems often achieve high performance in unexpected ways that reveal the limitations of our performance metrics, and more generally, our techniques for specifying our intentions. Learning about human intentions using DNNs shows some promise, but DNNs are still prone to learning to solve tasks using concepts of "features" very different from those which are salient to humans. Indeed, this is a major source of their poor generalization on out-of-distribution data. By better understanding the successes and failures of DNN generalization and current methods of specifying our intentions, we aim to make progress towards deep-learning based AI systems that are able to understand users' intentions and act accordingly.Cette thèse discute quelques travaux en apprentissage profond visant à comprendre et à améliorer les capacités de généralisation des réseaux de neurones profonds (DNN). Les DNNs atteignent des performances inégalées dans un éventail croissant de tâches et de domaines, mais leur comportement pendant l'apprentissage et le déploiement reste mal compris. Ils peuvent également être étonnamment fragiles: la généralisation dans la distribution peut être un mauvais prédicteur du comportement ou de la performance lors de changements de distribution, ce qui ne peut généralement pas être évité dans la pratique. Bien que ces limitations ne soient pas propres aux DNN - et sont en effet susceptibles de constituer des défis pour tout système d'IA suffisamment complexe - la prévalence et la puissance des DNN les rendent particulièrement dignes d'étude. J'encadre ces défis dans le contexte plus large de «l'alignement de l'IA»: un domaine naissant axé sur la garantie que les systèmes d'IA se comportent conformément aux intentions de leurs utilisateurs. Bien que rendre les systèmes d'IA plus intelligents ou capables puisse aider à les rendre plus alignés, cela n'est ni nécessaire ni suffisant pour l'alignement. Cependant, être capable d'aligner les systèmes d'IA de pointe (par exemple les DNN) est d'une grande importance sociale afin d'éviter les comportements indésirables et dangereux des systèmes d'IA avancés. Sans progrès dans l'alignement de l'IA, les systèmes d'IA avancés pourraient poursuivre des objectifs contraires à la survie humaine, posant un risque existentiel («x-risque») pour l'humanité. L'un des principes fondamentaux de cette thèse est que l'obtention de hautes performances sur les repères d'apprentissage automatique est souvent un bon indicateur des capacités des systèmes d'IA, mais pas de leur alignement. En effet, les systèmes d'IA atteignent souvent des performances élevées de manière inattendue, ce qui révèle les limites de nos mesures de performance et, plus généralement, de nos techniques pour spécifier nos intentions. L'apprentissage des intentions humaines à l'aide des DNN est quelque peu prometteur, mais les DNN sont toujours enclins à apprendre à résoudre des tâches en utilisant des concepts de «caractéristiques» très différents de ceux qui sont saillants pour les humains. En effet, c'est une source majeure de leur mauvaise généralisation sur les données hors distribution. En comprenant mieux les succès et les échecs de la généralisation DNN et les méthodes actuelles de spécification de nos intentions, nous visons à progresser vers des systèmes d'IA basés sur l'apprentissage en profondeur qui sont capables de comprendre les intentions des utilisateurs et d'agir en conséquence

Stochastic Model Predictive Control for Eco-Driving Assistance Systems in Electric Vehicles

Electric vehicles are expected to become one of the key elements of future sustainable transportation systems. The first generation of electric cars are already commercially available but still, suffer from problems and constraints that have to be solved before a mass market might be created. Key aspects that will play an important role in modern electric vehicles are range extension, energy efficiency, safety, comfort as well as communication. An overall solution approach to integrating all these aspects is the development of advanced driver assistance systems to make electric vehicles more intelligent. Driver assistance systems are based on the integration of suitable sensors and actuators as well as electronic devices and software-enabled control functionality to automatically support the human driver. Driver assistance for electric vehicles will differ from the already used systems in fuel-powered cars such as electronic stability programs, adaptive cruise control etc. in a way that they must support energy efficiency while the system itself must also have a low power consumption. In this work, an eco-driving functionality as the first step towards those new driver assistance systems for electric vehicles will be investigated. Using information about the internal state of the car, navigation information as well as advanced information about the environment coming from sensors and network connections, an algorithm will be developed that will adapt the speed of the vehicle automatically to minimize energy consumption. From an algorithmic point of view, a stochastic model predictive control approach will be applied and adapted to the special constraints of the problem. Finally, the solution will be tested in simulations as well as in first experiments with a commercial electric vehicle in the SnT Automation & Robotics Research Group (SnT ARG)

The British Energy Market Reform: Carbon Prices, Retail Tariffs, and Cost Pass-through

The United Kingdom’s (UK’s) Climate Change Act 2008 sets a “net zero” target on greenhouse gas emissions by 2050. The Act has triggered the Electricity Market Reform (EMR) started in 2013, which aims at decarbonising electricity supply, ensuring the security of supply, and minimising the cost of energy to consumers. This thesis focus on policies and instruments that support the EMR. Chapter 1 provides a review of the UK’s Climate Change Act, with a focus on the energy sector. Chapters 2 and 3 focus on the British decarbonisation policy levied on the electricity sector. Chapter 4 studies competition in the wholesale electricity market, to investigate the existence of market power. Chapter 5 examines the impact of dynamic retail tariffs and demand response, which are possible instruments to secure electricity supply. Chapter 6 concludes. Decarbonisation requires increasing the capacity of renewable energy to phase out carbon insensitive fossil plants, and the British Carbon Price Support (CPS, a carbon tax) gives adequate, credible and sufficiently durable carbon price signals for low-carbon investments. Chapter 2 studies the impact of the CPS on the CO2 emission reduction of wind in the Great Britain’s (GB’s) electricity market. We show how to measure the Marginal Displacement Factor (MDF, tonnes CO2/MWh) of wind. The short-run (SR) MDF is estimated econometrically while the long-run (LR) MDF is calculated from a unit commitment model of the GB system in 2015. We examine counter-factual fuel and carbon price scenarios. The CPS lowered the SR-MDF by 7% in 2015 but raised the LR-MDF (for a 25% increase in wind capacity) by 18%. We discuss reasons for the modest differences in the SR- and LR-MDFs. Being a unilateral carbon tax, the CPS can distort electricity trade with external markets. Chapter 3 shows how to estimate the deadweight cost of the distortion and possible external global benefits from reduced emissions, and investigate econometrically the impact of the CPS on GB’s cross-border electricity trade with France and The Netherlands. Over 2015-2018 the CPS raised GB day-ahead electricity price by about €11/MWh, after allowing for replacement by cheaper imports. It raised French wholesale prices by 3.5% and Dutch wholesale prices by 2.8%. The CPS increased GB imports by 12 TWh/yr, thereby reducing carbon tax revenue by €100 m/yr. Congestion income increased by €150 m/yr, half transferred to foreign interconnector owners. The unilateral CPS created €80 m/yr deadweight loss, about 32% of the initial social value created by the interconnector, or 4% of the global emissions benefit of the CPS at €2 bn/yr. About 0.9% of the CO2 emission reduction is undone by France and The Netherlands, the monetary loss of which is about €18 m/yr. Cost pass-through rates give a useful perspective of market competition, which determines whether consumers are overwhelmed by the market power. Chapter 4 studies how generation costs are passed through to electricity wholesale prices in GB between 2015 and 2018. Our empirical results fail to reject 100% pass-through rates for gas prices, carbon prices, and exchange rates, indicating a competitive GB wholesale electricity market. We observe higher pass-through rates in peak compared to off-peak periods, because generators bidding at a lower rate during off-peak periods to supply at minimum load to avoid the cost of shutting down and starting up. We extend the argument by assessing generators’ bidding behaviour. The study also considers how two key events occurred during the examined period – the drastic decline in the GBP/EUR exchange rate since the Brexit referendum, and major reformation of the EU Emissions Trading System – have affected the electricity bill to a typical domestic household, showing that they have increased the average annual bills by €49(£41)/year/household, or a 7% rise. Finally, one possible solution to the security of electricity supply is demand response, which is usually achieved through dynamic tariffs by offering consumers financial incentives to shift or reduce peak load to off-peak periods. In Chapter 5, we construct an agent-based model in which the retailer sets dynamic tariffs to maximize profit, and consumers respond to the prices. The model suggests that in the baseline scenario, the dynamic tariff would generate for the retailer an additional €7.35 of annual profit from the average household. For a firm equal in size to British Gas in 2017, this is equivalent to €40 million of total benefit. With market regulations, the dynamic tariff will benefit consumers and retailers alike, resulting in a win–win condition. We also find that the interaction between demand-side management stimuli and market regulation can further reduce consumer-level electricity demand, increase retail profit, and lower consumers’ electricity bills

Distributionally robust project crashing with partial or no correlation information

Crashing is shortening the project makespan by reducing activity times in a project network by allocating resources to them. Activity durations are often uncertain and an exact probability distribution itself might be ambiguous. We study a class of distributionally robust project crashing problems where the objective is to optimize the first two marginal moments (means and SDs) of the activity durations to minimize the worst‐case expected makespan. Under partial correlation information and no correlation information, the problem is solvable in polynomial time as a semidefinite program and a second‐order cone program, respectively. However, solving semidefinite programs is challenging for large project networks. We exploit the structure of the distributionally robust formulation to reformulate a convex‐concave saddle point problem over the first two marginal moment variables and the arc criticality index variables. We then use a projection and contraction algorithm for monotone variational inequalities in conjunction with a gradient method to solve the saddle point problem enabling us to tackle large instances. Numerical results indicate that a manager who is faced with ambiguity in the distribution of activity durations has a greater incentive to invest resources in decreasing the variations rather than the means of the activity durations