Polynomial approximation method for stochastic programming.

Two stage stochastic programming is an important part in the whole area of stochastic programming, and is widely spread in multiple disciplines, such as financial management, risk management, and logistics. The two stage stochastic programming is a natural extension of linear programming by incorporating uncertainty into the model. This thesis solves the two stage stochastic programming using a novel approach. For most two stage stochastic programming model instances, both the objective function and constraints are convex but non-differentiable, e.g. piecewise-linear, and thereby solved by the first gradient-type methods. When encountering large scale problems, the performance of known methods, such as the stochastic decomposition (SD) and stochastic approximation (SA), is poor in practice. This thesis replaces the objective function and constraints with their polynomial approximations. That is because polynomial counterpart has the following benefits: first, the polynomial approximation will preserve the convexity; Second, the polynomial approximation will uniformly converge to the original objective/constraints with arbitrary accuracy; and third, the polynomial approximation will not only provide good estimation on the original objectives/functions but also their gradients/sub-gradients. All these features enable us to apply convex optimization techniques for large scale problems. Hence, the thesis applies SAA, polynomial approximation method and then steepest descent method in combination to solve the large-scale problems effectively and efficiently

Robust and stochastic approaches to network capacity design under demand uncertainty

This thesis considers the network capacity design problem with demand uncertainty using the stochastic, robust and distributionally robust stochastic optimization approaches (DRSO). Network modeling in itself has found wide areas of application in most fields of human endeavor. The network would normally consist of source (origin) and sink (destination) nodes connected by arcs that allow for flows of an entity from the origin to the destination nodes. In this thesis, a special type of the minimum cost flow problem is addressed, the multi-commodity network flow problem. Commodities are the flow types that are transported on a shared network. Offered demands are, for the most part, unknown or uncertain, hence a model that immune against this uncertainty becomes the focus as well as the practicability of such models in the industry. This problem falls under the two-stage optimization framework where a decision is delayed in time to adjust for the first decision earlier made. The first stage decision is called the "here and now", while the second stage traffic re-adjustment is the "wait and see" decision. In the literature, the decision-maker is often believed to know the shape of the uncertainty, hence we address this by considering a data-driven uncertainty set. The research also addressed the non-linearity of cost function despite the abundance of literature assuming linearity and models proposed for this. This thesis consist of four main chapters excluding the "Introduction" chapter and the "Approaches to Optimization under Uncertainty" chapter where the methodologies are reviewed. The first of these four, Chapter 3, proposes the two models for the Robust Network Capacity Expansion Problem (RNCEP) with cost non-linearity. These two are the RNCEP with fixed-charge cost and RNCEP with piecewise-linear cost. The next chapter, Chapter 4, compares the RNCEP models under two types of uncertainties in order to address the issue of usefulness in a real world setting. The resulting two robust models are also comapared with the stochastic optimization model with distribution mean. Chapter 5 re-examines the earlier problem using machine learning approaches to generate the two uncertainty sets while the last of these chapters, Chapter 6, investigates DRSO model to network capacity planning and proposes an efficient solution technique

Algorithm Engineering in Robust Optimization

Robust optimization is a young and emerging field of research having received a considerable increase of interest over the last decade. In this paper, we argue that the the algorithm engineering methodology fits very well to the field of robust optimization and yields a rewarding new perspective on both the current state of research and open research directions. To this end we go through the algorithm engineering cycle of design and analysis of concepts, development and implementation of algorithms, and theoretical and experimental evaluation. We show that many ideas of algorithm engineering have already been applied in publications on robust optimization. Most work on robust optimization is devoted to analysis of the concepts and the development of algorithms, some papers deal with the evaluation of a particular concept in case studies, and work on comparison of concepts just starts. What is still a drawback in many papers on robustness is the missing link to include the results of the experiments again in the design

Solving the bifurcated and nonbifurcated robust network loading problem with k-adaptive routing

International audienceWe experiment with an alternative routing scheme for the robust network loading problem with demand uncertainty. Named k‐adaptive, it is based on the fact that the decision‐maker chooses k second‐stage solutions and then commits to one of them only after realization of the uncertainty. This routing scheme, with its corresponding k‐partition of the uncertainty set, is dynamically defined under an iterative method to sequentially improve the solution. The method has an inherent characteristic of multiplying the number of variables and constraints after each iteration, so that additional measures are introduced in the solution strategy in order to control time performance. We compare our k‐adaptive results with the ones obtained through other routing schemes and also verify the effectiveness of the methods utilized using several realistic networks from SNDlib and other sources

A comparison of different routing schemes for the robust network loading problem: polyhedral results and computation

International audienceWe consider the capacity formulation of the Robust Network Loading Problem. The aim of the paper is to study what happens from the theoretical and from the computational point of view when the routing policy (or scheme) changes. The theoretical results consider static, volume, affine and dynamic routing, along with splittable and unsplittable flows. Our polyhedral study provides evidence that some well-known valid inequalities (the robust cutset inequalities) are facets for all the considered routing/flows policies under the same assumptions. We also introduce a new class of valid inequalities, the robust 3-partition inequalities, showing that, instead, they are facets in some settings, but not in others. A branch-and-cut algorithm is also proposed and tested. The computational experiments refer to the problem with splittable flows and the budgeted uncertainty set. We report results on several instances coming from real-life networks, also including historical traffic data, as well as on randomly generated instances. Our results show that the problem with static and volume routing can be solved quite efficiently in practice and that, in many cases, volume routing is cheaper than static routing, thus possibly representing the best compromise between cost and computing time. Moreover, unlikely from what one may expect, the problem with dynamic routing is easier to solve than the one with affine routing, which is hardly tractable, even using decomposition methods

Multi-Period Stochastic Resource Planning: Models, Algorithms and Applications

This research addresses the problem of sequential decision making in the presence of uncertainty in the professional service industry. Specifically, it considers the problem of dynamically assigning resources to tasks in a stochastic environment with both the uncertainty of resource availability due to attrition, and the uncertainty of job availability due to unknown project bid outcome. This problem is motivated by the resource planning application at the Hewlett Packard (HP) Enterprises. The challenge is to provide resource planning support over a time horizon under the influence of internal resource attrition and demand uncertainty. To ensure demand is satisfied, the external contingent resources can be engaged to make up for internal resource attrition. The objective is to maximize profitability by identifying the optimal mix of internal and contingent resources and their assignments to project tasks under explicit uncertainty. While the sequential decision problems under uncertainty can often be modeled as a Markov decision process (MDP), the classical dynamic programming (DP) method using the Bellman’s equation suffers the well-known curses-of-dimensionality and only works for small size instances. To tackle the challenge of curses-of-dimensionality this research focuses on developing computationally tractable closed-loop Approximate Dynamic Programming (ADP) algorithms to obtain near-optimal solutions in reasonable computational time. Various approximation schemes are developed to approximate the cost-to-go function. A comprehensive computational experiment is conducted to investigate the performance and behavior of the ADP algorithm. The performance of ADP is also compared with that of a rolling horizon approach as a benchmark solution. Computational results show that the optimization model and algorithm developed in this thesis are able to offer solutions with higher profitability and utilization of internal resource for companies in the professional service industry

Outsourcing policies for the Facility Location Problem with Bernoulli Demand

This paper focuses on the Facility Location Problem with Bernoulli Demand, a discrete facility location problem with uncertainty where the joint distribution of the customers' demands is expressed by means of a set of possible scenarios. A two-stage stochastic program with recourse is used to select the facility locations and the a priori assignments of customers to open plants, together with the a posteriori strategy to apply in those realizations where the a priori solution is not feasible. Four alternative outsourcing policies are studied for the recourse action, and a mathematical programming formulation is presented for each of them. Extensive computational experiments have been carried-out to analyze the performance of each of the formulations and to compare the quality of the solutions produced by each of them relative to the other outsourcing policies