A parallel Branch-and-Fix Coordination based matheuristic algorithm for solving large sized multistage stochastic mixed 0-1 problems

A parallel matheuristic algorithm is presented as a spin-off from the exact Branch-and-Fix Coordination (BFC) algorithm for solving multistage stochastic mixed 0-1 problems. Some steps to guarantee the solution’s optimality are relaxed in the BFC algorithm, such that an incomplete backward branching scheme is considered for solving large sized problems. Additionally, a new branching criterion is considered, based on dynamically-guided and stage-wise ordering schemes, such that fewer Twin Node Families are expected to be visited during the execution of the so-called H-DBFC algorithm. The inner parallelization IH-DBFC of the new approach, allows to solve in parallel scenario clusters MIP submodels at different steps of the algorithm. The outer parallel version, OH-DBFC, considers independent paths and allows iterative incumbent solution values exchanges to obtain tighter bounds of the solution value of the original problem. A broad computational experience is reported for assessing the quality of the matheuristic solution for large sized instances. The instances dimensions that are considered are up to two orders of magnitude larger than in some other works that we are aware of. The optimality gap of the H-DBFC solution value versus the one obtained by a state-of-the-artMIP solver is very small, if any. The new approach frequently outperforms it in terms of solution’s quality and computing time. A comparison with our Stochastic Dynamic Programming algorithm is also reported. The use of parallel computing provides, on one hand, a perspective for solving very large sized instances and, on the other hand, an expected large reduction in elapsed time.MTM2015-65317-P, MTM2015-63710-P, IT928-16; UFI BETS 2011; IZO-SGI SGIke

Some experiments on solving multistage stochastic mixed 0-1 programs with time stochastic dominance constraints

In this work we extend to the multistage case two recent risk averse measures for two-stage stochastic programs based on first- and second-order stochastic dominance constraints induced by mixed-integer linear recourse. Additionally, we consider Time Stochastic Dominance (TSD) along a given horizon. Given the dimensions of medium-sized problems augmented by the new variables and constraints required by those risk measures, it is unrealistic to solve the problem up to optimality by plain use of MIP solvers in a reasonable computing time, at least. Instead of it, decomposition algorithms of some type should be used. We present an extension of our Branch-and-Fix Coordination algorithm, so named BFC-TSD, where a special treatment is given to cross scenario group constraints that link variables from different scenario groups. A broad computational experience is presented by comparing the risk neutral approach and the tested risk averse strategies. The performance of the new version of the BFC algorithm versus the plain use of a state-of-the-artMIP solver is also reported

On capacity expansion planning under strategic and operational uncertainties based on stochastic dominance risk averse management

A new scheme for dealing with uncertainty in scenario trees is presented for dynamic mixed 0–1 optimization problems with strategic and operational stochastic parameters. Let us generically name this type of problems as capacity expansion planning (CEP) in a given system, e.g., supply chain, production, rapid transit network, energy generation and transmission network, etc. The strategic scenario tree is usually a multistage one, and the replicas of the strategic nodes root structures in the form of either a special scenario graph or a two-stage scenario tree, depending on the type of operational activity in the system. Those operational scenario structures impact in the constraints of the model and, thus, in the decomposition methodology for solving usually large-scale problems. This work presents the modeling framework for some of the risk neutral and risk averse measures to consider for CEP problem solving. Two types of risk averse measures are considered. The first one is a time-inconsistent mixture of the chance-constrained and second-order stochastic dominance (SSD) functionals of the value of a given set of functions up to the strategic nodes in selected stages along the time horizon, The second type is a strategic node-based time-consistent SSD functional for the set of operational scenarios in the strategic nodes at selected stages. A specialization of the nested stochastic decomposition methodology for that problem solving is outlined. Its advantages and drawbacks as well as the framework for some schemes to, at least, partially avoid those drawbacks are also presentedThis research has been partially supported by the projects: MTM2015-63710 and MTM2016-79765 from the Spanish Ministry of Economy and Competitiveness. The authors like to thank the positive criticism of their colleagues Antonio Alonso-Ayuso, Luis Cadarso, F. Javier Martín-Campo and Angel Marín that helped to improve the presentation of the wor

On the time-consistent stochastic dominance risk averse measure for tactical supply chain planning under uncertainty

In this work a modeling framework and a solution approach have been presented for a multi-period stochastic mixed 0–1 problem arising in tactical supply chain planning (TSCP). A multistage scenario tree based scheme is used to represent the parameters’ uncertainty and develop the related Deterministic Equivalent Model. A cost risk reduction is performed by using a new time-consistent risk averse measure. Given the dimensions of this problem in real-life applications, a decomposition approach is proposed. It is based on stochastic dynamic programming (SDP). The computational experience is twofold, a compar- ison is performed between the plain use of a current state-of-the-art mixed integer optimization solver and the proposed SDP decomposition approach considering the risk neutral version of the model as the subject for the benchmarking. The add-value of the new risk averse strategy is confirmed by the compu- tational results that are obtained using SDP for both versions of the TSCP model, namely, risk neutral and risk averse.The authors would like to thank to the two anonymous review- ers for their help on clarifying some concepts presented in the manuscript and strongly improving its presentatio

Time consistent expected mean-variance in multistage stochastic quadratic optimization: a model and a matheuristic

In this paper, we present a multistage time consistent Expected Conditional Risk Measure for minimizing a linear combination of the expected mean and the expected variance, so-called Expected Mean-Variance. The model is formulated as a multistage stochastic mixed-integer quadratic programming problem combining risk-sensitive cost and scenario analysis approaches. The proposed problem is solved by a matheuristic based on the Branch-and-Fix Coordination method. The multistage scenario cluster primal decomposition framework is extended to deal with large-scale quadratic optimization by means of stage-wise reformulation techniques. A specific case study in risk-sensitive production planning is used to illustrate that a remarkable decrease in the expected variance (risk cost) is obtained. A competitive behavior on the part of our methodology in terms of solution quality and computation time is shown when comparing with plain use of CPLEX in 150 benchmark instances, ranging up to 711,845 constraints and 193,000 binary variables.project MTM2015-65317-P (MINECO/FEDER/EU); BERC 2014-2017; IT-928-16; and by the University of the Basque Country UPV/EHU; BCAM Severo Ochoa excellence accreditation Grant SEV-2013-0323; BERC 2014-201

On solving large-scale multistage stochastic problems with a new specialized interior-point approach

A novel approach based on a specialized interior-point method (IPM) is presented for solving large-scale stochastic multistage continuous optimization problems, which represent the uncertainty in strategic multistage and operational two-stage scenario trees, the latter being rooted at the strategic nodes. This new solution approach considers a split-variable formulation of the strategic and operational structures, for which copies are made of the strategic nodes and the structures are rooted in the form of nested strategic-operational two-stage trees. The specialized IPM solves the normal equations of the problem’s Newton system by combining Cholesky factorizations with preconditioned conjugate gradients, doing so for, respectively, the constraints of the stochastic formulation and those that equate the split-variables. We show that, for multistage stochastic problems, the preconditioner (i) is a block-diagonal matrix composed of as many shifted tridiagonal matrices as the number of nested strategicoperational two-stage trees, thus allowing the efficient solution of systems of equations; (ii) its complexity in a multistage stochastic problem is equivalent to that of a very large-scale two-stage problem. A broad computational experience is reported for large multistage stochastic supply network design (SND) and revenue management (RM) problems; the mathematical structures vary greatly for those two application types. Some of the most difficult instances of SND had 5 stages, 839 million variables, 13 million quadratic variables, 21 million constraints, and 3750 scenario tree nodes; while those of RM had 8 stages, 278 million variables, 100 million constraints, and 100,000 scenario tree nodes. For those problems, the proposed approach obtained the solution in 2.3 days using 167 gigabytes of memory for SND, and in 1.7 days using 83 gigabytes for RM; while the state-of-the-art solver CPLEX v20.1 required more than 24 days and 526 gigabytes for SND, and more than 19 days and 410 gigabytes for RMPeer ReviewedPreprin

On modelling planning under uncertainty in manufacturing

We present a modelling framework for two-stage and multi-stage mixed 0-1 problems under uncertainty for strategic Supply Chain Management, tactical production planning and operations assignment and scheduling. A scenario tree based scheme is used to represent the uncertainty. We present the Deterministic Equivalent Model of the stochastic mixed 0-1 programs with complete recourse that we study. The constraints are modelled by compact and splitting variable representations via scenarios

On solving large-scale multistage stochastic optimization problems with a new specialized interior-point approach

© 2023 The Authors. Published by Elsevier B.VA novel approach based on a specialized interior-point method (IPM) is presented for solving largescale stochastic multistage continuous optimization problems, which represent the uncertainty in strategic multistage and operational two-stage scenario trees. This new solution approach considers a splitvariable formulation of the strategic and operational structures. The specialized IPM solves the normal equations by combining Cholesky factorizations with preconditioned conjugate gradients, doing so for, respectively, the constraints of the stochastic formulation and those that equate the split-variables. We show that, for multistage stochastic problems, the preconditioner (i) is a block-diagonal matrix composed of as many shifted tridiagonal matrices as the number of nested strategic-operational two-stage trees, thus allowing the efficient solution of systems of equations; (ii) its complexity in a multistage stochastic problem is equivalent to that of a very large-scale two-stage problem. A broad computational experience is reported for large multistage stochastic supply network design (SND) and revenue management (RM) problems. Some of the most difficult instances of SND had 5 stages, 839 million linear variables, 13 million quadratic variables, 21 million constraints, and 3750 scenario tree nodes; while those of RM had 8 stages, 278 million linear variables, 100 million constraints, and 100,000 scenario tree nodes. For those problems, the proposed approach obtained the solution in 1.1 days using 174 gigabytes of memory for SND, and in 1.7 days using 83 gigabytes for RM; while CPLEX v20.1 required more than 53 days and 531 gigabytes for SND, and more than 19 days and 410 gigabytes for RM.J. Castro was supported by the MCIN/AEI/FEDER grant RTI2018-097580-B-I00. L.E. Escudero was supported by the MCIN/AEI/10.13039/501100011033 grant PID2021-122640OB-I00. J.F. Monge was supported by the MCIN/AEI/10.13039/501100011033/ERDF grants PID2019-105952GB-I00 and PID2021-122344NB-I00, and by PROMETEO/2021/063 grant funded by the government of the Valencia Community, Spain.Peer ReviewedPostprint (published version

Multi-stage stochastic optimization and reinforcement learning for forestry epidemic and covid-19 control planning

This dissertation focuses on developing new modeling and solution approaches based on multi-stage stochastic programming and reinforcement learning for tackling biological invasions in forests and human populations. Emerald Ash Borer (EAB) is the nemesis of ash trees. This research introduces a multi-stage stochastic mixed-integer programming model to assist forest agencies in managing emerald ash borer insects throughout the U.S. and maximize the public benets of preserving healthy ash trees. This work is then extended to present the first risk-averse multi-stage stochastic mixed-integer program in the invasive species management literature to account for extreme events. Significant computational achievements are obtained using a scenario dominance decomposition and cutting plane algorithm.The results of this work provide crucial insights and decision strategies for optimal resource allocation among surveillance, treatment, and removal of ash trees, leading to a better and healthier environment for future generations. This dissertation also addresses the computational difficulty of solving one of the most difficult classes of combinatorial optimization problems, the Multi-Dimensional Knapsack Problem (MKP). A novel 2-Dimensional (2D) deep reinforcement learning (DRL) framework is developed to represent and solve combinatorial optimization problems focusing on MKP. The DRL framework trains different agents for making sequential decisions and finding the optimal solution while still satisfying the resource constraints of the problem. To our knowledge, this is the first DRL model of its kind where a 2D environment is formulated, and an element of the DRL solution matrix represents an item of the MKP. Our DRL framework shows that it can solve medium-sized and large-sized instances at least 45 and 10 times faster in CPU solution time, respectively, with a maximum solution gap of 0.28% compared to the solution performance of CPLEX. Applying this methodology, yet another recent epidemic problem is tackled, that of COVID-19. This research investigates a reinforcement learning approach tailored with an agent-based simulation model to simulate the disease growth and optimize decision-making during an epidemic. This framework is validated using the COVID-19 data from the Center for Disease Control and Prevention (CDC). Research results provide important insights into government response to COVID-19 and vaccination strategies

Robust and stochastic approaches to network capacity design under demand uncertainty

This thesis considers the network capacity design problem with demand uncertainty using the stochastic, robust and distributionally robust stochastic optimization approaches (DRSO). Network modeling in itself has found wide areas of application in most fields of human endeavor. The network would normally consist of source (origin) and sink (destination) nodes connected by arcs that allow for flows of an entity from the origin to the destination nodes. In this thesis, a special type of the minimum cost flow problem is addressed, the multi-commodity network flow problem. Commodities are the flow types that are transported on a shared network. Offered demands are, for the most part, unknown or uncertain, hence a model that immune against this uncertainty becomes the focus as well as the practicability of such models in the industry. This problem falls under the two-stage optimization framework where a decision is delayed in time to adjust for the first decision earlier made. The first stage decision is called the "here and now", while the second stage traffic re-adjustment is the "wait and see" decision. In the literature, the decision-maker is often believed to know the shape of the uncertainty, hence we address this by considering a data-driven uncertainty set. The research also addressed the non-linearity of cost function despite the abundance of literature assuming linearity and models proposed for this. This thesis consist of four main chapters excluding the "Introduction" chapter and the "Approaches to Optimization under Uncertainty" chapter where the methodologies are reviewed. The first of these four, Chapter 3, proposes the two models for the Robust Network Capacity Expansion Problem (RNCEP) with cost non-linearity. These two are the RNCEP with fixed-charge cost and RNCEP with piecewise-linear cost. The next chapter, Chapter 4, compares the RNCEP models under two types of uncertainties in order to address the issue of usefulness in a real world setting. The resulting two robust models are also comapared with the stochastic optimization model with distribution mean. Chapter 5 re-examines the earlier problem using machine learning approaches to generate the two uncertainty sets while the last of these chapters, Chapter 6, investigates DRSO model to network capacity planning and proposes an efficient solution technique