Valid inequalities for the single-item capacitated lot sizing problem with step-wise costs

This paper presents a new class of valid inequalities for the single-item capacitated lotsizing problem with step-wise production costs (LS-SW). We first provide a survey of different optimization methods proposed to solve LS-SW. Then, flow cover and flow cover inequalities derived from the single node flow set are described in order to generate the new class of valid inequalities. The single node flow set can be seen as a generalization of some valid relaxations of LS-SW. A new class of valid inequalities we call mixed flow cover, is derived from the integer flow cover inequalities by a lifting procedure. The lifting coefficients are sequence independent when the batch sizes (V) and the production capacities (P) are constant and if V divides P. When the restriction of the divisibility is removed, the lifting coefficients are shown to be sequence independent. We identify some cases where the mixed flow cover inequalities are facet defining. A cutting plane algorithmis proposed for these three classes of valid inequalities. The exact separation algorithmproposed for the constant capacitated case runs in polynomial time. Finally, some computational results are given to compare the performance of the different optimization methods including the new class of valid inequalities.single-item capacitated lot sizing problem, flow cover inequalities, cutting plane algorithm

An Expandable Machine Learning-Optimization Framework to Sequential Decision-Making

We present an integrated prediction-optimization (PredOpt) framework to efficiently solve sequential decision-making problems by predicting the values of binary decision variables in an optimal solution. We address the key issues of sequential dependence, infeasibility, and generalization in machine learning (ML) to make predictions for optimal solutions to combinatorial problems. The sequential nature of the combinatorial optimization problems considered is captured with recurrent neural networks and a sliding-attention window. We integrate an attention-based encoder-decoder neural network architecture with an infeasibility-elimination and generalization framework to learn high-quality feasible solutions to time-dependent optimization problems. In this framework, the required level of predictions is optimized to eliminate the infeasibility of the ML predictions. These predictions are then fixed in mixed-integer programming (MIP) problems to solve them quickly with the aid of a commercial solver. We demonstrate our approach to tackling the two well-known dynamic NP-Hard optimization problems: multi-item capacitated lot-sizing (MCLSP) and multi-dimensional knapsack (MSMK). Our results show that models trained on shorter and smaller-dimensional instances can be successfully used to predict longer and larger-dimensional problems. The solution time can be reduced by three orders of magnitude with an average optimality gap below 0.1%. We compare PredOpt with various specially designed heuristics and show that our framework outperforms them. PredOpt can be advantageous for solving dynamic MIP problems that need to be solved instantly and repetitively

A relax-and-fix with fix-and-optimize heuristic applied to multi-level lot-sizing problems

In this paper, we propose a simple but efficient heuristic that combines construction and improvement heuristic ideas to solve multi-level lot-sizing problems. A relax-and-fix heuristic is firstly used to build an initial solution, and this is further improved by applying a fix-and-optimize heuristic. We also introduce a novel way to define the mixed-integer subproblems solved by both heuristics. The efficiency of the approach is evaluated solving two different classes of multi-level lot-sizing problems: the multi-level capacitated lot-sizing problem with backlogging and the two-stage glass container production scheduling problem (TGCPSP). We present extensive computational results including four test sets of the Multi-item Lot-Sizing with Backlogging library, and real-world test problems defined for the TGCPSP, where we benchmark against state-of-the-art methods from the recent literature. The computational results show that our combined heuristic approach is very efficient and competitive, outperforming benchmark methods for most of the test problems

Multistage stochastic capacitated discrete lot-sizing with lead times: problem definition, complexity analysis and tighter formulations

A stochastic capacitated discrete procurement problem with lead times, cancellation and postponement is addressed. The problem determines the expected cost minimization of satisfying the uncertain demand of a product during a discrete time planning horizon. The supply of the product is made through the purchase of optional distinguishable orders of fixed size with lead time. Due to the uncertainty of demand, corrective actions, such as order cancellation and postponement, may be taken with associated costs and time limits. The problem is modeled as an extension of a capacitated discrete lot-sizing problem with uncertain demand and lead times through a multistage stochastic mixed-integer programming approach. To improve the resolution of the model by tightening its formulation, valid inequalities are generated based on conventional inequalities. Subsets of approximately non dominated valid inequalities are determined heuristically. A procedure to tighten an upgraded formulation based on a known scheme of pairing of inequalities is proposed. Computational experiments are performed for several instances with different uncertainty information structure. The experimental results allow to conclude that the inclusion of subsets of the generated valid inequalities enable a more efficient resolution of the model

Integrated machine learning and optimization approaches

This dissertation focuses on the integration of machine learning and optimization. Specifically, novel machine learning-based frameworks are proposed to help solve a broad range of well-known operations research problems to reduce the solution times. The first study presents a bidirectional Long Short-Term Memory framework to learn optimal solutions to sequential decision-making problems. Computational results show that the framework significantly reduces the solution time of benchmark capacitated lot-sizing problems without much loss in feasibility and optimality. Also, models trained using shorter planning horizons can successfully predict the optimal solution of the instances with longer planning horizons. For the hardest data set, the predictions at the 25% level reduce the solution time of 70 CPU hours to less than 2 CPU minutes with an optimality gap of 0.8% and without infeasibility. In the second study, an extendable prediction-optimization framework is presented for multi-stage decision-making problems to address the key issues of sequential dependence, infeasibility, and generalization. Specifically, an attention-based encoder-decoder neural network architecture is integrated with an infeasibility-elimination and generalization framework to learn high-quality feasible solutions. The proposed framework is demonstrated to tackle the two well-known dynamic NP-Hard optimization problems: multi-item capacitated lot-sizing and multi-dimensional knapsack. The results show that models trained on shorter and smaller-dimension instances can be successfully used to predict longer and larger-dimension problems with the presented item-wise expansion algorithm. The solution time can be reduced by three orders of magnitude with an average optimality gap below 0.1%. The proposed framework can be advantageous for solving dynamic mixed-integer programming problems that need to be solved instantly and repetitively. In the third study, a deep reinforcement learning-based framework is presented for solving scenario-based two-stage stochastic programming problems, which are computationally challenging to solve. A general two-stage deep reinforcement learning framework is proposed where two learning agents sequentially learn to solve each stage of a general two-stage stochastic multi-dimensional knapsack problem. The results show that solution time can be reduced significantly with a relatively small gap. Additionally, decision-making agents can be trained with a few scenarios and solve problems with a large number of scenarios. In the fourth study, a learning-based prediction-optimization framework is proposed for solving scenario-based multi-stage stochastic programs. The issue of non-anticipativity is addressed with a novel neural network architecture that is based on a neural machine translation system. Furthermore, training the models on deterministic problems is suggested instead of solving hard and time-consuming stochastic programs. In this framework, the level of variables used for the solution is iteratively reduced to eliminate infeasibility, and a heuristic based on a linear relaxation is performed to reduce the solution time. An improved item-wise expansion strategy is introduced to generalize the algorithm to tackle instances with different sizes. The results are presented in solving stochastic multi-item capacitated lot-sizing and stochastic multi-stage multi-dimensional knapsack problems. The results show that the solution time can be reduced by a factor of 599 with an optimality gap of only 0.08%. Moreover, results demonstrate that the models can be used to predict similarly structured stochastic programming problems with a varying number of periods, items, and scenarios. The frameworks presented in this dissertation can be utilized to achieve high-quality and fast solutions to repeatedly-solved problems in various industrial and business settings, such as production and inventory management, capacity planning, scheduling, airline logistics, dynamic pricing, and emergency management

Fuzzy Mathematical Model For A Lot-Sizing Problem In Closed-Loop Supply Chain

The aim of lot sizing problems is to determine the periods where production takes place and the quantities to be produced in order to satisfy the customer demand while minimizing the total cost. Due to its importance on the efficiency of the production and inventory systems, Lot sizing problems are one of the most challenging production planning problems and have been studied for many years with different modeling features. In this paper, we propose a fuzzy mathematical model for the single-item capacitated lot-sizing problem in closed-loop supply chain. The possibility approach is chosen to convert the fuzzy mathematical model to crisp mathematical model. The obtained crisp model is in the form of mixed integer linear programming (MILP), which can be solved by existing solver in crisp environment to find optimal solution. Due to the complexity of the problems harmony search (HS) algorithm and genetic algorithm (GA) have been used to solve the model for fifteen problem. To verify the performance of the algorithm, we computationally compared the results obtained by the algorithms with the results of the branch-and-bound method. Additionally, Taguchi method was used to calibrate the parameters of the meta-heuristic algorithms. The computational results show that, the objective values obtained by HS are better from GA results for large dimensions test problems, also CPU time obtained by HS are better than GA for Large dimensions

Reformulation and decomposition of integer programs

In this survey we examine ways to reformulate integer and mixed integer programs. Typically, but not exclusively, one reformulates so as to obtain stronger linear programming relaxations, and hence better bounds for use in a branch-and-bound based algorithm. First we cover in detail reformulations based on decomposition, such as Lagrangean relaxation, Dantzig-Wolfe column generation and the resulting branch-and-price algorithms. This is followed by an examination of Benders’ type algorithms based on projection. Finally we discuss in detail extended formulations involving additional variables that are based on problem structure. These can often be used to provide strengthened a priori formulations. Reformulations obtained by adding cutting planes in the original variables are not treated here.Integer program, Lagrangean relaxation, column generation, branch-and-price, extended formulation, Benders' algorithm

Models and algorithms for decomposition problems

This thesis deals with the decomposition both as a solution method and as a problem itself. A decomposition approach can be very effective for mathematical problems presenting a specific structure in which the associated matrix of coefficients is sparse and it is diagonalizable in blocks. But, this kind of structure may not be evident from the most natural formulation of the problem. Thus, its coefficient matrix may be preprocessed by solving a structure detection problem in order to understand if a decomposition method can successfully be applied. So, this thesis deals with the k-Vertex Cut problem, that is the problem of finding the minimum subset of nodes whose removal disconnects a graph into at least k components, and it models relevant applications in matrix decomposition for solving systems of equations by parallel computing. The capacitated k-Vertex Separator problem, instead, asks to find a subset of vertices of minimum cardinality the deletion of which disconnects a given graph in at most k shores and the size of each shore must not be larger than a given capacity value. Also this problem is of great importance for matrix decomposition algorithms. This thesis also addresses the Chance-Constrained Mathematical Program that represents a significant example in which decomposition techniques can be successfully applied. This is a class of stochastic optimization problems in which the feasible region depends on the realization of a random variable and the solution must optimize a given objective function while belonging to the feasible region with a probability that must be above a given value. In this thesis, a decomposition approach for this problem is introduced. The thesis also addresses the Fractional Knapsack Problem with Penalties, a variant of the knapsack problem in which items can be split at the expense of a penalty depending on the fractional quantity

Mixed integer programming formulations and heuristics for joint production and transportation problems.

In this thesis we consider different joint production and transportation problems. We first study the simplest two-level problem, the uncapacitated two-level production-in-series lot-sizing problem (2L-S/LS-U). We give a new polynomial dynamic programming algorithm and a new compact extended formulation for the problem and for an extension with sales. Some computational tests are performed comparing several reformulations on a NP-Hard problem containing the 2L-S/LS-U as a relaxation. We also investigate the one-warehouse multi-retailer problem (OWMR), another NP-Hard extension of the 2L-S/LS-U. We study possible ways to tackle the problem effectively using mixed integer programming (MIP) techniques. We analyze the projection of a multi-commodity reformulation onto the space of the original variables for two special cases and characterize valid inequalities for the 2L-S/LS-U. Limited computational experiments are performed to compare several approaches. We then analyze a more general two-level production and transportation problem with multiple production sites. Relaxations for the problem for which reformulations are known are identified in order to improve the linear relaxation bounds. We show that some uncapacitated instances of the basic problem of reasonable size can often be solved to optimality. We also show that a hybrid MIP heuristic based on two different MIP formulations permits us to find solutions guaranteed to be within 10% of optimality for harder instances with limited transportation capacity and/or with additional sales. For instances with big bucket production or aggregate storage capacity constraints the gaps can be larger. In addition, we study a different type of production and transportation problem in which cllients place orders with different sizes and delivery dates and the transportation is performed by a third company. We develop a MIP formulation and an algorithm with a local search procedure that allows us to solve large instances effectively.