Separable Convex Optimization with Nested Lower and Upper Constraints

We study a convex resource allocation problem in which lower and upper bounds are imposed on partial sums of allocations. This model is linked to a large range of applications, including production planning, speed optimization, stratified sampling, support vector machines, portfolio management, and telecommunications. We propose an efficient gradient-free divide-and-conquer algorithm, which uses monotonicity arguments to generate valid bounds from the recursive calls, and eliminate linking constraints based on the information from sub-problems. This algorithm does not need strict convexity or differentiability. It produces an $\epsilon$-approximate solution for the continuous problem in $\mathcal{O}(n \log m \log \frac{n B}{\epsilon})$ time and an integer solution in $\mathcal{O}(n \log m \log B)$ time, where $n$ is the number of decision variables, $m$ is the number of constraints, and $B$ is the resource bound. A complexity of $\mathcal{O}(n \log m)$ is also achieved for the linear and quadratic cases. These are the best complexities known to date for this important problem class. Our experimental analyses confirm the good performance of the method, which produces optimal solutions for problems with up to 1,000,000 variables in a few seconds. Promising applications to the support vector ordinal regression problem are also investigated

Indefinite Knapsack Separable Quadratic Programming: Methods and Applications

Quadratic programming (QP) has received significant consideration due to an extensive list of applications. Although polynomial time algorithms for the convex case have been developed, the solution of large scale QPs is challenging due to the computer memory and speed limitations. Moreover, if the QP is nonconvex or includes integer variables, the problem is NP-hard. Therefore, no known algorithm can solve such QPs efficiently. Alternatively, row-aggregation and diagonalization techniques have been developed to solve QP by a sub-problem, knapsack separable QP (KSQP), which has a separable objective function and is constrained by a single knapsack linear constraint and box constraints. KSQP can therefore be considered as a fundamental building-block to solve the general QP and is an important class of problems for research. For the convex KSQP, linear time algorithms are available. However, if some quadratic terms or even only one term is negative in KSQP, the problem is known to be NP-hard, i.e. it is notoriously difficult to solve. The main objective of this dissertation is to develop efficient algorithms to solve general KSQP. Thus, the contributions of this dissertation are five-fold. First, this dissertation includes comprehensive literature review for convex and nonconvex KSQP by considering their computational efficiencies and theoretical complexities. Second, a new algorithm with quadratic time worst-case complexity is developed to globally solve the nonconvex KSQP, having open box constraints. Third, the latter global solver is utilized to develop a new bounding algorithm for general KSQP. Fourth, another new algorithm is developed to find a bound for general KSQP in linear time complexity. Fifth, a list of comprehensive applications for convex KSQP is introduced, and direct applications of indefinite KSQP are described and tested with our newly developed methods. Experiments are conducted to compare the performance of the developed algorithms with that of local, global, and commercial solvers such as IBM CPLEX using randomly generated problems in the context of certain applications. The experimental results show that our proposed methods are superior in speed as well as in the quality of solutions

Fast approximation schemes for multi-criteria combinatorial optimization

Cover title.Includes bibliographical references (p. 38-44).by Hershel M. Safer, James B. Orlin

Constructive solution methodologies to the capacitated newsvendor problem and surrogate extension

The newsvendor problem is a single-period stochastic model used to determine the order quantity of perishable product that maximizes/minimizes the profit/cost of the vendor under uncertain demand. The goal is to fmd an initial order quantity that can offset the impact of backlog or shortage caused by mismatch between the procurement amount and uncertain demand. If there are multiple products and substitution between them is feasible, overstocking and understocking can be further reduced and hence, the vendor\u27s overall profit is improved compared to the standard problem. When there are one or more resource constraints, such as budget, volume or weight, it becomes a constrained newsvendor problem. In the past few decades, many researchers have proposed solution methods to solve the newsvendor problem. The literature is first reviewed where the performance of each of existing model is examined and its contribution is reported. To add to these works, it is complemented through developing constructive solution methods and extending the existing published works by introducing the product substitution models which so far has not received sufficient attention despite its importance to supply chain management decisions. To illustrate this dissertation provides an easy-to-use approach that utilizes the known network flow problem or knapsack problem. Then, a polynomial in fashion algorithm is developed to solve it. Extensive numerical experiments are conducted to compare the performance of the proposed method and some existing ones. Results show that the proposed approach though approximates, yet, it simplifies the solution steps without sacrificing accuracy. Further, this dissertation addresses the important arena of product substitute models. These models deal with two perishable products, a primary product and a surrogate one. The primary product yields higher profit than the surrogate. If the demand of the primary exceeds the available quantity and there is excess amount of the surrogate, this excess quantity can be utilized to fulfill the shortage. The objective is to find the optimal lot sizes of both products, that minimize the total cost (alternatively, maximize the profit). Simulation is utilized to validate the developed model. Since the analytical solutions are difficult to obtain, Mathematical software is employed to find the optimal results. Numerical experiments are also conducted to analyze the behavior of the optimal results versus the governing parameters. The results show the contribution of surrogate approach to the overall performance of the policy. From a practical perspective, this dissertation introduces the applications of the proposed models and methods in different industries such as inventory management, grocery retailing, fashion sector and hotel reservation

Fully Polynomial Time Approximation Schemes for Stochastic Dynamic Programs

We present a framework for obtaining fully polynomial time approximation schemes (FPTASs) for stochastic univariate dynamic programs with either convex or monotone single-period cost functions. This framework is developed through the establishment of two sets of computational rules, namely, the calculus of K-approximation functions and the calculus of K-approximation sets. Using our framework, we provide the first FPTASs for several NP-hard problems in various fields of research such as knapsack models, logistics, operations management, economics, and mathematical finance. Extensions of our framework via the use of the newly established computational rules are also discussed