Domination and Decomposition in Multiobjective Programming

During the last few decades, multiobjective programming has received much attention for both its numerous theoretical advances as well as its continued success in modeling and solving real-life decision problems in business and engineering. In extension of the traditionally adopted concept of Pareto optimality, this research investigates the more general notion of domination and establishes various theoretical results that lead to new optimization methods and support decision making. After a preparatory discussion of some preliminaries and a review of the relevant literature, several new findings are presented that characterize the nondominated set of a general vector optimization problem for which the underlying domination structure is defined in terms of different cones. Using concepts from linear algebra and convex analysis, a well known result relating nondominated points for polyhedral cones with Pareto solutions is generalized to nonpolyhedral cones that are induced by positively homogeneous functions, and to translated polyhedral cones that are used to describe a notion of approximate nondominance. Pareto-oriented scalarization methods are modified and several new solution approaches are proposed for these two classes of cones. In addition, necessary and sufficient conditions for nondominance with respect to a variable domination cone are developed, and some more specific results for the case of Bishop-Phelps cones are derived. Based on the above findings, a decomposition framework is proposed for the solution of multi-scenario and large-scale multiobjective programs and analyzed in terms of the efficiency relationships between the original and the decomposed subproblems. Using the concept of approximate nondominance, an interactive decision making procedure is formulated to coordinate tradeoffs between these subproblems and applied to selected problems from portfolio optimization and engineering design. Some introductory remarks and concluding comments together with ideas and research directions for possible future work complete this dissertation

An Algorithm for Biobjective Mixed Integer Quadratic Programs

Multiobjective quadratic programs (MOQPs) are appealing since convex quadratic programs have elegant mathematical properties and model important applications. Adding mixed-integer variables extends their applicability while the resulting programs become global optimization problems. Thus, in this work, we develop a branch and bound (BB) algorithm for solving biobjective mixed-integer quadratic programs (BOMIQPs). An algorithm of this type does not exist in the literature. The algorithm relies on five fundamental components of the BB scheme: calculating an initial set of efficient solutions with associated Pareto points, solving node problems, fathoming, branching, and set dominance. Considering the properties of the Pareto set of BOMIQPs, two new fathoming rules are proposed. An extended branching module is suggested to cooperate with the node problem solver. A procedure to make the dominance decision between two Pareto sets with limited information is proposed. This set dominance procedure can eliminate the dominated points and eventually produce the Pareto set of the BOMIQP. Numerical examples are provided. Solving multiobjective quadratic programs (MOQPs) is fundamental to our research. Therefore, we examine the algorithms for this class of problems with different perspectives. The scalarization techniques for (strictly) convex MOPs are reviewed and the available algorithms for computing efficient solutions for MOQPs are discussed. These algorithms are compared with respect to four properties of MOQPs. In addition, methods for solving parametric multiobjective quadratic programs are studied. Computational studies are provided with synthetic instances, and examples in statistics and portfolio optimization. The real-life context reveals the interplay between the scalarizations and provides an additional insight into the obtained parametric solution sets

A Critical Review of Optimization Methods for Road Vehicles Design

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/77078/1/AIAA-2006-6998-235.pd

Designing a Framework for Solving Multiobjective Simulation Optimization Problems

Multiobjective simulation optimization (MOSO) problems are optimization problems with multiple conflicting objectives, where evaluation of at least one of the objectives depends on a black-box numerical code or real-world experiment, which we refer to as a simulation. This paper describes the design goals driving the development of the parallel MOSO library ParMOO. We derive these goals from the research trends and real-world requirements that arise when designing and deploying solvers for generic MOSO problems. Our specific design goals were to provide a customizable MOSO framework that allows for exploitation of simulation-based problem structures, ease of deployment in scientific workflows, maintainability, and flexibility in our support for many problem types. We explain how we have achieved these goals in the ParMOO library and provide two examples demonstrating how customized ParMOO solvers can be quickly built and deployed in real-world MOSO problems

Efficient Covariance Matrix Update for Variable Metric Evolution Strategies

International audienceRandomized direct search algorithms for continuous domains, such as Evolution Strategies, are basic tools in machine learning. They are especially needed when the gradient of an objective function (e.g., loss, energy, or reward function) cannot be computed or estimated efficiently. Application areas include supervised and reinforcement learning as well as model selection. These randomized search strategies often rely on normally distributed additive variations of candidate solutions. In order to efficiently search in non-separable and ill-conditioned landscapes the covariance matrix of the normal distribution must be adapted, amounting to a variable metric method. Consequently, Covariance Matrix Adaptation (CMA) is considered state-of-the-art in Evolution Strategies. In order to sample the normal distribution, the adapted covariance matrix needs to be decomposed, requiring in general $\Theta(n^3)$ operations, where $n$ is the search space dimension. We propose a new update mechanism which can replace a rank-one covariance matrix update and the computationally expensive decomposition of the covariance matrix. The newly developed update rule reduces the computational complexity of the rank-one covariance matrix adaptation to $\Theta(n^2)$ without resorting to outdated distributions. We derive new versions of the elitist Covariance Matrix Adaptation Evolution Strategy (CMA-ES) and the multi-objective CMA-ES. These algorithms are equivalent to the original procedures except that the update step for the variable metric distribution scales better in the problem dimension. We also introduce a simplified variant of the non-elitist CMA-ES with the incremental covariance matrix update and investigate its performance. Apart from the reduced time-complexity of the distribution update, the algebraic computations involved in all new algorithms are simpler compared to the original versions. The new update rule improves the performance of the CMA-ES for large scale machine learning problems in which the objective function can be evaluated fast

Deep Learning the Efficient Frontier of Convex Vector Optimization Problems

In this paper, we design a neural network architecture to approximate the weakly efficient frontier of convex vector optimization problems (CVOP) satisfying Slater's condition. The proposed machine learning methodology provides both an inner and outer approximation of the weakly efficient frontier, as well as an upper bound to the error at each approximated efficient point. In numerical case studies we demonstrate that the proposed algorithm is effectively able to approximate the true weakly efficient frontier of CVOPs. This remains true even for large problems (i.e., many objectives, variables, and constraints) and thus overcoming the curse of dimensionality

Approximation in Multiobjective Optimization with Applications

Over the last couple of decades, the field of multiobjective optimization has received much attention in solving real-life optimization problems in science, engineering, economics and other fields where optimal decisions need to be made in the presence of trade-offs between two or more conflicting objective functions. The conflicting nature of objective functions implies a solution set for a multiobjective optimization problem. Obtaining this set is difficult for many reasons, and a variety of approaches for approximating it either partially or entirely have been proposed. In response to the growing interest in approximation, this research investigates developing a theory and methodology for representing and approximating solution sets of multiobjective optimization problems. The concept of the tolerance function is proposed as a tool for modeling representation quality. Two types of subsets of the set being represented, covers and approximations, are defined, and their properties are examined. In addition, approximating the solution set of the multiobjective set covering problem (MOSCP), one of the challenging combinatorial optimization problems that has seen limited study, is investigated. Two algorithms are proposed for approximating the solution set of the MOSCP, and their approximation quality is derived. A heuristic algorithm is also proposed to approximate the solution set of the MOSCP. The performance of each algorithm is evaluated using test problems. Since the MOSCP has many real-life applications, and in particular designing reserve systems for ecological species is a common field for its applications, two optimization models are proposed in this dissertation for preserving reserve sites for species and their natural habitats