Progressively interactive evolutionary multiobjective optimization

A complete optimization procedure for a multi-objective problem essentially comprises of search and decision making. Depending upon how the search and decision making task is integrated, algorithms can be classified into various categories. Following `a decision making after search' approach, which is common with evolutionary multi-objective optimization algorithms, requires to produce all the possible alternatives before a decision can be taken. This, with the intricacies involved in producing the entire Pareto-front, is not a wise approach for high objective problems. Rather, for such kind of problems, the most preferred point on the front should be the target. In this study we propose and evaluate algorithms where search and decision making tasks work in tandem and the most preferred solution is the outcome. For the two tasks to work simultaneously, an interaction of the decision maker with the algorithm is necessary, therefore, preference information from the decision maker is accepted periodically by the algorithm and progress towards the most preferred point is made. Two different progressively interactive procedures have been suggested in the dissertation which can be integrated with any existing evolutionary multi-objective optimization algorithm to improve its effectiveness in handling high objective problems by making it capable to accept preference information at the intermediate steps of the algorithm. A number of high objective un-constrained as well as constrained problems have been successfully solved using the procedures. One of the less explored and difficult domains, i.e., bilevel multiobjective optimization has also been targeted and a solution methodology has been proposed. Initially, the bilevel multi-objective optimization problem has been solved by developing a hybrid bilevel evolutionary multi-objective optimization algorithm. Thereafter, the progressively interactive procedure has been incorporated in the algorithm leading to an increased accuracy and savings in computational cost. The efficacy of using a progressively interactive approach for solving difficult multi-objective problems has, therefore, further been justifie

International Conference on Continuous Optimization (ICCOPT) 2019 Conference Book

The Sixth International Conference on Continuous Optimization took place on the campus of the Technical University of Berlin, August 3-8, 2019. The ICCOPT is a flagship conference of the Mathematical Optimization Society (MOS), organized every three years. ICCOPT 2019 was hosted by the Weierstrass Institute for Applied Analysis and Stochastics (WIAS) Berlin. It included a Summer School and a Conference with a series of plenary and semi-plenary talks, organized and contributed sessions, and poster sessions. This book comprises the full conference program. It contains, in particular, the scientific program in survey style as well as with all details, and information on the social program, the venue, special meetings, and more

Understanding Complexity in Multiobjective Optimization

This report documents the program and outcomes of the Dagstuhl Seminar 15031 Understanding Complexity in Multiobjective Optimization. This seminar carried on the series of four previous Dagstuhl Seminars (04461, 06501, 09041 and 12041) that were focused on Multiobjective Optimization, and strengthening the links between the Evolutionary Multiobjective Optimization (EMO) and Multiple Criteria Decision Making (MCDM) communities. The purpose of the seminar was to bring together researchers from the two communities to take part in a wide-ranging discussion about the different sources and impacts of complexity in multiobjective optimization. The outcome was a clarified viewpoint of complexity in the various facets of multiobjective optimization, leading to several research initiatives with innovative approaches for coping with complexity

Development of Methods for Solving Bilevel Optimization Problems

Bilevel optimization, also referred to as bilevel programming, involves solving an upper level problem subject to the optimality of a corresponding lower level problem. The upper and lower level problems are also referred to as the leader and follower problems, respectively. Both levels have their associated objective(s), variable(s) and constraint(s). Such problems model real-life scenarios of cases where the performance of an upper level authority is realizable/sustainable only if the corresponding lower level objective is optimum. A number of practical applications in the field of engineering, logistics, economics and transportation have inherent nested structure that are suited to this type of modelling. The range of applications as well as a rapid increase in the size and complexity of such problems has prompted active interest in the design of efficient algorithms for bilevel optimization. Bilevel optimization problems present a number of unique and interesting challenges to algorithm design. The nested nature of the problem requires optimization of a lower level problem to evaluate each upper level solution, which makes it computationally exorbitant. Theoretically, an upper level solution is considered valid/feasible only if the corresponding lower level variables are the true global optimum of the lower level problem. Global optimality can be reliably asserted in very limited cases, for example convex and linear problems. In deceptive cases, an inaccurate lower level optimum may result in an objective value better than true optimum at the upper level, which poses a severe challenge for ranking/selection strategies used within any optimization technique. In turn, this also makes the performance evaluation very difficult since the performance cannot be judged based on the objective values alone. While the area of bilevel (or more generally, multilevel) programming itself is not very new, most reports in this direction up until about a decade ago considered solving linear or at most quadratic problems at both levels. Correspondingly, the focus on was on development of exact methods to solve such problems. However, such methods typically require assumptions on mathematical properties, which may not always hold in practical applications. With increasing use of computer simulation-based evaluations in a number of disciplines in science and engineering, there is more need than ever to handle problems that are highly nonlinear or even black-box in nature. Metaheuristic algorithms, such as evolutionary algorithms are more suited to this emerging paradigm. The foray of evolutionary algorithms in bilevel programming is relatively recent and there remains scope of substantial development in the field in terms of addressing the aforementioned challenges. The work presented in this thesis is directed towards improving evolutionary techniques to enable them solve generic bilevel problems more accurately using lower number of function evaluations compared to the existing methods. Three key approaches are investigated towards accomplishing this: (a) e active hybridization of global and local search methods during dierent stages of the overall search; (b) use of surrogate models to guide the search using approximations in lieu of true function evaluations, and (c) use of a non-nested re-formulation of the problem. While most of the work is focused on single-objective problems, preliminary studies are also presented on multi-objective bilevel problems. The performance of the proposed approaches is evaluated on a comprehensive suite of mathematical test problems available in the literature, as well as some practical problems. The proposed approaches are observed to achieve a favourable balance between accuracy and computational expense for solving bilevel optimization problems, and thus exhibit suitability for use in real-life applications

SOLVING TWO-LEVEL OPTIMIZATION PROBLEMS WITH APPLICATIONS TO ROBUST DESIGN AND ENERGY MARKETS

This dissertation provides efficient techniques to solve two-level optimization problems. Three specific types of problems are considered. The first problem is robust optimization, which has direct applications to engineering design. Traditionally robust optimization problems have been solved using an inner-outer structure, which can be computationally expensive. This dissertation provides a method to decompose and solve this two-level structure using a modified Benders decomposition. This gradient-based technique is applicable to robust optimization problems with quasiconvex constraints and provides approximate solutions to problems with nonlinear constraints. The second types of two-level problems considered are mathematical and equilibrium programs with equilibrium constraints. Their two-level structure is simplified using Schur's decomposition and reformulation schemes for absolute value functions. The resulting formulations are applicable to game theory problems in operations research and economics. The third type of two-level problem studied is discretely-constrained mixed linear complementarity problems. These are first formulated into a two-level mathematical program with equilibrium constraints and then solved using the aforementioned technique for mathematical and equilibrium programs with equilibrium constraints. The techniques for all three problems help simplify the two-level structure into one level, which helps gain numerical and application insights. The computational effort for solving these problems is greatly reduced using the techniques in this dissertation. Finally, a host of numerical examples are presented to verify the approaches. Diverse applications to economics, operations research, and engineering design motivate the relevance of the novel methods developed in this dissertation

Metaheuristic and matheuristic approaches for multi-objective optimization problems in process engineering : application to the hydrogen supply chain design

Complex optimization problems are ubiquitous in Process Systems Engineering (PSE) and are generally solved by deterministic approaches. The treatment of real case studies usually involves mixed-integer variables, nonlinear functions, a large number of constraints, and several conflicting criteria to be optimized simultaneously, thus challenging the classical methods. The main motivation of this research is therefore to explore alternative solution methods for addressing these complex multiobjective optimization problems related to the PSE area, focusing on the recent advances in Evolutionary Computation. If multiobjective evolutionary algorithms (MOEAs) have proven to be robust for the solution of multiobjective problems, their performance yet strongly depends on the constraint-handling techniques for the solution of highly constrained problems. The core of innovation of this research is the adaptation of metaheuristic-based tools to this class of PSE problems. For this purpose, a two-stage strategy was developed. First, an empirical study was performed in the perspective of comparing different algorithmic configurations and selecting the best to provide a high-quality approximation of the Pareto front. This study, comprising both academic test problems and several PSE applications, demonstrated that a method using the gradient-based mechanism to repair infeasible solutions consistently obtains the best results, in particular for handling equality constraints. Capitalizing on the experience from this preliminary numerical investigation, a novel matheuristic solution strategy was then developed and adapted to the problem of Hydrogen Supply Chain (HSC) design that encompasses the aforementioned numerical difficulties, considering both economic and environmental criteria. A MOEA based on decomposition combined with the gradient-based repair was first explored as a solution technique. However, due to the important number of mass balances (equality constraints), this approach showed a poor convergence to the optimal Pareto front. Therefore, a novel matheuristic was developed and adapted to this problem, following a bilevel decomposition: the upper level (discrete) addresses the HSC structure design problem (facility sizing and location), whereas the lower level (Linear Programming problem) solves the corresponding operation subproblem (production and transportation). This strategy allows the development of an ad-hoc matheuristic solution technique, through the hybridization of a MOEA (upper level) with a LP solver (lower level) using a scalarizing function to deal with the two objectives considered. The numerical results obtained for the Occitanie region case study highlight that the hybrid approach produces an accurate approximation of the optimal Pareto front, more efficiently than exact solution methods. Finally, the matheuristic allowed studying the HSC design problem with more realistic assumptions regarding the technologies used for hydrogen synthesis, the learning rates capturing the increasing maturity of these technologies over time and nonlinear relationships for the computation of Capital and Operational Expenditures (CAPEX and OPEX) for the hydrogen production facilities. The resulting novel model, with a non-convex, bi-objective mixed-integer nonlinear programming (MINLP) formulation, can be efficiently solved through minor modifications in the hybrid algorithm proposed earlier, which finds its mere justification in the determination of the timewise deployment of sustainable hydrogen supply chains