A simplex-like search method for bi-objective optimization

We describe a new algorithm for bi-objective optimization, similar to the Nelder Mead simplex algorithm, widely used for single objective optimization. For diferentiable bi-objective functions on a continuous search space, internal Pareto optima occur where the two gradient vectors point in opposite directions. So such optima may be located by minimizing the cosine of the angle between these vectors. This requires a complex rather than a simplex, so we term the technique the \cosine seeking complex". An extra beneft of this approach is that a successful search identifes the direction of the effcient curve of Pareto points, expediting further searches. Results are presented for some standard test functions. The method presented is quite complicated and space considerations here preclude complete details. We hope to publish a fuller description in another place

Curses, Tradeoffs, and Scalable Management:Advancing Evolutionary Multiobjective Direct Policy Search to Improve Water Reservoir Operations

Optimal management policies for water reservoir operation are generally designed via stochastic dynamic programming (SDP). Yet, the adoption of SDP in complex real-world problems is challenged by the three curses of dimensionality, modeling, and multiple objectives. These three curses considerably limit SDP’s practical application. Alternatively, this study focuses on the use of evolutionary multiobjective direct policy search (EMODPS), a simulation-based optimization approach that combines direct policy search, nonlinear approximating networks, and multiobjective evolutionary algorithms to design Pareto-approximate closed-loop operating policies for multipurpose water reservoirs. This analysis explores the technical and practical implications of using EMODPS through a careful diagnostic assessment of the effectiveness and reliability of the overall EMODPS solution design as well as of the resulting Pareto-approximate operating policies. The EMODPS approach is evaluated using the multipurpose Hoa Binh water reservoir in Vietnam, where water operators are seeking to balance the conflicting objectives of maximizing hydropower production and minimizing flood risks. A key choice in the EMODPS approach is the selection of alternative formulations for flexibly representing reservoir operating policies. This study distinguishes between the relative performance of two widely-used nonlinear approximating networks, namely artificial neural networks (ANNs) and radial basis functions (RBFs). The results show that RBF solutions are more effective than ANN ones in designing Pareto approximate policies for the Hoa Binh reservoir. Given the approximate nature of EMODPS, the diagnostic benchmarking uses SDP to evaluate the overall quality of the attained Pareto-approximate results. Although the Hoa Binh test case’s relative simplicity should maximize the potential value of SDP, the results demonstrate that EMODPS successfully dominates the solutions derived via SDP

Otimização multiobjetivo com estimação de distribuição guiada por tomada de decisão multicritério

Orientadores: Fernando José Von Zuben, Guilherme Palermo CoelhoDissertação (mestrado) - Universidade Estadual de Campinas, Faculdade de Engenharia Elétrica e de ComputaçãoResumo: Considerando as meta-heurísticas estado-da-arte para otimização multiobjetivo (MOO, do inglês Multi-Objective Optimization), como NSGA-II, NSGA-III, SPEA2 e SMS-EMOA, apenas um critério de preferência por vez é levado em conta para classificar soluções ao longo do processo de busca. Neste trabalho, alguns dos critérios de seleção adotados por esses algoritmos estado-da-arte, incluindo classe de não-dominância e contribuição para a métrica de hipervolume, são utilizados em conjunto por uma técnica de tomada de decisão multicritério (MCDM, do inglês Multi-Criteria Decision Making), mais especificamente o algoritmo TOPSIS (Technique for Order of Preference by Similarity to Ideal Solution), responsável por ordenar todas as soluções candidatas. O algoritmo TOPSIS permite o uso de abordagens baseadas em múltiplas preferências, ao invés de apenas uma como na maioria das técnicas híbridas de MOO e MCDM. Cada preferência é tratada como um critério com uma importância relativa determinada pelo tomador de decisão. Novas soluções candidatas são então amostradas por meio de um modelo de distribuição, neste caso uma mistura de Gaussianas, obtido a partir da lista ordenada de soluções candidatas produzida pelo TOPSIS. Essencialmente, um operador de roleta é utilizado para selecionar um par de soluções candidatas de acordo com o seu mérito relativo, adequadamente determinado pelo TOPSIS, e então uma novo par de soluções candidatas é gerado a partir de perturbações Gaussianas centradas nas correspondentes soluções candidatas escolhidas. O desvio padrão das funções Gaussianas é definido em função da distância das soluções no espaço de decisão. Também foram utilizados operadores para auxiliar a busca a atingir regiões potencialmente promissoras do espaço de busca que ainda não foram mapeadas pelo modelo de distribuição. Embora houvesse outras opções, optou-se por seguir a estrutura do algoritmo NSGA-II, também adotada no algoritmo NSGA-III, como base para o método aqui proposto, denominado MOMCEDA (Multi-Objective Multi-Criteria Estimation of Distribution Algorithm). Assim, os aspectos distintos da proposta, quando comparada com o NSGA-II e o NSGA-III, são a forma como a população de soluções candidatas é ordenada e a estratégia adotada para gerar novos indivíduos. Os resultados nos problemas de teste ZDT mostram claramente que nosso método é superior aos algoritmos NSGA- II e NSGA-III, e é competitivo com outras meta-heurísticas bem estabelecidas na literatura de otimização multiobjetivo, levando em conta as métricas de convergência, hipervolume e a medida IGDAbstract: Considering the state-of-the-art meta-heuristics for multi-objective optimization (MOO), such as NSGA-II, NSGA-III, SPEA2 and SMS-EMOA, only one preference criterion at a time is considered to properly rank candidate solutions along the search process. Here, some of the preference criteria adopted by those state-of-the-art algorithms, including non-dominance level and contribution to the hypervolume, are taken together as inputs to a multi-criteria decision making (MCDM) strategy, more specifically the Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS), responsible for sorting all candidate solutions. The TOPSIS algorithm allows the use of multiple preference based approaches, rather than focusing on a particular one like in most hybrid algorithms composed of MOO and MCDM techniques. Here, each preference is treated as a criterion with a relative relevance to the decision maker (DM). New candidate solutions are then generated using a distribution model, in our case a Gaussian mixture model, derived from the sorted list of candidate solutions produced by TOPSIS. Essentially, a roulette wheel is used to choose a pair of the current candidate solutions according to the relative quality, suitably determined by TOPSIS, and after that a new pair of candidate solutions is generated as Gaussian perturbations centered at the corresponding parent solutions. The standard deviation of the Gaussian functions is defined in terms of the parents distance in the decision space. We also adopt refreshing operators, aiming at reaching potentially promising regions of the search space not yet mapped by the distribution model. Though other choices could have been made, we decided to follow the structural conception of the NSGA-II algorithm, also adopted in the NSGA-III algorithm, as basis for our proposal, denoted by MOMCEDA (Multi-Objective Multi-Criteria Estimation of Distribution Algorithm). Therefore, the distinctive aspects, when compared to NSGA-II and NSGA-III, are the way the current population of candidate solutions is ranked and the strategy adopted to generate new individuals. The results on ZDT benchmarks show that our method is clearly superior to NSGA-II and NSGA-III, and is competitive with other wellestablished meta-heuristics for multi-objective optimization from the literature, considering convergence to the Pareto front, hypervolume and IGD as performance metricsMestradoEngenharia de ComputaçãoMestre em Engenharia Elétrica2016/21031-0FAPESPCAPE

Efficient multi-objective ranking and selection in the presence of uncertainty

We consider the problem of ranking and selection with multiple-objectives in the presence of uncertainty. Simulation optimisation offers great opportunities in the design and optimisation of complex systems. In the presence of multiple objectives there is usually no single solution that performs best on all the objectives. Instead, there are several Pareto-optimal (efficient) solutions with different trade-offs which cannot be improved in any objective without sacrificing performance in another objective. For the case where alternatives are evaluated on multiple stochastic criteria, and the performance of an alternative can only be estimated via simulation, we consider the problem of efficiently identifying the Pareto optimal designs out of a (small) given set of alternatives. We develop a simple myopic budget allocation algorithm and propose several variants for different settings. In particular, this myopic method only allocates one simulation sample to one alternative in each iteration. Empirical tests show that the proposed algorithm can significantly reduce the necessary simulation budget and perform better than some existing well known algorithms in certain settings

Multi-objective optimization of cellular fenestration by an evolutionary algorithm

This paper describes the multi-objective optimized design of fenestration that is based on the façade of the building being divided into a number of small regularly spaced cells. The minimization of energy use and capital cost by a multi-objective genetic algorithm was investigated for; two alternative problem encodings (bit-string and integer); the application of constraint functions to control the aspect ratio of the windows; and the seeding of the search with feasible design solutions. It is concluded that the optimization approach is able to find near locally Pareto optimal solutions that have innovative architectural forms. Confidence in the optimality of the solutions was gained through repeated trail optimizations and a local search and sensitivity analysis. It was also concluded that seeding the optimization with feasible solutions was important in obtaining the optimum solutions when the window aspect ratio was constrained