Solving the G-problems in less than 500 iterations: Improved efficient constrained optimization by surrogate modeling and adaptive parameter control

Constrained optimization of high-dimensional numerical problems plays an important role in many scientific and industrial applications. Function evaluations in many industrial applications are severely limited and no analytical information about objective function and constraint functions is available. For such expensive black-box optimization tasks, the constraint optimization algorithm COBRA was proposed, making use of RBF surrogate modeling for both the objective and the constraint functions. COBRA has shown remarkable success in solving reliably complex benchmark problems in less than 500 function evaluations. Unfortunately, COBRA requires careful adjustment of parameters in order to do so. In this work we present a new self-adjusting algorithm SACOBRA, which is based on COBRA and capable to achieve high-quality results with very few function evaluations and no parameter tuning. It is shown with the help of performance profiles on a set of benchmark problems (G-problems, MOPTA08) that SACOBRA consistently outperforms any COBRA algorithm with fixed parameter setting. We analyze the importance of the several new elements in SACOBRA and find that each element of SACOBRA plays a role to boost up the overall optimization performance. We discuss the reasons behind and get in this way a better understanding of high-quality RBF surrogate modeling

A modified differential evolution based solution technique for economic dispatch problems

Economic dispatch (ED) plays one of the major roles in power generation systems. The objective of economic dispatch problem is to find the optimal combination of power dispatches from different power generating units in a given time period to minimize the total generation cost while satisfying the specified constraints. Due to valve-point loading effects the objective function becomes nondifferentiable and has many local minima in the solution space. Traditional methods may fail to reach the global solution of ED problems. Most of the existing stochastic methods try to make the solution feasible or penalize an infeasible solution with penalty function method. However, to find the appropriate penalty parameter is not an easy task. Differential evolution is a population-based heuristic approach that has been shown to be very efficient to solve global optimization problems with simple bounds. In this paper, we propose a modified differential evolution based solution technique along with a tournament selection that makes pair-wise comparison among feasible and infeasible solutions based on the degree of constraint violation for economic dispatch problems. We reformulate the nonsmooth objective function to a smooth one and add nonlinear inequality constraints to original ED problems. We consider five ED problems and compare the obtained results with existing standard deterministic NLP solvers as well as with other stochastic techniques available in literature.Fundação para a Ciência e a Tecnologia (FCT

On Challenging Techniques for Constrained Global Optimization

This chapter aims to address the challenging and demanding issue of solving a continuous nonlinear constrained global optimization problem. We propose four stochastic methods that rely on a population of points to diversify the search for a global solution: genetic algorithm, differential evolution, artificial fish swarm algorithm and electromagnetism-like mechanism. The performance of different variants of these algorithms is analyzed using a benchmark set of problems. Three different strategies to handle the equality and inequality constraints of the problem are addressed. An augmented Lagrangian-based technique, the tournament selection based on feasibility and dominance rules, and a strategy based on ranking objective and constraint violation are presented and tested. Numerical experiments are reported showing the effectiveness of our suggestions. Two well-known engineering design problems are successfully solved by the proposed methods. © Springer-Verlag Berlin Heidelberg 2013.Fundação para a Ciência e a Tecnologia (Foundation for Science and Technology), Portugal for the financial support under fellowship grant: C2007-UMINHO-ALGORITMI-04. The other authors acknowledge FEDER COMPETE, Programa Operacional Fatores de Competitividade (Operational Programme Thematic Factors of Competitiveness) and FCT for the financial support under project grant: FCOMP-01-0124-FEDER-022674info:eu-repo/semantics/publishedVersio

A new hybrid evolutionary algorithm for the treatment of equality constrained MOPs

Multi-objective evolutionary algorithms are widely used by researchers and practitioners to solve multi-objective optimization problems (MOPs), since they require minimal assumptions and are capable of computing a finite size approximation of the entire solution set in one run of the algorithm. So far, however, the adequate treatment of equality constraints has played a minor role. Equality constraints are particular since they typically reduce the dimension of the search space, which causes problems for stochastic search algorithms such as evolutionary strategies. In this paper, we show that multi-objective evolutionary algorithms hybridized with continuation-like techniques lead to fast and reliable numerical solvers. For this, we first propose three new problems with different characteristics that are indeed hard to solve by evolutionary algorithms. Next, we develop a variant of NSGA-II with a continuation method. We present numerical results on several equality-constrained MOPs to show that the resulting method is highly competitive to state-of-the-art evolutionary algorithms.Peer ReviewedPostprint (published version

Investigating evolutionary computation with smart mutation for three types of Economic Load Dispatch optimisation problem

The Economic Load Dispatch (ELD) problem is an optimisation task concerned with how electricity generating stations can meet their customers’ demands while minimising under/over-generation, and minimising the operational costs of running the generating units. In the conventional or Static Economic Load Dispatch (SELD), an optimal solution is sought in terms of how much power to produce from each of the individual generating units at the power station, while meeting (predicted) customers’ load demands. With the inclusion of a more realistic dynamic view of demand over time and associated constraints, the Dynamic Economic Load Dispatch (DELD) problem is an extension of the SELD, and aims at determining the optimal power generation schedule on a regular basis, revising the power system configuration (subject to constraints) at intervals during the day as demand patterns change. Both the SELD and DELD have been investigated in the recent literature with modern heuristic optimisation approaches providing excellent results in comparison with classical techniques. However, these problems are defined under the assumption of a regulated electricity market, where utilities tend to share their generating resources so as to minimise the total cost of supplying the demanded load. Currently, the electricity distribution scene is progressing towards a restructured, liberalised and competitive market. In this market the utility companies are privatised, and naturally compete with each other to increase their profits, while they also engage in bidding transactions with their customers. This formulation is referred to as: Bid-Based Dynamic Economic Load Dispatch (BBDELD). This thesis proposes a Smart Evolutionary Algorithm (SEA), which combines a standard evolutionary algorithm with a “smart mutation” approach. The so-called ‘smart’ mutation operator focuses mutation on genes contributing most to costs and penalty violations, while obeying operational constraints. We develop specialised versions of SEA for each of the SELD, DELD and BBDELD problems, and show that this approach is superior to previously published approaches in each case. The thesis also applies the approach to a new case study relevant to Nigerian electricity deregulation. Results on this case study indicate that our SEA is able to deal with larger scale energy optimisation tasks