A clustering particle swarm optimizer for locating and tracking multiple optima in dynamic environments

This article is posted here with permission from the IEEE - Copyright @ 2010 IEEEIn the real world, many optimization problems are dynamic. This requires an optimization algorithm to not only find the global optimal solution under a specific environment but also to track the trajectory of the changing optima over dynamic environments. To address this requirement, this paper investigates a clustering particle swarm optimizer (PSO) for dynamic optimization problems. This algorithm employs a hierarchical clustering method to locate and track multiple peaks. A fast local search method is also introduced to search optimal solutions in a promising subregion found by the clustering method. Experimental study is conducted based on the moving peaks benchmark to test the performance of the clustering PSO in comparison with several state-of-the-art algorithms from the literature. The experimental results show the efficiency of the clustering PSO for locating and tracking multiple optima in dynamic environments in comparison with other particle swarm optimization models based on the multiswarm method.This work was supported by the Engineering and Physical Sciences Research Council of U.K., under Grant EP/E060722/1

A memetic algorithm with adaptive hill climbing strategy for dynamic optimization problems

Copyright @ Springer-Verlag 2008Dynamic optimization problems challenge traditional evolutionary algorithms seriously since they, once converged, cannot adapt quickly to environmental changes. This paper investigates the application of memetic algorithms, a class of hybrid evolutionary algorithms, for dynamic optimization problems. An adaptive hill climbing method is proposed as the local search technique in the framework of memetic algorithms, which combines the features of greedy crossover-based hill climbing and steepest mutation-based hill climbing. In order to address the convergence problem, two diversity maintaining methods, called adaptive dual mapping and triggered random immigrants, respectively, are also introduced into the proposed memetic algorithm for dynamic optimization problems. Based on a series of dynamic problems generated from several stationary benchmark problems, experiments are carried out to investigate the performance of the proposed memetic algorithm in comparison with some peer evolutionary algorithms. The experimental results show the efficiency of the proposed memetic algorithm in dynamic environments.This work was supported by the National Nature Science Foundation of China (NSFC) under Grant Nos. 70431003 and 70671020, the National Innovation Research Community Science Foundation of China under Grant No. 60521003, and the National Support Plan of China under Grant No. 2006BAH02A09 and the Engineering and Physical Sciences Research Council (EPSRC) of UK under Grant EP/E060722/01

A general framework of multi-population methods with clustering in undetectable dynamic environments

Copyright @ 2011 IEEETo solve dynamic optimization problems, multiple population methods are used to enhance the population diversity for an algorithm with the aim of maintaining multiple populations in different sub-areas in the fitness landscape. Many experimental studies have shown that locating and tracking multiple relatively good optima rather than a single global optimum is an effective idea in dynamic environments. However, several challenges need to be addressed when multi-population methods are applied, e.g., how to create multiple populations, how to maintain them in different sub-areas, and how to deal with the situation where changes can not be detected or predicted. To address these issues, this paper investigates a hierarchical clustering method to locate and track multiple optima for dynamic optimization problems. To deal with undetectable dynamic environments, this paper applies the random immigrants method without change detection based on a mechanism that can automatically reduce redundant individuals in the search space throughout the run. These methods are implemented into several research areas, including particle swarm optimization, genetic algorithm, and differential evolution. An experimental study is conducted based on the moving peaks benchmark to test the performance with several other algorithms from the literature. The experimental results show the efficiency of the clustering method for locating and tracking multiple optima in comparison with other algorithms based on multi-population methods on the moving peaks benchmark

Moving Horizon Estimation with Dynamic Programming

Moving Horizon Estimation(MHE) is a optimization based strategy to state estimation. It involves computation of arrival cost, a penalty term, based on the MHE cost function. Minimization of this arrival cost is done through various methods. All these methods use nonlinear programming optimization technique which gives the estimate. The main idea of MHE revolves around minimizing the estimation cost function. The cost function is dependent on prediction error computation from data and arrival cost summarization. The major issue that hampers the MHE is choosing the arrival cost for ensuring stability of the overall estimation and computational time. In order to attain this stability, this thesis incorporates dynamic programming algorithm to estimate MHE cost function. Dynamic programming is an algorithm for solving complex problems. The MHE cost function algorithm has been modied based on dynamic programming algorithm in order to ensure stability of the overall estimation. In order to apply this algorithm, a specic non-linear lter, particle lter is used for the initialization of MHE. The reason of using particle lter for initialization of MHE is due to fact that dynamic programming algorithm works on principle of samples and particle lter provides the samples. A comparison of mean squared error(MSE) using the nonlinear programming optimization and dynamic programming optimization is veried for the proposed theory of using dynamic programming algorithm in estimation of cost functio

A Novel Adaptive Spiral Dynamic Algorithm for Global Optimization

This paper presents a novel adaptive spiral dynamic algorithm for global optimization. Through a spiral model, spiral dynamic algorithm has a balanced exploration and exploitation strategy. Defining suitable value for the radius and displacement in its spiral model may lead the algorithm to converge with high speed. The dynamic step size produced by the model also allows the algorithm to avoid oscillation around the optimum point. However, for high dimension problems, the algorithm may easily get trapped into local optima. This is due to the incorporation of a constant radius and displacement in the model. In order to solve the problem, a novel adaptive formulation is proposed in this paper by varying the radius and displacement of the spiral model. The proposed algorithm is validated with various dimensions of unimodal and multimodal benchmark functions. Furthermore, it is applied to parameter optimization of an autoregressive with exogenous terms dynamic model of a flexible manipulator system. Comparison with the original spiral dynamic algorithm shows that the proposed algorithm has better accuracy. Moreover, the time domain and frequency domain responses of the flexible manipulator model shows that the proposed algorithm outperforms its predecessor algorithm

Moving Horizon Estimation with Dynamic Programming

Moving Horizon Estimation(MHE) is a optimization based strategy to state estimation. It involves computation of arrival cost, a penalty term, based on the MHE cost function. Minimization of this arrival cost is done through various methods. All these methods use nonlinear programming optimization technique which gives the estimate. The main idea of MHE revolves around minimizing the estimation cost function. The cost function is dependent on prediction error computation from data and arrival cost summarization. The major issue that hampers the MHE is choosing the arrival cost for ensuring stability of the overall estimation and computational time. In order to attain this stability, this thesis incorporates dynamic programming algorithm to estimate MHE cost function. Dynamic programming is an algorithm for solving complex problems. The MHE cost function algorithm has been modied based on dynamic programming algorithm in order to ensure stability of the overall estimation. In order to apply this algorithm, a specic non-linear lter, particle lter is used for the initialization of MHE. The reason of using particle lter for initialization of MHE is due to fact that dynamic programming algorithm works on principle of samples and particle lter provides the samples. A comparison of mean squared error(MSE) using the nonlinear programming optimization and dynamic programming optimization is veried for the proposed theory of using dynamic programming algorithm in estimation of cost functio

A Graphical Algorithm for Solving an Investment Optimization Problem

http://www.math.uni-magdeburg.de/~werner/pr-mi-13.pdfInternational audienceIn this paper, a graphical algorithm (GrA) is presented for an investment optimization problem. This algorithm is based on the same Bellman equations as the best known dynamic programming algorithm (DPA) for the problem but the GrA has several advantages in comparison with the DPA. Based on this GrA, a fully-polynomial time approximation scheme is proposed having the best known running time. The idea of the GrA presented can also be used to solve some similar scheduling or lot-sizing problems in a more e ffective wa

Generating Preview Tables for Entity Graphs

Users are tapping into massive, heterogeneous entity graphs for many applications. It is challenging to select entity graphs for a particular need, given abundant datasets from many sources and the oftentimes scarce information for them. We propose methods to produce preview tables for compact presentation of important entity types and relationships in entity graphs. The preview tables assist users in attaining a quick and rough preview of the data. They can be shown in a limited display space for a user to browse and explore, before she decides to spend time and resources to fetch and investigate the complete dataset. We formulate several optimization problems that look for previews with the highest scores according to intuitive goodness measures, under various constraints on preview size and distance between preview tables. The optimization problem under distance constraint is NP-hard. We design a dynamic-programming algorithm and an Apriori-style algorithm for finding optimal previews. Results from experiments, comparison with related work and user studies demonstrated the scoring measures' accuracy and the discovery algorithms' efficiency.Comment: This is the camera-ready version of a SIGMOD16 paper. There might be tiny differences in layout, spacing and linebreaking, compared with the version in the SIGMOD16 proceedings, since we must submit TeX files and use arXiv to compile the file

A dynamic programming approach for generalized nearly isotonic optimization

Shape restricted statistical estimation problems have been extensively studied, with many important practical applications in signal processing, bioinformatics, and machine learning. In this paper, we propose and study a generalized nearly isotonic optimization (GNIO) model, which recovers, as special cases, many classic problems in shape constrained statistical regression, such as isotonic regression, nearly isotonic regression and unimodal regression problems. We develop an efficient and easy-to-implement dynamic programming algorithm for solving the proposed model whose recursion nature is carefully uncovered and exploited. For special $\ell_2$-GNIO problems, implementation details and the optimal ${\cal O}(n)$ running time analysis of our algorithm are discussed. Numerical experiments, including the comparison between our approach and the powerful commercial solver Gurobi for solving $\ell_1$-GNIO and $\ell_2$-GNIO problems, on both simulated and real data sets are presented to demonstrate the high efficiency and robustness of our proposed algorithm in solving large scale GNIO problems