Adaptive hybrid optimization strategy for calibration and parameter estimation of physical models

A new adaptive hybrid optimization strategy, entitled squads, is proposed for complex inverse analysis of computationally intensive physical models. The new strategy is designed to be computationally efficient and robust in identification of the global optimum (e.g. maximum or minimum value of an objective function). It integrates a global Adaptive Particle Swarm Optimization (APSO) strategy with a local Levenberg-Marquardt (LM) optimization strategy using adaptive rules based on runtime performance. The global strategy optimizes the location of a set of solutions (particles) in the parameter space. The LM strategy is applied only to a subset of the particles at different stages of the optimization based on the adaptive rules. After the LM adjustment of the subset of particle positions, the updated particles are returned to the APSO strategy. The advantages of coupling APSO and LM in the manner implemented in squads is demonstrated by comparisons of squads performance against Levenberg-Marquardt (LM), Particle Swarm Optimization (PSO), Adaptive Particle Swarm Optimization (APSO; the TRIBES strategy), and an existing hybrid optimization strategy (hPSO). All the strategies are tested on 2D, 5D and 10D Rosenbrock and Griewank polynomial test functions and a synthetic hydrogeologic application to identify the source of a contaminant plume in an aquifer. Tests are performed using a series of runs with random initial guesses for the estimated (function/model) parameters. Squads is observed to have the best performance when both robustness and efficiency are taken into consideration than the other strategies for all test functions and the hydrogeologic application

Extended two-stage adaptive designswith three target responses forphase II clinical trials

We develop a nature-inspired stochastic population-based algorithm and call it discrete particle swarm optimization tofind extended two-stage adaptive optimal designs that allow three target response rates for the drug in a phase II trial.Our proposed designs include the celebrated Simon’s two-stage design and its extension that allows two target responserates to be specified for the drug. We show that discrete particle swarm optimization not only frequently outperformsgreedy algorithms, which are currently used to find such designs when there are only a few parameters; it is also capableof solving design problems posed here with more parameters that greedy algorithms cannot solve. In stage 1 of ourproposed designs, futility is quickly assessed and if there are sufficient responders to move to stage 2, one tests one ofthe three target response rates of the drug, subject to various user-specified testing error rates. Our designs aretherefore more flexible and interestingly, do not necessarily require larger expected sample size requirements thantwo-stage adaptive designs. Using a real adaptive trial for melanoma patients, we show our proposed design requires onehalf fewer subjects than the implemented design in the study

Adaptive Parameters for a Modified Comprehensive Learning Particle Swarm Optimizer

Particle swarm optimization (PSO) is a stochastic optimization method sensitive to parameter settings. The paper presents a modification on the comprehensive learning particle swarm optimizer (CLPSO), which is one of the best performing PSO algorithms. The proposed method introduces a self-adaptive mechanism that dynamically changes the values of key parameters including inertia weight and acceleration coefficient based on evolutionary information of individual particles and the swarm during the search. Numerical experiments demonstrate that our approach with adaptive parameters can provide comparable improvement in performance of solving global optimization problems

Multi-Objective Solution Based on Various Particle Swarm Optimization Techniques in Power Systems

A proposed optimization technique based on fuzzy logic and particle swarm is presented in this paper. This technique is referred to as Fuzzy Adaptive Particle Swarm Optimization (FAPSO). In this technique, the fuzzy logic is employed to adjust the parameters of the particle swarm. The proposed technique is applied to the IEEE-30-bus-system model along with previous optimization methods to obtain a multiobjective solution to the voltage control, the voltage deviation, and the real power loss problems in power systems. The multi-objective problem is subjected to the same constraints for all methods and a comparison between the results obtained by various methods is presented. It has been demonstrated that the results of the proposed technique superseded that of all previous optimization technique methods

Adaptive particle swarm optimization

An adaptive particle swarm optimization (APSO) that features better search efficiency than classical particle swarm optimization (PSO) is presented. More importantly, it can perform a global search over the entire search space with faster convergence speed. The APSO consists of two main steps. First, by evaluating the population distribution and particle fitness, a real-time evolutionary state estimation procedure is performed to identify one of the following four defined evolutionary states, including exploration, exploitation, convergence, and jumping out in each generation. It enables the automatic control of inertia weight, acceleration coefficients, and other algorithmic parameters at run time to improve the search efficiency and convergence speed. Then, an elitist learning strategy is performed when the evolutionary state is classified as convergence state. The strategy will act on the globally best particle to jump out of the likely local optima. The APSO has comprehensively been evaluated on 12 unimodal and multimodal benchmark functions. The effects of parameter adaptation and elitist learning will be studied. Results show that APSO substantially enhances the performance of the PSO paradigm in terms of convergence speed, global optimality, solution accuracy, and algorithm reliability. As APSO introduces two new parameters to the PSO paradigm only, it does not introduce an additional design or implementation complexity

Adaptive optimal digital PID controller

Abstract: It is necessary to change the parameters of PID controller if the parameters of plants change or there are disturbances. Particle swarm optimization algorithm is a powerful optimization algorithm to find the global optimal values in the problem space. In this paper, the particle swarm optimization algorithm is used to identify the model of the plant and the parameter of digital PID controller online. The model of the plant is identified online according to the absolute error of the real system output and the identified model output. The digital PID parameters are tuned based on the identified model and they are adaptive if the model is changed. Simulations are done to validate the proposed method comparing with the classical PID controller.Originally presented at 2014 International Conference on Mechatronics, Automation and Manufacturing (ICMAM 2014), Beijing, October 24-26, 2014

Optimizing Laying Hen Diet using Multi-Swarm Particle Swarm Optimization

Formulating animal diet by accounting fluctuating cost, nutrient requirement, balanced amino acids, and maximum composition simultaneously is a difficult and complex task. Manual formulation and Linear Programming encounter difficulty to solve this problem. Furthermore, the complexity of laying hen diet problem is change through ingredient choices. Thus, an advanced technique to enhance formula quality is a vital necessity. This paper proposes the Multi-Swarm Particle Swarm Optimization (MSPSO) to enhance the diversity of particles and prevent premature convergence in PSO. MSPSO work cooperatively and competitively to optimize laying hen diet and produce improved and stable formula than Genetic Algorithm, Hybridization of Adaptive Genetic Algorithm and Simulated Annealing, and Standard Particle Swarm Optimization with less time complexity. In addition, swarm size, iteration, and inertia weight parameters are investigated and show that swarm size of 50 for each sub-swarm, total iteration of 16,000, and inertia weight of 6.0 should be used as a good parameter for MSPSO to optimize laying hen diet