Global optimization and simulated annealing

In this paper we are concerned with global optimization, which can be defined as the problem of finding points on a bounded subset of Rn in which some real valued functionf assumes its optimal (i.e. maximal or minimal) value. We present a stochastic approach which is based on the simulated annealing algorithm. The approach closely follows the formulation of the simulated annealing algorithm as originally given for discrete optimization problems. The mathematic formulation is extended to continuous optimization problems and we prove asymptotic convergence to the set of global optima. Furthermore, we discuss an implementation of the algorithm and compare its performance with other well known algorithms. The performance evaluation is carried out for a standard set of test functions from the literature. Keywords: global optimization, continuous variables, simulated annealing

Generalized Simulated Annealing

We propose a new stochastic algorithm (generalized simulated annealing) for computationally finding the global minimum of a given (not necessarily convex) energy/cost function defined in a continuous D-dimensional space. This algorithm recovers, as particular cases, the so called classical ("Boltzmann machine") and fast ("Cauchy machine") simulated annealings, and can be quicker than both. Key-words: simulated annealing; nonconvex optimization; gradient descent; generalized statistical mechanics.Comment: 13 pages, latex, 4 figures available upon request with the authors

Some Experiments on Fitting of Gielis Curves by Simulated Annealing and Particle Swarm Methods of Global Optimization

In this paper an attempt has been made to fit the Gielis curves (modified by various functions) to simulated data. The estimation has been done by two methods - the Classical Simulated Annealing (CSA) and the Particle Swarm (PS) methods - of global optimization. The Repulsive Particle Swarm (RPS) optimization algorithm has been used. It has been found that both methods are quite successful in fitting the modified Gielis curves to the data. However, the lack of uniqueness of Gielis parameters to data (from which they are estimated) is corroborated. From a technical viewpoint, this exercise may be considered as an application of CSA and RPS to extremely nonlinear least-squares curve-fitting to data that may exhibit a large number of local optima.Gielis curves; superformula; nonlinear curve-fitting; Least squares; multi-modal; local optima; global optimization; simulated annealing; particle swarm; parameters estimation

Global optimization method for design problems

In structural design optimization method, numerical techniques are increasingly used. In typical structural optimization problems there may be many locally minimum configurations. For that reason, the application of a global method, which may escape from the locally minimum points, remains essential. In this paper, a new hybrid simulated annealing algorithm for global optimization with constraints is proposed. We have developed a new algorithm called Adaptive Simulated Annealing Penalty Simultaneous Perturbation Stochastic Approximation algorithm (ASAPSPSA) that uses Adaptive Simulated Annealing algorithm (ASA); ASA is a series of modifications done to the traditional simulated annealing algorithm that gives the global solution of an objective function. In addition, the stochastic method Simultaneous Perturbation Stochastic Approximation (SPSA) for solving unconstrained optimization problems is used to refine the solution. We also propose Penalty SPSA (PSPSA) for solving constrained optimization problems. The constraints are handled using exterior point penalty functions. The hybridization of both techniques ASA and PSPSA provides a powerful hybrid heuristic optimization method; the proposed method is applicable to any problem where the topology of the structure is not fixed; it is simple and capable of handling problems subject to any number of nonlinear constraints. Extensive tests on the ASAPSPSA as a global optimization method are presented; its performance as a viable optimization method is demonstrated by applying it first to a series of benchmark functions with 2 - 50 dimensions and then it is used in structural design to demonstrate its applicability and efficiency