Evolutionary Synthesis of Analog Electronic Circuits Using EDA Algorithms

Disertační práce je zaměřena na návrh analogových elektronických obvodů pomocí algoritmů s pravěpodobnostními modely (algoritmy EDA). Prezentované metody jsou na základě požadovaných charakteristik cílových obvodů schopny navrhnout jak parametry použitých komponent tak také jejich topologii zapojení. Tři různé metody využití EDA algoritmů jsou navrženy a otestovány na příkladech skutečných problémů z oblasti analogových elektronických obvodů. První metoda je určena pro návrh pasivních analogových obvodů a využívá algoritmus UMDA pro návrh jak topologie zapojení tak také hodnot parametrů použitých komponent. Metoda je použita pro návrh admitanční sítě s požadovanou vstupní impedancí pro účely chaotického oscilátoru. Druhá metoda je také určena pro návrh pasivních analogových obvodů a využívá hybridní přístup - UMDA pro návrh topologie a metodu lokální optimalizace pro návrh parametrů komponent. Třetí metoda umožňuje návrh analogových obvodů obsahujících také tranzistory. Metoda využívá hybridní přístup - EDA algoritmus pro syntézu topologie a metoda lokální optimalizace pro určení parametrů použitých komponent. Informace o topologii je v jednotlivých jedincích populace vyjádřena pomocí grafů a hypergrafů.Dissertation thesis is focused on design of analog electronic circuits using Estimation of Distribution Algorithms (EDA). Based on the desired characteristics of the target circuits the proposed methods are able to design the parameters of the used components and theirs topology of connection as well. Three different methods employing EDA algorithms are proposed and verified on examples of real problems from the area of analog circuits design. The first method is capable to design passive analog circuits. The method employs UMDA algorithm which is used for determination of the parameters of the used components and synthesis of the topology of their connection as well. The method is verified on the problem of design of admittance network with desired input impedance function which is used as a part of chaotic oscillator circuit. The second method is also capable to design passive analog circuits. The method employs hybrid approach - UMDA for synthesis of the topology and local optimization method for determination of the parameters of the components. The third method is capable to design analog circuits which include also ac- tive components such as transistors. Hybrid approach is used. The topology is synthesized using EDA algorithm and the parameters are determined using a local optimization method. In the individuals of the population information about the topology is represented using graphs and hypergraphs.

Sub-structural Niching in Estimation of Distribution Algorithms

We propose a sub-structural niching method that fully exploits the problem decomposition capability of linkage-learning methods such as the estimation of distribution algorithms and concentrate on maintaining diversity at the sub-structural level. The proposed method consists of three key components: (1) Problem decomposition and sub-structure identification, (2) sub-structure fitness estimation, and (3) sub-structural niche preservation. The sub-structural niching method is compared to restricted tournament selection (RTS)--a niching method used in hierarchical Bayesian optimization algorithm--with special emphasis on sustained preservation of multiple global solutions of a class of boundedly-difficult, additively-separable multimodal problems. The results show that sub-structural niching successfully maintains multiple global optima over large number of generations and does so with significantly less population than RTS. Additionally, the market share of each of the niche is much closer to the expected level in sub-structural niching when compared to RTS

Transmission function models of infinite population genetic algorithms

The so-called transmission function framework is described, and implementations of transmission function models are given for a broad range of genetic algorithms. These models describe GA's with a population of infinite size. An actual implementation of these models for a non-trivial problem involving deception is given, these models are traced, and the results are visualized by means of population flow diagrams. These diagrams show that cross-competition between different parts of the optimal solution takes place

State Aggregation and Population Dynamics in Linear Systems

We consider complex systems that are composed of many interacting elements, evolving under some dynamics. We are interested in characterizing the ways in which these elements may be grouped into higher-level, macroscopic states in a way that is compatible with those dynamics. Such groupings may then be thought of as naturally emergent properties of the system. We formalize this idea and, in the case that the dynamics are linear, prove necessary and sufficient conditions for this to happen. In cases where there is an underlying symmetry among the components of the system, group theory may be used to provide a strong sufficient condition. These observations are illustrated with some artificial life examples

A Kullback-Leibler Divergence Exploration into a Look-Ahead Simulation Optimization of the Extended Compact Genetic Algorithm

The Kullback-Leibler Divergence of gene distributions between successive generations of the Extended Compact Genetic Algorithm (ECGA) is explored. Therein, the fragility of the algorithm’s dependability to the beginning generations’ biasing is suggested. A novel approach within the scope of the ECGA for choosing a better bias by allowing the ECGA to simulate itself is presented. It is shown that, by simulating itself, the ECGA is able to use a smaller population and evaluate fewer fitness calls while maintaining the same ability to find optimal solutions

A probabilistic cooperative-competitive hierarchical search model.

by Wong Yin Bun, Terence.Thesis (M.Phil.)--Chinese University of Hong Kong, 1998.Includes bibliographical references (leaves 99-104).Abstract also in Chinese.List of Figures --- p.ixList of Tables --- p.xiChapter I --- Preliminary --- p.1Chapter 1 --- Introduction --- p.2Chapter 1.1 --- Thesis themes --- p.4Chapter 1.1.1 --- Dynamical view of landscape --- p.4Chapter 1.1.2 --- Bottom-up self-feedback algorithm with memory --- p.4Chapter 1.1.3 --- Cooperation and competition --- p.5Chapter 1.1.4 --- Contributions to genetic algorithms --- p.5Chapter 1.2 --- Thesis outline --- p.5Chapter 1.3 --- Contribution at a glance --- p.6Chapter 1.3.1 --- Problem --- p.6Chapter 1.3.2 --- Approach --- p.7Chapter 1.3.3 --- Contributions --- p.7Chapter 2 --- Background --- p.8Chapter 2.1 --- Iterative stochastic searching algorithms --- p.8Chapter 2.1.1 --- The algorithm --- p.8Chapter 2.1.2 --- Stochasticity --- p.10Chapter 2.2 --- Fitness landscapes and its relation to neighborhood --- p.12Chapter 2.2.1 --- Direct searching --- p.12Chapter 2.2.2 --- Exploration and exploitation --- p.12Chapter 2.2.3 --- Fitness landscapes --- p.13Chapter 2.2.4 --- Neighborhood --- p.16Chapter 2.3 --- Species formation methods --- p.17Chapter 2.3.1 --- Crowding methods --- p.17Chapter 2.3.2 --- Deterministic crowding --- p.18Chapter 2.3.3 --- Sharing method --- p.18Chapter 2.3.4 --- Dynamic niching --- p.19Chapter 2.4 --- Summary --- p.21Chapter II --- Probabilistic Binary Hierarchical Search --- p.22Chapter 3 --- The basic algorithm --- p.23Chapter 3.1 --- Introduction --- p.23Chapter 3.2 --- Search space reduction with binary hierarchy --- p.25Chapter 3.3 --- Search space modeling --- p.26Chapter 3.4 --- The information processing cycle --- p.29Chapter 3.4.1 --- Local searching agents --- p.29Chapter 3.4.2 --- Global environment --- p.30Chapter 3.4.3 --- Cooperative refinement and feedback --- p.33Chapter 3.5 --- Enhancement features --- p.34Chapter 3.5.1 --- Fitness scaling --- p.34Chapter 3.5.2 --- Elitism --- p.35Chapter 3.6 --- Illustration of the algorithm behavior --- p.36Chapter 3.6.1 --- Test problem --- p.36Chapter 3.6.2 --- Performance study --- p.38Chapter 3.6.3 --- Benchmark tests --- p.45Chapter 3.7 --- Discussion and analysis --- p.45Chapter 3.7.1 --- Hierarchy of partitions --- p.45Chapter 3.7.2 --- Availability of global information --- p.47Chapter 3.7.3 --- Adaptation --- p.47Chapter 3.8 --- Summary --- p.48Chapter III --- Cooperation and Competition --- p.50Chapter 4 --- High-dimensionality --- p.51Chapter 4.1 --- Introduction --- p.51Chapter 4.1.1 --- The challenge of high-dimensionality --- p.51Chapter 4.1.2 --- Cooperation - A solution to high-dimensionality --- p.52Chapter 4.2 --- Probabilistic Cooperative Binary Hierarchical Search --- p.52Chapter 4.2.1 --- Decoupling --- p.52Chapter 4.2.2 --- Cooperative fitness --- p.53Chapter 4.2.3 --- The cooperative model --- p.54Chapter 4.3 --- Empirical performance study --- p.56Chapter 4.3.1 --- pBHS versus pcBHS --- p.56Chapter 4.3.2 --- Scaling behavior of pcBHS --- p.60Chapter 4.3.3 --- Benchmark test --- p.62Chapter 4.4 --- Summary --- p.63Chapter 5 --- Deception --- p.65Chapter 5.1 --- Introduction --- p.65Chapter 5.1.1 --- The challenge of deceptiveness --- p.65Chapter 5.1.2 --- Competition: A solution to deception --- p.67Chapter 5.2 --- Probabilistic cooperative-competitive binary hierarchical search --- p.67Chapter 5.2.1 --- Overview --- p.68Chapter 5.2.2 --- The cooperative-competitive model --- p.68Chapter 5.3 --- Empirical performance study --- p.70Chapter 5.3.1 --- Goldberg's deceptive function --- p.70Chapter 5.3.2 --- "Shekel family - S5, S7, and S10" --- p.73Chapter 5.4 --- Summary --- p.74Chapter IV --- Finale --- p.78Chapter 6 --- A new genetic operator --- p.79Chapter 6.1 --- Introduction --- p.79Chapter 6.2 --- Variants of the integration --- p.80Chapter 6.2.1 --- Fixed-fraction-of-all --- p.83Chapter 6.2.2 --- Fixed-fraction-of-best --- p.83Chapter 6.2.3 --- Best-from-both --- p.84Chapter 6.3 --- Empricial performance study --- p.84Chapter 6.4 --- Summary --- p.88Chapter 7 --- Conclusion and Future work --- p.89Chapter A --- The pBHS Algorithm --- p.91Chapter A.1 --- Overview --- p.91Chapter A.2 --- Details --- p.91Chapter B --- Test problems --- p.96Bibliography --- p.9