Applications of swarm, evolutionary and quantum algorithms in system identification and digital filter design

The thesis focuses on the application of computational intelligence (CI) techniques for two problems - system identification and digital filter design. In system identification, different case studies have been carried out with equal or reduced number of orders as the original system and also in identifying a blackbox model. Lowpass, Highpass, Bandpass and Bandstop FIR and Lowpass IIR filters have been designed using three algorithms using two different fitness functions. Particle Swarm Optimization (PSO), Differential Evolution based PSO (DEPSO) and PSO with Quantum Infusion (PSO-QI) algorithms have been applied in this work --Abstract, page iii

Linear Phase FIR Low Pass Filter Design Based on Firefly Algorithm

In this paper, a linear phase Low Pass FIR filter is designed and proposed based on Firefly algorithm. We exploit the exploitation and exploration mechanism with a local search routine to improve the convergence and get higher speed computation. The optimum FIR filters are designed based on the Firefly method for which the finite word length is used to represent coefficients. Furthermore, Particle Swarm Optimization (PSO) and Differential Evolution algorithm (DE) will be used to show the solution. The results will be compared with PSO and DE methods. Firefly algorithm and Parks–McClellan (PM) algorithm are also compared in this paper thoroughly. The design goal is successfully achieved in all design examples using the Firefly algorithm. They are compared with that obtained by using the PSO and the DE algorithm. For the problem at hand, the simulation results show that the Firefly algorithm outperforms the PSO and DE methods in some of the presented design examples. It also performs well in a portion of the exhibited design examples particularly in speed and quality

Differential Evolution Particle Swarm Optimization for Digital Filter Design

In this paper, swarm and evolutionary algorithms have been applied for the design of digital filters. Particle swarm optimization (PSO) and differential evolution particle swarm optimization (DEPSO) have been used here for the design of linear phase finite impulse response (FIR) filters. Two different fitness functions have been studied and experimented, each having its own significance. The first study considers a fitness function based on the passband and stopband ripple, while the second study considers a fitness function based on the mean squared error between the actual and the ideal filter response. DEPSO seems to be promising tool for FIR filter design especially in a dynamic environment where filter coefficients have to be adapted and fast convergence is of importance

An Efficient Hybrid SIMBO-GA Approach to Design FIR Low Pass Filter

In this paper a narrative approach for designing FIR low pass filter is presented by practicing hybrid technique of Swine Influenza Model based Optimization (SIMBO) and Genetic Algorithm (GA). Premature convergence was the major difficulty faced by SIMBO algorithm individually in FIR filter design. To address this problem, a hybrid SIMBO-GA is proposed in this paper. GA is used to help SIMBO escape from local optima and prevent premature convergence. Results are presented and compared in term of magnitude response with Differential Evolution Particle Swarm Optimization (DEPSO), Genetic Lbest Particle Swarm Optimization with Dynamically Varying Neighbourhood (GLPSO DVN). A comparison of simulation results divulges that SIMBO-GA seems to be promising tool for FIR filter design. Keywords: FIR Filter, SIMBO-GA, DEPSO, LPSO, GLPSO DVN

Differential Evolution Biogeography Based Optimization for Linear Phase Fir Low Pass Filter Design

This paper presents an efficient way of designing Linear Phase Finite Impulse Response (FIR) Filter using hybrid Differential Evolution (DE) and Biogeography based optimization (BBO) algorithms. DE is a fast and robust evolutionary algorithm tool for global optimization. On the other hand, BBO uses migration operator to share information among solutions. FIR filter of order 20 is designed using fitness function that is based on minimization of maximum ripples in pass band and stop band of the filter response. The result obtained from Differential Evolution Biogeography Based Optimization (DEBBO) for the FIR low pass filter is good in convergence speed and solution quality in terms of pass band ripple, stop band ripple, transition width. Keywords: DE, BBO, DEBBO, Convergence, FIR Filter

Linear Phase FIR Digital Filter Design Using Differential Evolution Algorithms

Digital filter plays a vital part in digital signal processing field. It has been used in control systems, aerospace, telecommunications, medical applications, speech processing and so on. Digital filters can be divided into infinite impulse response filter (IIF) and finite impulse response filter (FIR). The advantage of FIR is that it can be linear phase using symmetric or anti-symmetry coefficients. Besides traditional methods like windowing function and frequency sampling, optimization methods can be used to design FIR filters. A common method for FIR filter design is to use the Parks-McClellan algorithm. Meanwhile, evolutional algorithm such as Genetic Algorithm (GA), Particle Swarm Optimization (PSO) [2], and Differential Evolution (DE) have shown successes in solving multi-parameters optimization problems. This thesis reports a comparison work on the use of PSO, DE, and two modified DE algorithms from [18] and [19] for designing six types of linear phase FIR filters, consisting of type1 lowpass, highpass, bandpass, and bandstop filters, and type2 lowpass and bandpass filters. Although PSO has been applied in this field for some years, the results of some of the designs, especially for high-dimensional filters, are not good enough when comparing with those of the Parks-McClellan algorithm. DE algorithms use parallel search techniques to explore optimal solutions in a global range. What’s more, when facing higher dimensional filter design problems, through combining the knowledge acquired during the searching process, the DE algorithm shows obvious advantage in both frequency response and computational time

Digital Filter Design Using Improved Teaching-Learning-Based Optimization

Digital filters are an important part of digital signal processing systems. Digital filters are divided into finite impulse response (FIR) digital filters and infinite impulse response (IIR) digital filters according to the length of their impulse responses. An FIR digital filter is easier to implement than an IIR digital filter because of its linear phase and stability properties. In terms of the stability of an IIR digital filter, the poles generated in the denominator are subject to stability constraints. In addition, a digital filter can be categorized as one-dimensional or multi-dimensional digital filters according to the dimensions of the signal to be processed. However, for the design of IIR digital filters, traditional design methods have the disadvantages of easy to fall into a local optimum and slow convergence. The Teaching-Learning-Based optimization (TLBO) algorithm has been proven beneficial in a wide range of engineering applications. To this end, this dissertation focusses on using TLBO and its improved algorithms to design five types of digital filters, which include linear phase FIR digital filters, multiobjective general FIR digital filters, multiobjective IIR digital filters, two-dimensional (2-D) linear phase FIR digital filters, and 2-D nonlinear phase FIR digital filters. Among them, linear phase FIR digital filters, 2-D linear phase FIR digital filters, and 2-D nonlinear phase FIR digital filters use single-objective type of TLBO algorithms to optimize; multiobjective general FIR digital filters use multiobjective non-dominated TLBO (MOTLBO) algorithm to optimize; and multiobjective IIR digital filters use MOTLBO with Euclidean distance to optimize. The design results of the five types of filter designs are compared to those obtained by other state-of-the-art design methods. In this dissertation, two major improvements are proposed to enhance the performance of the standard TLBO algorithm. The first improvement is to apply a gradient-based learning to replace the TLBO learner phase to reduce approximation error(s) and CPU time without sacrificing design accuracy for linear phase FIR digital filter design. The second improvement is to incorporate Manhattan distance to simplify the procedure of the multiobjective non-dominated TLBO (MOTLBO) algorithm for general FIR digital filter design. The design results obtained by the two improvements have demonstrated their efficiency and effectiveness

Digital Filter Design Using Improved Artificial Bee Colony Algorithms

Digital filters are often used in digital signal processing applications. The design objective of a digital filter is to find the optimal set of filter coefficients, which satisfies the desired specifications of magnitude and group delay responses. Evolutionary algorithms are population-based meta-heuristic algorithms inspired by the biological behaviors of species. Compared to gradient-based optimization algorithms such as steepest descent and Newton’s like methods, these bio-inspired algorithms have the advantages of not getting stuck at local optima and being independent of the starting point in the solution space. The limitations of evolutionary algorithms include the presence of control parameters, problem specific tuning procedure, premature convergence and slower convergence rate. The artificial bee colony (ABC) algorithm is a swarm-based search meta-heuristic algorithm inspired by the foraging behaviors of honey bee colonies, with the benefit of a relatively fewer control parameters. In its original form, the ABC algorithm has certain limitations such as low convergence rate, and insufficient balance between exploration and exploitation in the search equations. In this dissertation, an ABC-AMR algorithm is proposed by incorporating an adaptive modification rate (AMR) into the original ABC algorithm to increase convergence rate by adjusting the balance between exploration and exploitation in the search equations through an adaptive determination of the number of parameters to be updated in every iteration. A constrained ABC-AMR algorithm is also developed for solving constrained optimization problems.There are many real-world problems requiring simultaneous optimizations of more than one conflicting objectives. Multiobjective (MO) optimization produces a set of feasible solutions called the Pareto front instead of a single optimum solution. For multiobjective optimization, if a decision maker’s preferences can be incorporated during the optimization process, the search process can be confined to the region of interest instead of searching the entire region. In this dissertation, two algorithms are developed for such incorporation. The first one is a reference-point-based MOABC algorithm in which a decision maker’s preferences are included in the optimization process as the reference point. The second one is a physical-programming-based MOABC algorithm in which physical programming is used for setting the region of interest of a decision maker. In this dissertation, the four developed algorithms are applied to solve digital filter design problems. The ABC-AMR algorithm is used to design Types 3 and 4 linear phase FIR differentiators, and the results are compared to those obtained by the original ABC algorithm, three improved ABC algorithms, and the Parks-McClellan algorithm. The constrained ABC-AMR algorithm is applied to the design of sparse Type 1 linear phase FIR filters of filter orders 60, 70 and 80, and the results are compared to three state-of-the-art design methods. The reference-point-based multiobjective ABC algorithm is used to design of asymmetric lowpass, highpass, bandpass and bandstop FIR filters, and the results are compared to those obtained by the preference-based multiobjective differential evolution algorithm. The physical-programming-based multiobjective ABC algorithm is used to design IIR lowpass, highpass and bandpass filters, and the results are compared to three state-of-the-art design methods. Based on the obtained design results, the four design algorithms are shown to be competitive as compared to the state-of-the-art design methods