A Review of Particle Swarm Optimization: Feature Selection, Classification and Hybridizations

Particle swarm optimization (PSO) is a recently grown, popular, evolutionary and conceptually simple but efficient algorithm which belongs to swarm intelligence category. This paper outlines basic concepts and reviews PSO based techniques with their applications to classification and feature selection along with some of the hybridized applications of PSO with similar other techniques. DOI: 10.17762/ijritcc2321-8169.16041

Learning enhancement of radial basis function network with particle swarm optimization

Back propagation (BP) algorithm is the most common technique in Artificial Neural Network (ANN) learning, and this includes Radial Basis Function Network. However, major disadvantages of BP are its convergence rate is relatively slow and always being trapped at the local minima. To overcome this problem, Particle Swarm Optimization (PSO) has been implemented to enhance ANN learning to increase the performance of network in terms of convergence rate and accuracy. In Back Propagation Radial Basis Function Network (BP-RBFN), there are many elements to be considered. These include the number of input nodes, hidden nodes, output nodes, learning rate, bias, minimum error and activation/transfer functions. These elements will affect the speed of RBF Network learning. In this study, Particle Swarm Optimization (PSO) is incorporated into RBF Network to enhance the learning performance of the network. Two algorithms have been developed on error optimization for Back Propagation of Radial Basis Function Network (BP-RBFN) and Particle Swarm Optimization of Radial Basis Function Network (PSO-RBFN) to seek and generate better network performance. The results show that PSO-RBFN give promising outputs with faster convergence rate and better classifications compared to BP-RBFN

Water filtration by using apple and banana peels as activated carbon

Water filter is an important devices for reducing the contaminants in raw water. Activated from charcoal is used to absorb the contaminants. Fruit peels are some of the suitable alternative carbon to substitute the charcoal. Determining the role of fruit peels which were apple and banana peels powder as activated carbon in water filter is the main goal. Drying and blending the peels till they become powder is the way to allow them to absorb the contaminants. Comparing the results for raw water before and after filtering is the observation. After filtering the raw water, the reading for pH was 6.8 which is in normal pH and turbidity reading recorded was 658 NTU. As for the colour, the water becomes more clear compared to the raw water. This study has found that fruit peels such as banana and apple are an effective substitute to charcoal as natural absorbent

A novel approach to data mining using simplified swarm optimization

Data mining has become an increasingly important approach to deal with the rapid growth of data collected and stored in databases. In data mining, data classification and feature selection are considered the two main factors that drive people when making decisions. However, existing traditional data classification and feature selection techniques used in data management are no longer enough for such massive data. This deficiency has prompted the need for a new intelligent data mining technique based on stochastic population-based optimization that could discover useful information from data. In this thesis, a novel Simplified Swarm Optimization (SSO) algorithm is proposed as a rule-based classifier and for feature selection. SSO is a simplified Particle Swarm Optimization (PSO) that has a self-organising ability to emerge in highly distributed control problem space, and is flexible, robust and cost effective to solve complex computing environments. The proposed SSO classifier has been implemented to classify audio data. To the author’s knowledge, this is the first time that SSO and PSO have been applied for audio classification. Furthermore, two local search strategies, named Exchange Local Search (ELS) and Weighted Local Search (WLS), have been proposed to improve SSO performance. SSO-ELS has been implemented to classify the 13 benchmark datasets obtained from the UCI repository database. Meanwhile, SSO-WLS has been implemented in Anomaly-based Network Intrusion Detection System (A-NIDS). In A-NIDS, a novel hybrid SSO-based Rough Set (SSORS) for feature selection has also been proposed. The empirical analysis showed promising results with high classification accuracy rate achieved by all proposed techniques over audio data, UCI data and KDDCup 99 datasets. Therefore, the proposed SSO rule-based classifier with local search strategies has offered a new paradigm shift in solving complex problems in data mining which may not be able to be solved by other benchmark classifiers

Artificial immune system and particle swarm optimization for electroencephalogram based epileptic seizure classification

Automated analysis of brain activity from electroencephalogram (EEG) has indispensable applications in many fields such as epilepsy research. This research has studied the abilities of negative selection and clonal selection in artificial immune system (AIS) and particle swarm optimization (PSO) to produce different reliable and efficient methods for EEG-based epileptic seizure recognition which have not yet been explored. Initially, an optimization-based classification model was proposed to describe an individual use of clonal selection and PSO to build nearest centroid classifier for EEG signals. Next, two hybrid optimization-based negative selection models were developed to investigate the integration of the AIS-based techniques and negative selection with PSO from the perspective of classification and detection. In these models, a set of detectors was created by negative selection as self-tolerant and their quality was improved towards non-self using clonal selection or PSO. The models included a mechanism to maintain the diversity and generality among the detectors. The detectors were produced in the classification model for each class, while the detection model generated the detectors only for the abnormal class. These hybrid models differ from each other in hybridization configuration, solution representation and objective function. The three proposed models were abstracted into innovative methods by applying clonal selection and PSO for optimization, namely clonal selection classification algorithm (CSCA), particle swarm classification algorithm (PSCA), clonal negative selection classification algorithm (CNSCA), swarm negative selection classification algorithm (SNSCA), clonal negative selection detection algorithm (CNSDA) and swarm negative selection detection algorithm (SNSDA). These methods were evaluated on EEG data using common measures in medical diagnosis. The findings demonstrated that the methods can efficiently achieve a reliable recognition of epileptic activity in EEG signals. Although CNSCA gave the best performance, CNSDA and SNSDA are preferred due to their efficiency in time and space. A comparison with other methods in the literature showed the competitiveness of the proposed methods

A review of quantum-inspired metaheuristic algorithms for automatic clustering

In real-world scenarios, identifying the optimal number of clusters in a dataset is a difficult task due to insufficient knowledge. Therefore, the indispensability of sophisticated automatic clus tering algorithms for this purpose has been contemplated by some researchers. Several automatic clustering algorithms assisted by quantum-inspired metaheuristics have been developed in recent years. However, the literature lacks definitive documentation of the state-of-the-art quantum-inspired metaheuristic algorithms for automatically clustering datasets. This article presents a brief overview of the automatic clustering process to establish the importance of making the clustering process automatic. The fundamental concepts of the quantum computing paradigm are also presented to highlight the utility of quantum-inspired algorithms. This article thoroughly analyses some algo rithms employed to address the automatic clustering of various datasets. The reviewed algorithms were classified according to their main sources of inspiration. In addition, some representative works of each classification were chosen from the existing works. Thirty-six such prominent algorithms were further critically analysed based on their aims, used mechanisms, data specifications, merits and demerits. Comparative results based on the performance and optimal computational time are also presented to critically analyse the reviewed algorithms. As such, this article promises to provide a detailed analysis of the state-of-the-art quantum-inspired metaheuristic algorithms, while highlighting their merits and demerits.Web of Science119art. no. 201

Facing classification problems with Particle Swarm Optimization

The use of Particle Swarm Optimization, a heuristic optimization technique based on the concept of swarm, is described to face the problem of classification of instances in multiclass databases. Three different fitness functions are taken into account, resulting in three versions being investigated. Their performance is contrasted on 13 typical test databases. The resulting best version is then compared against other nine classification techniques well known in literature. Results show the competitiveness of Particle Swarm Optimization. In particular, it turns out to be the best on 3 out of the 13 challenged problems