Hybrid ACO and SVM algorithm for pattern classification

Ant Colony Optimization (ACO) is a metaheuristic algorithm that can be used to solve a variety of combinatorial optimization problems. A new direction for ACO is to optimize continuous and mixed (discrete and continuous) variables. Support Vector Machine (SVM) is a pattern classification approach originated from statistical approaches. However, SVM suffers two main problems which include feature subset selection and parameter tuning. Most approaches related to tuning SVM parameters discretize the continuous value of the parameters which will give a negative effect on the classification performance. This study presents four algorithms for tuning the SVM parameters and selecting feature subset which improved SVM classification accuracy with smaller size of feature subset. This is achieved by performing the SVM parameters’ tuning and feature subset selection processes simultaneously. Hybridization algorithms between ACO and SVM techniques were proposed. The first two algorithms, ACOR-SVM and IACOR-SVM, tune the SVM parameters while the second two algorithms, ACOMV-R-SVM and IACOMV-R-SVM, tune the SVM parameters and select the feature subset simultaneously. Ten benchmark datasets from University of California, Irvine, were used in the experiments to validate the performance of the proposed algorithms. Experimental results obtained from the proposed algorithms are better when compared with other approaches in terms of classification accuracy and size of the feature subset. The average classification accuracies for the ACOR-SVM, IACOR-SVM, ACOMV-R and IACOMV-R algorithms are 94.73%, 95.86%, 97.37% and 98.1% respectively. The average size of feature subset is eight for the ACOR-SVM and IACOR-SVM algorithms and four for the ACOMV-R and IACOMV-R algorithms. This study contributes to a new direction for ACO that can deal with continuous and mixed-variable ACO

Detection of Compound Word with Combination Noun and Adjective using Rule Based Technique in Malay Standard Document

In this paper we describe our methods for detecting the compound word with combination of Noun and Adjective Compound Nouns in Malay standard document. We addressed the problem on detection of combination noun and adjective in Malay sentences to become a compound word. We modified several identification rules based by using Malay grammar rules and syntactic information to increase the percentage of recall, precision and F1-Score. For compound word identification, we used dictionary-based and thesaurus information for implementing Part of Speech (POS) tagging to all words in the selected Malay document. Testing was done on selected Malay document. The result showed an improvement compared to previous research with a precision of 90.9%, a recall of 10.2% and a F1-Score of 18.1%

Prediction of electron beam welding penetration depth using machine learning-enhanced computational fluid dynamics modelling

The necessity for precise prediction of penetration depth in the context of electron beam welding (EBW) cannot be overstated. Traditional statistical methodologies, including regression analysis and neural networks, often necessitate a considerable investment of both time and financial resources to produce results that meet acceptable standards. To address these challenges, this study introduces a novel approach for predicting EBW penetration depth that synergistically combines computational fluid dynamics (CFD) modelling with artificial neural networks (ANN). The CFD modelling technique was proven to be highly effective, yielding predictions with an average absolute percentage deviation of around 8%. This level of accuracy is consistent across a linear electron beam (EB) power range spanning from 86 J/mm to 324 J/mm. One of the most compelling advantages of this integrated approach is its efficiency. By leveraging the capabilities of CFD and ANN, the need for extensive and costly preliminary testing is effectively eliminated, thereby reducing both the time and financial outlay typically associated with such predictive modelling. Furthermore, the versatility of this approach is demonstrated by its adaptability to other types of EB machines, made possible through the application of the beam characterisation method outlined in the research. With the implementation of the models introduced in this study, practitioners can exert effective control over the quality of EBW welds. This is achieved by fine-tuning key variables, including but not limited to the beam power, beam radius, and the speed of travel during the welding process.Lloyds Register Foundation; Joining 4.0 Innovation Centre (J4IC); Cranfield Universit

Speaker recognition utilizing distributed DCT-II based Mel frequency cepstral coefficients and fuzzy vector quantization

In this paper, a new and novel Automatic Speaker Recognition (ASR) system is presented. The new ASR system includes novel feature extraction and vector classification steps utilizing distributed Discrete Cosine Transform (DCT-II) based Mel Frequency Cepstral Coef?cients (MFCC) and Fuzzy Vector Quantization (FVQ). The ASR algorithm utilizes an approach based on MFCC to identify dynamic features that are used for Speaker Recognition (SR)

Системи диференциални уравнения и невронни мрежи със закъснения и импулси

Department of Mathematics & Statistics, College of Science, Sultan Qaboos University, Muscat, Sultanate of Oman и ИМИ-БАН, 16.06.2014 г., присъждане на научна степен "доктор на науките" на Валерий Ковачев по научна специалност 01.01.13. математическо моделиране и приложение на математиката. [Covachev Valery Hristov; Ковачев Валерий Христов

Plantwide simulation and monitoring of offshore oil and gas production facility

Monitoring is one of the major concerns in offshore oil and gas production platform since the access to the offshore facilities is difficult. Also, it is quite challenging to extract oil and gas safely in such a harsh environment, and any abnormalities may lead to a catastrophic event. The process data, including all possible faulty scenarios, is required to build an appropriate monitoring system. Since the plant wide process data is not available in the literature, a dynamic model and simulation of an offshore oil and gas production platform is developed by using Aspen HYSYS. Modeling and simulations are handy tools for designing and predicting the accurate behavior of a production plant. The model was built based on the gas processing plant at the North Sea platform reported in Voldsund et al. (2013). Several common faults from different fault categories were simulated in the dynamic system, and their impacts on the overall hydrocarbon production were analyzed. The simulated data are then used to build a monitoring system for each of the faulty states. A new monitoring method has been proposed by combining Principal Component Analysis (PCA) and Dynamic PCA (DPCA) with Artificial Neural Network (ANN). The application of ANN to process systems is quite difficult as it involves a very large number of input neurons to model the system. Training of such large scale network is time-consuming and provides poor accuracy with a high error rate. In PCA-ANN and DPCA-ANN monitoring system, PCA and DPCA are used to reduce the dimension of the training data set and extract the main features of measured variables. Subsequently ANN uses this lower-dimensional score vectors to build a training model and classify the abnormalities. It is found that the proposed approach reduces the time to train ANN and successfully diagnose, detects and classifies the faults with a high accuracy rate

Machine learning for network based intrusion detection: an investigation into discrepancies in findings with the KDD cup '99 data set and multi-objective evolution of neural network classifier ensembles from imbalanced data.

For the last decade it has become commonplace to evaluate machine learning techniques for network based intrusion detection on the KDD Cup '99 data set. This data set has served well to demonstrate that machine learning can be useful in intrusion detection. However, it has undergone some criticism in the literature, and it is out of date. Therefore, some researchers question the validity of the findings reported based on this data set. Furthermore, as identified in this thesis, there are also discrepancies in the findings reported in the literature. In some cases the results are contradictory. Consequently, it is difficult to analyse the current body of research to determine the value in the findings. This thesis reports on an empirical investigation to determine the underlying causes of the discrepancies. Several methodological factors, such as choice of data subset, validation method and data preprocessing, are identified and are found to affect the results significantly. These findings have also enabled a better interpretation of the current body of research. Furthermore, the criticisms in the literature are addressed and future use of the data set is discussed, which is important since researchers continue to use it due to a lack of better publicly available alternatives. Due to the nature of the intrusion detection domain, there is an extreme imbalance among the classes in the KDD Cup '99 data set, which poses a significant challenge to machine learning. In other domains, researchers have demonstrated that well known techniques such as Artificial Neural Networks (ANNs) and Decision Trees (DTs) often fail to learn the minor class(es) due to class imbalance. However, this has not been recognized as an issue in intrusion detection previously. This thesis reports on an empirical investigation that demonstrates that it is the class imbalance that causes the poor detection of some classes of intrusion reported in the literature. An alternative approach to training ANNs is proposed in this thesis, using Genetic Algorithms (GAs) to evolve the weights of the ANNs, referred to as an Evolutionary Neural Network (ENN). When employing evaluation functions that calculate the fitness proportionally to the instances of each class, thereby avoiding a bias towards the major class(es) in the data set, significantly improved true positive rates are obtained whilst maintaining a low false positive rate. These findings demonstrate that the issues of learning from imbalanced data are not due to limitations of the ANNs; rather the training algorithm. Moreover, the ENN is capable of detecting a class of intrusion that has been reported in the literature to be undetectable by ANNs. One limitation of the ENN is a lack of control of the classification trade-off the ANNs obtain. This is identified as a general issue with current approaches to creating classifiers. Striving to create a single best classifier that obtains the highest accuracy may give an unfruitful classification trade-off, which is demonstrated clearly in this thesis. Therefore, an extension of the ENN is proposed, using a Multi-Objective GA (MOGA), which treats the classification rate on each class as a separate objective. This approach produces a Pareto front of non-dominated solutions that exhibit different classification trade-offs, from which the user can select one with the desired properties. The multi-objective approach is also utilised to evolve classifier ensembles, which yields an improved Pareto front of solutions. Furthermore, the selection of classifier members for the ensembles is investigated, demonstrating how this affects the performance of the resultant ensembles. This is a key to explaining why some classifier combinations fail to give fruitful solutions

Influence of Rain on Vision-Based Algorithms in the Automotive Domain

The Automotive domain is a highly regulated domain with stringent requirements that characterize automotive systems’ performance and safety. Automotive applications are required to operate under all driving conditions and meet high levels of safety standards. Vision-based systems in the automotive domain are accordingly required to operate at all weather conditions, favorable or adverse. Rain is one of the most common types of adverse weather conditions that reduce quality images used in vision-based algorithms. Rain can be observed in an image in two forms, falling rain streaks or adherent raindrops. Both forms corrupt the input images and degrade the performance of vision-based algorithms. This dissertation describes the work we did to study the effect of rain on the quality images and the target vision systems that use them as the main input. To study falling rain, we developed a framework for simulating failing rain streaks. We also developed a de-raining algorithm that detects and removes rain streaks from the images. We studied the relation between image degradation due to adherent raindrops and the performance of the target vision algorithm and provided quantitive metrics to describe such a relation. We developed an adherent raindrop simulator that generates synthetic rained images, by adding generated raindrops to rain-free images. We used this simulator to generate rained image datasets, which we used to train some vision algorithms and evaluate the feasibility of using transfer-learning to improve DNN-based vision algorithms to improve performance under rainy conditions.Ph.D.College of Engineering & Computer ScienceUniversity of Michigan-Dearbornhttp://deepblue.lib.umich.edu/bitstream/2027.42/170924/1/Yazan Hamzeh final dissertation.pdfDescription of Yazan Hamzeh final dissertation.pdf : Dissertatio