Local feature weighting in nearest prototype classification

The distance metric is the corner stone of nearest neighbor (NN)-based methods, and therefore, of nearest prototype (NP) algorithms. That is because they classify depending on the similarity of the data. When the data is characterized by a set of features which may contribute to the classification task in different levels, feature weighting or selection is required, sometimes in a local sense. However, local weighting is typically restricted to NN approaches. In this paper, we introduce local feature weighting (LFW) in NP classification. LFW provides each prototype its own weight vector, opposite to typical global weighting methods found in the NP literature, where all the prototypes share the same one. Providing each prototype its own weight vector has a novel effect in the borders of the Voronoi regions generated: They become nonlinear. We have integrated LFW with a previously developed evolutionary nearest prototype classifier (ENPC). The experiments performed both in artificial and real data sets demonstrate that the resulting algorithm that we call LFW in nearest prototype classification (LFW-NPC) avoids overfitting on training data in domains where the features may have different contribution to the classification task in different areas of the feature space. This generalization capability is also reflected in automatically obtaining an accurate and reduced set of prototypes.Publicad

Epileptic Seizure Detection And Prediction From Electroencephalogram Using Neuro-Fuzzy Algorithms

This dissertation presents innovative approaches based on fuzzy logic in epileptic seizure detection and prediction from Electroencephalogram (EEG). The fuzzy rule-based algorithms were developed with the aim to improve quality of life of epilepsy patients by utilizing intelligent methods. An adaptive fuzzy logic system was developed to detect seizure onset in a patient specific way. Fuzzy if-then rules were developed to mimic the human reasoning and taking advantage of the combination in spatial-temporal domain. Fuzzy c-means clustering technique was utilized for optimizing the membership functions for varying patterns in the feature domain. In addition, application of the adaptive neuro-fuzzy inference system (ANFIS) is presented for efficient classification of several commonly arising artifacts from EEG. Finally, we present a neuro-fuzzy approach of seizure prediction by applying the ANFIS. Patient specific ANFIS classifier was constructed to forecast a seizure followed by postprocessing methods. Three nonlinear seizure predictive features were used to characterize changes prior to seizure. The nonlinear features used in this study were similarity index, phase synchronization, and nonlinear interdependence. The ANFIS classifier was constructed based on these features as inputs. Fuzzy if-then rules were generated by the ANFIS classifier using the complex relationship of feature space provided during training. In this dissertation, the application of the neuro-fuzzy algorithms in epilepsy diagnosis and treatment was demonstrated by applying the methods on different datasets. Several performance measures such as detection delay, sensitivity and specificity were calculated and compared with results reported in literature. The proposed algorithms have potentials to be used in diagnostics and therapeutic applications as they can be implemented in an implantable medical device to detect a seizure, forecast a seizure, and initiate neurostimulation therapy for the purpose of seizure prevention or abortion

A Review of Kernel Methods for Feature Extraction in Nonlinear Process Monitoring

Kernel methods are a class of learning machines for the fast recognition of nonlinear patterns in any data set. In this paper, the applications of kernel methods for feature extraction in industrial process monitoring are systematically reviewed. First, we describe the reasons for using kernel methods and contextualize them among other machine learning tools. Second, by reviewing a total of 230 papers, this work has identified 12 major issues surrounding the use of kernel methods for nonlinear feature extraction. Each issue was discussed as to why they are important and how they were addressed through the years by many researchers. We also present a breakdown of the commonly used kernel functions, parameter selection routes, and case studies. Lastly, this review provides an outlook into the future of kernel-based process monitoring, which can hopefully instigate more advanced yet practical solutions in the process industries

Designing an Interval Type-2 Fuzzy Logic System for Handling Uncertainty Effects in Brain–Computer Interface Classification of Motor Imagery Induced EEG Patterns

One of the urgent challenges in the automated analysis and interpretation of electrical brain activity is the effective handling of uncertainties associated with the complexity and variability of brain dynamics, reflected in the nonstationary nature of brain signals such as electroencephalogram (EEG). This poses a severe problem for existing approaches to the classification task within brain–computer interface (BCI) systems. Recently emerged type-2 fuzzy logic (T2FL) methodology has shown a remarkable potential in dealing with uncertain information given limited insight into the nature of the data generating mechanism. The objective of this work is thus to examine the applicability of T2FL approach to the problem of EEG pattern recognition. In particular, the focus is two-fold: i) the design methodology for the interval T2FL system (IT2FLS) that can robustly deal with inter-session as well as within-session manifestations of nonstationary spectral EEG correlates of motor imagery (MI), and ii) the comprehensive examination of the proposed fuzzy classifier in both off-line and on-line EEG classification case studies. The on-line evaluation of the IT2FLS-controlled real-time neurofeedback over multiple recording sessions holds special importance for EEG-based BCI technology. In addition, a retrospective comparative analysis accounting for other popular BCI classifiers such as linear discriminant analysis (LDA), kernel Fisher discriminant (KFD) and support vector machines (SVMs) as well as a conventional type-1 FLS (T1FLS), simulated off-line on the recorded EEGs, has demonstrated the enhanced potential of the proposed IT2FLS approach to robustly handle uncertainty effects in BCI classification

Signal and data processing for machine olfaction and chemical sensing: A review

Signal and data processing are essential elements in electronic noses as well as in most chemical sensing instruments. The multivariate responses obtained by chemical sensor arrays require signal and data processing to carry out the fundamental tasks of odor identification (classification), concentration estimation (regression), and grouping of similar odors (clustering). In the last decade, important advances have shown that proper processing can improve the robustness of the instruments against diverse perturbations, namely, environmental variables, background changes, drift, etc. This article reviews the advances made in recent years in signal and data processing for machine olfaction and chemical sensing