Extended Fuzzy Clustering Algorithms

Fuzzy clustering is a widely applied method for obtaining fuzzy models from data. Ithas been applied successfully in various fields including finance and marketing. Despitethe successful applications, there are a number of issues that must be dealt with in practicalapplications of fuzzy clustering algorithms. This technical report proposes two extensionsto the objective function based fuzzy clustering for dealing with these issues. First, the(point) prototypes are extended to hypervolumes whose size is determined automaticallyfrom the data being clustered. These prototypes are shown to be less sensitive to a biasin the distribution of the data. Second, cluster merging by assessing the similarity amongthe clusters during optimization is introduced. Starting with an over-estimated number ofclusters in the data, similar clusters are merged during clustering in order to obtain a suitablepartitioning of the data. An adaptive threshold for merging is introduced. The proposedextensions are applied to Gustafson-Kessel and fuzzy c-means algorithms, and the resultingextended algorithms are given. The properties of the new algorithms are illustrated invarious examples.fuzzy clustering;cluster merging;similarity;volume prototypes

Speaker specific feature based clustering and its applications in language independent forensic speaker recognition

Forensic speaker recognition (FSR) is the process of determining whether the source of a questioned voice recording (trace) is a specific individual (suspected speaker). The role of the forensic expert is to testify by using, if possible, a quantitative measure of this value to the value of the voice evidence. Using this information as an aid in their judgments and decisions are up to the judge and/or the jury. Most existing methods measure inter-utterance similarities directly based on spectrum-based characteristics, the resulting clusters may not be well related to speaker’s, but rather to different acoustic classes. This research addresses this deficiency by projecting language-independent utterances into a reference space equipped to cover the standard voice features underlying the entire utterance set. The resulting projection vectors naturally represent the language-independent voice-like relationships among all the utterances and are therefore more robust against non-speaker interference. Then a clustering approach is proposed based on the peak approximation in order to maximize the similarities between language-independent utterances within all clusters. This method uses a K-medoid, Fuzzy C-means, Gustafson and Kessel and Gath-Geva algorithm to evaluate the cluster to which each utterance should be allocated, overcoming the disadvantage of traditional hierarchical clustering that the ultimate outcome can only hit the optimum recognition efficiency. The recognition efficiency of K-medoid, Fuzzy C-means, Gustafson and Kessel and Gath-Geva clustering algorithms are 95.2%, 97.3%, 98.5% and 99.7% and EER are 3.62%, 2.91 %, 2.82%, and 2.61% respectively. The EER improvement of the Gath-Geva technique based FSRsystem compared with Gustafson and Kessel and Fuzzy C-means is 8.04% and 11.49% respectivel

E2GKpro: An evidential evolving multi-modeling approach for system behavior prediction with applications.

International audienceNonlinear dynamical systems identification and behavior prediction are di cult problems encountered in many areas of industrial applications such as fault diagnosis and prognosis. In practice, the analytical description of a nonlinear system directly from observed data is a very challenging task because of the the too large number of the related parameters to be estimated. As a solution, multi-modeling approaches have lately been applied and consist in dividing the operating range of the system under study into di erent operating regions easier to describe by simpler functions to be combined. In order to take into consideration the uncertainty related to the available data as well as the uncertainty resulting from the nonlinearity of the system, evidence theory is of particular interest, because it permits the explicit modeling of doubt and ignorance. In the context of multi-modeling, information of doubt may be exploited to properly segment the data and take into account the uncertainty in the transitions between the operating regions. Recently, the Evidential Evolving Gustafson-Kessel algorithm (E2GK) has been proposed to ensure an online partitioning of the data into clusters that correspond to operating regions. Based on E2GK, a multi-modeling approach called E2GKpro is introduced in this paper, which dynamically performs the estimation of the local models by upgrading and modifying their parameters while data arrive. The proposed algorithm is tested on several datasets and compared to existing approaches. The results show that the use of virtual centroids in E2GKpro account for its robustness to noise and generating less operating regions while ensuring precise predictions

Evolving fuzzy and neuro-fuzzy approaches in clustering, regression, identification, and classification: A Survey

Major assumptions in computational intelligence and machine learning consist of the availability of a historical dataset for model development, and that the resulting model will, to some extent, handle similar instances during its online operation. However, in many real world applications, these assumptions may not hold as the amount of previously available data may be insufficient to represent the underlying system, and the environment and the system may change over time. As the amount of data increases, it is no longer feasible to process data efficiently using iterative algorithms, which typically require multiple passes over the same portions of data. Evolving modeling from data streams has emerged as a framework to address these issues properly by self-adaptation, single-pass learning steps and evolution as well as contraction of model components on demand and on the fly. This survey focuses on evolving fuzzy rule-based models and neuro-fuzzy networks for clustering, classification and regression and system identification in online, real-time environments where learning and model development should be performed incrementally. (C) 2019 Published by Elsevier Inc.Igor Škrjanc, Jose Antonio Iglesias and Araceli Sanchis would like to thank to the Chair of Excellence of Universidad Carlos III de Madrid, and the Bank of Santander Program for their support. Igor Škrjanc is grateful to Slovenian Research Agency with the research program P2-0219, Modeling, simulation and control. Daniel Leite acknowledges the Minas Gerais Foundation for Research and Development (FAPEMIG), process APQ-03384-18. Igor Škrjanc and Edwin Lughofer acknowledges the support by the ”LCM — K2 Center for Symbiotic Mechatronics” within the framework of the Austrian COMET-K2 program. Fernando Gomide is grateful to the Brazilian National Council for Scientific and Technological Development (CNPq) for grant 305906/2014-3

Extended Fuzzy Clustering Algorithms

Fuzzy clustering is a widely applied method for obtaining fuzzy models from data. It has been applied successfully in various fields including finance and marketing. Despite the successful applications, there are a number of issues that must be dealt with in practical applications of fuzzy clustering algorithms. This technical report proposes two extensions to the objective function based fuzzy clustering for dealing with these issues. First, the (point) prototypes are extended to hypervolumes whose size is determined automatically from the data being clustered. These prototypes are shown to be less sensitive to a bias in the distribution of the data. Second, cluster merging by assessing the similarity among the clusters during optimization is introduced. Starting with an over-estimated number of clusters in the data, similar clusters are merged during clustering in order to obtain a suitable partitioning of the data. An adaptive threshold for merging is introduced. The proposed extensions are applied to Gustafson-Kessel and fuzzy c-means algorithms, and the resulting extended algorithms are given. The properties of the new algorithms are illustrated in various examples

Using Sub-optimal Kalman Filtering for Anomaly Detection in Networks

Possibility theory can be used as a suitable frameworkto build a normal behavioral model for an anomaly detector.Based on linear and/or nonlinear systems, sub-optimal filteringapproaches based on the Extended Kalman Filter and the UnscentedKalman Filter are calibrated for entropy reduction andcould be a good basis to find a suitable model to build a decisionvariable where, a decision process can be applied to identifyanomalous events. Sophisticated fuzzy clustering algorithms canbe used to find a set of clusters built on the decision variable,where anomalies might happen inside a few of them. To achievean efficient detection step, a robust decision scheme is built, bymeans of possibility distributions, to separate the clusters intonormal and abnormal spaces. We had studied the false alarmrate vs. detection rate trade-off by means of ROC (ReceiverOperating Characteristic) curves to show the results. We validatethe approach over different realistic network traffic

Identification of Evolving Rule-based Models.

An approach to identification of evolving fuzzy rule-based (eR) models is proposed. eR models implement a method for the noniterative update of both the rule-base structure and parameters by incremental unsupervised learning. The rule-base evolves by adding more informative rules than those that previously formed the model. In addition, existing rules can be replaced with new rules based on ranking using the informative potential of the data. In this way, the rule-base structure is inherited and updated when new informative data become available, rather than being completely retrained. The adaptive nature of these evolving rule-based models, in combination with the highly transparent and compact form of fuzzy rules, makes them a promising candidate for modeling and control of complex processes, competitive to neural networks. The approach has been tested on a benchmark problem and on an air-conditioning component modeling application using data from an installation serving a real building. The results illustrate the viability and efficiency of the approach. (c) IEEE Transactions on Fuzzy System

Interval Valued Fuzzy Modeling and Indirect Adaptive Control of Quadrotor

In this paper, a combination of fuzzy clustering estimation and sliding mode control is used to control a quadrotor system, whose mathematical model is complex and has unknown elements, including structure, parameters, and so on. In addition, they may be affected by external environmental disturbances. At first, the nonlinear unknown part of the system is estimated by a fuzzy model, A new method is presented for constructing a Takagi-Sugeno (TS) interval-valued fuzzy model (IVFM) based on inputoutput data of the identified system. Following the construction of the fuzzy model that estimates the unknown part of the quadrotor system, a control and on-line adjusting of the fuzzy modeled part of dynamics is used. In this step, the system model will be estimated in adaptive form so that the dynamic equations can be used in sliding mode control. Finally, the proposed technique is applied, and the simulation results are presented to show the effectiveness of this approach in controlling the quadrotor with unknown nonlinear dynamics.Comment: 25 page

Autoregressive time series prediction by means of fuzzy inference systems using nonparametric residual variance estimation

We propose an automatic methodology framework for short- and long-term prediction of time series by means of fuzzy inference systems. In this methodology, fuzzy techniques and statistical techniques for nonparametric residual variance estimation are combined in order to build autoregressive predictive models implemented as fuzzy inference systems. Nonparametric residual variance estimation plays a key role in driving the identification and learning procedures. Concrete criteria and procedures within the proposed methodology framework are applied to a number of time series prediction problems. The learn from examples method introduced by Wang and Mendel (W&M) is used for identification. The Levenberg–Marquardt (L–M) optimization method is then applied for tuning. The W&M method produces compact and potentially accurate inference systems when applied after a proper variable selection stage. The L–M method yields the best compromise between accuracy and interpretability of results, among a set of alternatives. Delta test based residual variance estimations are used in order to select the best subset of inputs to the fuzzy inference systems as well as the number of linguistic labels for the inputs. Experiments on a diverse set of time series prediction benchmarks are compared against least-squares support vector machines (LS-SVM), optimally pruned extreme learning machine (OP-ELM), and k-NN based autoregressors. The advantages of the proposed methodology are shown in terms of linguistic interpretability, generalization capability and computational cost. Furthermore, fuzzy models are shown to be consistently more accurate for prediction in the case of time series coming from real-world applications.Ministerio de Ciencia e Innovación TEC2008-04920Junta de Andalucía P08-TIC-03674, IAC07-I-0205:33080, IAC08-II-3347:5626