Learning and identification of fuzzy systems

This thesis concentrates on learning and identification of fuzzy systems, and this thesis is composed about learning fuzzy systems from data for regression and function approximation by constructing complete, compact, and consistent fuzzy systems. Fuzzy systems are prevalent to solve pattern recognition problems and function approximation problems as a result of the good knowledge representation. With the development of fuzzy systems, a lot of sophisticated methods based on them try to completely solve pattern recognition problems and function approximation problems by constructing a great diversity of mathematical models. However, there exists a conflict between the degree of the interpretability and the accuracy of the approximation in general fuzzy systems. Thus, how to properly make the best compromise between the accuracy of the approximation and the degree of the interpretability in the entire system is a significant study of the subject.The first work of this research is concerned with the clustering technique on constructing fuzzy models in fuzzy system identification, and this method is a part of clustering based learning of fuzzy systems. As the determination of the proper number of clusters and the appropriate location of clusters is one of primary considerations on constructing an effectively fuzzy model, the task of the clustering technique aims at recognizing the proper number of clusters and the appropriate location as far as possible, which gives a good preparation for the construction of fuzzy models. In order to acquire the mutually exclusive performance by constructing effectively fuzzy models, a modular method to fuzzy system identification based on a hybrid clustering-based technique has been considered. Due to the above reasons, a hybrid clustering algorithm concerning input, output, generalization and specialization has hence been introduced in this work. Thus, the primary advantage of this work is the proposed clustering technique integrates a variety of clustering properties to positively identify the proper number of clusters and the appropriate location of clusters by carrying out a good performance of recognizing the precise position of each dataset, and this advantage brings fuzzy systems more complete.The second work of this research is an extended work of the first work, and two ways to improve the original work have been considered in the extended work, including the pruning strategy for simplifying the structure of fuzzy systems and the optimization scheme for parameters optimization. So far as the pruning strategy is concerned, the purpose of which aims at refining rule base by the similarity analysis of fuzzy sets, fuzzy numbers, fuzzy membership functions or fuzzy rules. By other means, through the similarity analysis of which, the complete rules can be kept and the redundant rules can be reduced probably in the rule base of fuzzy systems. Also, the optimization scheme can be regarded as a two-layer parameters optimization in the extended work, because the parameters of the initial fuzzy model have been fine tuning by two phases gradation on layer. Hence, the extended work primarily puts focus on enhancing the performance of the initial fuzzy models toward the positive reliability of the final fuzzy models. Thus, the primary advantage of this work consists of the simplification of fuzzy rule base by the similarity-based pruning strategy, as well as more accuracy of the optimization by the two-layer optimization scheme, and these advantages bring fuzzy systems more compact and precise.So far as a perfect modular method for fuzzy system identification is concerned, in addition to positively solve pattern recognition problems and function approximation problems, it should primarily comprise the following features, including the well-understanding interpretability, low-degree dimensionality, highly reliability, stable robustness, highly accuracy of the approximation, less computational cost, and maximum performance. However, it is extremely difficult to meet all of these conditions above. Inasmuch as attaining the highly achievement from the features above as far as possible, the research works of this thesis try to present a modular method concerning a variety of requirements to fuzzy systems identification.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

A hierarchical Mamdani-type fuzzy modelling approach with new training data selection and multi-objective optimisation mechanisms: A special application for the prediction of mechanical properties of alloy steels

In this paper, a systematic data-driven fuzzy modelling methodology is proposed, which allows to construct Mamdani fuzzy models considering both accuracy (precision) and transparency (interpretability) of fuzzy systems. The new methodology employs a fast hierarchical clustering algorithm to generate an initial fuzzy model efficiently; a training data selection mechanism is developed to identify appropriate and efficient data as learning samples; a high-performance Particle Swarm Optimisation (PSO) based multi-objective optimisation mechanism is developed to further improve the fuzzy model in terms of both the structure and the parameters; and a new tolerance analysis method is proposed to derive the confidence bands relating to the final elicited models. This proposed modelling approach is evaluated using two benchmark problems and is shown to outperform other modelling approaches. Furthermore, the proposed approach is successfully applied to complex high-dimensional modelling problems for manufacturing of alloy steels, using ‘real’ industrial data. These problems concern the prediction of the mechanical properties of alloy steels by correlating them with the heat treatment process conditions as well as the weight percentages of the chemical compositions

Online Tool Condition Monitoring Based on Parsimonious Ensemble+

Accurate diagnosis of tool wear in metal turning process remains an open challenge for both scientists and industrial practitioners because of inhomogeneities in workpiece material, nonstationary machining settings to suit production requirements, and nonlinear relations between measured variables and tool wear. Common methodologies for tool condition monitoring still rely on batch approaches which cannot cope with a fast sampling rate of metal cutting process. Furthermore they require a retraining process to be completed from scratch when dealing with a new set of machining parameters. This paper presents an online tool condition monitoring approach based on Parsimonious Ensemble+, pENsemble+. The unique feature of pENsemble+ lies in its highly flexible principle where both ensemble structure and base-classifier structure can automatically grow and shrink on the fly based on the characteristics of data streams. Moreover, the online feature selection scenario is integrated to actively sample relevant input attributes. The paper presents advancement of a newly developed ensemble learning algorithm, pENsemble+, where online active learning scenario is incorporated to reduce operator labelling effort. The ensemble merging scenario is proposed which allows reduction of ensemble complexity while retaining its diversity. Experimental studies utilising real-world manufacturing data streams and comparisons with well known algorithms were carried out. Furthermore, the efficacy of pENsemble was examined using benchmark concept drift data streams. It has been found that pENsemble+ incurs low structural complexity and results in a significant reduction of operator labelling effort.Comment: this paper has been published by IEEE Transactions on Cybernetic

Energy performance forecasting of residential buildings using fuzzy approaches

The energy consumption used for domestic purposes in Europe is, to a considerable extent, due to heating and cooling. This energy is produced mostly by burning fossil fuels, which has a high negative environmental impact. The characteristics of a building are an important factor to determine the necessities of heating and cooling loads. Therefore, the study of the relevant characteristics of the buildings, regarding the heating and cooling needed to maintain comfortable indoor air conditions, could be very useful in order to design and construct energy-efficient buildings. In previous studies, different machine-learning approaches have been used to predict heating and cooling loads from the set of variables: relative compactness, surface area, wall area, roof area, overall height, orientation, glazing area and glazing area distribution. However, none of these methods are based on fuzzy logic. In this research, we study two fuzzy logic approaches, i.e., fuzzy inductive reasoning (FIR) and adaptive neuro fuzzy inference system (ANFIS), to deal with the same problem. Fuzzy approaches obtain very good results, outperforming all the methods described in previous studies except one. In this work, we also study the feature selection process of FIR methodology as a pre-processing tool to select the more relevant variables before the use of any predictive modelling methodology. It is proven that FIR feature selection provides interesting insights into the main building variables causally related to heating and cooling loads. This allows better decision making and design strategies, since accurate cooling and heating load estimations and correct identification of parameters that affect building energy demands are of high importance to optimize building designs and equipment specifications.Peer ReviewedPostprint (published version

Optimal Fuzzy Model Construction with Statistical Information using Genetic Algorithm

Fuzzy rule based models have a capability to approximate any continuous function to any degree of accuracy on a compact domain. The majority of FLC design process relies on heuristic knowledge of experience operators. In order to make the design process automatic we present a genetic approach to learn fuzzy rules as well as membership function parameters. Moreover, several statistical information criteria such as the Akaike information criterion (AIC), the Bhansali-Downham information criterion (BDIC), and the Schwarz-Rissanen information criterion (SRIC) are used to construct optimal fuzzy models by reducing fuzzy rules. A genetic scheme is used to design Takagi-Sugeno-Kang (TSK) model for identification of the antecedent rule parameters and the identification of the consequent parameters. Computer simulations are presented confirming the performance of the constructed fuzzy logic controller