A new data-driven neural fuzzy system with collaborative fuzzy clustering mechanism

© 2015 Elsevier B.V. In this paper, a novel fuzzy rule transfer mechanism for self-constructing neural fuzzy inference networks is being proposed. The features of the proposed method, termed data-driven neural fuzzy system with collaborative fuzzy clustering mechanism (DDNFS-CFCM) are; (1) Fuzzy rules are generated facilely by fuzzy c-means (FCM) and then adapted by the preprocessed collaborative fuzzy clustering (PCFC) technique, and (2) Structure and parameter learning are performed simultaneously without selecting the initial parameters. The DDNFS-CFCM can be applied to deal with big data problems by the virtue of the PCFC technique, which is capable of dealing with immense datasets while preserving the privacy and security of datasets. Initially, the entire dataset is organized into two individual datasets for the PCFC procedure, where each of the dataset is clustered separately. The knowledge of prototype variables (cluster centers) and the matrix of just one halve of the dataset through collaborative technique are deployed. The DDNFS-CFCM is able to achieve consistency in the presence of collective knowledge of the PCFC and boost the system modeling process by parameter learning ability of the self-constructing neural fuzzy inference networks (SONFIN). The proposed method outperforms other existing methods for time series prediction problems

Soft-Boosted Self-Constructing Neural Fuzzy Inference Network

© 2013 IEEE. This correspondence paper proposes an improved version of the self-constructing neural fuzzy inference network (SONFIN), called soft-boosted SONFIN (SB-SONFIN). The design softly boosts the learning process of the SONFIN in order to decrease the error rate and enhance the learning speed. The SB-SONFIN boosts the learning power of the SONFIN by taking into account the numbers of fuzzy rules and initial weights which are two important parameters of the SONFIN, SB-SONFIN advances the learning process by: 1) initializing the weights with the width of the fuzzy sets rather than just with random values and 2) improving the parameter learning rates with the number of learned fuzzy rules. The effectiveness of the proposed soft boosting scheme is validated on several real world and benchmark datasets. The experimental results show that the SB-SONFIN possesses the capability to outperform other known methods on various datasets

Levenberg-Marquardt Algorithm for Mackey-Glass Chaotic Time Series Prediction

For decades, Mackey-Glass chaotic time series prediction has attracted more and more attention. When the multilayer perceptron is used to predict the Mackey-Glass chaotic time series, what we should do is to minimize the loss function. As is well known, the convergence speed of the loss function is rapid in the beginning of the learning process, while the convergence speed is very slow when the parameter is near to the minimum point. In order to overcome these problems, we introduce the Levenberg-Marquardt algorithm (LMA). Firstly, a rough introduction is given to the multilayer perceptron, including the structure and the model approximation method. Secondly, we introduce the LMA and discuss how to implement the LMA. Lastly, an illustrative example is carried out to show the prediction efficiency of the LMA. Simulations show that the LMA can give more accurate prediction than the gradient descent method

Interval and Fuzzy Computing in Neural Network for System Identification Problems

Increase of population and growing of societal and commercial activities with limited land available in a modern city leads to construction up of tall/high-rise buildings. As such, it is important to investigate about the health of the structure after the occurrence of manmade or natural disasters such as earthquakes etc. A direct mathematical expression for parametric study or system identification of these structures is not always possible. Actually System Identification (SI) problems are inverse vibration problems consisting of coupled linear or non-linear differential equations that depend upon the physics of the system. It is also not always possible to get the solutions for these problems by classical methods. Few researchers have used different methods to solve the above mentioned problems. But difficulties are faced very often while finding solution to these problems because inverse problem generally gives non-unique parameter estimates. To overcome these difficulties alternate soft computing techniques such as Artificial Neural Networks (ANNs) are being used by various researchers to handle the above SI problems. It is worth mentioning that traditional neural network methods have inherent advantage because it can model the experimental data (input and output) where good mathematical model is not available. Moreover, inverse problems have been solved by other researchers for deterministic cases only. But while performing experiments it is always not possible to get the data exactly in crisp form. There may be some errors that are due to involvement of human or experiment. Accordingly, those data may actually be in uncertain form and corresponding methodologies need to be developed. It is an important issue about dealing with variables, parameters or data with uncertain value. There are three classes of uncertain models, which are probabilistic, fuzzy and interval. Recently, fuzzy theory and interval analysis are becoming powerful tools for many applications in recent decades. It is known that interval and fuzzy computations are themselves very complex to handle. Having these in mind one has to develop efficient computational models and algorithms very carefully to handle these uncertain problems. As said above, in general we may not obtain the corresponding input and output values (experimental) exactly or in crisp form but we may have only uncertain information of the data. Hence, investigations are needed to handle the SI problems where data is available in uncertain form. Identification methods with crisp (exact) data are known and traditional neural network methods have already been used by various researchers. But when the data are in uncertain form then traditional ANN may not be applied. Accordingly, new ANN models need to be developed which may solve the targeted uncertain SI problems. Hence present investigation targets to develop powerful methods of neural network based on interval and fuzzy theory for the analysis and simulation with respect to the uncertain system identification problems. In this thesis, these uncertain data are assumed as interval and fuzzy numbers. Accordingly, identification methodologies are developed for multistorey shear buildings by proposing new models of Interval Neural Network (INN) and Fuzzy Neural Network (FNN) models which can handle interval and fuzzified data respectively. It may however be noted that the developed methodology not only be important for the mentioned problems but those may very well be used in other application problems too. Few SI problems have been solved in the present thesis using INN and FNN model which are briefly described below. From initial design parameters (namely stiffness and mass in terms of interval and fuzzy) corresponding design frequencies may be obtained for a given structural problem viz. for a multistorey shear structure. The uncertain (interval/fuzzy) frequencies may then be used to estimate the present structural parameter values by the proposed INN and FNN. Next, the identification has been done using vibration response of the structure subject to ambient vibration with interval/fuzzy initial conditions. Forced vibration with horizontal displacement in interval/fuzzified form has also been used to investigate the identification problem. Moreover this study involves SI problems of structures (viz. shear buildings) with respect to earthquake data in order to know the health of a structure. It is well known that earthquake data are both positive and negative. The Interval Neural Network and Fuzzy Neural Network model may not handle the data with negative sign due to the complexity in interval and fuzzy computation. As regards, a novel transformation method have been developed to compute response of a structural system by training the model for Indian earthquakes at Chamoli and Uttarkashi using uncertain (interval/fuzzified) ground motion data. The simulation may give an idea about the safety of the structural system in case of future earthquakes. Further a single layer interval and fuzzy neural network based strategy has been proposed for simultaneous identification of the mass, stiffness and damping of uncertain multi-storey shear buildings using series/cluster of neural networks. It is known that training in MNN and also in INN and FNN are time consuming because these models depend upon the number of nodes in the hidden layer and convergence of the weights during training. As such, single layer Functional Link Neural Network (FLNN) with multi-input and multi-output model has also been proposed to solve the system identification problems for the first time. It is worth mentioning that, single input single output FLNN had been proposed by previous authors. In FLNN, the hidden layer is replaced by a functional expansion block for enhancement of the input patterns using orthogonal polynomials such as Chebyshev, Legendre and Hermite, etc. The computations become more efficient than the traditional or classical multi-layer neural network due to the absence of hidden layer. FLNN has also been used for structural response prediction of multistorey shear buildings subject to earthquake ground motion. It is seen that FLNN can very well predict the structural response of different floors of multi-storey shear building subject to earthquake data. Comparison of results among Multi layer Neural Network (MNN), Chebyshev Neural Network (ChNN), Legendre Neural Network (LeNN), Hermite Neural Network (HNN) and desired are considered and it is found that Functional Link Neural Network models are more effective and takes less computation time than MNN. In order to show the reliability, efficacy and powerfulness of INN, FNN and FLNN models variety of problems have been solved here. Finally FLNN is also extended to interval based FLNN which is again proposed for the first time to the best of our knowledge. This model is implemented to estimate the uncertain stiffness parameters of a multi-storey shear building. The parameters are identified here using uncertain response of the structure subject to ambient and forced vibration with interval initial condition and horizontal displacement also in interval form