16 research outputs found
Wind Speed Intervals Prediction using Meta-cognitive Approach
© 2018 The Authors. Published by Elsevier Ltd. In this paper, an interval type-2 neural fuzzy inference system and its meta-cognitive learning algorithm for wind speed prediction is proposed. Interval type-2 neuro-fuzzy system is capable of handling uncertainty associated with the data and meta-cognition employs self-regulation mechanism for learning. The proposed system realizes Takagi-Sugeno-Kang inference mechanism and adopts a fast data-driven interval-reduction method. Meta-cognitive learning enables the network structure to evolve automatically based on the knowledge in data. The parameters are updated based on an extended Kalman filter algorithm. In addition, the proposed network is able to construct prediction intervals to quantify uncertainty associated with forecasts. For performance evaluation, a real-world wind speed prediction problem is utilized. Using historical data, the model provides short-term prediction intervals of wind speed. The performance of proposed algorithm is compared with existing state-of-the art fuzzy inference system approaches and the results clearly indicate its advantages in forecasting problems
A randomized neural network for data streams
© 2017 IEEE. Randomized neural network (RNN) is a highly feasible solution in the era of big data because it offers a simple and fast working principle in processing dynamic and evolving data streams. This paper proposes a novel RNN, namely recurrent type-2 random vector functional link network (RT2McRVFLN), which provides a highly scalable solution for data streams in a strictly online and integrated framework. It is built upon the psychologically inspired concept of metacognitive learning, which covers three basic components of human learning: what-to-learn, how-to-learn, and when-to-learn. The what-to-learn selects important samples on the fly with the use of online active learning scenario, which renders our algorithm an online semi-supervised algorithm. The how-to-learn process combines an open structure of evolving concept and a randomized learning algorithm of random vector functional link network (RVFLN). The efficacy of the RT2McRVFLN has been numerically validated through two real-world case studies and comparisons with its counterparts, which arrive at a conclusive finding that our algorithm delivers a tradeoff between accuracy and simplicity
Wave Forecasting using Meta-cognitive Interval Type-2 Fuzzy Inference System
© 2018 The Authors. Published by Elsevier Ltd. Renewable energy is fast becoming a mainstay in today's energy scenario. One of the important sources of renewable energy is the wave energy, in addition to wind, solar, tidal, etc. Wave prediction/forecasting is consequently essential in coastal and ocean engineering studies. However, it is difficult to predict wave parameters in long term and even in the short term due to its intermittent nature. This study aims to propose a solution to handle the issue using Interval type-2 fuzzy inference system, or IT2FIS. IT2FIS has been shown to be capable of handling uncertainty associated with the data. The proposed IT2FIS is a fuzzy neural network realizing Takagi-Sugeno-Kang inference mechanism employing meta-cognitive learning algorithm. The algorithm monitors knowledge in a sample to decide an appropriate learning strategy. Performance of the system is evaluated by studying significant wave heights obtained from buoys located in Singapore. The results compared with existing state-of-the art fuzzy inference system approaches clearly indicate the advantage of IT2FIS based wave prediction
An Incremental Construction of Deep Neuro Fuzzy System for Continual Learning of Non-stationary Data Streams
Existing FNNs are mostly developed under a shallow network configuration
having lower generalization power than those of deep structures. This paper
proposes a novel self-organizing deep FNN, namely DEVFNN. Fuzzy rules can be
automatically extracted from data streams or removed if they play limited role
during their lifespan. The structure of the network can be deepened on demand
by stacking additional layers using a drift detection method which not only
detects the covariate drift, variations of input space, but also accurately
identifies the real drift, dynamic changes of both feature space and target
space. DEVFNN is developed under the stacked generalization principle via the
feature augmentation concept where a recently developed algorithm, namely
gClass, drives the hidden layer. It is equipped by an automatic feature
selection method which controls activation and deactivation of input attributes
to induce varying subsets of input features. A deep network simplification
procedure is put forward using the concept of hidden layer merging to prevent
uncontrollable growth of dimensionality of input space due to the nature of
feature augmentation approach in building a deep network structure. DEVFNN
works in the sample-wise fashion and is compatible for data stream
applications. The efficacy of DEVFNN has been thoroughly evaluated using seven
datasets with non-stationary properties under the prequential test-then-train
protocol. It has been compared with four popular continual learning algorithms
and its shallow counterpart where DEVFNN demonstrates improvement of
classification accuracy. Moreover, it is also shown that the concept drift
detection method is an effective tool to control the depth of network structure
while the hidden layer merging scenario is capable of simplifying the network
complexity of a deep network with negligible compromise of generalization
performance.Comment: This paper has been published in IEEE Transactions on Fuzzy System
Evolving fuzzy and neuro-fuzzy approaches in clustering, regression, identification, and classification: A Survey
Major assumptions in computational intelligence and machine learning consist of the availability of a historical dataset for model development, and that the resulting model will, to some extent, handle similar instances during its online operation. However, in many real world applications, these assumptions may not hold as the amount of previously available data may be insufficient to represent the underlying system, and the environment and the system may change over time. As the amount of data increases, it is no longer feasible to process data efficiently using iterative algorithms, which typically require multiple passes over the same portions of data. Evolving modeling from data streams has emerged as a framework to address these issues properly by self-adaptation, single-pass learning steps and evolution as well as contraction of model components on demand and on the fly. This survey focuses on evolving fuzzy rule-based models and neuro-fuzzy networks for clustering, classification and regression and system identification in online, real-time environments where learning and model development should be performed incrementally. (C) 2019 Published by Elsevier Inc.Igor Škrjanc, Jose Antonio Iglesias and Araceli Sanchis would like to thank to the Chair of Excellence of Universidad Carlos III de Madrid, and the Bank of Santander Program for their support. Igor Škrjanc is grateful to Slovenian Research Agency with the research program P2-0219, Modeling, simulation and control. Daniel Leite acknowledges the Minas Gerais Foundation for Research and Development (FAPEMIG), process APQ-03384-18. Igor Škrjanc and Edwin Lughofer acknowledges the support by the ”LCM — K2 Center for Symbiotic Mechatronics” within the framework of the Austrian COMET-K2 program. Fernando Gomide is grateful to the Brazilian National Council for Scientific and Technological Development (CNPq) for grant
305906/2014-3
Heuristic design of fuzzy inference systems: a review of three decades of research
This paper provides an in-depth review of the optimal design of type-1 and type-2 fuzzy inference systems (FIS) using five well known computational frameworks: genetic-fuzzy systems (GFS), neuro-fuzzy systems (NFS), hierarchical fuzzy systems (HFS), evolving fuzzy systems (EFS), and multi-objective fuzzy systems (MFS), which is in view that some of them are linked to each other. The heuristic design of GFS uses evolutionary algorithms for optimizing both Mamdani-type and Takagi–Sugeno–Kang-type fuzzy systems. Whereas, the NFS combines the FIS with neural network learning systems to improve the approximation ability. An HFS combines two or more low-dimensional fuzzy logic units in a hierarchical design to overcome the curse of dimensionality. An EFS solves the data streaming issues by evolving the system incrementally, and an MFS solves the multi-objective trade-offs like the simultaneous maximization of both interpretability and accuracy. This paper offers a synthesis of these dimensions and explores their potentials, challenges, and opportunities in FIS research. This review also examines the complex relations among these dimensions and the possibilities of combining one or more computational frameworks adding another dimension: deep fuzzy systems
Multiobjective programming for type-2 hierarchical fuzzy inference trees
This paper proposes a design of hierarchical fuzzy inference tree (HFIT). An HFIT produces an
optimum tree-like structure. Specifically, a natural hierarchical structure that accommodates simplicity by
combining several low-dimensional fuzzy inference systems (FISs). Such a natural hierarchical structure
provides a high degree of approximation accuracy. The construction of HFIT takes place in two phases.
Firstly, a nondominated sorting based multiobjective genetic programming (MOGP) is applied to obtain a
simple tree structure (low model’s complexity) with a high accuracy. Secondly, the differential evolution
algorithm is applied to optimize the obtained tree’s parameters. In the obtained tree, each node has a
different input’s combination, where the evolutionary process governs the input’s combination. Hence,
HFIT nodes are heterogeneous in nature, which leads to a high diversity among the rules generated
by the HFIT. Additionally, the HFIT provides an automatic feature selection because it uses MOGP
for the tree’s structural optimization that accept inputs only relevant to the knowledge contained in
data. The HFIT was studied in the context of both type-1 and type-2 FISs, and its performance was
evaluated through six application problems. Moreover, the proposed multiobjective HFIT was compared
both theoretically and empirically with recently proposed FISs methods from the literature, such as
McIT2FIS, TSCIT2FNN, SIT2FNN, RIT2FNS-WB, eT2FIS, MRIT2NFS, IT2FNN-SVR, etc. From the
obtained results, it was found that the HFIT provided less complex and highly accurate models compared
to the models produced by most of the other methods. Hence, the proposed HFIT is an efficient and
competitive alternative to the other FISs for function approximation and feature selectio
Literature Review of the Recent Trends and Applications in various Fuzzy Rule based systems
Fuzzy rule based systems (FRBSs) is a rule-based system which uses linguistic
fuzzy variables as antecedents and consequent to represent human understandable
knowledge. They have been applied to various applications and areas throughout
the soft computing literature. However, FRBSs suffers from many drawbacks such
as uncertainty representation, high number of rules, interpretability loss,
high computational time for learning etc. To overcome these issues with FRBSs,
there exists many extensions of FRBSs. This paper presents an overview and
literature review of recent trends on various types and prominent areas of
fuzzy systems (FRBSs) namely genetic fuzzy system (GFS), hierarchical fuzzy
system (HFS), neuro fuzzy system (NFS), evolving fuzzy system (eFS), FRBSs for
big data, FRBSs for imbalanced data, interpretability in FRBSs and FRBSs which
use cluster centroids as fuzzy rules. The review is for years 2010-2021. This
paper also highlights important contributions, publication statistics and
current trends in the field. The paper also addresses several open research
areas which need further attention from the FRBSs research community.Comment: 49 pages, Accepted for publication in ijf