79 research outputs found
Learnt Topology Gating Artificial Neural Networks
This work combines several established regression and meta-learning techniques to give a holistic regression model
and presents the proposed Learnt Topology Gating Artificial
Neural Networks (LTGANN) model in the context of a general
architecture previously published by the authors. The applied regression techniques are Artificial Neural Networks, which are on one hand used as local experts for the regression modelling and on the other hand as gating networks. The role of the gating networks is to estimate the prediction error of the local experts dependent on the input data samples. This is achieved by relating the input data space to the performance of the local experts, and thus building a performance map, for each of the local experts. The estimation of the prediction error is
then used for the weighting of the local experts predictions. Another advantage of our approach is that the particular neural networks are unconstrained in terms of the number of hidden units. It is only necessary to define the range within which the number of hidden units has to be generated. The model links the topology to the performance, which has been achieved by the network with the given complexity, using a probabilistic approach. As the model was developed in the context of process industry data, it is evaluated using two industrial data sets. The evaluation has shown a clear advantage when using a model combination and meta-learning approach as well as demonstrating the higher performance of LTGANN when compared to a standard combination method
The effect of locality based learning on software defect prediction
Software defect prediction poses many problems during classification. A common solution used to improve software defect prediction is to train on similar, or local, data to the testing data. Prior work [12, 64] shows that locality improves the performance of classifiers. This approach has been commonly applied to the field of software defect prediction. In this thesis, we compare the performance of many classifiers, both locality based and non-locality based. We propose a novel classifier called Clump, with the goals of improving classification while providing an explanation as to how the decisions were reached. We also explore the effects of standard clustering and relevancy filtering algorithms.;Through experimentation, we show that locality does not improve classification performance when applied to software defect prediction. The performance of the algorithms is impacted more by the datasets used than by the algorithmic choices made. More research is needed to explore locality based learning and the impact of the datasets chosen
Nature-Inspired Adaptive Architecture for Soft Sensor Modelling
This paper gives a general overview of the challenges present in the research field of Soft Sensor
building and proposes a novel architecture for building of Soft Sensors, which copes with the identified challenges. The
architecture is inspired and making use of nature-related techniques for computational intelligence. Another aspect,
which is addressed by the proposed architecture, are the identified characteristics of the process industry data. The data
recorded in the process industry consist usually of certain amount of missing values or sample exceeding meaningful
values of the measurements, called data outliers. Other process industry data properties causing problems for the
modelling are the collinearity of the data, drifting data and the different sampling rates of the particular hardware
sensors. It is these characteristics which are the source of the need for an adaptive behaviour of Soft Sensors. The
architecture reflects this need and provides mechanisms for the adaptation and evolution of the Soft Sensor at different
levels. The adaptation capabilities are provided by maintaining a variety of rather simple models. These particular
models, called paths in terms of the architecture, can for example focus on different partition of the input data space, or
provide different adaptation speeds to changes in the data. The actual modelling techniques involved into the
architecture are data-driven computational learning approaches like artificial neural networks, principal component
regression, etc
Application of Computational Intelligence Techniques to Process Industry Problems
In the last two decades there has been a large progress in the computational
intelligence research field. The fruits of the effort spent on the research in the discussed
field are powerful techniques for pattern recognition, data mining, data modelling, etc.
These techniques achieve high performance on traditional data sets like the UCI
machine learning database. Unfortunately, this kind of data sources usually represent
clean data without any problems like data outliers, missing values, feature co-linearity,
etc. common to real-life industrial data. The presence of faulty data samples can have
very harmful effects on the models, for example if presented during the training of the
models, it can either cause sub-optimal performance of the trained model or in the worst
case destroy the so far learnt knowledge of the model. For these reasons the application
of present modelling techniques to industrial problems has developed into a research
field on its own. Based on the discussion of the properties and issues of the data and the
state-of-the-art modelling techniques in the process industry, in this paper a novel
unified approach to the development of predictive models in the process industry is
presented
- …