Self-Organization of Topographic Mixture Networks Using Attentional Feedback

This paper proposes a biologically-motivated neural network model of supervised learning. The model possesses two novel learning mechanisms. The first is a network for learning topographic mixtures. The network's internal category nodes are the mixture components, which learn to encode smooth distributions in the input space by taking advantage of topography in the input feature maps. The second mechanism is an attentional biasing feedback circuit. When the network makes an incorrect output prediction, this feedback circuit modulates the learning rates of the category nodes, by amounts based on the sharpness of their tuning, in order to improve the network's prediction accuracy. The network is evaluated on several standard classification benchmarks and shown to perform well in comparison to other classifiers. Possible relationships are discussed between the network's learning properties and those of biological neural networks. Possible future extensions of the network are also discussed.Defense Advanced Research Projects Agency and the Office of Naval Research (N00014-95-1-0409

Heuristic pattern correction scheme using adaptively trained generalized regression neural networks

In many pattern classification problems, an intelligent neural system is required which can learn the newly encountered but misclassified patterns incrementally, while keeping a good classification performance over the past patterns stored in the network. In the paper, an heuristic pattern correction scheme is proposed using adaptively trained generalized regression neural networks (GRNNs). The scheme is based upon both network growing and dual-stage shrinking mechanisms. In the network growing phase, a subset of the misclassified patterns in each incoming data set is iteratively added into the network until all the patterns in the incoming data set are classified correctly. Then, the redundancy in the growing phase is removed in the dual-stage network shrinking. Both long- and short-term memory models are considered in the network shrinking, which are motivated from biological study of the brain. The learning capability of the proposed scheme is investigated through extensive simulation studie

Artmap Networks for Classification of Ultrasonic Weld Inspection Signals

Inverse problems in Nondestructive Evaluation (NDE) involve estimating the characteristics of flaws from measurements obtained during an inspection. Several techniques have been developed over the years for solving the inverse problem [1]. These techniques range from calibration approaches to numerical methods based on integral equations. Signal identification and classification is one of the more popular approaches for inverse problems encountered in many practical NDE applications

Integrating Local and Global Error Statistics for Multi-Scale RBF Network Training: An Assessment on Remote Sensing Data

Background This study discusses the theoretical underpinnings of a novel multi-scale radial basis function (MSRBF) neural network along with its application to classification and regression tasks in remote sensing. The novelty of the proposed MSRBF network relies on the integration of both local and global error statistics in the node selection process. Methodology and Principal Findings The method was tested on a binary classification task, detection of impervious surfaces using a Landsat satellite image, and a regression problem, simulation of waveform LiDAR data. In the classification scenario, results indicate that the MSRBF is superior to existing radial basis function and back propagation neural networks in terms of obtained classification accuracy and training-testing consistency, especially for smaller datasets. The latter is especially important as reference data acquisition is always an issue in remote sensing applications. In the regression case, MSRBF provided improved accuracy and consistency when contrasted with a multi kernel RBF network. Conclusion and Significance Results highlight the potential of a novel training methodology that is not restricted to a specific algorithmic type, therefore significantly advancing machine learning algorithms for classification and regression tasks. The MSRBF is expected to find numerous applications within and outside the remote sensing field

On the Use of the FuzzyARTMAP Neural Network for Pattern Recognition in Statistical Process Control using a Factorial Design

Time-series statistical pattern recognition is of prime importance in statistics, especially in quality control techniques for manufacturing processes. A frequent problem in this application is the complexity when trying to determine the behaviour (pattern) from sample data. There have been identified standard patterns which are commonly present when using the X chart; its detection depends on human judgement supported by norms and graphical criteria. In the last few years, it has been demonstrated that Artificial Neural Networks (ANN’s) are useful to predict the type of time-series pattern instead of the use of rules. However, the ANN control parameters have to be fixed to values that maximize its performance. This research proposes an experimental design methodology to determine the most appropriate values for the control parameters of the FuzzyARTMAP ANN such as: learning rate (β ) and network vigilance (ρa, ρb, ρab) in order to increment the neural network efficiency during unnatural pattern recognition

Time series analysis using fractal theory and online ensemble classifiers with application to stock portfolio optimization

Neural Network method is a technique that is heavily researched and used in applications within the engineering field for various purposes ranging from process control to biomedical applications. The success of Neural Networks (NN) in engineering applications, e.g. object tracking and face recognition has motivated its application to the finance industry. In the financial industry, time series data is used to model economic variables. As a result, finance researchers, portfolio managers and stockbrokers have taken interest in applying NN to model non-linear problems they face in their practice. NN facilitates the approach of predicting stocks due to its ability to accurately and intuitively learn complex patterns and characterizes these patterns as simple equations. In this research, a methodology that uses fractal theory and NN framework to model the stock market behavior is proposed and developed. The time series analysis is carried out using the proposed approach with application to modelling the Dow Jones Average Index’s future directional movement. A methodology to establish self-similarity of time series and long memory effects that result in classifying the time series signal as persistent, random or non-persistent using the rescaled range analysis technique is developed. A linear regression technique is used for the estimation of the required parameters and an incremental online NN algorithm is implemented to predict the directional movement of the stock. An iterative fractal analysis technique is used to select the required signal intervals using the approximated parameters. The selected data is later combined to form a signal of interest and then pass it to the ensemble of classifiers. The classifiers are modelled using a neural network based algorithm. The performance of the final algorithm is measured based on accuracy of predicting the direction of movement and also on the algorithm’s confidence in its decision-making. The improvement within the final algorithm is easily assessed by comparing results from two different models in which the first model is implemented without fractal analysis and the second model is implemented with the aid of a strong fractal analysis technique. The results of the first NN model were published in the Lecture Notes in Computer Science 2006 by Springer. The second NN model incorporated a fractal theory technique. The results from this model shows a great deal of improvement when classifying the next day’s stock direction of movement. A summary of these results were submitted to the Australian Joint Conference on Artificial Intelligence 2006 for publishing. Limitations on the sample size, including problems encountered with the proposed approach are also outlined in the next sections. This document also outlines recommendations that can be implemented as further steps to advance and improve the proposed approach for future work