Adaptive Resonance Theory: Self-Organizing Networks for Stable Learning, Recognition, and Prediction

Adaptive Resonance Theory (ART) is a neural theory of human and primate information processing and of adaptive pattern recognition and prediction for technology. Biological applications to attentive learning of visual recognition categories by inferotemporal cortex and hippocampal system, medial temporal amnesia, corticogeniculate synchronization, auditory streaming, speech recognition, and eye movement control are noted. ARTMAP systems for technology integrate neural networks, fuzzy logic, and expert production systems to carry out both unsupervised and supervised learning. Fast and slow learning are both stable response to large non stationary databases. Match tracking search conjointly maximizes learned compression while minimizing predictive error. Spatial and temporal evidence accumulation improve accuracy in 3-D object recognition. Other applications are noted.Office of Naval Research (N00014-95-I-0657, N00014-95-1-0409, N00014-92-J-1309, N00014-92-J4015); National Science Foundation (IRI-94-1659

Learning FCMs with multi-local and balanced memetic algorithms for forecasting industrial drying processes

In this paper, we propose a Fuzzy Cognitive Map (FCM) learning approach with a multi-local search in balanced memetic algorithms for forecasting industrial drying processes. The first contribution of this paper is to propose a FCM model by an Evolutionary Algorithm (EA), but the resulted FCM model is improved by a multi-local and balanced local search algorithm. Memetic algorithms can be tuned with different local search strategies (CMA-ES, SW, SSW and Simplex) and the balance of the effort between global and local search. To do this, we applied the proposed approach to the forecasting of moisture loss in industrial drying process. The thermal drying process is a relevant one used in many industrial processes such as food industry, biofuels production, detergents and dyes in powder production, pharmaceutical industry, reprography applications, textile industries, and others. This research also shows that exploration of the search space is more relevant than finding local optima in the FCM models tested

Survey of data mining approaches to user modeling for adaptive hypermedia

The ability of an adaptive hypermedia system to create tailored environments depends mainly on the amount and accuracy of information stored in each user model. Some of the difficulties that user modeling faces are the amount of data available to create user models, the adequacy of the data, the noise within that data, and the necessity of capturing the imprecise nature of human behavior. Data mining and machine learning techniques have the ability to handle large amounts of data and to process uncertainty. These characteristics make these techniques suitable for automatic generation of user models that simulate human decision making. This paper surveys different data mining techniques that can be used to efficiently and accurately capture user behavior. The paper also presents guidelines that show which techniques may be used more efficiently according to the task implemented by the applicatio

Network Analysis, Creative System Modelling and Decision Support: The NetSyMoD Approach

This paper presents the NetSyMoD approach – where NetSyMod stands for Network Analysis – Creative System Modelling – Decision Support. It represents the outcome of several years of research at FEEM in the field of natural resources management, environmental evaluation and decision-making, within the Natural Resources Management Research Programme. NetSyMoD is a flexible and comprehensive methodological framework, which uses a suite of support tools, aimed at facilitating the involvement of stakeholders or experts in decision-making processes. The main phases envisaged for the process are: (i) the identification of relevant actors, (ii) the analysis of social networks, (iii) the creative system modelling and modelling of the reality being considered (i.e. the local socio-economic and environmental system), and (iv) the analysis of alternative options available for the management of the specific case (e.g. alternative projects, plans, strategies). The strategies for participation are necessarily context-dependent, and thus not all the NetSyMod phases may be needed in every application. Furthermore, the practical solutions for their implementation may significantly differ from one case to another, depending not only on the context, but also on the available resources (human and financial). The various applications of NetSyMoD have nonetheless in common the same approach for problem analysis and communication within a group of actors, based upon the use of creative thinking techniques, the formalisation of human-environment relationships through the DPSIR framework, and the use of multi-criteria analysis through the mDSS software.Social Network, Integrated Analysis, Participatory Modelling, Decision Support

Deep fusion of multi-channel neurophysiological signal for emotion recognition and monitoring

How to fuse multi-channel neurophysiological signals for emotion recognition is emerging as a hot research topic in community of Computational Psychophysiology. Nevertheless, prior feature engineering based approaches require extracting various domain knowledge related features at a high time cost. Moreover, traditional fusion method cannot fully utilise correlation information between different channels and frequency components. In this paper, we design a hybrid deep learning model, in which the 'Convolutional Neural Network (CNN)' is utilised for extracting task-related features, as well as mining inter-channel and inter-frequency correlation, besides, the 'Recurrent Neural Network (RNN)' is concatenated for integrating contextual information from the frame cube sequence. Experiments are carried out in a trial-level emotion recognition task, on the DEAP benchmarking dataset. Experimental results demonstrate that the proposed framework outperforms the classical methods, with regard to both of the emotional dimensions of Valence and Arousal

Fuzzy ARTMAP: A Neural Network Architecture for Incremental Supervised Learning of Analog Multidimensional Maps

A new neural network architecture is introduced for incremental supervised learning of recognition categories and multidimensional maps in response to arbitrary sequences of analog or binary input vectors. The architecture, called Fuzzy ARTMAP, achieves a synthesis of fuzzy logic and Adaptive Resonance Theory (ART) neural networks by exploiting a close formal similarity between the computations of fuzzy subsethood and ART category choice, resonance, and learning. Fuzzy ARTMAP also realizes a new Minimax Learning Rule that conjointly minimizes predictive error and maximizes code compression, or generalization. This is achieved by a match tracking process that increases the ART vigilance parameter by the minimum amount needed to correct a predictive error. As a result, the system automatically learns a minimal number of recognition categories, or "hidden units", to met accuracy criteria. Category proliferation is prevented by normalizing input vectors at a preprocessing stage. A normalization procedure called complement coding leads to a symmetric theory in which the MIN operator (Λ) and the MAX operator (v) of fuzzy logic play complementary roles. Complement coding uses on-cells and off-cells to represent the input pattern, and preserves individual feature amplitudes while normalizing the total on-cell/off-cell vector. Learning is stable because all adaptive weights can only decrease in time. Decreasing weights correspond to increasing sizes of category "boxes". Smaller vigilance values lead to larger category boxes. Improved prediction is achieved by training the system several times using different orderings of the input set. This voting strategy can also be used to assign probability estimates to competing predictions given small, noisy, or incomplete training sets. Four classes of simulations illustrate Fuzzy ARTMAP performance as compared to benchmark back propagation and genetic algorithm systems. These simulations include (i) finding points inside vs. outside a circle; (ii) learning to tell two spirals apart; (iii) incremental approximation of a piecewise continuous function; and (iv) a letter recognition database. The Fuzzy ARTMAP system is also compared to Salzberg's NGE system and to Simpson's FMMC system.British Petroleum (89-A-1204); Defense Advanced Research Projects Agency (90-0083); National Science Foundation (IRI 90-00530); Office of Naval Research (N00014-91-J-4100); Air Force Office of Scientific Research (90-0175