371 research outputs found
Adaptive Resonance: An Emerging Neural Theory of Cognition
Adaptive resonance is a theory of cognitive information processing which has been realized as a family of neural network models. In recent years, these models have evolved to incorporate new capabilities in the cognitive, neural, computational, and technological domains. Minimal models provide a conceptual framework, for formulating questions about the nature of cognition; an architectural framework, for mapping cognitive functions to cortical regions; a semantic framework, for precisely defining terms; and a computational framework, for testing hypotheses. These systems are here exemplified by the distributed ART (dART) model, which generalizes localist ART systems to allow arbitrarily distributed code representations, while retaining basic capabilities such as stable fast learning and scalability. Since each component is placed in the context of a unified real-time system, analysis can move from the level of neural processes, including learning laws and rules of synaptic transmission, to cognitive processes, including attention and consciousness. Local design is driven by global functional constraints, with each network synthesizing a dynamic balance of opposing tendencies. The self-contained working ART and dART models can also be transferred to technology, in areas that include remote sensing, sensor fusion, and content-addressable information retrieval from large databases.Office of Naval Research and the defense Advanced Research Projects Agency (N00014-95-1-0409, N00014-1-95-0657); National Institutes of Health (20-316-4304-5
A Survey of Adaptive Resonance Theory Neural Network Models for Engineering Applications
This survey samples from the ever-growing family of adaptive resonance theory
(ART) neural network models used to perform the three primary machine learning
modalities, namely, unsupervised, supervised and reinforcement learning. It
comprises a representative list from classic to modern ART models, thereby
painting a general picture of the architectures developed by researchers over
the past 30 years. The learning dynamics of these ART models are briefly
described, and their distinctive characteristics such as code representation,
long-term memory and corresponding geometric interpretation are discussed.
Useful engineering properties of ART (speed, configurability, explainability,
parallelization and hardware implementation) are examined along with current
challenges. Finally, a compilation of online software libraries is provided. It
is expected that this overview will be helpful to new and seasoned ART
researchers
The category proliferation problem in ART neural networks
This article describes the design of a new model IKMART, for classification of documents and their incorporation into categories based on the KMART architecture. The architecture consists of two networks that mutually cooperate through the interconnection of weights and the output matrix of the coded documents. The architecture retains required network features such as incremental learning without the need of descriptive and input/output fuzzy data, learning acceleration and classification of documents and a minimal number of user-defined parameters. The conducted experiments with real documents showed a more precise categorization of documents and higher classification performance in comparison to the classic KMART algorithm.Web of Science145634
Hybrid Models Of Fuzzy Artmap And Qlearning For Pattern Classification
Pengelasan corak adalah salah satu isu utama dalam pelbagai tugas pencarian
data. Dalam kajian ini, fokus penyelidikan tertumpu kepada reka bentuk dan
pembinaan model hibrid yang menggabungkan rangkaian neural Teori Resonan
Adaptif (ART) terselia dan model Pembelajaran Pengukuhan (RL) untuk pengelasan
corak. Secara khususnya, rangkaian ARTMAP Kabur (FAM) dan Pembelajaran-Q
dijadikan sebagai tulang belakang dalam merekabentuk dan membina model-model
hibrid. Satu model QFAM baharu terlebih dahulu diperkenalkan bagi menambahbaik
prestasi pengelasan rangkaian FAM. Strategi pruning dimasukkan bagi
mengurangkan kekompleksan QFAM. Bagi mengatasi isu ketidak-telusan, Algoritma
Genetik (GA) digunakan bagi mengekstrak hukum kabur if-then daripada QFAM.
Model yang terhasil iaitu QFAM-GA, dapat memberi ramalan berserta dengan
huraian dengan hanya menggunakan bilangan antisiden yang sedikit. Bagi
menambahkan lagi kebolehtahanan model-model Q-FAM, penggunaan sistem agenpelbagai
telah dicadangkan. Hasilnya, model gugusan QFAM berasaskan agen
dengan ukuran percaya dan kaedah rundingan baharu telah dicadangkan. Pelbagai
jenis masalah tanda-aras telah digunakan bagi penilaian model-model gugusan dan
individu berasaskan QFAM. Hasilnya telah dianalisa dan dibandingkan dengan FAM
serta model-model yang dilaporkan dalam kajian terdahulu. Sebagai tambahan, dua
daripada masalah dunia-nyata digunakan bagi menunjukkan kebolehan praktikal
model hibrid. Keputusan akhir menunjukkan keberkesanan modul berasaskan QFAM
dalam menerajui tugas-tugas pengelasan corak.
________________________________________________________________________________________________________________________
Pattern classification is one of the primary issues in various data mining
tasks. In this study, the main research focus is on the design and
development of hybrid models, combining the supervised Adaptive
Resonance Theory (ART) neural network and Reinforcement Learning (RL)
models for pattern classification. Specifically, the Fuzzy ARTMAP (FAM)
network and Q-learning are adopted as the backbone for designing and
developing the hybrid models. A new QFAM model is first introduced to
improve the classification performance of FAM network. A pruning strategy
is incorporated to reduce the complexity of QFAM. To overcome the
opaqueness issue, a Genetic Algorithm (GA) is used to extract fuzzy if-then
rules from QFAM. The resulting model, i.e. QFAM-GA, is able to provide
predictions with explanations using only a few antecedents. To further
improve the robustness of QFAM-based models, the notion of multi agent
systems is employed. As a result, an agent-based QFAM ensemble model
with a new trust measurement and negotiation method is proposed. A variety
of benchmark problems are used for evaluation of individual and ensemble
QFAM-based models. The results are analyzed and compared with those
from FAM as well as other models reported in the literature. In addition, two
real-world problems are used to demonstrate the practicality of the hybrid
models. The outcomes indicate the effectiveness of QFAM-based models in
tackling pattern classification tasks
Neural Network and Bioinformatic Methods for Predicting HIV-1 Protease Inhibitor Resistance
This article presents a new method for predicting viral resistance to seven protease inhibitors from the HIV-1 genotype, and for identifying the positions in the protease gene at which the specific nature of the mutation affects resistance. The neural network Analog ARTMAP predicts protease inhibitor resistance from viral genotypes. A feature selection method detects genetic positions that contribute to resistance both alone and through interactions with other positions. This method has identified positions 35, 37, 62, and 77, where traditional feature selection methods have not detected a contribution to resistance.
At several positions in the protease gene, mutations confer differing degress of resistance, depending on the specific amino acid to which the sequence has mutated. To find these positions, an Amino Acid Space is introduced to represent genes in a vector space that captures the functional similarity between amino acid pairs. Feature selection identifies several new positions, including 36, 37, and 43, with amino acid-specific contributions to resistance. Analog ARTMAP networks applied to inputs that represent specific amino acids at these positions perform better than networks that use only mutation locations.Air Force Office of Scientific Research (F49620-01-1-0423); National Geospatial-Intelligence Agency (NMA 201-01-1-2016); National Science Foundation (SBE-0354378); Office of Naval Research (N00014-01-1-0624
Solving a Direct Marketing Problem by Three Types of ARTMAP Neural Networks
An important task for a direct mailing company is to detect potential customers in order to avoid
unnecessary and unwanted mailing. This paper describes a non-linear method to predict profiles of potential
customers using dARTMAP, ARTMAP-IC, and Fuzzy ARTMAP neural networks. The paper discusses
advantages of the proposed approaches over similar techniques based on MLP neural networks
Genetically Engineered Adaptive Resonance Theory (art) Neural Network Architectures
Fuzzy ARTMAP (FAM) is currently considered to be one of the premier neural network architectures in solving classification problems. One of the limitations of Fuzzy ARTMAP that has been extensively reported in the literature is the category proliferation problem. That is Fuzzy ARTMAP has the tendency of increasing its network size, as it is confronted with more and more data, especially if the data is of noisy and/or overlapping nature. To remedy this problem a number of researchers have designed modifications to the training phase of Fuzzy ARTMAP that had the beneficial effect of reducing this phenomenon. In this thesis we propose a new approach to handle the category proliferation problem in Fuzzy ARTMAP by evolving trained FAM architectures. We refer to the resulting FAM architectures as GFAM. We demonstrate through extensive experimentation that an evolved FAM (GFAM) exhibits good (sometimes optimal) generalization, small size (sometimes optimal size), and requires reasonable computational effort to produce an optimal or sub-optimal network. Furthermore, comparisons of the GFAM with other approaches, proposed in the literature, which address the FAM category proliferation problem, illustrate that the GFAM has a number of advantages (i.e. produces smaller or equal size architectures, of better or as good generalization, with reduced computational complexity). Furthermore, in this dissertation we have extended the approach used with Fuzzy ARTMAP to other ART architectures, such as Ellipsoidal ARTMAP (EAM) and Gaussian ARTMAP (GAM) that also suffer from the ART category proliferation problem. Thus, we have designed and experimented with genetically engineered EAM and GAM architectures, named GEAM and GGAM. Comparisons of GEAM and GGAM with other ART architectures that were introduced in the ART literature, addressing the category proliferation problem, illustrate similar advantages observed by GFAM (i.e, GEAM and GGAM produce smaller size ART architectures, of better or improved generalization, with reduced computational complexity). Moverover, to optimally cover the input space of a problem, we proposed a genetically engineered ART architecture that combines the category structures of two different ART networks, FAM and EAM. We named this architecture UART (Universal ART). We analyzed the order of search in UART, that is the order according to which a FAM category or an EAM category is accessed in UART. This analysis allowed us to better understand UART\u27s functionality. Experiments were also conducted to compare UART with other ART architectures, in a similar fashion as GFAM and GEAM were compared. Similar conclusions were drawn from this comparison, as in the comparison of GFAM and GEAM with other ART architectures. Finally, we analyzed the computational complexity of the genetically engineered ART architectures and we compared it with the computational complexity of other ART architectures, introduced into the literature. This analytical comparison verified our claim that the genetically engineered ART architectures produce better generalization and smaller sizes ART structures, at reduced computational complexity, compared to other ART approaches. In review, a methodology was introduced of how to combine the answers (categories) of ART architectures, using genetic algorithms. This methodology was successfully applied to FAM, EAM and FAM and EAM ART architectures, with success, resulting in ART neural networks which outperformed other ART architectures, previously introduced into the literature, and quite often produced ART architectures that attained optimal classification results, at reduced computational complexity
- …