A Survey of Adaptive Resonance Theory Neural Network Models for Engineering Applications

This survey samples from the ever-growing family of adaptive resonance theory (ART) neural network models used to perform the three primary machine learning modalities, namely, unsupervised, supervised and reinforcement learning. It comprises a representative list from classic to modern ART models, thereby painting a general picture of the architectures developed by researchers over the past 30 years. The learning dynamics of these ART models are briefly described, and their distinctive characteristics such as code representation, long-term memory and corresponding geometric interpretation are discussed. Useful engineering properties of ART (speed, configurability, explainability, parallelization and hardware implementation) are examined along with current challenges. Finally, a compilation of online software libraries is provided. It is expected that this overview will be helpful to new and seasoned ART researchers

A Hierarchical ART Network for the Stable Incremental Learning of Topological Structures and Associations from Noisy Data

Tscherepanow M, Kortkamp M, Kammer M. A Hierarchical ART Network for the Stable Incremental Learning of Topological Structures and Associations from Noisy Data. Neural Networks. 2011;24(8):906-916.In this article, a novel unsupervised neural network combining elements from Adaptive Resonance Theory and topology-learning neural networks is presented. It enables stable on-line clustering of stationary and non-stationary input data by learning their inherent topology. Here, two network components representing two different levels of detail are trained simultaneously. By virtue of several filtering mechanisms, the sensitivity to noise is diminished, which renders the proposed network suitable for the application to real-world problems. Furthermore, we demonstrate that this network constitutes an excellent basis to learn and recall associations between real-world associative keys. Its incremental nature ensures that the capacity of the corresponding associative memory fits the amount of knowledge to be learnt. Moreover, the formed clusters efficiently represent the relations between the keys, even if noisy data is used for training. In addition, we present an iterative recall mechanism to retrieve stored information based on one of the associative keys used for training. As different levels of detail are learnt, the recall can be performed with different degrees of accuracy

Neuroengineering of Clustering Algorithms

Cluster analysis can be broadly divided into multivariate data visualization, clustering algorithms, and cluster validation. This dissertation contributes neural network-based techniques to perform all three unsupervised learning tasks. Particularly, the first paper provides a comprehensive review on adaptive resonance theory (ART) models for engineering applications and provides context for the four subsequent papers. These papers are devoted to enhancements of ART-based clustering algorithms from (a) a practical perspective by exploiting the visual assessment of cluster tendency (VAT) sorting algorithm as a preprocessor for ART offline training, thus mitigating ordering effects; and (b) an engineering perspective by designing a family of multi-criteria ART models: dual vigilance fuzzy ART and distributed dual vigilance fuzzy ART (both of which are capable of detecting complex cluster structures), merge ART (aggregates partitions and lessens ordering effects in online learning), and cluster validity index vigilance in fuzzy ART (features a robust vigilance parameter selection and alleviates ordering effects in offline learning). The sixth paper consists of enhancements to data visualization using self-organizing maps (SOMs) by depicting in the reduced dimension and topology-preserving SOM grid information-theoretic similarity measures between neighboring neurons. This visualization\u27s parameters are estimated using samples selected via a single-linkage procedure, thereby generating heatmaps that portray more homogeneous within-cluster similarities and crisper between-cluster boundaries. The seventh paper presents incremental cluster validity indices (iCVIs) realized by (a) incorporating existing formulations of online computations for clusters\u27 descriptors, or (b) modifying an existing ART-based model and incrementally updating local density counts between prototypes. Moreover, this last paper provides the first comprehensive comparison of iCVIs in the computational intelligence literature --Abstract, page iv

Planiranje robotskog djelovanja zasnovano na tumačenju prostornih struktura

Robot je programabilan mehanizam čije se djelovanje temelji na upravljačkim algoritmima. Prilikom rada u nestrukturiranoj okolini upravljački algoritmi postaju eksplicitne funkcije položaja i vremena u povratnoj vezi sa stanjem okoline. Obradu podataka iz okoline te zaključivanje o odgovarajućem djelovanju robota moguće je temeljiti na principima strojnoga učenja. Predloženo istraživanje bavi se razvojem modela učenja i planiranja djelovanja robota. Proces učenja temelji se na novoj umjetnoj neuronskoj mreži klasifikacijom prostornih struktura. Pojam prostorne strukture podrazumijeva interpretaciju rasporeda poznatih objekata u ravnini koje robot percipira vizijskim sustavom. Umjetna neuronska mreža za klasifikaciju i prepoznavanje prostornih struktura zasniva se na teoriji adaptivne rezonancije. Planiranje djelovanja robota temeljno je na usporednoj evoluciji rješenja razvojem novoga genetskoga algoritma. Genetski algoritam kao osnovni cilj ima prostornu pretvorbu neuređenoga stanja objekata u uređeno. Izvorni znanstveni doprinos rada očituje se u sljedećem: 1) Samoorganizirajuća umjetna neuronska mreža za klasifikaciju i prepoznavanje prostornih struktura zasnovana na teoriji adaptivne rezonancije, koju odlikuje nova dvorazinska klasifikacija po obliku i rasporedu objekata te mehanizam asocijativnoga povezivanja neuređenoga skupa objekata s uređenim i 2) Novi genetski algoritam za planiranje robotskoga djelovanja u nestrukturiranoj radnoj okolini karakteriziran usporednom evolucijskom strategijom za pronalaženje rješenja, s ciljem prostorne pretvorbe neuređenoga stanja objekata u uređeno