A Survey of Adaptive Resonance Theory Neural Network Models for Engineering Applications

This survey samples from the ever-growing family of adaptive resonance theory (ART) neural network models used to perform the three primary machine learning modalities, namely, unsupervised, supervised and reinforcement learning. It comprises a representative list from classic to modern ART models, thereby painting a general picture of the architectures developed by researchers over the past 30 years. The learning dynamics of these ART models are briefly described, and their distinctive characteristics such as code representation, long-term memory and corresponding geometric interpretation are discussed. Useful engineering properties of ART (speed, configurability, explainability, parallelization and hardware implementation) are examined along with current challenges. Finally, a compilation of online software libraries is provided. It is expected that this overview will be helpful to new and seasoned ART researchers

An ART1 microchip and its use in multi-ART1 systems

Recently, a real-time clustering microchip neural engine based on the ART1 architecture has been reported. Such chip is able to cluster 100-b patterns into up to 18 categories at a speed of 1.8 μs per pattern. However, that chip rendered an extremely high silicon area consumption of 1 cm2, and consequently an extremely low yield of 6%. Redundant circuit techniques can be introduced to improve yield performance at the cost of further increasing chip size. In this paper we present an improved ART1 chip prototype based on a different approach to implement the most area consuming circuit elements of the first prototype: an array of several thousand current sources which have to match within a precision of around 1%. Such achievement was possible after a careful transistor mismatch characterization of the fabrication process (ES2-1.0 μm CMOS). A new prototype chip has been fabricated which can cluster 50-b input patterns into up to ten categories. The chip has 15 times less area, shows a yield performance of 98%, and presents the same precision and speed than the previous prototype. Due to its higher robustness multichip systems are easily assembled. As a demonstration we show results of a two-chip ART1 system, and of an ARTMAP system made of two ART1 chips and an extra interfacing chip

On the role of pre and post-processing in environmental data mining

The quality of discovered knowledge is highly depending on data quality. Unfortunately real data use to contain noise, uncertainty, errors, redundancies or even irrelevant information. The more complex is the reality to be analyzed, the higher the risk of getting low quality data. Knowledge Discovery from Databases (KDD) offers a global framework to prepare data in the right form to perform correct analyses. On the other hand, the quality of decisions taken upon KDD results, depend not only on the quality of the results themselves, but on the capacity of the system to communicate those results in an understandable form. Environmental systems are particularly complex and environmental users particularly require clarity in their results. In this paper some details about how this can be achieved are provided. The role of the pre and post processing in the whole process of Knowledge Discovery in environmental systems is discussed

Integrating Symbolic and Neural Processing in a Self-Organizing Architechture for Pattern Recognition and Prediction

British Petroleum (89A-1204); Defense Advanced Research Projects Agency (N00014-92-J-4015); National Science Foundation (IRI-90-00530); Office of Naval Research (N00014-91-J-4100); Air Force Office of Scientific Research (F49620-92-J-0225

A cyclo-stationary complex multichannel wiener filter for the prediction of wind speed and direction

This paper develops a linear predictor for application to wind speed and direction forecasting in time and across different sites. The wind speed and direction are modelled via the magnitude and phase of a complex-valued time-series. A multichannel adaptive filter is set to predict this signal, based on its past values and the spatio-temporal correlation between wind signals measured at numerous geographical locations. The time-varying nature of the underlying system and the annual cycle of seasons motivates the development of a cyclo-stationary Wiener filter, which is tested on hourly mean wind speed and direction data from 13 weather stations across the UK, and shown to provide an improvement over both stationary Wiener filtering and a recent auto-regressive approach

Data mining in soft computing framework: a survey

The present article provides a survey of the available literature on data mining using soft computing. A categorization has been provided based on the different soft computing tools and their hybridizations used, the data mining function implemented, and the preference criterion selected by the model. The utility of the different soft computing methodologies is highlighted. Generally fuzzy sets are suitable for handling the issues related to understandability of patterns, incomplete/noisy data, mixed media information and human interaction, and can provide approximate solutions faster. Neural networks are nonparametric, robust, and exhibit good learning and generalization capabilities in data-rich environments. Genetic algorithms provide efficient search algorithms to select a model, from mixed media data, based on some preference criterion/objective function. Rough sets are suitable for handling different types of uncertainty in data. Some challenges to data mining and the application of soft computing methodologies are indicated. An extensive bibliography is also included

A hybrid model-based and memory-based short-term traffic prediction system

Short-term traffic forecasting capabilities on freeways and major arterials have received special attention in the past decade due primarily to their vital role in supporting various travelers\u27 trip decisions and traffic management functions. This research presents a hybrid model-based and memory-based methodology to improve freeway traffic prediction performance. The proposed methodology integrates both approaches to strengthen predictions under both recurrent and non-recurrent conditions. The model-based approach relies on a combination of static and dynamic neural network architectures to achieve optimal prediction performance under various input and traffic condition settings. Concurrently, the memory-based component is derived from the data archival system that encodes the commuters\u27 travel experience in the past. The outcomes of the two approaches are two prediction values for each query case. The two values are subsequently processed by a prediction query manager, which ultimately produces one final prediction value using an error-based decision algorithm. It was found that the hybrid approach produces speed estimates with smaller errors than if the two approaches employed separately. The proposed prediction approach could be used in deriving travel times more reliable as the Traffic Management Centers move towards implementing Advanced Traveler Information Systems (ATIS) applications

Artificial Intelligence-based Control Techniques for HVDC Systems

The electrical energy industry depends, among other things, on the ability of networks to deal with uncertainties from several directions. Smart-grid systems in high-voltage direct current (HVDC) networks, being an application of artificial intelligence (AI), are a reliable way to achieve this goal as they solve complex problems in power system engineering using AI algorithms. Due to their distinctive characteristics, they are usually effective approaches for optimization problems. They have been successfully applied to HVDC systems. This paper presents a number of issues in HVDC transmission systems. It reviews AI applications such as HVDC transmission system controllers and power flow control within DC grids in multi-terminal HVDC systems. Advancements in HVDC systems enable better performance under varying conditions to obtain the optimal dynamic response in practical settings. However, they also pose difficulties in mathematical modeling as they are non-linear and complex. ANN-based controllers have replaced traditional PI controllers in the rectifier of the HVDC link. Moreover, the combination of ANN and fuzzy logic has proven to be a powerful strategy for controlling excessively non-linear loads. Future research can focus on developing AI algorithms for an advanced control scheme for UPFC devices. Also, there is a need for a comprehensive analysis of power fluctuations or steady-state errors that can be eliminated by the quick response of this control scheme. This survey was informed by the need to develop adaptive AI controllers to enhance the performance of HVDC systems based on their promising results in the control of power systems. Doi: 10.28991/ESJ-2023-07-02-024 Full Text: PD