Integrating Symbolic and Neural Processing in a Self-Organizing Architechture for Pattern Recognition and Prediction

British Petroleum (89A-1204); Defense Advanced Research Projects Agency (N00014-92-J-4015); National Science Foundation (IRI-90-00530); Office of Naval Research (N00014-91-J-4100); Air Force Office of Scientific Research (F49620-92-J-0225

Adaptive Resonance Theory

Defense Advanced Research Projects Agency and the Office of Naval Research (N00014-95-l-0409); National Science Foundation (IRI-97-20333); Office of Naval Research (N00014-95-l-0657

Bring ART into the ACT

ACT is compared with a particular type of connectionist model that cannot handle symbols and use non-biological operations that cannot learn in real time. This focus continues an unfortunate trend of straw man "debates" in cognitive science. Adaptive Resonance Theory, or ART, neural models of cognition can handle both symbols and sub-symbolic representations, and meets the Newell criteria at least as well as these models.Air Force Office of Scientific Research (F49620-01-1-0397); Office of Naval Research (N00014-01-1-0624

Adaptive Resonance Theory

SyNAPSE program of the Defense Advanced Projects Research Agency (Hewlett-Packard Company, subcontract under DARPA prime contract HR0011-09-3-0001, and HRL Laboratories LLC, subcontract #801881-BS under DARPA prime contract HR0011-09-C-0001); CELEST, an NSF Science of Learning Center (SBE-0354378

Emergence of Self-Organized Symbol-Based Communication \ud in Artificial Creatures

In this paper, we describe a digital scenario where we simulated the emergence of self-organized symbol-based communication among artificial creatures inhabiting a \ud virtual world of unpredictable predatory events. In our experiment, creatures are autonomous agents that learn symbolic relations in an unsupervised manner, with no explicit feedback, and are able to engage in dynamical and autonomous communicative interactions with other creatures, even simultaneously. In order to synthesize a behavioral ecology and infer the minimum organizational constraints for the design of our creatures, \ud we examined the well-studied case of communication in vervet monkeys. Our results show that the creatures, assuming the role of sign users and learners, behave collectively as a complex adaptive system, where self-organized communicative interactions play a \ud major role in the emergence of symbol-based communication. We also strive in this paper for a careful use of the theoretical concepts involved, including the concepts of symbol and emergence, and we make use of a multi-level model for explaining the emergence of symbols in semiotic systems as a basis for the interpretation of inter-level relationships in the semiotic processes we are studying

A Neural Network Architecture for Autonomous Learning, Recognition, and Prediction in a Nonstationary World

In a constantly changing world, humans are adapted to alternate routinely between attending to familiar objects and testing hypotheses about novel ones. We can rapidly learn to recognize and narne novel objects without unselectively disrupting our memories of familiar ones. We can notice fine details that differentiate nearly identical objects and generalize across broad classes of dissimilar objects. This chapter describes a class of self-organizing neural network architectures--called ARTMAP-- that are capable of fast, yet stable, on-line recognition learning, hypothesis testing, and naming in response to an arbitrary stream of input patterns (Carpenter, Grossberg, Markuzon, Reynolds, and Rosen, 1992; Carpenter, Grossberg, and Reynolds, 1991). The intrinsic stability of ARTMAP allows the system to learn incrementally for an unlimited period of time. System stability properties can be traced to the structure of its learned memories, which encode clusters of attended features into its recognition categories, rather than slow averages of category inputs. The level of detail in the learned attentional focus is determined moment-by-moment, depending on predictive success: an error due to over-generalization automatically focuses attention on additional input details enough of which are learned in a new recognition category so that the predictive error will not be repeated. An ARTMAP system creates an evolving map between a variable number of learned categories that compress one feature space (e.g., visual features) to learned categories of another feature space (e.g., auditory features). Input vectors can be either binary or analog. Computational properties of the networks enable them to perform significantly better in benchmark studies than alternative machine learning, genetic algorithm, or neural network models. Some of the critical problems that challenge and constrain any such autonomous learning system will next be illustrated. Design principles that work together to solve these problems are then outlined. These principles are realized in the ARTMAP architecture, which is specified as an algorithm. Finally, ARTMAP dynamics are illustrated by means of a series of benchmark simulations.Advanced Research Projects Agency (N00014-92-J-4015); British Petroleum (89A-1204); National Science Foundation (IRI-90-J-4015); Office of Naval Research (N00014-91-J-4100); Air Force Office of Scientific Research (F49620-92-J-0225

Implicit cognitions in awareness: Three empirical examples and implications for conscious identity.

open accessAcross psychological science the prevailing view of mental events includes unconscious mental representations that result from a separate implicit system outside of awareness. Recently, scientific interest in consciousness of self and the widespread application of mindfulness practice have made necessary innovative methods of assessing awareness during cognitive tasks and validating those assessments wherever they are researched. Studies from three areas of psychology, self-esteem, sustainability thinking, and the learning of control systems questioned the unconscious status of implicit cognitions. The studies replicated published results using methods of investigating (a) unselective learning of a control task (b) implicit attitudes using IAT, and (c) the Name-letter effect. In addition, a common analytic method of awareness assessment and its validation was used. Study 1 demonstrated that learned control of a dynamic system was predicted by the validity of rules of control in awareness. In Study 2, verbal reports of hesitations and trial difficulty predicted IAT scores for 34 participants’ environmental attitudes. In Study 3, the famous Name-letter effect was predicted by the validity of university students’ reported awareness of letter preference reasons. The repeated finding that self knowledge in awareness predicted what should be cognitions outside of awareness, according to the dual processing view, suggests an alternative model of implicit mental events in which associative relations evoke conscious symbolic representations. The analytic method of validating phenomenal reports will be discussed along with its potential contribution to research involving implicit cognitions

The emergence of information systems: a communication-based theory

An information system is more than just the information technology; it is the system that emerges from the complex interactions and relationships between the information technology and the organization. However, what impact information technology has on an organization and how organizational structures and organizational change influence information technology remains an open question. We propose a theory to explain how communication structures emerge and adapt to environmental changes. We operationalize the interplay of information technology and organization as language communities whose members use and develop domain-specific languages for communication. Our theory is anchored in the philosophy of language. In developing it as an emergent perspective, we argue that information systems are self-organizing and that control of this ability is disseminated throughout the system itself, to the members of the language community. Information technology influences the dynamics of this adaptation process as a fundamental constraint leading to perturbations for the information system. We demonstrate how this view is separated from the entanglement in practice perspective and show that this understanding has far-reaching consequences for developing, managing, and examining information systems