Models of incremental concept formation

Given a set of observations, humans acquire concepts that organize those observations and use them in classifying future experiences. This type of concept formation can occur in the absence of a tutor and it can take place despite irrelevant and incomplete information. A reasonable model of such human concept learning should be both incremental and capable of handling this type of complex experiences that people encounter in the real world. In this paper, we review three previous models of incremental concept formation and then present CLASSIT, a model that extends these earlier systems. All of the models integrate the process of recognition and learning, and all can be viewed as carrying out search through the space of possible concept hierarchies. In an attempt to show that CLASSIT is a robust concept formation system, we also present some empirical studies of its behavior under a variety of conditions

IGMN: An incremental connectionist approach for concept formation, reinforcement learning and robotics

This paper demonstrates the use of a new connectionist approach, called IGMN (standing for Incremental Gaussian Mixture Network) in some state-of-the-art research problems such as incremental concept formation, reinforcement learning and robotic mapping. IGMN is inspired on recent theories about the brain, especially the Memory-Prediction Framework and the Constructivist Artificial Intelligence, which endows it with some special features that are not present in most neural network models such as MLP, RBF and GRNN. Moreover, IGMN is based on strong statistical principles (Gaussian mixture models) and asymptotically converges to the optimal regression surface as more training data arrive. Through several experiments using the proposed model it is also demonstrated that IGMN learns incrementally from data flows (each data can be immediately used and discarded), it is not sensible to initialization conditions, does not require fine-tuning its configuration parameters and has a good computational performance, thus allowing its use in real time control applications. Therefore, IGMN is a very useful machine learning tool for concept formation and robotic tasks.Key words: Artificial neural networks, Bayesian methods, concept formation, incremental learning, Gaussianmixture models, autonomous robots, reinforcement learning

On the automated interpretation and indexing of American football

This work combines natural language understanding and image processing with incremental learning to develop a system that can automatically interpret and index American Football. We have developed a model for representing spatio-temporal characteristics of multiple objects in dynamic scenes in this domain. Our representation combines expert knowledge, domain knowledge, spatial knowledge and temporal knowledge. We also present an incremental learning algorithm to improve the knowledge base as well as to keep previously developed concepts consistent with new data. The advantages of the incremental learning algorithm are that is that it does not split concepts and it generates a compact conceptual hierarchy which does not store instances

On the incremental learning and recognition of the pattern of movement of multiple labelled objects in dynamic scenes

In this paper we discuss combining incremental learning and incremental recognition to classify patterns consisting of multiple objects, each represented by multiple spatio-temporal features. Importantly the technique allows for ambiguity in terms of the positions of the start and finish of the pattern. This involves a progressive classification which considers the data at each time instance in the query and thus provides a probable answer before all the query information becomes available. We present two methods that combine incremental learning and incremental recognition: a time instance method and an overall best match method.<br /

The structure and formation of natural categories

Categorization and concept formation are critical activities of intelligence. These processes and the conceptual structures that support them raise important issues at the interface of cognitive psychology and artificial intelligence. The work presumes that advances in these and other areas are best facilitated by research methodologies that reward interdisciplinary interaction. In particular, a computational model is described of concept formation and categorization that exploits a rational analysis of basic level effects by Gluck and Corter. Their work provides a clean prescription of human category preferences that is adapted to the task of concept learning. Also, their analysis was extended to account for typicality and fan effects, and speculate on how the concept formation strategies might be extended to other facets of intelligence, such as problem solving

Winter ozone formation and VOC incremental reactivities in the Upper Green River Basin of Wyoming

The Upper Green River Basin (UGRB) in Wyoming experiences ozone episodes in the winter when the air is relatively stagnant and the ground is covered by snow. A modeling study was carried out to assess relative contributions of oxides of nitrogen (NO_x) and individual volatile organic compounds (VOCs), and nitrous acid (HONO) in winter ozone formation episodes in this region. The conditions of two ozone episodes, one in February 2008 and one in March 2011, were represented using a simplified box model with all pollutants present initially, but with the detailed SAPRC-07 chemical mechanism adapted for the temperature and radiation conditions arising from the high surface albedo of the snow that was present. Sensitivity calculations were conducted to assess effects of varying HONO inputs, ambient VOC speciation, and changing treatments of temperature and lighting conditions. The locations modeled were found to be quite different in VOC speciation and sensitivities to VOC and NO_x emissions, with one site modeled for the 2008 episode being highly NO_x-sensitive and insensitive to VOCs and HONO, and the other 2008 site and both 2011 sites being very sensitive to changes in VOC and HONO inputs. Incremental reactivity scales calculated for VOC-sensitive conditions in the UGRB predict far lower relative contributions of alkanes to ozone formation than in the traditional urban-based MIR scale and that the major contributors to ozone formation were the alkenes and the aromatics, despite their relatively small mass contributions. The reactivity scales are affected by the variable ambient VOC speciation and uncertainties in ambient HONO levels. These box model calculations are useful for indicating general sensitivities and reactivity characteristics of these winter UGRB episodes, but fully three-dimensional models will be required to assess ozone abatement strategies in the UGRB

Machine learning : techniques and foundations

The field of machine learning studies computational methods for acquiring new knowledge, new skills, and new ways to organize existing knowledge. In this paper we present some of the basic techniques and principles that underlie AI research on learning, including methods for learning from examples, learning in problem solving, learning by analogy, grammar acquisition, and machine discovery. In each case, we illustrate the techniques with paradigmatic examples

A survey of clustering methods

In this paper, I describe a large variety of clustering methods within a single framework. This paper unifies work across different fields, from biology (numerical taxonomy) to machine learning (concept formation). An important objective for this paper is to show that one can benefit by a knowledge of research across different disciplines. After describing the task from a set of different viewpoints or paradigms, I begin by describing the similarity measures or evaluation functions that form the basis of any clustering technique. Next, I describe a number of different algorithms that use these measures, and I close with a brief discussion of ways to evaluate different approaches to clustering