Language acquisition and machine learning

In this paper, we review recent progress in the field of machine learning and examine its implications for computational models of language acquisition. As a framework for understanding this research, we propose four component tasks involved in learning from experience - aggregation, clustering, characterization, and storage. We then consider four common problems studied by machine learning researchers - learning from examples, heuristics learning, conceptual clustering, and learning macro-operators - describing each in terms of our framework. After this, we turn to the problem of grammar acquisition, relating this problem to other learning tasks and reviewing four AI systems that have addressed the problem. Finally, we note some limitations of the earlier work and propose an alternative approach to modeling the mechanisms underlying language acquisition

Evolutionary Robotics: a new scientific tool for studying cognition

We survey developments in Artificial Neural Networks, in Behaviour-based Robotics and Evolutionary Algorithms that set the stage for Evolutionary Robotics in the 1990s. We examine the motivations for using ER as a scientific tool for studying minimal models of cognition, with the advantage of being capable of generating integrated sensorimotor systems with minimal (or controllable) prejudices. These systems must act as a whole in close coupling with their environments which is an essential aspect of real cognition that is often either bypassed or modelled poorly in other disciplines. We demonstrate with three example studies: homeostasis under visual inversion; the origins of learning; and the ontogenetic acquisition of entrainment

In the Beginning Was the Verb: The Emergence and Evolution of Language Problem in the Light of the Big Bang Epistemological Paradigm.

The enigma of the Emergence of Natural Languages, coupled or not with the closely related problem of their Evolution is perceived today as one of the most important scientific problems. \ud The purpose of the present study is actually to outline such a solution to our problem which is epistemologically consonant with the Big Bang solution of the problem of the Emergence of the Universe}. Such an outline, however, becomes articulable, understandable, and workable only in a drastically extended epistemic and scientific oecumene, where known and habitual approaches to the problem, both theoretical and experimental, become distant, isolated, even if to some degree still hospitable conceptual and methodological islands. \ud The guiding light of our inquiry will be Eugene Paul Wigner's metaphor of ``the unreasonable effectiveness of mathematics in natural sciences'', i.e., the steadily evolving before our eyes, since at least XVIIth century, \ud ``the miracle of the appropriateness of the language of mathematics for the formulation of the laws of physics''. Kurt Goedel's incompleteness and undecidability theory will be our guardian discerner against logical fallacies of otherwise apparently plausible explanations. \ud John Bell's ``unspeakableness'' and the commonplace counterintuitive character of quantum phenomena will be our encouragers. And the radical novelty of the introduced here and adapted to our purposes Big Bang epistemological paradigm will be an appropriate, even if probably shocking response to our equally shocking discovery in the oldest among well preserved linguistic fossils of perfect mathematical structures outdoing the best artifactual Assemblers

Kripkenstein from the mathematical point of view: a preliminary survey

This paper deals with the problem of the impact of Kripke’s skeptical paradox on the philosophy of mathematics. By perceiving mathematics as a huge rule-following discipline, one could argue that the Kripkean nonfactualist thesis should be adopted within the philosophy of mathematics en bloc to imply a refutation of objectivity and an enforcement of a particular view on the nature of mathematics. In this paper I will discuss this claim. According to Kripke’s skeptical solution we should reject the notion of fact and adopt the use theory of meaning that could be stated as follows: ’One understands the concepts embodied in a language to the extent that one knows how to use the language correctly.’ [Shapiro 1991, 211] [Kripke 1982]. Focusing on mathematical discourse, we should ask: what are the implications of the use theory of meaning for the philosophy of mathematics? Furthermore, is the answer to the skeptical paradox consistent with selected views in philosophy of mathematics? The supposed answer to the first question is that it demands the view that mathematics should be perceived as a strictly pragmatic discipline and the rules of mathematical discourse are mere conventions. But this is too simplistic a view and the matter at hand is far more complicated.This paper is a part of a research project financed by National Centre of Science (Poland) on the basis of the decision no. UMO-2016/20/T/HS5/00232

Distributional Measures of Semantic Distance: A Survey

The ability to mimic human notions of semantic distance has widespread applications. Some measures rely only on raw text (distributional measures) and some rely on knowledge sources such as WordNet. Although extensive studies have been performed to compare WordNet-based measures with human judgment, the use of distributional measures as proxies to estimate semantic distance has received little attention. Even though they have traditionally performed poorly when compared to WordNet-based measures, they lay claim to certain uniquely attractive features, such as their applicability in resource-poor languages and their ability to mimic both semantic similarity and semantic relatedness. Therefore, this paper presents a detailed study of distributional measures. Particular attention is paid to flesh out the strengths and limitations of both WordNet-based and distributional measures, and how distributional measures of distance can be brought more in line with human notions of semantic distance. We conclude with a brief discussion of recent work on hybrid measures

Hume's Legacy: A Cognitive Science Perspective

Hume is an experimental philosopher who attempts to understand why we think, feel, and act as we do. But how should we evaluate the adequacy of his proposals? This chapter examines Hume’s account from the perspective of interdisciplinary work in cognitive science

Threshold Concepts Vs. Tricky Topics - Exploring the Causes of Student's Misunderstandings with the Problem Distiller Tool

This paper presents a study developed within the international project JuxtaLearn. This project aims to improve student understanding of threshold concepts by promoting student curiosity and creativity through video creation. The math concept of 'Division', widely referred in the literature as problematic for students, was recognised as a 'Tricky Topic' by teachers with the support of the Tricky Topic Tool and the Problem Distiller tool, two apps developed under the JuxtaLearn project. The methodology was based on qualitative data collected through Think Aloud protocol from a group of teachers of a public Elementary school as they used these tools. Results show that the Problem Distiller tool fostered the teachers to reflect more deeply on the causes of the students’ misunderstandings of that complex math concept. This process enabled them to develop appropriate strategies to help the students overcome these misunderstandings. The results also suggest that the stumbling blocks associated to the Tricky Topic ‘Division’ are similar to the difficulties reported in the literature describing Threshold Concepts. This conclusion is the key issue discussed in this paper and a contribution to the state of the art

Mammalian Brain As a Network of Networks

Acknowledgements AZ, SG and AL acknowledge support from the Russian Science Foundation (16-12-00077). Authors thank T. Kuznetsova for Fig. 6.Peer reviewedPublisher PD