Toward Self-Referential Autonomous Learning of Object and Situation Models

Most current approaches to scene understanding lack the capability to adapt object and situation models to behavioral needs not anticipated by the human system designer. Here, we give a detailed description of a system architecture for self-referential autonomous learning which enables the refinement of object and situation models during operation in order to optimize behavior. This includes structural learning of hierarchical models for situations and behaviors that is triggered by a mismatch between expected and actual action outcome. Besides proposing architectural concepts, we also describe a first implementation of our system within a simulated traffic scenario to demonstrate the feasibility of our approach

Toward Self-Referential Autonomous Learning of Object and Situation Models

Most current approaches to scene understanding lack the capability to adapt object and situation models to behavioral needs not anticipated by the human system designer. Here, we give a detailed description of a system architecture for self-referential autonomous learning which enables the refinement of object and situation models during operation in order to optimize behavior. This includes structural learning of hierarchical models for situations and behaviors that is triggered by a mismatch between expected and actual action outcome. Besides proposing architectural concepts, we also describe a first implementation of our system within a simulated traffic scenario to demonstrate the feasibility of our approach

From Biological to Synthetic Neurorobotics Approaches to Understanding the Structure Essential to Consciousness (Part 3)

This third paper locates the synthetic neurorobotics research reviewed in the second paper in terms of themes introduced in the first paper. It begins with biological non-reductionism as understood by Searle. It emphasizes the role of synthetic neurorobotics studies in accessing the dynamic structure essential to consciousness with a focus on system criticality and self, develops a distinction between simulated and formal consciousness based on this emphasis, reviews Tani and colleagues' work in light of this distinction, and ends by forecasting the increasing importance of synthetic neurorobotics studies for cognitive science and philosophy of mind going forward, finally in regards to most- and myth-consciousness

Emerging Linguistic Functions in Early Infancy

This paper presents results from experimental studies on early language acquisition in infants and attempts to interpret the experimental results within the framework of the Ecological Theory of Language Acquisition (ETLA) recently proposed by (Lacerda et al., 2004a). From this perspective, the infant’s first steps in the acquisition of the ambient language are seen as a consequence of the infant’s general capacity to represent sensory input and the infant’s interaction with other actors in its immediate ecological environment. On the basis of available experimental evidence, it will be argued that ETLA offers a productive alternative to traditional descriptive views of the language acquisition process by presenting an operative model of how early linguistic function may emerge through interaction

Learning the Meaning of the Vervet Alarm Calls using a Cognitive and Computational Model

This thesis explains how the infant vervet, Chlorocebus pygerthrus, learns the meaning of vervet alarm calls using the Learning Intelligent Distribution Agent\u27s (LIDA) perceptual learning mechanism. We consider an approch of multiple meanings which corresponds to a feeling-based meaning, an action-based meaning, and a referential meaning. The first part of simulations was performed to test the learning of the meaning of these alarm calls while the infant is attached physically to the mother. The second part of simulations was performed to study the infant\u27s understanding of these alarm calls while the infant is detached physically from the mother. The results show that a LIDA-based agent is capable to learn such multiple meanings. The agent learned in sequence the feeling-based meaning, the action-based meaning, and the referential meaning. The LIDA agent achieved a good performance of understanding. This was verified by checking the correct escape action after hearing a specific alarm call

Integration of Action and Language Knowledge: A Roadmap for Developmental Robotics

“This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder." “Copyright IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.”This position paper proposes that the study of embodied cognitive agents, such as humanoid robots, can advance our understanding of the cognitive development of complex sensorimotor, linguistic, and social learning skills. This in turn will benefit the design of cognitive robots capable of learning to handle and manipulate objects and tools autonomously, to cooperate and communicate with other robots and humans, and to adapt their abilities to changing internal, environmental, and social conditions. Four key areas of research challenges are discussed, specifically for the issues related to the understanding of: 1) how agents learn and represent compositional actions; 2) how agents learn and represent compositional lexica; 3) the dynamics of social interaction and learning; and 4) how compositional action and language representations are integrated to bootstrap the cognitive system. The review of specific issues and progress in these areas is then translated into a practical roadmap based on a series of milestones. These milestones provide a possible set of cognitive robotics goals and test scenarios, thus acting as a research roadmap for future work on cognitive developmental robotics.Peer reviewe

Symbol Emergence in Robotics: A Survey

Humans can learn the use of language through physical interaction with their environment and semiotic communication with other people. It is very important to obtain a computational understanding of how humans can form a symbol system and obtain semiotic skills through their autonomous mental development. Recently, many studies have been conducted on the construction of robotic systems and machine-learning methods that can learn the use of language through embodied multimodal interaction with their environment and other systems. Understanding human social interactions and developing a robot that can smoothly communicate with human users in the long term, requires an understanding of the dynamics of symbol systems and is crucially important. The embodied cognition and social interaction of participants gradually change a symbol system in a constructive manner. In this paper, we introduce a field of research called symbol emergence in robotics (SER). SER is a constructive approach towards an emergent symbol system. The emergent symbol system is socially self-organized through both semiotic communications and physical interactions with autonomous cognitive developmental agents, i.e., humans and developmental robots. Specifically, we describe some state-of-art research topics concerning SER, e.g., multimodal categorization, word discovery, and a double articulation analysis, that enable a robot to obtain words and their embodied meanings from raw sensory--motor information, including visual information, haptic information, auditory information, and acoustic speech signals, in a totally unsupervised manner. Finally, we suggest future directions of research in SER.Comment: submitted to Advanced Robotic

The relation between language and theory of mind in development and evolution

Considering the close relation between language and theory of mind in development and their tight connection in social behavior, it is no big leap to claim that the two capacities have been related in evolution as well. But what is the exact relation between them? This paper attempts to clear a path toward an answer. I consider several possible relations between the two faculties, bring conceptual arguments and empirical evidence to bear on them, and end up arguing for a version of co-evolution. To model this co-evolution, we must distinguish between different stages or levels of language and theory of mind, which fueled each other’s evolution in a protracted escalation process

Across the Bridge: A story of community, sociality, and art education

The article examines the planning, development, and outcome of an experiential learning project that brought together undergraduate studio art students and the workers of a power plant about to shut down. As one of the instructors for the project, I reflect on how our emergent pedagogical methods interfaced or conflicted with students interests, and plant employees. Principles of phenomenological research inspired my early steps to the study. However, its operative conceptual framework follows the thoughts of socially engaged artists Suzanne Lacy (2010) and Pablo Helguera (2011), guiding an analysis of the relationships between students and workers with instructors as observer-participants. I investigate how these roles and relations developed through different modalities that ranged from familial sentiments to memorializing impulses, including the industrial conditions that inspired various sensual and aesthetic student responses. I argue that the production of artwork as autonomous objects, which constituted the self-evident outcome of this community-focused experience, contributed only a transactional materiality to the project, and that the relational exchanges from which transformative experiences originated, offered unrivaled creative possibilities.Published versio