A computational model of perception and action for cognitive robotics

Robots are increasingly expected to perform tasks in complex environments. To this end, engineers provide them with processing architectures that are based on models of human information processing. In contrast to traditional models, where information processing is typically set up in stages (i.e., from perception to cognition to action), it is increasingly acknowledged by psychologists and robot engineers that perception and action are parts of an interactive and integrated process. In this paper, we present HiTEC, a novel computational (cognitive) model that allows for direct interaction between perception and action as well as for cognitive control, demonstrated by task-related attentional influences. Simulation results show that key behavioral studies can be readily replicated. Three processing aspects of HiTEC are stressed for their importance for cognitive robotics: (1) ideomotor learning of action control, (2) the influence of task context and attention on perception, action planning, and learning, and (3) the interaction between perception and action planning. Implications for the design of cognitive robotics are discussed

Chapter 12: Perception in Instructional Message Design

This chapter aims to discuss perception from various academic disciplines and its relations and effects on information processing in instructional message design. Improved awareness of this concept assists instructional designers in conveying their message effectively and improves effective instruction in immersive learning environments. In this chapter, Gestalt, neurological, ecological, and computational perspectives and processes on perception are first discussed and followed by applications in instructional message design and instructional design

An architecture for fluid real-time conversational agents: Integrating incremental output generation and input processing

Kopp S, van Welbergen H, Yaghoubzadeh R, Buschmeier H. An architecture for fluid real-time conversational agents: Integrating incremental output generation and input processing. Journal on Multimodal User Interfaces. 2014;8:97-108.Embodied conversational agents still do not achieve the fluidity and smoothness of natural conversational interaction. One main reason is that current system often respond with big latencies and in inflexible ways. We argue that to overcome these problems, real-time conversational agents need to be based on an underlying architecture that provides two essential features for fast and fluent behavior adaptation: a close bi-directional coordination between input processing and output generation, and incrementality of processing at both stages. We propose an architectural framework for conversational agents [Artificial Social Agent Platform (ASAP)] providing these two ingredients for fluid real-time conversation. The overall architectural concept is described, along with specific means of specifying incremental behavior in BML and technical implementations of different modules. We show how phenomena of fluid real- time conversation, like adapting to user feedback or smooth turn-keeping, can be realized with ASAP and we describe in detail an example real-time interaction with the implemented system

On the dynamic interplay between perception and action - a connectionist perspective

Increasing evidence suggests that perception and action planning do not represent separable stages of a unidirectional processing sequence, but rather emerging properties of highly interactive processes. To capture these characteristics of the human cognitive system, we have developed a connectionist model of the interaction between perception and action planning: HiTEC, based on the Theory of Event Coding (Hommel, M_sseler, Achschersleben & Prinz, 2001). The model is characterized by representations at multiple levels and by shared representations and processes. It complements available models of stimulus__response translation by providing a rationale for (1) how situation-specific meanings of motor actions emerge, (2) how and why some aspects of stimulus__response translation occur automatically and (3) how task demands modulate sensorimotor processing. The model is demonstrated to provide a unitary account and simulation of a number of key findings with multiple experimental paradigms on the interaction between perception and action such as the Simon effect, its inversion (Hommel, 1993), and action__effect learning.Action Contro

Instructional Message Design: Theory, Research, and Practice (Volume 2)

Message design is all around us, from the presentations we see in meetings and classes, to the instructions that come with our latest tech gadgets, to multi-million-dollar training simulations. In short, instructional message design is the real-world application of instructional and learning theories to design the tools and technologies used to communicate and effectively convey information. This field of study pulls from many applied sciences including cognitive psychology, industrial design, graphic design, instructional design, information technology, and human performance technology to name just a few. In this book we visit several foundational theories that guide our research, look at different real-world applications, and begin to discuss directions for future best practice. For instance, cognitive load and multimedia learning theories provide best practice, virtual reality and simulations are only a few of the multitude of applications. Special needs learners and designing for online, e-learning, and web conferencing are only some of many applied areas where effective message design can improve outcomes. Studying effective instructional message design tools and techniques has and will continue to be a critical aspect of the overall instructional design process. Hopefully, this book will serve as an introduction to these topics and inspire your curiosity to explore further!https://digitalcommons.odu.edu/distancelearning_books/1003/thumbnail.jp

Instructional Message Design: Theory, Research, and Practice (Volume 2)

Message design is all around us, from the presentations we see in meetings and classes, to the instructions that come with our latest tech gadgets, to multi-million-dollar training simulations. In short, instructional message design is the real-world application of instructional and learning theories to design the tools and technologies used to communicate and effectively convey information. This field of study pulls from many applied sciences including cognitive psychology, industrial design, graphic design, instructional design, information technology, and human performance technology to name just a few. In this book we will visit several foundational theories that guide our research, look at different real-world applications, and begin to discuss directions for future best practice. For instance, cognitive load and multimedia learning theories provide best practice, virtual reality and simulations are only a few of the multitude of applications. Special needs learners and designing for online, e-learning, and web conferencing are only some of many applied areas where effective message design can improve outcomes. Studying effective instructional message design tools and techniques has and will continue to be a critical aspect of the overall instructional design process. Hopefully, this book will serve as an introduction to these topics and inspire your curiosity to explore further

A Unified Cognitive Model of Visual Filling-In Based on an Emergic Network Architecture

The Emergic Cognitive Model (ECM) is a unified computational model of visual filling-in based on the Emergic Network architecture. The Emergic Network was designed to help realize systems undergoing continuous change. In this thesis, eight different filling-in phenomena are demonstrated under a regime of continuous eye movement (and under static eye conditions as well). ECM indirectly demonstrates the power of unification inherent with Emergic Networks when cognition is decomposed according to finer-grained functions supporting change. These can interact to raise additional emergent behaviours via cognitive re-use, hence the Emergic prefix throughout. Nevertheless, the model is robust and parameter free. Differential re-use occurs in the nature of model interaction with a particular testing paradigm. ECM has a novel decomposition due to the requirements of handling motion and of supporting unified modelling via finer functional grains. The breadth of phenomenal behaviour covered is largely to lend credence to our novel decomposition. The Emergic Network architecture is a hybrid between classical connectionism and classical computationalism that facilitates the construction of unified cognitive models. It helps cutting up of functionalism into finer-grains distributed over space (by harnessing massive recurrence) and over time (by harnessing continuous change), yet simplifies by using standard computer code to focus on the interaction of information flows. Thus while the structure of the network looks neurocentric, the dynamics are best understood in flowcentric terms. Surprisingly, dynamic system analysis (as usually understood) is not involved. An Emergic Network is engineered much like straightforward software or hardware systems that deal with continuously varying inputs. Ultimately, this thesis addresses the problem of reduction and induction over complex systems, and the Emergic Network architecture is merely a tool to assist in this epistemic endeavour. ECM is strictly a sensory model and apart from perception, yet it is informed by phenomenology. It addresses the attribution problem of how much of a phenomenon is best explained at a sensory level of analysis, rather than at a perceptual one. As the causal information flows are stable under eye movement, we hypothesize that they are the locus of consciousness, howsoever it is ultimately realized

Cognition in context: Evidence on affordances and verbal language

This thesis investigated affordances and verbal language to demonstrate the flexibility of embodied simulation processes. Starting from the assumption that both object/action understanding and language comprehension are tied to the context in which they take place, six studies clarified the factors that modulate simulation. The studies in chapter 4 and 5 investigated affordance activation in complex scenes, revealing the strong influence of the visual context, which included either objects and actions, on compatibility effects. The study in chapter 6 compared the simulation triggered by visual objects and objects names, showing differences depending on the kind of materials processed. The study in chapter 7 tested the predictions of the WAT theory, confirming that the different contexts in which words are acquired lead to the difference typically observed in the literature between concrete and abstract words. The study in chapter 8 on the grounding of abstract concepts tested the mapping of temporal contents on the spatial frame of reference of the mental timeline, showing that metaphoric congruency effects are not automatic, but flexibly mediated by the context determined by the goals of different tasks. The study in chapter 9 investigated the role of iconicity in verbal language, showing sound-to-shape correspondences when every-day object figures, result that validated the reality of sound-symbolism in ecological contexts. On the whole, this evidence favors embodied views of cognition, and supports the hypothesis of a high flexibility of simulation processes. The reported conceptual effects confirm that the context plays a crucial role in affordances emergence, metaphoric mappings activation and language grounding. In conclusion, this thesis highlights that in an embodied perspective cognition is necessarily situated and anchored to a specific context, as it is sustained by the existence of a specific body immersed in a specific environment