From Biological to Synthetic Neurorobotics Approaches to Understanding the Structure Essential to Consciousness (Part 3)

This third paper locates the synthetic neurorobotics research reviewed in the second paper in terms of themes introduced in the first paper. It begins with biological non-reductionism as understood by Searle. It emphasizes the role of synthetic neurorobotics studies in accessing the dynamic structure essential to consciousness with a focus on system criticality and self, develops a distinction between simulated and formal consciousness based on this emphasis, reviews Tani and colleagues' work in light of this distinction, and ends by forecasting the increasing importance of synthetic neurorobotics studies for cognitive science and philosophy of mind going forward, finally in regards to most- and myth-consciousness

Social Cognition for Human-Robot Symbiosis—Challenges and Building Blocks

The next generation of robot companions or robot working partners will need to satisfy social requirements somehow similar to the famous laws of robotics envisaged by Isaac Asimov time ago (Asimov, 1942). The necessary technology has almost reached the required level, including sensors and actuators, but the cognitive organization is still in its infancy and is only partially supported by the current understanding of brain cognitive processes. The brain of symbiotic robots will certainly not be a “positronic” replica of the human brain: probably, the greatest part of it will be a set of interacting computational processes running in the cloud. In this article, we review the challenges that must be met in the design of a set of interacting computational processes as building blocks of a cognitive architecture that may give symbiotic capabilities to collaborative robots of the next decades: (1) an animated body-schema; (2) an imitation machinery; (3) a motor intentions machinery; (4) a set of physical interaction mechanisms; and (5) a shared memory system for incremental symbiotic development. We would like to stress that our approach is totally un-hierarchical: the five building blocks of the shared cognitive architecture are fully bi-directionally connected. For example, imitation and intentional processes require the “services” of the animated body schema which, on the other hand, can run its simulations if appropriately prompted by imitation and/or intention, with or without physical interaction. Successful experiences can leave a trace in the shared memory system and chunks of memory fragment may compete to participate to novel cooperative actions. And so on and so forth. At the heart of the system is lifelong training and learning but, different from the conventional learning paradigms in neural networks, where learning is somehow passively imposed by an external agent, in symbiotic robots there is an element of free choice of what is worth learning, driven by the interaction between the robot and the human partner. The proposed set of building blocks is certainly a rough approximation of what is needed by symbiotic robots but we believe it is a useful starting point for building a computational framework

Examples of Gibsonian Affordances in Legged Robotics Research Using an Empirical, Generative Framework

Evidence from empirical literature suggests that explainable complex behaviors can be built from structured compositions of explainable component behaviors with known properties. Such component behaviors can be built to directly perceive and exploit affordances. Using six examples of recent research in legged robot locomotion, we suggest that robots can be programmed to effectively exploit affordances without developing explicit internal models of them. We use a generative framework to discuss the examples, because it helps us to separate—and thus clarify the relationship between—description of affordance exploitation from description of the internal representations used by the robot in that exploitation. Under this framework, details of the architecture and environment are related to the emergent behavior of the system via a generative explanation. For example, the specific method of information processing a robot uses might be related to the affordance the robot is designed to exploit via a formal analysis of its control policy. By considering the mutuality of the agent-environment system during robot behavior design, roboticists can thus develop robust architectures which implicitly exploit affordances. The manner of this exploitation is made explicit by a well constructed generative explanation

Toward a Brain-Inspired System: Deep Recurrent Reinforcement Learning for a Simulated Self-Driving Agent

An effective way to achieve intelligence is to simulate various intelligent behaviors in the human brain. In recent years, bio-inspired learning methods have emerged, and they are different from the classical mathematical programming principle. From the perspective of brain inspiration, reinforcement learning has gained additional interest in solving decision-making tasks as increasing neuroscientific research demonstrates that significant links exist between reinforcement learning and specific neural substrates. Because of the tremendous research that focuses on human brains and reinforcement learning, scientists have investigated how robots can autonomously tackle complex tasks in the form of making a self-driving agent control in a human-like way. In this study, we propose an end-to-end architecture using novel deep-Q-network architecture in conjunction with a recurrence to resolve the problem in the field of simulated self-driving. The main contribution of this study is that we trained the driving agent using a brain-inspired trial-and-error technique, which was in line with the real world situation. Besides, there are three innovations in the proposed learning network: raw screen outputs are the only information which the driving agent can rely on, a weighted layer that enhances the differences of the lengthy episode, and a modified replay mechanism that overcomes the problem of sparsity and accelerates learning. The proposed network was trained and tested under a third-party OpenAI Gym environment. After training for several episodes, the resulting driving agent performed advanced behaviors in the given scene. We hope that in the future, the proposed brain-inspired learning system would inspire practicable self-driving control solutions

Systematic review on which analytics and learning methodologies are applied in primary and secondary education in the learning of robotics sensors

Robotics technology has become increasingly common both for businesses and for private citizens. Primary and secondary schools, as a mirror of societal evolution, have increasingly integrated science, technology, engineering and math concepts into their curricula. Our research questions are: “In teaching robotics to primary and secondary school students, which pedagogical-methodological interventions result in better understanding and knowledge in the use of sensors in educational robotics?”, and “In teaching robotics to primary and secondary school students, which analytical methods related to Learning Analytics processes are proposed to analyze and reflect on students’ behavior in their learning of concepts and skills of sensors in educational robotics?”. To answer these questions, we have carried out a systematic review of the literature in the Web of Science and Scopus databases regarding robotics sensors in primary and secondary education, and Learning Analytics processes. We applied PRISMA methodology and reviewed a total of 24 articles. The results show a consensus about the use of the Learning by Doing and Project-Based Learning methodologies, including their different variations, as the most common methodology for achieving optimal engagement, motivation and performance in students’ learning. Finally, future lines of research are identified from this study.This research was co-funded by the support of the Secretaria d’Universitats i Recerca of the Department of Business and Knowledge of the Generalitat de Catalunya with the help of 2017 SGR 93

Modeling the Synchronization of Multimodal Perceptions as a Basis for the Emergence of Deterministic Behaviors.

Living organisms have either innate or acquired mechanisms for reacting to percepts with an appropriate behavior e.g., by escaping from the source of a perception detected as threat, or conversely by approaching a target perceived as potential food. In the case of artifacts, such capabilities must be built in through either wired connections or software. The problem addressed here is to define a neural basis for such behaviors to be possibly learned by bio-inspired artifacts. Toward this end, a thought experiment involving an autonomous vehicle is first simulated as a random search. The stochastic decision tree that drives this behavior is then transformed into a plastic neuronal circuit. This leads the vehicle to adopt a deterministic behavior by learning and applying a causality rule just as a conscious human driver would do. From there, a principle of using synchronized multimodal perceptions in association with the Hebb principle of wiring together neuronal cells is induced. This overall framework is implemented as a virtual machine i.e., a concept widely used in software engineering. It is argued that such an interface situated at a meso-scale level between abstracted micro-circuits representing synaptic plasticity, on one hand, and that of the emergence of behaviors, on the other, allows for a strict delineation of successive levels of complexity. More specifically, isolating levels allows for simulating yet unknown processes of cognition independently of their underlying neurological grounding

sEMG-based natural control interface for a variable stiffness transradial hand prosthesis

We propose, implement, and evaluate a natural human-machine control interface for a variable stiffness transradial hand prosthesis that achieves tele-impedance control through surface electromyography (sEMG) signals. This interface, together with variable stiffness actuation (VSA), enables an amputee to modulate the impedance of the prosthetic limb to properly match the requirements of a task while performing activities of daily living (ADL). Both the desired position and stiffness references are estimated through sEMG signals and used to control the VSA hand prosthesis. In particular, regulation of hand impedance is managed through the impedance measurements of the intact upper arm; this control takes place naturally and automatically as the amputee interacts with the environment, while the position of the hand prosthesis is regulated intentionally by the amputee through the estimated position of the shoulder. The proposed approach is advantageous since the impedance regulation takes place naturally without requiring amputees' attention and diminishing their functional capability. Consequently, the proposed interface is easy to use, does not require long training periods or interferes with the control of intact body segments. This control approach is evaluated through human subject experiments conducted over able volunteers where adequate estimation of references and independent control of position and stiffness are demonstrated.Turkiye Bilimsel ve Teknolojik Arastirma Kurumu (TUBITAK) ; 219M58

Neuromusculoskeletal Arm Prostheses: Personal and Social Implications of Living With an Intimately Integrated Bionic Arm

People with limb loss are for the first time living chronically and uninterruptedly with intimately integrated neuromusculoskeletal prostheses. This new generation of artificial limbs are fixated to the skeleton and operated by bidirectionally transferred neural information. This unprecedented level of human–machine integration is bound to have profound psychosocial effects on the individuals living with these prostheses. Here, we examined the psychosociological impact on people as they integrate neuromusculoskeletal prostheses into their bodies and lives. Three people with transhumeral amputations participated in this study, all of whom had been living with neuromusculoskeletal prostheses in their daily lives between 2 and 6 years at the time of the interview. Direct neural sensory feedback had been enabled for 6 months to 2 years. Participants were interviewed about their experiences living with the neuromusculoskeletal prostheses in their home and professional daily lives. We analyzed these interviews to elucidate themes using an interpretive phenomenological approach that regards participants’ own experiences as forms of expertise and knowledge-making. Our participant-generated results indicate that people adapted and integrated the technology into functional and social arenas of daily living, with positive psychosocial effects on self-esteem, self-image, and social relations intimately linked to improved trust of the prostheses. Participants expressed enhanced prosthetic function, increased and more diverse prosthesis use in tasks of daily living, and improved relationships between their prosthesis and phantom limb. Our interviews with patients also generated critiques of the language commonly used to describe human-prosthetic relations, including terms such as “embodiment,” and the need for specificity surrounding the term “natural” with regard to control versus sensory feedback. Experiences living with neuromusculoskeletal prostheses were complex and subject-dependent, and therefore future research should consider human–machine interaction as a relationship that is constantly enacted, negotiated, and deeply contextualized

Passive Motion Paradigm: An Alternative to Optimal Control

In the last years, optimal control theory (OCT) has emerged as the leading approach for investigating neural control of movement and motor cognition for two complementary research lines: behavioral neuroscience and humanoid robotics. In both cases, there are general problems that need to be addressed, such as the “degrees of freedom (DoFs) problem,” the common core of production, observation, reasoning, and learning of “actions.” OCT, directly derived from engineering design techniques of control systems quantifies task goals as “cost functions” and uses the sophisticated formal tools of optimal control to obtain desired behavior (and predictions). We propose an alternative “softer” approach passive motion paradigm (PMP) that we believe is closer to the biomechanics and cybernetics of action. The basic idea is that actions (overt as well as covert) are the consequences of an internal simulation process that “animates” the body schema with the attractor dynamics of force fields induced by the goal and task-specific constraints. This internal simulation offers the brain a way to dynamically link motor redundancy with task-oriented constraints “at runtime,” hence solving the “DoFs problem” without explicit kinematic inversion and cost function computation. We argue that the function of such computational machinery is not only restricted to shaping motor output during action execution but also to provide the self with information on the feasibility, consequence, understanding and meaning of “potential actions.” In this sense, taking into account recent developments in neuroscience (motor imagery, simulation theory of covert actions, mirror neuron system) and in embodied robotics, PMP offers a novel framework for understanding motor cognition that goes beyond the engineering control paradigm provided by OCT. Therefore, the paper is at the same time a review of the PMP rationale, as a computational theory, and a perspective presentation of how to develop it for designing better cognitive architectures

A Neurorobotics Simulation of Autistic Behavior Induced by Unusual Sensory Precision

Recently, applying computational models developed in cognitive science to psychiatric disorders has been recognized as an essential approach for understanding cognitive mechanisms underlying psychiatric symptoms. Autism spectrum disorder is a neurodevelopmental disorder that is hypothesized to affect information processes in the brain involving the estimation of sensory precision (uncertainty), but the mechanism by which observed symptoms are generated from such abnormalities has not been thoroughly investigated. Using a humanoid robot controlled by a neural network using a precision-weighted prediction error minimization mechanism, it is suggested that both increased and decreased sensory precision could induce the behavioral rigidity characterized by resistance to change that is characteristic of autistic behavior. Specifically, decreased sensory precision caused any error signals to be disregarded, leading to invariability of the robot’s intention, while increased sensory precision caused an excessive response to error signals, leading to fluctuations and subsequent fixation of intention. The results may provide a system-level explanation of mechanisms underlying different types of behavioral rigidity in autism spectrum and other psychiatric disorders. In addition, our findings suggest that symptoms caused by decreased and increased sensory precision could be distinguishable by examining the internal experience of patients and neural activity coding prediction error signals in the biological brain