The implications of embodiment for behavior and cognition: animal and robotic case studies

In this paper, we will argue that if we want to understand the function of the brain (or the control in the case of robots), we must understand how the brain is embedded into the physical system, and how the organism interacts with the real world. While embodiment has often been used in its trivial meaning, i.e. 'intelligence requires a body', the concept has deeper and more important implications, concerned with the relation between physical and information (neural, control) processes. A number of case studies are presented to illustrate the concept. These involve animals and robots and are concentrated around locomotion, grasping, and visual perception. A theoretical scheme that can be used to embed the diverse case studies will be presented. Finally, we will establish a link between the low-level sensory-motor processes and cognition. We will present an embodied view on categorization, and propose the concepts of 'body schema' and 'forward models' as a natural extension of the embodied approach toward first representations.Comment: Book chapter in W. Tschacher & C. Bergomi, ed., 'The Implications of Embodiment: Cognition and Communication', Exeter: Imprint Academic, pp. 31-5

Synergy-Based Human Grasp Representations and Semi-Autonomous Control of Prosthetic Hands

Das sichere und stabile Greifen mit humanoiden Roboterhänden stellt eine große Herausforderung dar. Diese Dissertation befasst sich daher mit der Ableitung von Greifstrategien für Roboterhände aus der Beobachtung menschlichen Greifens. Dabei liegt der Fokus auf der Betrachtung des gesamten Greifvorgangs. Dieser umfasst zum einen die Hand- und Fingertrajektorien während des Greifprozesses und zum anderen die Kontaktpunkte sowie den Kraftverlauf zwischen Hand und Objekt vom ersten Kontakt bis zum statisch stabilen Griff. Es werden nichtlineare posturale Synergien und Kraftsynergien menschlicher Griffe vorgestellt, die die Generierung menschenähnlicher Griffposen und Griffkräfte erlauben. Weiterhin werden Synergieprimitive als adaptierbare Repräsentation menschlicher Greifbewegungen entwickelt. Die beschriebenen, vom Menschen gelernten Greifstrategien werden für die Steuerung robotischer Prothesenhände angewendet. Im Rahmen einer semi-autonomen Steuerung werden menschenähnliche Greifbewegungen situationsgerecht vorgeschlagen und vom Nutzenden der Prothese überwacht

The Anthropomorphic Hand Assessment Protocol (AHAP)

The progress in the development of anthropomorphic hands for robotic and prosthetic applications has not been followed by a parallel development of objective methods to evaluate their performance. The need for benchmarking in grasping research has been recognized by the robotics community as an important topic. In this study we present the Anthropomorphic Hand Assessment Protocol (AHAP) to address this need by providing a measure for quantifying the grasping ability of artificial hands and comparing hand designs. To this end, the AHAP uses 25 objects from the publicly available Yale-CMU-Berkeley Object and Model Set thereby enabling replicability. It is composed of 26 postures/tasks involving grasping with the eight most relevant human grasp types and two non-grasping postures. The AHAP allows to quantify the anthropomorphism and functionality of artificial hands through a numerical Grasping Ability Score (GAS). The AHAP was tested with different hands, the first version of the hand of the humanoid robot ARMAR-6 with three different configurations resulting from attachment of pads to fingertips and palm as well as the two versions of the KIT Prosthetic Hand. The benchmark was used to demonstrate the improvements of these hands in aspects like the grasping surface, the grasp force and the finger kinematics. The reliability, consistency and responsiveness of the benchmark have been statistically analyzed, indicating that the AHAP is a powerful tool for evaluating and comparing different artificial hand designs

On Neuromechanical Approaches for the Study of Biological Grasp and Manipulation

Biological and robotic grasp and manipulation are undeniably similar at the level of mechanical task performance. However, their underlying fundamental biological vs. engineering mechanisms are, by definition, dramatically different and can even be antithetical. Even our approach to each is diametrically opposite: inductive science for the study of biological systems vs. engineering synthesis for the design and construction of robotic systems. The past 20 years have seen several conceptual advances in both fields and the quest to unify them. Chief among them is the reluctant recognition that their underlying fundamental mechanisms may actually share limited common ground, while exhibiting many fundamental differences. This recognition is particularly liberating because it allows us to resolve and move beyond multiple paradoxes and contradictions that arose from the initial reasonable assumption of a large common ground. Here, we begin by introducing the perspective of neuromechanics, which emphasizes that real-world behavior emerges from the intimate interactions among the physical structure of the system, the mechanical requirements of a task, the feasible neural control actions to produce it, and the ability of the neuromuscular system to adapt through interactions with the environment. This allows us to articulate a succinct overview of a few salient conceptual paradoxes and contradictions regarding under-determined vs. over-determined mechanics, under- vs. over-actuated control, prescribed vs. emergent function, learning vs. implementation vs. adaptation, prescriptive vs. descriptive synergies, and optimal vs. habitual performance. We conclude by presenting open questions and suggesting directions for future research. We hope this frank assessment of the state-of-the-art will encourage and guide these communities to continue to interact and make progress in these important areas

Towards adaptive and autonomous humanoid robots: from vision to actions

Although robotics research has seen advances over the last decades robots are still not in widespread use outside industrial applications. Yet a range of proposed scenarios have robots working together, helping and coexisting with humans in daily life. In all these a clear need to deal with a more unstructured, changing environment arises. I herein present a system that aims to overcome the limitations of highly complex robotic systems, in terms of autonomy and adaptation. The main focus of research is to investigate the use of visual feedback for improving reaching and grasping capabilities of complex robots. To facilitate this a combined integration of computer vision and machine learning techniques is employed. From a robot vision point of view the combination of domain knowledge from both imaging processing and machine learning techniques, can expand the capabilities of robots. I present a novel framework called Cartesian Genetic Programming for Image Processing (CGP-IP). CGP-IP can be trained to detect objects in the incoming camera streams and successfully demonstrated on many different problem domains. The approach requires only a few training images (it was tested with 5 to 10 images per experiment) is fast, scalable and robust yet requires very small training sets. Additionally, it can generate human readable programs that can be further customized and tuned. While CGP-IP is a supervised-learning technique, I show an integration on the iCub, that allows for the autonomous learning of object detection and identification. Finally this dissertation includes two proof-of-concepts that integrate the motion and action sides. First, reactive reaching and grasping is shown. It allows the robot to avoid obstacles detected in the visual stream, while reaching for the intended target object. Furthermore the integration enables us to use the robot in non-static environments, i.e. the reaching is adapted on-the- fly from the visual feedback received, e.g. when an obstacle is moved into the trajectory. The second integration highlights the capabilities of these frameworks, by improving the visual detection by performing object manipulation actions

Mirror Activity in the Macaque Motor System

Mirror neurons (MirNs) within ventral premotor cortex (PMv) and primary motor cortex (M1), including pyramidal tract neurons (PTNs) projecting to the spinal cord, modulate their activity during both the execution and observation of motor acts. However, movement is not produced in the latter condition, and mirror responses cannot be explained by lowlevel muscle activity. Relatively reduced activity in M1 during observation may help to suppress movement. Here, we examined the extent to which activity at different stages of action observation reflects grasp representation and suppression of movement across multiple levels of the mirror system in monkeys and humans. We recorded MirNs in M1 and F5 (rostral PMv), including identified PTNs, in two macaque monkeys as they performed, observed, and withheld reach-to-grasp actions. Time-varying population activity was more distinct between execution and observation in M1 than in F5, and M1 activity in the lead-up to the observation of movement onset shared parallels with movement withholding activity. In separate experiments, modulation of short-latency responses evoked in hand muscles by pyramidal tract stimulation revealed modest grasp-specific facilitation at the spinal level during grasp observation. This contrasted with a relative suppression of excitability prior to observed movement onset or when monkeys simply withheld movement. Additional cortical recording experiments examined how contextual factors, such as observing to imitate, observing while engaged in action, or observation with reduced visual information, modulated mirror activity in M1 and F5. Finally, single-pulse transcranial magnetic stimulation (TMS) in healthy human volunteers was used to examine changes in corticospinal excitability (CSE) during action observation and withholding. Overall, the results reveal distinctions in the profile of mirror activity across premotor and motor areas. While F5 maintains a more abstract representation of grasp independent of the acting agent, a balance of excitation and inhibition in motor cortex and spinal circuitry during action observation may support a flexible dissociation between initiation of grasping actions and representation of observed grasp

The Future of Humanoid Robots

This book provides state of the art scientific and engineering research findings and developments in the field of humanoid robotics and its applications. It is expected that humanoids will change the way we interact with machines, and will have the ability to blend perfectly into an environment already designed for humans. The book contains chapters that aim to discover the future abilities of humanoid robots by presenting a variety of integrated research in various scientific and engineering fields, such as locomotion, perception, adaptive behavior, human-robot interaction, neuroscience and machine learning. The book is designed to be accessible and practical, with an emphasis on useful information to those working in the fields of robotics, cognitive science, artificial intelligence, computational methods and other fields of science directly or indirectly related to the development and usage of future humanoid robots. The editor of the book has extensive R&D experience, patents, and publications in the area of humanoid robotics, and his experience is reflected in editing the content of the book

Description of motor control using inverse models

Humans can perform complicated movements like writing or running without giving them much thought. The scientific understanding of principles guiding the generation of these movements is incomplete. How the nervous system ensures stability or compensates for injury and constraints – are among the unanswered questions today. Furthermore, only through movement can a human impose their will and interact with the world around them. Damage to a part of the motor control system can lower a person’s quality of life. Understanding how the central nervous system (CNS) forms control signals and executes them helps with the construction of devices and rehabilitation techniques. This allows the user, at least in part, to bypass the damaged area or replace its function, thereby improving their quality of life. CNS forms motor commands, for example a locomotor velocity or another movement task. These commands are thought to be processed through an internal model of the body to produce patterns of motor unit activity. An example of one such network in the spinal cord is a central pattern generator (CPG) that controls the rhythmic activation of synergistic muscle groups for overground locomotion. The descending drive from the brainstem and sensory feedback pathways initiate and modify the activity of the CPG. The interactions between its inputs and internal dynamics are still under debate in experimental and modelling studies. Even more complex neuromechanical mechanisms are responsible for some non-periodic voluntary movements. Most of the complexity stems from internalization of the body musculoskeletal (MS) system, which is comprised of hundreds of joints and muscles wrapping around each other in a sophisticated manner. Understanding their control signals requires a deep understanding of their dynamics and principles, both of which remain open problems. This dissertation is organized into three research chapters with a bottom-up investigation of motor control, plus an introduction and a discussion chapter. Each of the three research chapters are organized as stand-alone articles either published or in preparation for submission to peer-reviewed journals. Chapter two introduces a description of the MS kinematic variables of a human hand. In an effort to simulate human hand motor control, an algorithm was defined that approximated the moment arms and lengths of 33 musculotendon actuators spanning 18 degrees of freedom. The resulting model could be evaluated within 10 microseconds and required less than 100 KB of memory. The structure of the approximating functions embedded anatomical and functional features of the modelled muscles, providing a meaningful description of the system. The third chapter used the developments in musculotendon modelling to obtain muscle activity profiles controlling hand movements and postures. The agonist-antagonist coactivation mechanism was responsible for producing joint stability for most degrees of freedom, similar to experimental observations. Computed muscle excitations were used in an offline control of a myoelectric prosthesis for a single subject. To investigate the higher-order generation of control signals, the fourth chapter describes an analytical model of CPG. Its parameter space was investigated to produce forward locomotion when controlled with a desired speed. The model parameters were varied to produce asymmetric locomotion, and several control strategies were identified. Throughout the dissertation the balance between analytical, simulation, and phenomenological modelling for the description of simple and complex behavior is a recurrent theme of discussion