On Neuromechanical Approaches for the Study of Biological Grasp and Manipulation

Biological and robotic grasp and manipulation are undeniably similar at the level of mechanical task performance. However, their underlying fundamental biological vs. engineering mechanisms are, by definition, dramatically different and can even be antithetical. Even our approach to each is diametrically opposite: inductive science for the study of biological systems vs. engineering synthesis for the design and construction of robotic systems. The past 20 years have seen several conceptual advances in both fields and the quest to unify them. Chief among them is the reluctant recognition that their underlying fundamental mechanisms may actually share limited common ground, while exhibiting many fundamental differences. This recognition is particularly liberating because it allows us to resolve and move beyond multiple paradoxes and contradictions that arose from the initial reasonable assumption of a large common ground. Here, we begin by introducing the perspective of neuromechanics, which emphasizes that real-world behavior emerges from the intimate interactions among the physical structure of the system, the mechanical requirements of a task, the feasible neural control actions to produce it, and the ability of the neuromuscular system to adapt through interactions with the environment. This allows us to articulate a succinct overview of a few salient conceptual paradoxes and contradictions regarding under-determined vs. over-determined mechanics, under- vs. over-actuated control, prescribed vs. emergent function, learning vs. implementation vs. adaptation, prescriptive vs. descriptive synergies, and optimal vs. habitual performance. We conclude by presenting open questions and suggesting directions for future research. We hope this frank assessment of the state-of-the-art will encourage and guide these communities to continue to interact and make progress in these important areas

Evidence for sparse synergies in grasping actions

Converging evidence shows that hand-actions are controlled at the level of synergies and not single muscles. One intriguing aspect of synergy-based action-representation is that it may be intrinsically sparse and the same synergies can be shared across several distinct types of hand-actions. Here, adopting a normative angle, we consider three hypotheses for hand-action optimal-control: sparse-combination hypothesis (SC) – sparsity in the mapping between synergies and actions - i.e., actions implemented using a sparse combination of synergies; sparse-elements hypothesis (SE) – sparsity in synergy representation – i.e., the mapping between degrees-of-freedom (DoF) and synergies is sparse; double-sparsity hypothesis (DS) – a novel view combining both SC and SE – i.e., both the mapping between DoF and synergies and between synergies and actions are sparse, each action implementing a sparse combination of synergies (as in SC), each using a limited set of DoFs (as in SE). We evaluate these hypotheses using hand kinematic data from six human subjects performing nine different types of reach-to-grasp actions. Our results support DS, suggesting that the best action representation is based on a relatively large set of synergies, each involving a reduced number of degrees-of-freedom, and that distinct sets of synergies may be involved in distinct tasks

Analysis of finger movement coordination during the Variable Dexterity Test and comparative activities of daily living

Background/Aims: This study aimed to analyse and compare finger coordination patterns during the performance of the Variable Dexterity Test (VDT) and comparative daily tasks. Methods: An optoelectronic system was used to record the joint angles of 10 healthy participants performing the VDT and daily tasks. Joint angles from digits 1 to 5 were cross-correlated across the tasks, providing a measure of the degree of finger movement coordination. Results: Correlation coefficients showed identifiable coordination patterns among the finger movements under analysis. Low correlation coefficients suggested the presence of independent finger movements during the performance of the selected tasks. Conclusions: Finger movement coordination patterns observed during activities of daily living are comparable with the patterns observed during performance of the Variable Dexterity Test for the three grasping patterns analysed in the stud

Exploring Teleimpedance and Tactile Feedback for Intuitive Control of the Pisa/IIT SoftHand

This paper proposes a teleimpedance controller with tactile feedback for more intuitive control of the Pisa/IIT SoftHand. With the aim to realize a robust, efficient and low-cost hand prosthesis design, the SoftHand is developed based on the motor control principle of synergies, through which the immense complexity of the hand is simplified into distinct motor patterns. Due to the built-in flexibility of the hand joints, as the SoftHand grasps, it follows a synergistic path while allowing grasping of objects of various shapes using only a single motor. The DC motor of the hand incorporates a novel teleimpedance control in which the user's postural and stiffness synergy references are tracked in real-time. In addition, for intuitive control of the hand, two tactile interfaces are developed. The first interface (mechanotactile) exploits a disturbance observer which estimates the interaction forces in contact with the grasped object. Estimated interaction forces are then converted and applied to the upper arm of the user via a custom made pressure cuff. The second interface employs vibrotactile feedback based on surface irregularities and acceleration signals and is used to provide the user with information about the surface properties of the object as well as detection of object slippage while grasping. Grasp robustness and intuitiveness of hand control were evaluated in two sets of experiments. Results suggest that incorporating the aforementioned haptic feedback strategies, together with user-driven compliance of the hand, facilitate execution of safe and stable grasps, while suggesting that a low-cost, robust hand employing hardware-based synergies might be a good alternative to traditional myoelectric prostheses

Analysing finger interdependencies during the Purdue Pegboard Test and comparative activities of daily living

Study Design: Bench, Cross-sectional Introduction: Information obtained from dexterity tests is an important component of a comprehensive examination of the hand. Purpose of the Study: To analyse and compare finger interdependencies during the performance of the Purdue Pegboard Test and comparative daily tasks. Methods: A method based on the optoelectronic kinematic analysis of the precision grip style and on the calculation of cross-correlation coefficients between relevant joint angles, which provided measures of the degree of finger coordination, was conducted on 10 healthy participants performing the Purdue Pegboard Test and two comparative daily living tasks. Results: Daily tasks showed identifiable interdependencies patterns between the metacarpophalangeal joints of the fingers involved in the grip. Tasks related to activities of daily living resulted in significantly higher cross-correlation coefficients across subjects and across movements during the formation and manipulation phases of the tasks (0.7-0.9), while the release stage produced significantly lower movement correlation values (0.3-0.7). Contrarily, the formation and manipulation stages of the Purdue Pegboard Test showed low finger correlation across most subjects (0.2-0.6), while the release stage resulted in the highest values for all relevant movements (0.65-0.9). Discussion: Interdependencies patterns were consistent for the activities of daily living, but differ from the patterns observed from the Purdue Pegboard Test. Conclusions: The Purdue Pegboard Test does not compare well with the whole range of finger movements that account for hand performance during daily tasks

Human-like arm motion generation: a review

In the last decade, the objectives outlined by the needs of personal robotics have led to the rise of new biologically-inspired techniques for arm motion planning. This paper presents a literature review of the most recent research on the generation of human-like arm movements in humanoid and manipulation robotic systems. Search methods and inclusion criteria are described. The studies are analyzed taking into consideration the sources of publication, the experimental settings, the type of movements, the technical approach, and the human motor principles that have been used to inspire and assess human-likeness. Results show that there is a strong focus on the generation of single-arm reaching movements and biomimetic-based methods. However, there has been poor attention to manipulation, obstacle-avoidance mechanisms, and dual-arm motion generation. For these reasons, human-like arm motion generation may not fully respect human behavioral and neurological key features and may result restricted to specific tasks of human-robot interaction. Limitations and challenges are discussed to provide meaningful directions for future investigations.FCT Project UID/MAT/00013/2013FCT–Fundação para a Ciência e Tecnologia within the R&D Units Project Scope: UIDB/00319/2020

Kineto-dynamic modeling of human upper limb for robotic manipulators and assistive applications

The sensory-motor architecture of human upper limb and hand is characterized by a complex inter-relation of multiple elements, such as ligaments, muscles, and joints. Nonetheless, humans are able to generate coordinated and meaningful motor actions to interact-and eventually explore-the external environment. Such a complexity reduction is usually studied within the framework of synergistic control, whose focus has been mostly limited on human grasping and manipulation. Little attention has been devoted to the spatio-temporal characterization of human upper limb kinematic strategies and how the purposeful exploitation of the environmental constraints shapes human execution of manipulative actions. In this chapter, we report results on the evidence of a synergistic control of human upper limb and during manipulation with the environment. We propose functional analysis to characterize main spatio-temporal coordinated patterns of arm joints. Furthermore, we study how the environment influences human grasping synergies. The effect of cutaneous impairment is also evaluated. Applications to the design and control of robotic and assistive devices are finally discussed

Proceedings of the first workshop on Peripheral Machine Interfaces: going beyond traditional surface electromyography

One of the hottest topics in rehabilitation robotics is that of proper control of prosthetic devices. Despite decades of research, the state of the art is dramatically behind the expectations. To shed light on this issue, in June, 2013 the first international workshop on Present and future of non-invasive PNS-Machine Interfaces was convened, hosted by the International Conference on Rehabilitation Robotics. The keyword PNS-Machine Interface (PMI) has been selected to denote human-machine interfaces targeted at the limb-deficient, mainly upper-limb amputees, dealing with signals gathered from the peripheral nervous system (PNS) in a non-invasive way, that is, from the surface of the residuum. The workshop was intended to provide an overview of the state of the art and future perspectives of such interfaces; this paper represents is a collection of opinions expressed by each and every researcher/group involved in it

Proceedings of the first workshop on Peripheral Machine Interfaces: going beyond traditional surface electromyography

abstract: One of the hottest topics in rehabilitation robotics is that of proper control of prosthetic devices. Despite decades of research, the state of the art is dramatically behind the expectations. To shed light on this issue, in June, 2013 the first international workshop on Present and future of non-invasive peripheral nervous system (PNS)–Machine Interfaces (MI; PMI) was convened, hosted by the International Conference on Rehabilitation Robotics. The keyword PMI has been selected to denote human–machine interfaces targeted at the limb-deficient, mainly upper-limb amputees, dealing with signals gathered from the PNS in a non-invasive way, that is, from the surface of the residuum. The workshop was intended to provide an overview of the state of the art and future perspectives of such interfaces; this paper represents is a collection of opinions expressed by each and every researcher/group involved in it