Teleimpedance Control of a Synergy-Driven Anthropomorphic Hand

In this paper, a novel synergy driven teleimpedance controller for the Pisa–IIT SoftHand is presented. Towards the development of an efficient, robust, and low-cost hand prothesis, the Pisa–IIT SoftHand is built on the motor control principle of synergies, through which the immense complexity of the hand is simplified into distinct motor patterns. As the SoftHand grasps, it follows a synergistic path with built-in flexibility to allow grasping of objects of various shapes using only a single motor. In this work, the hand grasping motion is regulated with an impedance controller which incorporates the user’s postural and stiffness synergy profiles in realtime. In addition, a disturbance observer is realized which estimates the grasping contact force. The estimated force is then fedback to the user via a vibration motor. Grasp robustness and transparency improvements were evaluated on two healthy subjects while grasping different objects. Implementation of the proposed teleimpedance controller led to the execution of stable grasps by controlling the grasping forces, via modulation of hand compliance. In addition, utilization of the vibrotactile feedback resulted in reduced physical load on the user. While these results need to be validated with amputees, they provide evidence that a low-cost, robust hand employing hardwarebased synergies is a viable alternative to traditional myoelectric prostheses

Exploring Teleimpedance and Tactile Feedback for Intuitive Control of the Pisa/IIT SoftHand

This paper proposes a teleimpedance controller with tactile feedback for more intuitive control of the Pisa/IIT SoftHand. With the aim to realize a robust, efficient and low-cost hand prosthesis design, the SoftHand is developed based on the motor control principle of synergies, through which the immense complexity of the hand is simplified into distinct motor patterns. Due to the built-in flexibility of the hand joints, as the SoftHand grasps, it follows a synergistic path while allowing grasping of objects of various shapes using only a single motor. The DC motor of the hand incorporates a novel teleimpedance control in which the user's postural and stiffness synergy references are tracked in real-time. In addition, for intuitive control of the hand, two tactile interfaces are developed. The first interface (mechanotactile) exploits a disturbance observer which estimates the interaction forces in contact with the grasped object. Estimated interaction forces are then converted and applied to the upper arm of the user via a custom made pressure cuff. The second interface employs vibrotactile feedback based on surface irregularities and acceleration signals and is used to provide the user with information about the surface properties of the object as well as detection of object slippage while grasping. Grasp robustness and intuitiveness of hand control were evaluated in two sets of experiments. Results suggest that incorporating the aforementioned haptic feedback strategies, together with user-driven compliance of the hand, facilitate execution of safe and stable grasps, while suggesting that a low-cost, robust hand employing hardware-based synergies might be a good alternative to traditional myoelectric prostheses

Proceedings of the first workshop on Peripheral Machine Interfaces: going beyond traditional surface electromyography

abstract: One of the hottest topics in rehabilitation robotics is that of proper control of prosthetic devices. Despite decades of research, the state of the art is dramatically behind the expectations. To shed light on this issue, in June, 2013 the first international workshop on Present and future of non-invasive peripheral nervous system (PNS)–Machine Interfaces (MI; PMI) was convened, hosted by the International Conference on Rehabilitation Robotics. The keyword PMI has been selected to denote human–machine interfaces targeted at the limb-deficient, mainly upper-limb amputees, dealing with signals gathered from the PNS in a non-invasive way, that is, from the surface of the residuum. The workshop was intended to provide an overview of the state of the art and future perspectives of such interfaces; this paper represents is a collection of opinions expressed by each and every researcher/group involved in it

Proceedings of the first workshop on Peripheral Machine Interfaces: going beyond traditional surface electromyography

One of the hottest topics in rehabilitation robotics is that of proper control of prosthetic devices. Despite decades of research, the state of the art is dramatically behind the expectations. To shed light on this issue, in June, 2013 the first international workshop on Present and future of non-invasive PNS-Machine Interfaces was convened, hosted by the International Conference on Rehabilitation Robotics. The keyword PNS-Machine Interface (PMI) has been selected to denote human-machine interfaces targeted at the limb-deficient, mainly upper-limb amputees, dealing with signals gathered from the peripheral nervous system (PNS) in a non-invasive way, that is, from the surface of the residuum. The workshop was intended to provide an overview of the state of the art and future perspectives of such interfaces; this paper represents is a collection of opinions expressed by each and every researcher/group involved in it

Soft Robotics: Design for Simplicity, Performance, and Robustness of Robots for Interaction with Humans.

This thesis deals with the design possibilities concerning the next generation of advanced Robots. Aim of the work is to study, analyse and realise artificial systems that are essentially simple, performing and robust and can live and coexist with humans. The main design guideline followed in doing so is the Soft Robotics Approach, that implies the design of systems with intrinsic mechanical compliance in their architecture. The first part of the thesis addresses design of new soft robotics actuators, or robotic muscles. At the beginning are provided information about what a robotic muscle is and what is needed to realise it. A possible classification of these systems is analysed and some criteria useful for their comparison are explained. After, a set of functional specifications and parameters is identified and defined, to characterise a specific subset of this kind of actuators, called Variable Stiffness Actuators. The selected parameters converge in a data-sheet that easily defines performance and abilities of the robotic system. A complete strategy for the design and realisation of this kind of system is provided, which takes into account their me- chanical morphology and architecture. As consequence of this, some new actuators are developed, validated and employed in the execution of complex experimental tasks. In particular the actuator VSA-Cube and its add-on, a Variable Damper, are developed as the main com- ponents of a robotics low-cost platform, called VSA-CubeBot, that v can be used as an exploratory platform for multi degrees of freedom experiments. Experimental validations and mathematical models of the system employed in multi degrees of freedom tasks (bimanual as- sembly and drawing on an uneven surface), are reported. The second part of the thesis is about the design of multi fingered hands for robots. In this part of the work the Pisa-IIT SoftHand is introduced. It is a novel robot hand prototype designed with the purpose of being as easily usable, robust and simple as an industrial gripper, while exhibiting a level of grasping versatility and an aspect comparable to that of the human hand. In the thesis the main theo- retical tool used to enable such simplification, i.e. the neuroscience– based notion of soft synergies, are briefly reviewed. The approach proposed rests on ideas coming from underactuated hand design. A synthesis method to realize a desired set of soft synergies through the principled design of adaptive underactuated mechanisms, which is called the method of adaptive synergies, is discussed. This ap- proach leads to the design of hands accommodating in principle an arbitrary number of soft synergies, as demonstrated in grasping and manipulation simulations and experiments with a prototype. As a particular instance of application of the method of adaptive syner- gies, the Pisa–IIT SoftHand is then described in detail. The design and implementation of the prototype hand are shown and its effec- tiveness demonstrated through grasping experiments. Finally, control of the Pisa/IIT Hand is considered. Few different control strategies are adopted, including an experimental setup with the use of surface Electromyographic signals

Assessment of Myoelectric Controller Performance and Kinematic Behavior of a Novel Soft Synergy-Inspired Robotic Hand for Prosthetic Applications

abstract: Myoelectric artificial limbs can significantly advance the state of the art in prosthetics, since they can be used to control mechatronic devices through muscular activity in a way that mimics how the subjects used to activate their muscles before limb loss. However, surveys indicate that dissatisfaction with the functionality of terminal devices underlies the widespread abandonment of prostheses. We believe that one key factor to improve acceptability of prosthetic devices is to attain human likeness of prosthesis movements, a goal which is being pursued by research on social and human–robot interactions. Therefore, to reduce early abandonment of terminal devices, we propose that controllers should be designed so as to ensure effective task accomplishment in a natural fashion. In this work, we have analyzed and compared the performance of three types of myoelectric controller algorithms based on surface electromyography to control an underactuated and multi-degrees of freedom prosthetic hand, the SoftHand Pro. The goal of the present study was to identify the myoelectric algorithm that best mimics the native hand movements. As a preliminary step, we first quantified the repeatability of the SoftHand Pro finger movements and identified the electromyographic recording sites for able-bodied individuals with the highest signal-to-noise ratio from two pairs of muscles, i.e., flexor digitorum superficialis/extensor digitorum communis, and flexor carpi radialis/extensor carpi ulnaris. Able-bodied volunteers were then asked to execute reach-to-grasp movements, while electromyography signals were recorded from flexor digitorum superficialis/extensor digitorum communis as this was identified as the muscle pair characterized by high signal-to-noise ratio and intuitive control. Subsequently, we tested three myoelectric controllers that mapped electromyography signals to position of the SoftHand Pro. We found that a differential electromyography-to-position mapping ensured the highest coherence with hand movements. Our results represent a first step toward a more effective and intuitive control of myoelectric hand prostheses.View the article as published at http://journal.frontiersin.org/article/10.3389/fnbot.2016.00011/ful

Feasibility of Muscle Synergy Outcomes in Clinics, Robotics, and Sports: A Systematic Review

In the last years, several studies have been focused on understanding how the central nervous system controls muscles to perform a specific motor task. Although it still remains an open question, muscle synergies have come to be an appealing theory to explain the modular organization of the central nervous system. Even though the neural encoding of muscle synergies remains controversial, a large number of papers demonstrated that muscle synergies are robust across different tested conditions, which are within a day, between days, within a single subject and between subjects that have similar demographic characteristics. Thus, muscle synergy theory has been largely used in several research fields, such as clinics, robotics and sports. The present systematical review aims at providing an overview on the applications of muscle synergy theory in clinics, robotics and sports; in particular, the review is focused on the papers that provide tangible information for: (i) diagnosis or pathology assessment in clinics; (ii) robot-control design in robotics; and (iii) athletes’ performance assessment or training guidelines in sports

Assessment of Myoelectric Controller Performance and Kinematic Behavior of a Novel Soft Synergy-Inspired Robotic Hand for Prosthetic Applications

Myoelectric artificial limbs can significantly advance the state of the art in prosthetics, since they can be used to control mechatronic devices through muscular activity in a way that mimics how the subjects used to activate their muscles before limb loss. However, surveys indicate that dissatisfaction with the functionality of terminal devices underlies the widespread abandonment of prostheses. We believe that one key factor to improve acceptability of prosthetic devices is to attain human likeness of prosthesis movements, a goal which is being pursued by research on social and human-robot interactions. Therefore, to reduce early abandonment of terminal devices, we propose that controllers should be designed so as to ensure effective task accomplishment in a natural fashion. In this work, we have analyzed and compared the performance of three types of myoelectric controller algorithms based on surface electromyography to control an underactuated and multi-degrees of freedom prosthetic hand, the SoftHand Pro. The goal of the present study was to identify the myoelectric algorithm that best mimics the native hand movements. As a preliminary step, we first quantified the repeatability of the SoftHand Pro finger movements and identified the electromyographic recording sites for able-bodied individuals with the highest signal-to-noise ratio from two pairs of muscles, i.e., flexor digitorum superficialis/extensor digitorum communis, and flexor carpi radialis/extensor carpi ulnaris. Able-bodied volunteers were then asked to execute reach-to-grasp movements, while electromyography signals were recorded from flexor digitorum superficialis/extensor digitorum communis as this was identified as the muscle pair characterized by high signal-to-noise ratio and intuitive control. Subsequently, we tested three myoelectric controllers that mapped electromyography signals to position of the SoftHand Pro. We found that a differential electromyography-to-position mapping ensured the highest coherence with hand movements. Our results represent a first step toward a more effective and intuitive control of myoelectric hand prostheses

A Novel Skin-Stretch Haptic Device for Intuitive Control of Robotic Prostheses and Avatars

Without proprioception, i.e., the intrinsic capability of a body to perceive its own limb position, completing daily life activities would require constant visual attention and it would be challenging or even impossible. This situation is similar to the one experienced after limb amputation and in robotic tele-operation, where the natural sensory-motor loop is broken. While some promising solutions based on skin stretch sensory substitution have been proposed to restore tactile properties in these conditions, there is still room for enhancing the intuitiveness of stimulus delivery and integration of haptic feedback devices within user's body. To contribute to this goal, here, we propose a wearable device based on skin stretch stimulation, the Stretch-Pro, which can provide proprioceptive information on artificial hand aperture. This system can be suitably integrated in a prosthetic socket or can be easily worn by a user controlling remote robots. The system can imitate the stretching of the skin that would naturally occur on the intact limb, when it is used to accomplish motor tasks. Two versions of the system are presented, with one and two actuators, respectively, which deliver the stretch stimulus in different ways. Experiments with able-bodied participants and a preliminary test with one prosthesis user are reported. Results suggest that Stretch-Pro could be a viable solution to convey proprioceptive cues to upper limb prosthesis users, opening promising perspectives for tele-robotics applications

Human to robot hand motion mapping methods: review and classification

In this article, the variety of approaches proposed in literature to address the problem of mapping human to robot hand motions are summarized and discussed. We particularly attempt to organize under macro-categories the great quantity of presented methods, that are often difficult to be seen from a general point of view due to different fields of application, specific use of algorithms, terminology and declared goals of the mappings. Firstly, a brief historical overview is reported, in order to provide a look on the emergence of the human to robot hand mapping problem as a both conceptual and analytical challenge that is still open nowadays. Thereafter, the survey mainly focuses on a classification of modern mapping methods under six categories: direct joint, direct Cartesian, taskoriented, dimensionality reduction based, pose recognition based and hybrid mappings. For each of these categories, the general view that associates the related reported studies is provided, and representative references are highlighted. Finally, a concluding discussion along with the authors’ point of view regarding future desirable trends are reported.This work was supported in part by the European Commission’s Horizon 2020 Framework Programme with the project REMODEL under Grant 870133 and in part by the Spanish Government under Grant PID2020-114819GB-I00.Peer ReviewedPostprint (published version