Ground Robotic Hand Applications for the Space Program study (GRASP)

This document reports on a NASA-STDP effort to address research interests of the NASA Kennedy Space Center (KSC) through a study entitled, Ground Robotic-Hand Applications for the Space Program (GRASP). The primary objective of the GRASP study was to identify beneficial applications of specialized end-effectors and robotic hand devices for automating any ground operations which are performed at the Kennedy Space Center. Thus, operations for expendable vehicles, the Space Shuttle and its components, and all payloads were included in the study. Typical benefits of automating operations, or augmenting human operators performing physical tasks, include: reduced costs; enhanced safety and reliability; and reduced processing turnaround time

A Multi-Modal Sensing Glove for Human Manual-Interaction Studies

We present an integrated sensing glove that combines two of the most visionary wearable sensing technologies to provide both hand posture sensing and tactile pressure sensing in a unique, lightweight, and stretchable device. Namely, hand posture reconstruction employs Knitted Piezoresistive Fabrics that allows us to measure bending. From only five of these sensors (one for each finger) the full hand pose of a 19 degrees of freedom (DOF) hand model is reconstructed leveraging optimal sensor placement and estimation techniques. To this end, we exploit a-priori information of synergistic coordination patterns in grasping tasks. Tactile sensing employs a piezoresistive fabric allowing us to measure normal forces in more than 50 taxels spread over the palmar surface of the glove. We describe both sensing technologies, report on the software integration of both modalities, and describe a preliminary evaluation experiment analyzing hand postures and force patterns during grasping. Results of the reconstruction are promising and encourage us to push further our approach with potential applications in neuroscience, virtual reality, robotics and tele-operation

Piezoresistive 3D graphene-PDMS spongy pressure sensors for IoT enabled wearables and smart products

Recently, 3D porous graphene-polymer composite-based piezoresistive sensors have drawn great interest of researchers in the field of flexible electronics owing to their ultralightweight nature, compressability, robustness, and excellent electromechanical properties. In this work, we present a facile recipe for developing repeatable, reliable, and linear 3D graphene-PDMS spongy sensors for internet-of-things (IoT)-enabled wearable systems and smart consumer products. Fundamental morphological characterization and sensing performance assessment of the piezoresistive 3D graphene-polymer sensors were conducted to establish its suitability for the development of squeezable, flexible, and skin-mountable human motion sensors. The density and porosity of the sponges were determined to be 250 mgcm-3 and 74% respectively. Mechanical compressive loading tests conducted on the sensors showed an average elastic modulus as low as ~56.7 kPa. Dynamic compressive force-resistance change response tests conducted on four identical sensors revealed a linear piezoresistive response (in the compressive load range 0.42–3.90 N) with an average force sensitivity of 0.209±0.027 N-1. In addition, an accelerated lifetime test comprising 1500 compressive loading cycles (at 3.90 N uniaxial compressive loading) was conducted to demonstrate the long-term reliability of the sensor. To test the applicability of the sensors in smart wearables, four identical graphene-PDMS sponges were configured on the fingertip regions of a soft nitrile glove to develop a pressure sensing smart glove for real-time haptic pressure monitoring. The sensors were also integrated into Philips electronic shaver to realize smart shaving applications with the ability to monitor shaving motions. Furthermore, the readiness of our system for next-generation IoT-enabled applications was demonstrated by integrating the smart glove with an embedded system software utilizing the Arduino-Uno platform. The system was capable of identifying real-time qualitative pressure distribution across the fingertips while grasping daily life objects, thus establishing the suitability of such sensors for next-generation wearables for prosthetics, consumer devices, and personalized healthcare monitoring devices

Full-hand electrotactile feedback using electronic skin and matrix electrodes for high-bandwidth human–machine interfacing

Tactile feedback is relevant in a broad range of human–machine interaction systems (e.g. teleoperation, virtual reality and prosthetics). The available tactile feedback interfaces comprise few sensing and stimulation units, which limits the amount of information conveyed to the user. The present study describes a novel technology that relies on distributed sensing and stimulation to convey comprehensive tactile feedback to the user of a robotic end effector. The system comprises six flexible sensing arrays (57 sensors) integrated on the fingers and palm of a robotic hand, embedded electronics (64 recording channels), a multichannel stimulator and seven flexible electrodes (64 stimulation pads) placed on the volar side of the subject’s hand. The system was tested in seven subjects asked to recognize contact positions and identify contact sliding on the electronic skin, using distributed anode configuration (DAC) and single dedicated anode configuration. The experiments demonstrated that DAC resulted in substantially better performance. Using DAC, the system successfully translated the contact patterns into electrotactile profiles that the subjects could recognize with satisfactory accuracy (i.e. median{IQR} of 88.6{11}% for static and 93.3{5}% for dynamic patterns). The proposed system is an important step towards the development of a high-density human–machine interfacing between the user and a robotic han

Wearable assistive tactile communication interface based on integrated touch sensors and actuators

This paper presents the design and fabrication of a wearable tactile communication interface with vibrotactile feedback for assistive communication. The interface is based on finger Braille, which is a simple and efficient tactile communication method used by deafblind people. It consists of a flexible piezoresistive sensor and a vibrotactile actuator integrated together and positioned at the index, middle and ring fingers of both hands to represent the six dots of Braille. The sensors were made using flexible piezoresistive material whereas the actuator utilizes electromagnetic principle by means of a flexible coil and a tiny NdFeB permanent magnet. Both were integrated to realize a Bluetooth-enabled tactile communication glove which enables deafblind people to communicate using Braille codes. The evaluation with 20 end-users (10 deafblind and 10 sighted and hearing person) of the tactile interface under standardized conditions demonstrated that users can feel and distinguish the vibration at frequencies ranging from 10Hz to 200Hz which is within the perceivable frequency range for the FA-II receptors. The results show that it took non-experts in Braille within 25s and 55s to send and receive words like “BEST” and “JOURNAL”, with an accuracy of ~75% and 68% respectively

Myoelectric forearm prostheses: State of the art from a user-centered perspective

User acceptance of myoelectric forearm prostheses is currently low. Awkward control, lack of feedback, and difficult training are cited as primary reasons. Recently, researchers have focused on exploiting the new possibilities offered by advancements in prosthetic technology. Alternatively, researchers could focus on prosthesis acceptance by developing functional requirements based on activities users are likely to perform. In this article, we describe the process of determining such requirements and then the application of these requirements to evaluating the state of the art in myoelectric forearm prosthesis research. As part of a needs assessment, a workshop was organized involving clinicians (representing end users), academics, and engineers. The resulting needs included an increased number of functions, lower reaction and execution times, and intuitiveness of both control and feedback systems. Reviewing the state of the art of research in the main prosthetic subsystems (electromyographic [EMG] sensing, control, and feedback) showed that modern research prototypes only partly fulfill the requirements. We found that focus should be on validating EMG-sensing results with patients, improving simultaneous control of wrist movements and grasps, deriving optimal parameters for force and position feedback, and taking into account the psychophysical aspects of feedback, such as intensity perception and spatial acuity