Moregrasp: Restoration of Upper Limb Function in Individuals with High Spinal Cord Injury by Multimodal Neuroprostheses for Interaction in Daily Activities

The aim of the MoreGrasp project is to develop a noninvasive, multimodal user interface including a brain-computer interface (BCI) for intuitive control of a grasp neuroprosthesis to support individuals with high spinal cord injury (SCI) in everyday activities. We describe the current state of the project, including the EEG system, preliminary results of natural movements decoding in people with SCI, the new electrode concept for the grasp neuroprosthesis, the shared control architecture behind the system and the implementation of a user-centered design

Smart Sensor Networks For Sensor-Neural Interface

One in every fifty Americans suffers from paralysis, and approximately 23% of paralysis cases are caused by spinal cord injury. To help the spinal cord injured gain functionality of their paralyzed or lost body parts, a sensor-neural-actuator system is commonly used. The system includes: 1) sensor nodes, 2) a central control unit, 3) the neural-computer interface and 4) actuators. This thesis focuses on a sensor-neural interface and presents the research related to circuits for the sensor-neural interface. In Chapter 2, three sensor designs are discussed, including a compressive sampling image sensor, an optical force sensor and a passive scattering force sensor. Chapter 3 discusses the design of the analog front-end circuit for the wireless sensor network system. A low-noise low-power analog front-end circuit in 0.5μm CMOS technology, a 12-bit 1MS/s successive approximation register (SAR) analog-to-digital converter (ADC) in 0.18μm CMOS process and a 6-bit asynchronous level-crossing ADC realized in 0.18μm CMOS process are presented. Chapter 4 shows the design of a low-power impulse-radio ultra-wide-band (IR-UWB) transceiver (TRx) that operates at a data rate of up to 10Mbps, with a power consumption of 4.9pJ/bit transmitted for the transmitter and 1.12nJ/bit received for the receiver. In Chapter 5, a wireless fully event-driven electrogoniometer is presented. The electrogoniometer is implemented using a pair of ultra-wide band (UWB) wireless smart sensor nodes interfacing with low power 3-axis accelerometers. The two smart sensor nodes are configured into a master node and a slave node, respectively. An experimental scenario data analysis shows higher than 90% reduction of the total data throughput using the proposed fully event-driven electrogoniometer to measure joint angle movements when compared with a synchronous Nyquist-rate sampling system. The main contribution of this thesis includes: 1) the sensor designs that emphasize power efficiency and data throughput efficiency; 2) the fully event-driven wireless sensor network system design that minimizes data throughput and optimizes power consumption

Stimulation discomfort comparison of asynchronous and synchronous methods with multi-field electrodes

Functional Electrical Stimulation (FES) is a technique that consists on applying electrical current pulses to artificially activate motor nerve fibers and produce muscle contractions to achieve functional movements. The main applications of FES are within the rehabilitation field, in which this technique is used to aid recovery or to restore lost motor functions. People that benefit of FES are usually patients with neurological disorders which result in motor dysfunctions; most common patients include stroke and spinal cord injury (SCI). Neuroprosthesis are devices that have their basis in FES technique, and their aim is to bridge interrupted or damaged neural paths between the brain and upper or lower limbs. One of the aims of neuroprosthesis is to artificially generate muscle contractions that produce functional movements, and therefore, assist impaired people by making them able to perform activities of daily living (ADL). FES applies current pulses and stimulates nerve fibers by means of electrodes, which can be either implanted or surface electrodes. Both of them have advantages and disadvantages. Implanted electrodes need open surgery to place them next to the nerve root, so these electrodes carry many disadvantages that are produced by the use of invasive techniques. In return, as the electrodes are attached to the nerve, they make it easier to achieve selective functional movements. On the contrary, surface electrodes are not invasive and are easily attached or detached on the skin. Main disadvantages of surface electrodes are the difficulty of selectively stimulating nerve fibers and uncomfortable feeling perceived by users due to sensory nerves located in the skin. Electrical stimulation surface electrode technology has improved significantly through the years and recently, multi-field electrodes have been suggested. This multi-field or matrix electrode approach brings many advantages to FES; among them it is the possibility of easily applying different stimulation methods and techniques. The main goal of this thesis is therefore, to test two stimulation methods, which are asynchronous and synchronous stimulation, in the upper limb with multi-field electrodes. To this end, a purpose-built wrist torque measuring system and a graphic user interface were developed to measure wrist torque produced with each of the methods and to efficiently carry out the experiments. Then, both methods were tested on 15 healthy subjects and sensitivity results were analyzed for different cases. Results show that there are significant differences between methods regarding sensation in some cases, which can affect effectiveness or success of FES.Tecnalia and Fundación Iñaki Goenag

Characterization Of Somatosensation In The Brainstem And The Development Of A Sensory Neuroprosthesis

Innovations in neuroprosthetics have restored sensorimotor function to paralysis patients and amputees. However, to date there is a lack of solutions available to adequately address the needs of spinal cord injury patients (SCI). In this dissertation we develop a novel sensor-brain interface (SBI) that delivers electric microstimulation to the cuneate nucleus (CN) to restore somatosensory feedback in patients with intact limbs. In Chapter II, we develop a fully passive liquid metal antenna using gallium-indium (GaIn) alloy injected in polydimethylsiloxane (PDM) channels to measure forces within the physiological sensitivity of a human fingertip. In Chapter III, we present the first chronic neural interface with the CN in primates to provide access to long-term unit recordings and stimulation. In Chapter IV, we demonstrate that microstimulation to the CN is detectable in a Three Alternative Force Choice Oddity task in awake behaving primates. In Chapter V, we explore the downstream effects of CN stimulation on primary somatosensory cortex, in the context of spontaneous and evoked spindles under sedation. In summary, these findings constitute a proof-of-concept for the sensory half of a bidirectional sensorimotor prosthesis in the CN

Doctor of Philosophy

dissertationHands are so central to the human experience, yet we often take for granted the capacity to maneuver objects, to form a gesture, or to caress a loved-one’s hand. The effects of hand amputation can be severe, including functional disabilities, chronic phantom pain, and a profound sense of loss which can lead to depression and anxiety. In previous studies, peripheral-nerve interfaces, such as the Utah Slanted Electrode Array (USEA), have shown potential for restoring a sense of touch and prosthesis movement control. This dissertation represents a substantial step forward in the use of the USEAs for clinical careâ€"ultimately providing human amputees with widespread hand sensation that is functionally useful and psychologically meaningful. In completion of this ultimate objective, we report on three major advances. First, we performed the first dual-USEA implantations in human amputees; placing one USEA in the residual median nerve and another USEA in the residual ulnar nerve. Chapter 2 of this dissertation shows that USEAs provided full-hand sensory coverage, and that movement of the implant site to the upper arm in the second subject, proximal to nerve branch-points to extrinsic hand muscles, enabled activation of both proprioceptive sensory percepts and cutaneous percepts. Second, in Chapter 3, we report on successful use of USEA-evoked sensory percepts for functional discrimination tasks. We provide a comprehensive report of functional discrimination among USEA-evoked sensory percepts from three human subjects, including discrimination among multiple proprioceptive or cutaneous sensory percepts with different hand locations, sensory qualities, and/or intensities. Finally, in Chapter 4, we report on the psychological value of multiple degree of freedom prosthesis control, multisensor prosthesis sensation, and closed-loop control. This chapter represents the first report of prosthesis embodiment during closed-loop and open-loop prosthesis control by an amputee, as well as the most sophisticated closed-loop prosthesis control reported in literature to-date, including 5-degree-of-freedom motor control and sensory feedback from 4 hand locations. Ultimately, we expect that USEA-evoked hand sensations may be used as part of a take-home prosthesis system which will provide users with both advanced functional capabilities and a meaningful sense of embodiment and limb restoration

Distributed Sensing and Stimulation Systems Towards Sense of Touch Restoration in Prosthetics

Modern prostheses aim at restoring the functional and aesthetic characteristics of the lost limb. To foster prosthesis embodiment and functionality, it is necessary to restitute both volitional control and sensory feedback. Contemporary feedback interfaces presented in research use few sensors and stimulation units to feedback at most two discrete feedback variables (e.g. grasping force and aperture), whereas the human sense of touch relies on a distributed network of mechanoreceptors providing high-fidelity spatial information. To provide this type of feedback in prosthetics, it is necessary to sense tactile information from artificial skin placed on the prosthesis and transmit tactile feedback above the amputation in order to map the interaction between the prosthesis and the environment. This thesis proposes the integration of distributed sensing systems (e-skin) to acquire tactile sensation, and non-invasive multichannel electrotactile feedback and virtual reality to deliver high-bandwidth information to the user. Its core focus addresses the development and testing of close-loop sensory feedback human-machine interface, based on the latest distributed sensing and stimulation techniques for restoring the sense of touch in prosthetics. To this end, the thesis is comprised of two introductory chapters that describe the state of art in the field, the objectives and the used methodology and contributions; as well as three studies distributed over stimulation system level and sensing system level. The first study presents the development of close-loop compensatory tracking system to evaluate the usability and effectiveness of electrotactile sensory feedback in enabling real-time close-loop control in prosthetics. It examines and compares the subject\u2019s adaptive performance and tolerance to random latencies while performing the dynamic control task (i.e. position control) and simultaneously receiving either visual feedback or electrotactile feedback for communicating the momentary tracking error. Moreover, it reported the minimum time delay needed for an abrupt impairment of users\u2019 performance. The experimental results have shown that electrotactile feedback performance is less prone to changes with longer delays. However, visual feedback drops faster than electrotactile with increased time delays. This is a good indication for the effectiveness of electrotactile feedback in enabling close- loop control in prosthetics, since some delays are inevitable. The second study describes the development of a novel non-invasive compact multichannel interface for electrotactile feedback, containing 24 pads electrode matrix, with fully programmable stimulation unit, that investigates the ability of able-bodied human subjects to localize the electrotactile stimulus delivered through the electrode matrix. Furthermore, it designed a novel dual parameter -modulation (interleaved frequency and intensity) and compared it to conventional stimulation (same frequency for all pads). In addition and for the first time, it compared the electrotactile stimulation to mechanical stimulation. More, it exposes the integration of virtual prosthesis with the developed system in order to achieve better user experience and object manipulation through mapping the acquired real-time collected tactile data and feedback it simultaneously to the user. The experimental results demonstrated that the proposed interleaved coding substantially improved the spatial localization compared to same-frequency stimulation. Furthermore, it showed that same-frequency stimulation was equivalent to mechanical stimulation, whereas the performance with dual-parameter modulation was significantly better. The third study presents the realization of a novel, flexible, screen- printed e-skin based on P(VDF-TrFE) piezoelectric polymers, that would cover the fingertips and the palm of the prosthetic hand (particularly the Michelangelo hand by Ottobock) and an assistive sensorized glove for stroke patients. Moreover, it developed a new validation methodology to examine the sensors behavior while being solicited. The characterization results showed compatibility between the expected (modeled) behavior of the electrical response of each sensor to measured mechanical (normal) force at the skin surface, which in turn proved the combination of both fabrication and assembly processes was successful. This paves the way to define a practical, simplified and reproducible characterization protocol for e-skin patches In conclusion, by adopting innovative methodologies in sensing and stimulation systems, this thesis advances the overall development of close-loop sensory feedback human-machine interface used for restoration of sense of touch in prosthetics. Moreover, this research could lead to high-bandwidth high-fidelity transmission of tactile information for modern dexterous prostheses that could ameliorate the end user experience and facilitate it acceptance in the daily life

A system for electrotactile feedback using electronic skin and flexible matrix electrodes: Experimental evaluation

Myoelectric prostheses are successfully controlled using muscle electrical activity, thereby restoring lost motor functions. However, the somatosensory feedback from the prosthesis to the user is still missing. The sensory substitution methods described in the literature comprise mostly simple position and force sensors combined with discrete stimulation units. The present study describes a novel system for sophisticated electrotactile feedback integrating advanced distributed sensing (electronic skin) and stimulation (matrix electrodes). The system was tested in eight healthy subjects who were asked to recognize the shape, trajectory, and direction of a set of dynamic movement patterns (single lines, geometrical objects, letters) presented on the electronic skin. The experiments demonstrated that the system successfully translated the mechanical interaction into the moving electrotactile profiles, which the subjects could recognize with a good performance (shape recognition: 86±8% lines, 73±13% geometries, 72±12% letters). In particular, the subjects could identify the movement direction with a high confidence. These results are in accordance with previous studies investigating the recognition of moving stimuli in human subjects. This is an important development towards closed-loop prostheses providing comprehensive and sophisticated tactile feedback to the user, facilitating the control and the embodiment of the artificial device into the user body scheme