A hybrid haptic stimulation prosthetic wearable device to recover the missing sensation of the upper limb amputees

A hybrid haptic feedback stimulation system that is capable in sensing the contact pressure, the surface texture, and the temperature, simultaneously, was designed for a prosthetic hand to provide a tactile sensation to amputation patients. In addition, the haptic system was developed to enable the prosthetic’s users to implement withdrawal reflexes due to the thermal noxious stimulus in a quick manner. The re-sensation is achieved by non-invasively stimulating the skin of the patients’ residual limbs, based on the type and the level of tactile signals provided by the sensory system of the prostheses. Accordingly, three stages of design and development were performed to satisfy the research methodology. A vibrotactile prosthetic device, which is designed for the detection of contact pressure and surface texture in upper extremity, represents. While, the design of a novel wearable hybrid pressure-vibration haptic feedback stimulation device for conveying the tactile information regarding the contact pressure between the prosthetic hand and the grasped objects represents the second methodology stage. Lastly, the third stage was achieved by designing a novel hybrid pressure-vibration-temperature feedback stimulation system to provide a huge information regarding the prostheses environment to the users without brain confusing or requiring long pre-training. The main contribution of this work is the development and evaluation of the first step of a novel approach for a lightweight, 7 Degrees-Of-Freedom (DOF) tactile prosthetic arm to perform an effective as well as fast object manipulation and grasping. Furthermore, this study investigates the ability to convey the tactile information about the contact pressure, surface texture, and object temperature to the amputees with high identification accuracy by mean of using the designed hybrid pressure-vibration-temperature feedback wearable device. An evaluation of sensation and response has been conducted on forty healthy volunteers to evaluate the ability of the haptic system to stimulate the human nervous system. The results in term of Stimulus Identification Rate (SIR) show that all the volunteers were correctly able to discriminate the sensation of touch, start of touch, end of touch, and grasping objects. While 94%, 96%, 97%, and 95.24% of the entire stimuli were successfully identified by the volunteers during the experiments of slippage, pressure level, surface texture, and temperature, respectively. The position tracking controller system was designed to synchronize the movements of the volunteers’ elbow joints and the prosthetic’s elbow joint to record the withdrawal reflexes. The results verified the ability of the haptic system to excite the human brain at the abnormal noxious stimulus and enable the volunteers to perform a quick withdrawal reflex within 0.32 sec. The test results and the volunteers' response established evidence that amputees are able to recover their sense of the contact pressure, the surface texture, and the object temperature as well as to perform thermal withdrawal reflexes using the solution developed in this work

A hierarchical sensorimotor control framework for human-in-the-loop robotic hands.

Human manual dexterity relies critically on touch. Robotic and prosthetic hands are much less dexterous and make little use of the many tactile sensors available. We propose a framework modeled on the hierarchical sensorimotor controllers of the nervous system to link sensing to action in human-in-the-loop, haptically enabled, artificial hands

Telerobotics in rehabilitation: Barriers to a virtual existence

The topics covered include the following: the need for telerobotics in rehabilitation; barriers to telerobotics technology in rehabilitation and health care; institutional barriers; technical barriers; and a partial view of the future

A Review of Non-Invasive Haptic Feedback stimulation Techniques for Upper Extremity Prostheses

A sense of touch is essential for amputees to reintegrate into their social and work life. The design of the next generation of the prostheses will have the ability to effectively convey the tactile information between the amputee and the artificial limbs. This work reviews non-invasive haptic feedback stimulation techniques to convey the tactile information from the prosthetic hand to the amputee’s brain. Various types of actuators that been used to stimulate the patient’s residual limb for different types of artificial prostheses in previous studies have been reviewed in terms of functionality, effectiveness, wearability and comfort. The non-invasive hybrid feedback stimulation system was found to be better in terms of the stimulus identification rate of the haptic prostheses’ users. It can be conclude that integrating hybrid haptic feedback stimulation system with the upper limb prostheses leads to improving its acceptance among users

Doctor of Philosophy

dissertationToday, we are implanting electrodes into many different parts of the peripheral and central nervous systems for the purpose of restoring function to people with nerve injury or disease. As technology and manufacturing continue to become more advanced, ne

Doctor of Philosophy

dissertationHigh-count microelectrode arrays implanted in peripheral nerves could restore motor function after spinal cord injury or sensory function after limb loss via electrical stimulation. The same device could also help restore volitional control to a prosthesis-using amputee, or sensation to a Spinal cord Injury (SCI) patient, via recordings from the still-viable peripheral nerves. The overall objective of these dissertations studies is to improve the usefulness of intrafascicular electrodes, such as the Utah Slanted Electrode Array (USEA), for neuroprosthetic devices for limb loss or spinal cord injury patients. Previous work in cat sciatic nerve has shown that stimulation through the USEA can remain viable for months after implant. However, stimulation parameters were not stable, and recordings were lost rapidly and were subject to strong contamination by myoelectrical activity from adjacent muscles. Recent research has shown that even when mobility is restored to a patient, either through prosthesis or functional electrical stimulation, difficulties in using the affected limbs arise from the lack of sensory input. In the absence of the usual proprioceptive and cutaneous inputs from the limb, planning and executing motions can be challenging and sometimes lead to the user's abandonment of prostheses. To begin to address this need, I examined the ability of USEAs in cat hindlimb nerves to activate primary sensory fibers by monitoring evoked potentials in somatosensory cortex via skull-screw electrodes. I iv also monitored evoked EMG responses, and determined that it is possible to recruit sensory or motor responses independently of one another. In the second study of this dissertation, I sought to improve the long-term stability of USEAs in the PNS by physically and electrically stabilizing and protecting the array. To demonstrate the efficacy of the stabilization and shielding technique, I examined the recording capabilities of USEA electrodes and their selectivity of muscle activation over the long term in cat sciatic nerve. In addition to long-term viability, clinically useful neuroprosthetic devices will have to be capable of interfacing with complex motor systems such as the human hand. To extend previous results of USEAs in cat hindlimb nerves and to examine selectivity when interfacing with a complex sensorimotor system, I characterized EMG and cortical somatosensory responses to acute USEA stimulation in monkey arm nerves. Then, to demonstrate the functional usefulness of stimulation through the USEA. I used multi-array, multi-electrode stimulation to generate a natural, coordinated grasp

Doctor of Philosophy

dissertationRecording the neural activity of human subjects is indispensable for fundamental neuroscience research and clinical applications. Human studies range from examining the neural activity of large regions of the cortex using electroencephalography (EEG) or electrocorticography (ECoG) to single neurons or small populations of neurons using microelectrode arrays. In this dissertation, microscale recordings in the human cortex were analyzed during administration of propofol anesthesia and articulate movements such as speech, finger flexion, and arm reach. Recordings were performed on epilepsy patients who required long-term electrocorticographic monitoring and were implanted with penetrating or surface microelectrode arrays. We used penetrating microelectrode arrays to investigate the effects of propofol anesthesia on action potentials (APs) and local field potentials (LFPs). Increased propofol concentration correlated with decreased high-frequency power in LFP spectra and decreased AP firing rates, as well as the generation of large amplitude spike-like LFP activity; however, the temporal relationship between APs and LFPs remained relatively consistent at all levels of propofol anesthesia. The propofol-induced suppression of neocortical network activity allowed LFPs to be dominated by low-frequency spike-like activity, and correlated with sedation and unconsciousness. As the low-frequency spike-like activity increased, and the AP-LFP relationship became more predictable, firing rate encoding capacity was impaired. This suggests a mechanism for decreased information processing in the neocortex that accounts for propofol-induced unconsciousness. We also demonstrated that speech, finger, and arm movements can be decoded from LFPs recorded with dense grids of microelectrodes placed on the surface of human cerebral cortex for brain computer interface (BCI) applications using LFPs recorded over face-motor area, vocalized articulations of ten different words and silence were classified on a trial-by-trial basis with 82.4% accuracy. Using LFPs recorded over the hand area of motor cortex, three individual finger movements and rest were classified on a trial-by-trial basis with 62% accuracy. LFPs recorded over the arm area of motor cortex were used to continuously decode the arm trajectory with a maximum correlation coefficient of 0.82 in the x-direction and 0.76 in the y-direction. These findings demonstrate that LFPs recorded by micro-ECoG grids from the surface of the cerebral cortex contain sufficient information to provide rapid and intuitive control a BCI communication or motor prosthesis

Mechanisms for enabling closed-loop upper limb sensorimotor prosthetic control

Myoelectric upper limb prostheses are limited in their ability to provide sensory feedback to a user. The lack of sensory feedback forces prosthesis users to rely on visual feedback alone in manipulating objects, and often leads to abandonment of the prosthesis in favor of the user's unimpaired arm. Consequently, there is a critical need to develop mechanisms that enable people with upper limb amputations to be able to receive sensory feedback from the environment. The goal of this dissertation is to describe the development and evaluation of various mechanisms that enable simultaneous myoelectric control of hand prostheses with proprioceptive and touch/pressure feedback. Sensory feedback is enabled through the use of a passive skin stretch mechanism for proprioception (Chapter 2), an epidermal electronic device that can provide electrotactile stimulation (Chapter 3), and a custom-built prosthetic hand that relays contact and pressure information from the fingertips (Chapter 4). In each of these chapters, motor control is simultaneously enabled through the use of electromyographic sensors. The remainder of the dissertation focuses on a method of enabling long-term wear of electrotactile stimulation electrodes by modeling (Chapter 5) and controlling (Chapter 6) sensation intensity in response to changes in the impedance of the electrode-skin interface. The techniques described in this dissertation have the potential to improve prosthesis embodiment for a person with an upper limb amputation, with the ultimate goal of reducing prosthesis abandonment and improving quality of life

Towards Natural Control of Artificial Limbs

The use of implantable electrodes has been long thought as the solution for a more natural control of artificial limbs, as these offer access to long-term stable and physiologically appropriate sources of control, as well as the possibility to elicit appropriate sensory feedback via neurostimulation. Although these ideas have been explored since the 1960’s, the lack of a long-term stable human-machine interface has prevented the utilization of even the simplest implanted electrodes in clinically viable limb prostheses.In this thesis, a novel human-machine interface for bidirectional communication between implanted electrodes and the artificial limb was developed and clinically implemented. The long-term stability was achieved via osseointegration, which has been shown to provide stable skeletal attachment. By enhancing this technology as a communication gateway, the longest clinical implementation of prosthetic control sourced by implanted electrodes has been achieved, as well as the first in modern times. The first recipient has used it uninterruptedly in daily and professional activities for over one year. Prosthetic control was found to improve in resolution while requiring less muscular effort, as well as to be resilient to motion artifacts, limb position, and environmental conditions.In order to support this work, the literature was reviewed in search of reliable and safe neuromuscular electrodes that could be immediately used in humans. Additional work was conducted to improve the signal-to-noise ratio and increase the amount of information retrievable from extraneural recordings. Different signal processing and pattern recognition algorithms were investigated and further developed towards real-time and simultaneous prediction of limb movements. These algorithms were used to demonstrate that higher functionality could be restored by intuitive control of distal joints, and that such control remains viable over time when using epimysial electrodes. Lastly, the long-term viability of direct nerve stimulation to produce intuitive sensory feedback was also demonstrated.The possibility to permanently and reliably access implanted electrodes, thus making them viable for prosthetic control, is potentially the main contribution of this work. Furthermore, the opportunity to chronically record and stimulate the neuromuscular system offers new venues for the prediction of complex limb motions and increased understanding of somatosensory perception. Therefore, the technology developed here, combining stable attachment with permanent and reliable human-machine communication, is considered by the author as a critical step towards more functional artificial limbs