797 research outputs found

    Distributed Sensing and Stimulation Systems Towards Sense of Touch Restoration in Prosthetics

    Get PDF
    Modern prostheses aim at restoring the functional and aesthetic characteristics of the lost limb. To foster prosthesis embodiment and functionality, it is necessary to restitute both volitional control and sensory feedback. Contemporary feedback interfaces presented in research use few sensors and stimulation units to feedback at most two discrete feedback variables (e.g. grasping force and aperture), whereas the human sense of touch relies on a distributed network of mechanoreceptors providing high-fidelity spatial information. To provide this type of feedback in prosthetics, it is necessary to sense tactile information from artificial skin placed on the prosthesis and transmit tactile feedback above the amputation in order to map the interaction between the prosthesis and the environment. This thesis proposes the integration of distributed sensing systems (e-skin) to acquire tactile sensation, and non-invasive multichannel electrotactile feedback and virtual reality to deliver high-bandwidth information to the user. Its core focus addresses the development and testing of close-loop sensory feedback human-machine interface, based on the latest distributed sensing and stimulation techniques for restoring the sense of touch in prosthetics. To this end, the thesis is comprised of two introductory chapters that describe the state of art in the field, the objectives and the used methodology and contributions; as well as three studies distributed over stimulation system level and sensing system level. The first study presents the development of close-loop compensatory tracking system to evaluate the usability and effectiveness of electrotactile sensory feedback in enabling real-time close-loop control in prosthetics. It examines and compares the subject\u2019s adaptive performance and tolerance to random latencies while performing the dynamic control task (i.e. position control) and simultaneously receiving either visual feedback or electrotactile feedback for communicating the momentary tracking error. Moreover, it reported the minimum time delay needed for an abrupt impairment of users\u2019 performance. The experimental results have shown that electrotactile feedback performance is less prone to changes with longer delays. However, visual feedback drops faster than electrotactile with increased time delays. This is a good indication for the effectiveness of electrotactile feedback in enabling close- loop control in prosthetics, since some delays are inevitable. The second study describes the development of a novel non-invasive compact multichannel interface for electrotactile feedback, containing 24 pads electrode matrix, with fully programmable stimulation unit, that investigates the ability of able-bodied human subjects to localize the electrotactile stimulus delivered through the electrode matrix. Furthermore, it designed a novel dual parameter -modulation (interleaved frequency and intensity) and compared it to conventional stimulation (same frequency for all pads). In addition and for the first time, it compared the electrotactile stimulation to mechanical stimulation. More, it exposes the integration of virtual prosthesis with the developed system in order to achieve better user experience and object manipulation through mapping the acquired real-time collected tactile data and feedback it simultaneously to the user. The experimental results demonstrated that the proposed interleaved coding substantially improved the spatial localization compared to same-frequency stimulation. Furthermore, it showed that same-frequency stimulation was equivalent to mechanical stimulation, whereas the performance with dual-parameter modulation was significantly better. The third study presents the realization of a novel, flexible, screen- printed e-skin based on P(VDF-TrFE) piezoelectric polymers, that would cover the fingertips and the palm of the prosthetic hand (particularly the Michelangelo hand by Ottobock) and an assistive sensorized glove for stroke patients. Moreover, it developed a new validation methodology to examine the sensors behavior while being solicited. The characterization results showed compatibility between the expected (modeled) behavior of the electrical response of each sensor to measured mechanical (normal) force at the skin surface, which in turn proved the combination of both fabrication and assembly processes was successful. This paves the way to define a practical, simplified and reproducible characterization protocol for e-skin patches In conclusion, by adopting innovative methodologies in sensing and stimulation systems, this thesis advances the overall development of close-loop sensory feedback human-machine interface used for restoration of sense of touch in prosthetics. Moreover, this research could lead to high-bandwidth high-fidelity transmission of tactile information for modern dexterous prostheses that could ameliorate the end user experience and facilitate it acceptance in the daily life

    Restoring Fine Motor Skills through Neural Interface Technology.

    Full text link
    Loss of motor function in the upper-limb, whether through paralysis or through loss of the limb itself, is a profound disability which affects a large population worldwide. Lifelike, fully-articulated prosthetic hands exist and are commercially available; however, there is currently no satisfactory method of controlling all of the available degrees of freedom. In order to generate better control signals for this technology, and help restore normal movement, it is necessary to interface directly with the nervous system. This thesis is intended to address several of the limitations of current neural interfaces and enable the long-term extraction of control signals for fine movements of the hand and fingers. The first study addresses the problems of low signal amplitudes and short implant lifetimes in peripheral nerve interfaces. In two rhesus macaques, we demonstrate the successful implantation of regenerative peripheral nerve interfaces (RPNI), which allowed us to record high amplitude, functionally-selective signals from peripheral nerves up to 20 months post-implantation. These signals could be accurately decoded into intended movement, and used to enable monkeys to control a virtual hand prosthesis. The second study presents a novel experimental paradigm for intracortical neural interfaces, which enables detailed investigation of fine motor information contained in primary motor cortex. We used this paradigm to demonstrate accurate decoding of continuous fingertip position and enable a monkey to control a virtual hand in closed-loop. This is the first demonstration of volitional control of fine motor skill enabled by a cortical neural interface. The final study presents the design and testing of a wireless implantable neural recording system. By extracting signal power in a single, configurable frequency band onboard the device, this system achieves low power consumption while maintaining decode performance, and is applicable to cortical, peripheral, and myoelectric signals. Taken together, these results represent a significant step towards clinical reality for neural interfaces, and towards restoration of full and dexterous movement for people with severe disabilities.PhDBiomedical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/120648/1/irwinz_1.pd

    Towards electrodeless EMG linear envelope signal recording for myo-activated prostheses control

    Get PDF
    After amputation, the residual muscles of the limb may function in a normal way, enabling the electromyogram (EMG) signals recorded from them to be used to drive a replacement limb. These replacement limbs are called myoelectric prosthesis. The prostheses that use EMG have always been the first choice for both clinicians and engineers. Unfortunately, due to the many drawbacks of EMG (e.g. skin preparation, electromagnetic interferences, high sample rate, etc.); researchers have aspired to find suitable alternatives. One proposes the dry-contact, low-cost sensor based on a force-sensitive resistor (FSR) as a valid alternative which instead of detecting electrical events, detects mechanical events of muscle. FSR sensor is placed on the skin through a hard, circular base to sense the muscle contraction and to acquire the signal. Similarly, to reduce the output drift (resistance) caused by FSR edges (creep) and to maintain the FSR sensitivity over a wide input force range, signal conditioning (Voltage output proportional to force) is implemented. This FSR signal acquired using FSR sensor can be used directly to replace the EMG linear envelope (an important control signal in prosthetics applications). To find the best FSR position(s) to replace a single EMG lead, the simultaneous recording of EMG and FSR output is performed. Three FSRs are placed directly over the EMG electrodes, in the middle of the targeted muscle and then the individual (FSR1, FSR2 and FSR3) and combination of FSR (e.g. FSR1+FSR2, FSR2-FSR3) is evaluated. The experiment is performed on a small sample of five volunteer subjects. The result shows a high correlation (up to 0.94) between FSR output and EMG linear envelope. Consequently, the usage of the best FSR sensor position shows the ability of electrode less FSR-LE to proportionally control the prosthesis (3-D claw). Furthermore, FSR can be used to develop a universal programmable muscle signal sensor that can be suitable to control the myo-activated prosthesis

    Human-Machine Interfaces using Distributed Sensing and Stimulation Systems

    Get PDF
    As the technology moves towards more natural human-machine interfaces (e.g. bionic limbs, teleoperation, virtual reality), it is necessary to develop a sensory feedback system in order to foster embodiment and achieve better immersion in the control system. Contemporary feedback interfaces presented in research use few sensors and stimulation units to feedback at most two discrete feedback variables (e.g. grasping force and aperture), whereas the human sense of touch relies on a distributed network of mechanoreceptors providing a wide bandwidth of information. To provide this type of feedback, it is necessary to develop a distributed sensing system that could extract a wide range of information during the interaction between the robot and the environment. In addition, a distributed feedback interface is needed to deliver such information to the user. This thesis proposes the development of a distributed sensing system (e-skin) to acquire tactile sensation, a first integration of distributed sensing system on a robotic hand, the development of a sensory feedback system that compromises the distributed sensing system and a distributed stimulation system, and finally the implementation of deep learning methods for the classification of tactile data. It\u2019s core focus addresses the development and testing of a sensory feedback system, based on the latest distributed sensing and stimulation techniques. To this end, the thesis is comprised of two introductory chapters that describe the state of art in the field, the objectives, and the used methodology and contributions; as well as six studies that tackled the development of human-machine interfaces

    Real-time EMG based pattern recognition control for hand prostheses : a review on existing methods, challenges and future implementation

    Get PDF
    Upper limb amputation is a condition that significantly restricts the amputees from performing their daily activities. The myoelectric prosthesis, using signals from residual stump muscles, is aimed at restoring the function of such lost limbs seamlessly. Unfortunately, the acquisition and use of such myosignals are cumbersome and complicated. Furthermore, once acquired, it usually requires heavy computational power to turn it into a user control signal. Its transition to a practical prosthesis solution is still being challenged by various factors particularly those related to the fact that each amputee has different mobility, muscle contraction forces, limb positional variations and electrode placements. Thus, a solution that can adapt or otherwise tailor itself to each individual is required for maximum utility across amputees. Modified machine learning schemes for pattern recognition have the potential to significantly reduce the factors (movement of users and contraction of the muscle) affecting the traditional electromyography (EMG)-pattern recognition methods. Although recent developments of intelligent pattern recognition techniques could discriminate multiple degrees of freedom with high-level accuracy, their efficiency level was less accessible and revealed in real-world (amputee) applications. This review paper examined the suitability of upper limb prosthesis (ULP) inventions in the healthcare sector from their technical control perspective. More focus was given to the review of real-world applications and the use of pattern recognition control on amputees. We first reviewed the overall structure of pattern recognition schemes for myo-control prosthetic systems and then discussed their real-time use on amputee upper limbs. Finally, we concluded the paper with a discussion of the existing challenges and future research recommendations

    Sensors for Robotic Hands: A Survey of State of the Art

    Get PDF
    Recent decades have seen significant progress in the field of artificial hands. Most of the surveys, which try to capture the latest developments in this field, focused on actuation and control systems of these devices. In this paper, our goal is to provide a comprehensive survey of the sensors for artificial hands. In order to present the evolution of the field, we cover five year periods starting at the turn of the millennium. At each period, we present the robot hands with a focus on their sensor systems dividing them into categories, such as prosthetics, research devices, and industrial end-effectors.We also cover the sensors developed for robot hand usage in each era. Finally, the period between 2010 and 2015 introduces the reader to the state of the art and also hints to the future directions in the sensor development for artificial hands

    A Review of fMRI as a Tool for Enhancing Eeg-Based Brain-Machine Interfaces

    Get PDF
    Human-robot interaction has been going stronger and stronger, up to find a notorious level on brain-machines interfaces. This assistive technology offers a great hope for patients suffering severe neuromuscular disorders. Starting from the current limitations hindering its extensive application outside the research laboratories, this paper reviews findings and prospects on functional magnetic resonance imaging showing how fMRI can help to overcome those limitations, while playing a key role on improving the development of brain-machine interfaces based on electroencephalography. The different types of derived benefits for this interfaces, as well as the different kinds of impact on their components, are presented under a field classification that reveals the distinctive roles that fMRI can play on the present context. The review concludes that fMRI provides complementary knowledge of immediate application, and that a greater profit could be obtained from the own EEG signal by integrating both neuroimaging modalities

    Doctor of Philosophy

    Get PDF
    dissertationImplantable microelectrode arrays are biomedical devices used in-vivo serving as neural interfaces between the nervous system and external systems such as neuroprosthetics. They are designed to be chronically implanted in the central or peripheral nervous system and record or stimulate neural signals. The Utah electrode array (UEA) is a representative example of silicon-based neural interfaces. They are typically encapsulated with the USP Class VI biocompatible material, Parylene-C, on the inactive areas to insulate and encapsulate the electrodes and minimize damage to the neural tissue. In order to record or stimulate neural signals, the active electrode sites must be deinsulated. Tip deinsulation of Parylene-coated UEAs is typically performed by a reactive ion etching (RIE) process using an O2 plasma, and an aluminum foil mask. This technique has limitations due to nonuniform tip exposure lengths contributing to large impedance variations (o > 0.5 MQ), and difficulty in controlling the magnitude of tip exposure, especially for tip exposures less than 40 ^m, which are needed to increase its selectivity in recording or stimulating single or multiple neurons. Moreover, foil masks cannot be used for more complex electrode geometries, such as variable height electrodes. In this work, excimer laser ablation of Parylene from a UEA using a tip metallization of iridium oxide (IrOx) was investigated as an alternative deinsulation technique. A hybrid method of etching Parylene-C using a combination of laser ablation and the O2 RIE was investigated in the efforts to minimize electrode damage and remove carbonaceous residues. The median impedance for fine tip ( 180 °C) temperatures in reducing ambients, resulting in dramatic changes to the structural and electrical properties of the tip metallization. The reduced IrOx material was found to tolerate significantly more laser irradiation than the fully oxidized material. The median impedance, cathodal charge storage capacity (CSCc), and charge injection capacity (CIC) for the reduced electrodes with 40 |im exposure were ~ 25 kQ, ~ 40 mC/cm2, and ~ 0.8 mC/cm2, respectively. These results suggest that a hybrid laser ablation using an excimer laser and RIE is promising for deinsulation of UEAs

    Computational Intelligence in Electromyography Analysis

    Get PDF
    Electromyography (EMG) is a technique for evaluating and recording the electrical activity produced by skeletal muscles. EMG may be used clinically for the diagnosis of neuromuscular problems and for assessing biomechanical and motor control deficits and other functional disorders. Furthermore, it can be used as a control signal for interfacing with orthotic and/or prosthetic devices or other rehabilitation assists. This book presents an updated overview of signal processing applications and recent developments in EMG from a number of diverse aspects and various applications in clinical and experimental research. It will provide readers with a detailed introduction to EMG signal processing techniques and applications, while presenting several new results and explanation of existing algorithms. This book is organized into 18 chapters, covering the current theoretical and practical approaches of EMG research
    corecore