Analysis of ANN and Fuzzy Logic Dynamic Modelling to Control the Wrist Exoskeleton

Human intention has long been a primary emphasis in the field of electromyography (EMG) research. This being considered, the movement of the exoskeleton hand can be accurately predicted based on the user's preferences. The EMG is a nonlinear signal formed by muscle contractions as the human hand moves and easily captured noise signal from its surroundings. Due to this fact, this study aims to estimate wrist desired velocity based on EMG signals using ANN and FL mapping methods. The output was derived using EMG signals and wrist position were directly proportional to control wrist desired velocity. Ten male subjects, ranging in age from 21 to 40, supplied EMG signal data set used for estimating the output in single and double muscles experiments. To validate the performance, a physical model of an exoskeleton hand was created using Sim-mechanics program tool. The ANN used Levenberg training method with 1 hidden layer and 10 neurons, while FL used a triangular membership function to represent muscles contraction signals amplitude at different MVC levels for each wrist position. As a result, PID was substituted to compensate fluctuation of mapping outputs, resulting in a smoother signal reading while improving the estimation of wrist desired velocity performance. As a conclusion, ANN compensates for complex nonlinear input to estimate output, but it works best with large data sets. FL allowed designers to design rules based on their knowledge, but the system will struggle due to the large number of inputs. Based on the results achieved, FL was able to show a distinct separation of wrist desired velocity hand movement when compared to ANN for similar testing datasets due to the decision making based on rules setting setup by the designer

Spatial distribution of HD-EMG improves identification of task and force in patients with incomplete spinal cord injury

Background: Recent studies show that spatial distribution of High Density surface EMG maps (HD-EMG) improves the identification of tasks and their corresponding contraction levels. However, in patients with incomplete spinal cord injury (iSCI), some nerves that control muscles are damaged, leaving some muscle parts without an innervation. Therefore, HD-EMG maps in patients with iSCI are affected by the injury and they can be different for every patient. The objective of this study is to investigate the spatial distribution of intensity in HD-EMG recordings to distinguish co-activation patterns for different tasks and effort levels in patients with iSCI. These patterns are evaluated to be used for extraction of motion intention.; Method: HD-EMG was recorded in patients during four isometric tasks of the forearm at three different effort levels. A linear discriminant classifier based on intensity and spatial features of HD-EMG maps of five upper-limb muscles was used to identify the attempted tasks. Task and force identification were evaluated for each patient individually, and the reliability of the identification was tested with respect to muscle fatigue and time interval between training and identification. Results: Three feature sets were analyzed in the identification: 1) intensity of the HD-EMG map, 2) intensity and center of gravity of HD-EMG maps and 3) intensity of a single differential EMG channel (gold standard).; Results show that the combination of intensity and spatial features in classification identifies tasks and effort levels properly (Acc = 98.8 %; S = 92.5 %; P = 93.2 %; SP = 99.4 %) and outperforms significantly the other two feature sets (p < 0.05).; Conclusion: In spite of the limited motor functionality, a specific co-activation pattern for each patient exists for both intensity, and spatial distribution of myoelectric activity. The spatial distribution is less sensitive than intensity to myoelectric changes that occur due to fatigue, and other time-dependent influences.Peer ReviewedPostprint (published version

Surface EMG pattern recognition for real-time control of a wrist exoskeleton

<p>Abstract</p> <p>Background</p> <p>Surface electromyography (sEMG) signals have been used in numerous studies for the classification of hand gestures and movements and successfully implemented in the position control of different prosthetic hands for amputees. sEMG could also potentially be used for controlling wearable devices which could assist persons with reduced muscle mass, such as those suffering from sarcopenia. While using sEMG for position control, estimation of the intended torque of the user could also provide sufficient information for an effective force control of the hand prosthesis or assistive device. This paper presents the use of pattern recognition to estimate the torque applied by a human wrist and its real-time implementation to control a novel two degree of freedom wrist exoskeleton prototype (WEP), which was specifically developed for this work.</p> <p>Methods</p> <p>Both sEMG data from four muscles of the forearm and wrist torque were collected from eight volunteers by using a custom-made testing rig. The features that were extracted from the sEMG signals included root mean square (rms) EMG amplitude, autoregressive (AR) model coefficients and waveform length. Support Vector Machines (SVM) was employed to extract classes of different force intensity from the sEMG signals. After assessing the off-line performance of the used classification technique, the WEP was used to validate in real-time the proposed classification scheme.</p> <p>Results</p> <p>The data gathered from the volunteers were divided into two sets, one with nineteen classes and the second with thirteen classes. Each set of data was further divided into training and testing data. It was observed that the average testing accuracy in the case of nineteen classes was about 88% whereas the average accuracy in the case of thirteen classes reached about 96%. Classification and control algorithm implemented in the WEP was executed in less than 125 ms.</p> <p>Conclusions</p> <p>The results of this study showed that classification of EMG signals by separating different levels of torque is possible for wrist motion and the use of only four EMG channels is suitable. The study also showed that SVM classification technique is suitable for real-time classification of sEMG signals and can be effectively implemented for controlling an exoskeleton device for assisting the wrist.</p

Myoelectric forearm prostheses: State of the art from a user-centered perspective

User acceptance of myoelectric forearm prostheses is currently low. Awkward control, lack of feedback, and difficult training are cited as primary reasons. Recently, researchers have focused on exploiting the new possibilities offered by advancements in prosthetic technology. Alternatively, researchers could focus on prosthesis acceptance by developing functional requirements based on activities users are likely to perform. In this article, we describe the process of determining such requirements and then the application of these requirements to evaluating the state of the art in myoelectric forearm prosthesis research. As part of a needs assessment, a workshop was organized involving clinicians (representing end users), academics, and engineers. The resulting needs included an increased number of functions, lower reaction and execution times, and intuitiveness of both control and feedback systems. Reviewing the state of the art of research in the main prosthetic subsystems (electromyographic [EMG] sensing, control, and feedback) showed that modern research prototypes only partly fulfill the requirements. We found that focus should be on validating EMG-sensing results with patients, improving simultaneous control of wrist movements and grasps, deriving optimal parameters for force and position feedback, and taking into account the psychophysical aspects of feedback, such as intensity perception and spatial acuity

Classification of EMG signals to control a prosthetic hand using time-frequesncy representations and Support Vector Machines

Myoelectric signals (MES) are viable control signals for externally-powered prosthetic devices. They may improve both the functionality and the cosmetic appearance of these devices. Conventional controllers, based on the signal\u27s amplitude features in the control strategy, lack a large number of controllable states because signals from independent muscles are required for each degree of freedom (DoF) of the device. Myoelectric pattern recognition systems can overcome this problem by discriminating different residual muscle movements instead of contraction levels of individual muscles. However, the lack of long-term robustness in these systems and the design of counter-intuitive control/command interfaces have resulted in low clinical acceptance levels. As a result, the development of robust, easy to use myoelectric pattern recognition-based control systems is the main challenge in the field of prosthetic control. This dissertation addresses the need to improve the controller\u27s robustness by designing a pattern recognition-based control system that classifies the user\u27s intention to actuate the prosthesis. This system is part of a cost-effective prosthetic hand prototype developed to achieve an acceptable level of functional dexterity using a simple to use interface. A Support Vector Machine (SVM) classifier implemented as a directed acyclic graph (DAG) was created. It used wavelet features from multiple surface EMG channels strategically placed over five forearm muscles. The classifiers were evaluated across seven subjects. They were able to discriminate five wrist motions with an accuracy of 91.5%. Variations of electrode locations were artificially introduced at each recording session as part of the procedure, to obtain data that accounted for the changes in the user\u27s muscle patterns over time. The generalization ability of the SVM was able to capture most of the variability in the data and to maintain an average classification accuracy of 90%. Two principal component analysis (PCA) frameworks were also evaluated to study the relationship between EMG recording sites and the need for feature space reduction. The dimension of the new feature set was reduced with the goal of improving the classification accuracy and reducing the computation time. The analysis indicated that the projection of the wavelet features into a reduced feature space did not significantly improve the accuracy and the computation time. However, decreasing the number of wavelet decomposition levels did lower the computational load without compromising the average signal classification accuracy. Based on the results of this work, a myoelectric pattern recognition-based control system that uses an SVM classifier applied to time-frequency features may be used to discriminate muscle contraction patterns for prosthetic applications

A quantitative taxonomy of human hand grasps

Background: A proper modeling of human grasping and of hand movements is fundamental for robotics, prosthetics, physiology and rehabilitation. The taxonomies of hand grasps that have been proposed in scientific literature so far are based on qualitative analyses of the movements and thus they are usually not quantitatively justified. Methods: This paper presents to the best of our knowledge the first quantitative taxonomy of hand grasps based on biomedical data measurements. The taxonomy is based on electromyography and kinematic data recorded from 40 healthy subjects performing 20 unique hand grasps. For each subject, a set of hierarchical trees are computed for several signal features. Afterwards, the trees are combined, first into modality-specific (i.e. muscular and kinematic) taxonomies of hand grasps and then into a general quantitative taxonomy of hand movements. The modality-specific taxonomies provide similar results despite describing different parameters of hand movements, one being muscular and the other kinematic. Results: The general taxonomy merges the kinematic and muscular description into a comprehensive hierarchical structure. The obtained results clarify what has been proposed in the literature so far and they partially confirm the qualitative parameters used to create previous taxonomies of hand grasps. According to the results, hand movements can be divided into five movement categories defined based on the overall grasp shape, finger positioning and muscular activation. Part of the results appears qualitatively in accordance with previous results describing kinematic hand grasping synergies. Conclusions: The taxonomy of hand grasps proposed in this paper clarifies with quantitative measurements what has been proposed in the field on a qualitative basis, thus having a potential impact on several scientific fields

Analysis of forearm muscles activity by means of new protocols of multichannel EMG signal recording and processing

Los movimientos voluntarios del cuerpo son controlados por el sistema nervioso central y periférico a través de la contracción de los músculos esqueléticos. La contracción se inicia al liberarse un neurotransmisor sobre la unión neuromuscular, iniciando la propagación de un biopotencial sobre la membrana de las fibras musculares que se desplaza hacia los tendones: el Potencial de Acción de la Unidad Motora (MUAP). La señal electromiográfica de superficie registra la activación continua de dichos potenciales sobre la superficie de la piel y constituye una valiosa herramienta para la investigación, diagnóstico y seguimiento clínico de trastornos musculares, así como para la identificación de la intención movimiento tanto en términos de dirección como de potencia. En el estudio de las enfermedades del sistema neuromuscular es necesario analizar el nivel de actividad, la capacidad de producción de fuerza, la activación muscular conjunta y la predisposición a la fatiga muscular, todos ellos asociados con factores fisiológicos que determinan la resultante contracción mioeléctrica. Además, el uso de matrices de electrodos facilita la investigación de las propiedades periféricas de las unidades motoras activas, las características anatómicas del músculo y los cambios espaciales en su activación, ocasionados por el tipo de tarea motora o la potencia de la misma. El objetivo principal de esta tesis es el diseño e implementación de protocolos experimentales y algoritmos de procesado para extraer información fiable de señales sEMG multicanal en 1 y 2 dimensiones del espacio. Dicha información ha sido interpretada y relacionada con dos patologías específicas de la extremidad superior: Epicondilitis Lateral y Lesión de Esfuerzo Repetitivo. También fue utilizada para identificar la dirección de movimiento y la fuerza asociada a la contracción muscular, cuyos patrones podrían ser de utilidad en aplicaciones donde la señal electromiográfica se utilice para controlar interfaces hombre-máquina como es el caso de terapia física basada en robots, entornos virtuales de rehabilitación o realimentación de la actividad muscular. En resumen, las aportaciones más relevantes de esta tesis son: * La definición de protocolos experimentales orientados al registro de señales sEMG en una región óptima del músculo. * Definición de índices asociados a la co-activación de diferentes músculos * Identificación de señales artefactuadas en registros multicanal * Selección de los canales mas relevantes para el análisis Extracción de un conjunto de características que permita una alta exactitud en la identificación de tareas motoras Los protocolos experimentales y los índices propuestos permitieron establecer que diversos desequilibrios entre músculos extrínsecos del antebrazo podrían desempeñar un papel clave en la fisiopatología de la epicondilitis lateral. Los resultados fueron consistentes en diferentes ejercicios y pueden definir un marco de evaluación para el seguimiento y evaluación de pacientes en programas de rehabilitación motora. Por otra parte, se encontró que las características asociadas con la distribución espacial de los MUAPs mejoran la exactitud en la identificación de la intención de movimiento. Lo que es más, las características extraídas de registros sEMG de alta densidad son más robustas que las extraídas de señales bipolares simples, no sólo por la redundancia de contacto implicada en HD-EMG, sino también porque permite monitorizar las regiones del músculo donde la amplitud de la señal es máxima y que varían con el tipo de ejercicio, permitiendo así una mejor estimación de la activación muscular mediante el análisis de los canales mas relevantes.Voluntary movements are achieved by the contraction of skeletal muscles controlled by the Central and Peripheral Nervous system. The contraction is initiated by the release of a neurotransmitter that promotes a reaction in the walls of the muscular fiber, producing a biopotential known as Motor Unit Action Potential (MUAP) that travels from the neuromuscular junction to the tendons. The surface electromyographic signal records the continuous activation of such potentials over the surface of the skin and constitutes a valuable tool for the diagnosis, monitoring and clinical research of muscular disorders as well as to infer motion intention not only regarding the direction of the movement but also its power. In the study of diseases of the neuromuscular system it is necessary to analyze the level of activity, the capacity of production of strength, the load-sharing between muscles and the probably predisposition to muscular fatigue, all of them associated with physiological factors determining the resultant muscular contraction. Moreover, the use of electrode arrays facilitate the investigation of the peripheral properties of the active Motor Units, the anatomical characteristics of the muscle and the spatial changes induced in their activation of as product of type of movement or power of the contraction.The main objective of this thesis was the design and implementation of experimental protocols, and algorithms to extract information from multichannel sEMG signals in 1 and 2 dimensions of the space. Such information was interpreted and related to pathological events associated to two upper-limb conditions: Lateral Epicondylitis and Repetitive Strain Injury. It was also used to identify the direction of movement and contraction strength which could be useful in applications concerning the use of biofeedback from EMG like in robotic- aided therapies and computer-based rehabilitation training.In summary, the most relevant contributions are:§The definition of experimental protocols intended to find optimal regions for the recording of sEMG signals. §The definition of indices associated to the co- activation of different muscles. §The detection of low-quality signals in multichannel sEMG recordings.§ The selection of the most relevant EMG channels for the analysis§The extraction of a set of features that led to high classification accuracy in the identification of tasks.The experimental protocols and the proposed indices allowed establishing that imbalances between extrinsic muscles of the forearm could play a key role in the pathophysiology of lateral epicondylalgia. Results were consistent in different types of motor task and may define an assessment framework for the monitoring and evaluation of patients during rehabilitation programs.On the other hand, it was found that features associated with the spatial distribution of the MUAPs improve the accuracy of the identification of motion intention. What is more, features extracted from high density EMG recordings are more robust not only because it implies contact redundancy but also because it allows the tracking of (task changing) skin surface areas where EMG amplitude is maximal and a better estimation of muscle activity by the proper selection of the most significant channels

AN INVESTIGATION OF ELECTROMYOGRAPHIC (EMG) CONTROL OF DEXTROUS HAND PROSTHESES FOR TRANSRADIAL AMPUTEES

In reference to IEEE copyrighted material which is used with permission in this thesis, the IEEE does not endorse any of Plymouth University's products or services.There are many amputees around the world who have lost a limb through conflict, disease or an accident. Upper-limb prostheses controlled using surface Electromyography (sEMG) offer a solution to help the amputees; however, their functionality is limited by the small number of movements they can perform and their slow reaction times. Pattern recognition (PR)-based EMG control has been proposed to improve the functional performance of prostheses. It is a very promising approach, offering intuitive control, fast reaction times and the ability to control a large number of degrees of freedom (DOF). However, prostheses controlled with PR systems are not available for everyday use by amputees, because there are many major challenges and practical problems that need to be addressed before clinical implementation is possible. These include lack of individual finger control, an impractically large number of EMG electrodes, and the lack of deployment protocols for EMG electrodes site selection and movement optimisation. Moreover, the inability of PR systems to handle multiple forces is a further practical problem that needs to be addressed. The main aim of this project is to investigate the research challenges mentioned above via non-invasive EMG signal acquisition, and to propose practical solutions to help amputees. In a series of experiments, the PR systems presented here were tested with EMG signals acquired from seven transradial amputees, which is unique to this project. Previous studies have been conducted using non-amputees. In this work, the challenges described are addressed and a new protocol is proposed that delivers a fast clinical deployment of multi-functional upper limb prostheses controlled by PR systems. Controlling finger movement is a step towards the restoration of lost human capabilities, and is psychologically important, as well as physically. A central thread running through this work is the assertion that no two amputees are the same, each suffering different injuries and retaining differing nerve and muscle structures. This work is very much about individualised healthcare, and aims to provide the best possible solution for each affected individual on a case-by-case basis. Therefore, the approach has been to optimise the solution (in terms of function and reliability) for each individual, as opposed to developing a generic solution, where performance is optimised against a test population. This work is unique, in that it contributes to improving the quality of life for each individual amputee by optimising function and reliability. The main four contributions of the thesis are as follows: 1- Individual finger control was achieved with high accuracy for a large number of finger movements, using six optimally placed sEMG channels. This was validated on EMG signals for ten non-amputee and six amputee subjects. Thumb movements were classified successfully with high accuracy for the first time. The outcome of this investigation will help to add more movements to the prosthesis, and reduce hardware and computational complexity. 2- A new subject-specific protocol for sEMG site selection and reliable movement subset optimisation, based on the amputee’s needs, has been proposed and validated on seven amputees. This protocol will help clinicians to perform an efficient and fast deployment of prostheses, by finding the optimal number and locations of EMG channels. It will also find a reliable subset of movements that can be achieved with high performance. 3- The relationship between the force of contraction and the statistics of EMG signals has been investigated, utilising an experimental design where visual feedback from a Myoelectric Control Interface (MCI) helped the participants to produce the correct level of force. Kurtosis values were found to decrease monotonically when the contraction level increased, thus indicating that kurtosis can be used to distinguish different forces of contractions. 4- The real practical problem of the degradation of classification performance as a result of the variation of force levels during daily use of the prosthesis has been investigated, and solved by proposing a training approach and the use of a robust feature extraction method, based on the spectrum. The recommendations of this investigation improve the practical robustness of prostheses controlled with PR systems and progress a step further towards clinical implementation and improving the quality of life of amputees. The project showed that PR systems achieved a reliable performance for a large number of amputees, taking into account real life issues such as individual finger control for high dexterity, the effect of force level variation, and optimisation of the movements and EMG channels for each individual amputee. The findings of this thesis showed that the PR systems need to be appropriately tuned before usage, such as training with multiple forces to help to reduce the effect of force variation, aiming to improve practical robustness, and also finding the optimal EMG channel for each amputee, to improve the PR system’s performance. The outcome of this research enables the implementation of PR systems in real prostheses that can be used by amputees.Ministry of Higher Education and Scientific Research and Baghdad University- Baghdad/Ira

Relating forearm muscle electrical activity to finger forces

The electromyogram (EMG) signal is desired to be used as a control signal for applications such as multifunction prostheses, wheelchair navigation, gait generation, grasping control, virtual keyboards, and gesture-based interfaces [25]. Several research studies have attempted to relate the electromyogram (EMG) activity of the forearm muscles to the mechanical activity of the wrist, hand and/or fingers [41], [42], [43]. A primary interest is for EMG control of powered upper-limb prostheses and rehabilitation orthotics. Existing commercial EMG-controlled devices are limited to rudimentary control capabilities of either discrete states (e.g. hand close/open), or one degree of freedom proportional control [4], [36]. Classification schemes for discriminating between hand/wrist functions and individual finger movements have demonstrated accuracy up to 95% [38], [39], [29]. These methods may provide for increased amputee function, though continuous control of movement is not generally achieved. This thesis considered proportional control via EMG-based estimation of finger forces with the goal of identifying whether multiple degrees of freedom of proportional control information are available from the surface EMG of the forearm. Electromyogram (EMG) activity from the extensor and flexor muscles of the forearm was sensed with bipolar surface electrodes and related to the force produced at the four fingertips during constant-posture, slowly force-varying contractions from 20 healthy subjects. The contractions ranged between 30% maximum voluntary contractions (MVC) extension and 30% MVC flexion. EMG amplitude sampling rate, least squares regularization, linear vs. nonlinear models and number of electrodes used in the system identification were studied. Results are supportive that multiple degrees of freedom of proportional control information are available from the surface EMG of the forearm, at least in healthy subjects. An EMG amplitude sampling frequency of 4.096 Hz was found to produce models which allowed for good EMG amplitude estimates. Least squares regularization with a pseudo-inverse tolerance of 0.055 resulted in significant improvement in modeling results, with an average error of 4.69% MVC-6.59% MVC (maximum voluntary contraction). Increasing polynomial order did not significantly improve modeling results. Results from smaller electrode arrays remained fairly good with as few as six electrodes, with the average %MVC error ranging from 5.13%-7.01% across the four fingers. This study also identified challenges in the current experimental study design and subsequent system identification when EMG-force modeling is performed with four fingers simultaneously. Methods to compensate for these issues have been proposed in this thesis