On Design and Implementation of Neural-Machine Interface for Artificial Legs

The quality-of-life of leg amputees can be improved dramatically by using a cyber-physical system (CPS) that controls artificial legs based on neural signals representing amputees\u27 intended movements. The key to the CPS is the neural-machine interface (NMI) that senses electromyographic (EMG) signals to make control decisions. This paper presents a design and implementation of a novel NMI using an embedded computer system to collect neural signals from a physical system-a leg amputee, provide adequate computational capability to interpret such signals, and make decisions to identify user\u27s intent for prostheses control in real time. A new deciphering algorithm, composed of an EMG pattern classifier and a postprocessing scheme, was developed to identify the user\u27s intended lower limb movements. To deal with environmental uncertainty, a trust management mechanism was designed to handle unexpected sensor failures and signal disturbances. Integrating the neural deciphering algorithm with the trust management mechanism resulted in a highly accurate and reliable software system for neural control of artificial legs. The software was then embedded in a newly designed hardware platform based on an embedded microcontroller and a graphic processing unit (GPU) to form a complete NMI for real-time testing. Real-time experiments on a leg amputee subject and an able-bodied subject have been carried out to test the control accuracy of the new NMI. Our extensive experiments have shown promising results on both subjects, paving the way for clinical feasibility of neural controlled artificial legs

Electromyography-Based Control of Lower Limb Prostheses: A Systematic Review

Most amputations occur in lower limbs and despite improvements in prosthetic technology, no commercially available prosthetic leg uses electromyography (EMG) information as an input for control. Efforts to integrate EMG signals as part of the control strategy have increased in the last decade. In this systematic review, we summarize the research in the field of lower limb prosthetic control using EMG. Four different online databases were searched until June 2022: Web of Science, Scopus, PubMed, and Science Direct. We included articles that reported systems for controlling a prosthetic leg (with an ankle and/or knee actuator) by decoding gait intent using EMG signals alone or in combination with other sensors. A total of 1,331 papers were initially assessed and 121 were finally included in this systematic review. The literature showed that despite the burgeoning interest in research, controlling a leg prosthesis using EMG signals remains challenging. Specifically, regarding EMG signal quality and stability, electrode placement, prosthetic hardware, and control algorithms, all of which need to be more robust for everyday use. In the studies that were investigated, large variations were found between the control methodologies, type of research participant, recording protocols, assessments, and prosthetic hardware

The Fuzzy Feedback Scheduling of Real-Time Middleware in Cyber-Physical Systems for Robot Control

Cyber-physical systems for robot control integrate the computing units and physical devices, which are real-time systems with periodic events. This work focuses on CPS task scheduling in order to solve the problem of slow response and packet loss caused by the interaction between each service. The two-level fuzzy feedback scheduling scheme is designed to adjust the task priority and period according to the combined effects of the response time and packet loss. Empirical results verify the rationality of the cyber-physical system architecture for robot control and illustrate the feasibility of the fuzzy feedback scheduling method

Down-Conditioning of Soleus Reflex Activity using Mechanical Stimuli and EMG Biofeedback

Spasticity is a common syndrome caused by various brain and neural injuries, which can severely impair walking ability and functional independence. To improve functional independence, conditioning protocols are available aimed at reducing spasticity by facilitating spinal neuroplasticity. This down-conditioning can be performed using different types of stimuli, electrical or mechanical, and reflex activity measures, EMG or impedance, used as biofeedback variable. Still, current results on effectiveness of these conditioning protocols are incomplete, making comparisons difficult. We aimed to show the within-session task- dependent and across-session long-term adaptation of a conditioning protocol based on mechanical stimuli and EMG biofeedback. However, in contrast to literature, preliminary results show that subjects were unable to successfully obtain task-dependent modulation of their soleus short-latency stretch reflex magnitude

Using Artificial Intelligence To Improve The Control Of Prosthetic Legs

For as long as people have been able to survive limb threatening injuries prostheses have been created. Modern lower limb prostheses are primarily controlled by adjusting the amount of damping in the knee to bend in a suitable manner for walking and running. Often the choice of walking state or running state has to be controlled manually by pressing a button. While this simple tuning strategy can work for many users it can be limiting and there is the tendency that controlling the leg is not intuitive and the wearer has to learn how to use leg. This thesis examines how this control can be improved using Artificial Intelligence (AI) to allow the system to be tuned for each individual. A wearable gait lab was developed consisting of a number of sensors attached to the limbs of eight volunteers. The signals from the sensors were analysed and features were extracted from them which were then passed through 2 separate Artificial Neural Networks (ANN). One network attempted to classify whether the wearer was standing still, walking or running. The other network attempted to estimate the wearer’s movement speed. A Genetic Algorithm (GA) was used to tune the ANNs parameters for each individual. The results showed that each individual needed different parameters to tune the features presented to the ANN. It was also found that different features were needed for each of the two problems presented to the ANN. Two new features are presented which identify the movement states of standing, walking and running and the movement speed of the volunteer. The results suggest that the control of the prosthetic limb can be improved

Lower limb exoskeleton robot and its cooperative control: A review, trends, and challenges for future research

Effective control of an exoskeleton robot (ER) using a human-robot interface is crucial for assessing the robot's movements and the force they produce to generate efficient control signals. Interestingly, certain surveys were done to show off cutting-edge exoskeleton robots. The review papers that were previously published have not thoroughly examined the control strategy, which is a crucial component of automating exoskeleton systems. As a result, this review focuses on examining the most recent developments and problems associated with exoskeleton control systems, particularly during the last few years (2017–2022). In addition, the trends and challenges of cooperative control, particularly multi-information fusion, are discussed

Assist-as-needed EMG-based control strategy for wearable powered assistive devices

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Eletrónica Médica)Robotic-based gait rehabilitation and assistance using Wearable Powered Assistive Devices (WPADs), such as orthosis and exoskeletons, has been growing in the rehabilitation area to recover and augment the motor function of neurologically impaired subjects. These WPADs should provide a personalized assistance, since physical condition and muscular fatigue modify from patient to patient. In this field, electromyography (EMG) signals have been used to control WPADs given their ability to infer the user’s motion intention. However, in cases of motor disability conditions, EMG signals present lower magnitudes when compared to EMG signals under healthy conditions. Thus, the use of WPADs managed by EMG signals may not have potential to provide the assistance that the patient requires. The main goal of this dissertation aims the development of an Assisted-As-Needed (AAN) EMG-based control strategy for a future insertion in a Smart Active Orthotic System (SmartOs). To achieve this goal, the following elements were developed and validated: (i) an EMG system to acquire muscle activity signals from the most relevant muscles during the motion of the ankle joint; (ii) machine learning-based tool for ankle joint torque estimation to serve as reference in the AAN EMG-based control strategy; and (iii) a tool for real EMG-based torque estimation using Tibialis Anterior (TA) and Gastrocnemius Lateralis (GASL) muscles and real ankle joint angles. EMG system showed satisfactory pattern correlations with a commercial system. The reference ankle joint torque was generated based on predicted reference ankle joint kinematics, walking speed information (from 1 to 4 km/h) and anthropometric data (body height from 1.51 m to 1.83 m and body mass from 52.0 kg to 83.7 kg), using five machine learning algorithms: Support Vector Regression (SVR), Random Forest (RF), Multilayer Perceptron (MLP), Long-Short Term Memory (LSTM) and Convolutional Neural Network (CNN). CNN provided the best performance, predicting the reference ankle joint torque with fitting curves ranging from 74.7 to 89.8 % and Normalized Root Mean Square Errors (NRMSEs) between 3.16 and 8.02 %. EMG-based torque estimation beneficiates of a higher number of muscles, since EMG data from TA and GASL are not enough to estimate the real ankle joint torque.A assistência e reabilitação robótica usando dispositivos de assistência ativos vestíveis (WPADs), como ortóteses e exosqueletos, tem crescido na área da reabilitação com o fim de recuperar e aumentar a função motora de sujeitos com alterações neurológicas. Estes dispositivos devem fornecer uma assistência personalizada, uma vez que a condição física e a fadiga muscular variam de paciente para paciente. Nesta área, sinais de eletromiografia (EMG) têm sido usados para controlar WPADs, dada a sua capacidade de inferir a intenção de movimento do utilizador. Contudo, em casos de deficiência motora, os sinais de EMG apresentam menor amplitude quando comparados com sinais de EMG em condições saudáveis e, portanto, o uso de WPADs geridos por sinais de EMG pode não oferecer a assistência que o paciente necessita. O principal objetivo desta dissertação visa o desenvolvimento de uma estratégia de controlo baseada em EMG capaz de fornecer assistência quando necessário, para futura integração num sistema ortótico ativo e inteligente (SmartOs). Para atingir este objetivo foram desenvolvidos e validados os seguintes elementos: (i) sistema de EMG para adquirir sinais de atividade muscular dos músculos mais relevantes no movimento da articulação do tornozelo; (ii) ferramenta de machine learning para estimação do binário da articulação do tornozelo para servir como referência na estratégia de controlo; e (iii) ferramenta de estimação do binário real do tornozelo considerando sinais de EMG dos músculos Tibialis Anterior (TA) e Gastrocnemius Lateralis (GASL) e ângulo real do tornozelo. O sistema de EMG apresentou correlações satisfatórias com um sistema comercial. O binário de referência para o tornozelo foi gerado com base no ângulo de referência da mesma articulação, velocidade de marcha (de 1 até 4 km/h) e dados antropométricos (alturas de 1.51 m até 1.83 e massas de 52.0 kg até 83.7 kg), usando cinco algoritmos de machine learning: Support Vector Machine, Random Forest, Multilayer Perceptron, Long-Short Term Memory e Convolutional Neural Network. CNN apresentou a melhor performance, prevendo binários de referência do tornozelo com um fit entre 74.7 e 89.8 % e Normalized Root Mean Square Errors (NRMSE) entre 3.16 e 8.02 %. A estimativa do torque com base em sinais de EMG requer a inclusão de um maior número de músculos, uma vez que sinais de EMG dos músculos TA e GASL não foram suficientes

Fall prevention strategy for an active orthotic system

Dissertação de mestrado integrado em Engenharia Biomédica (especialização em Eletrónica Médica)Todos os anos, são reportadas cerca de 684,000 quedas fatais e 37.3 milhões de quedas não fatais que requerem atenção médica, afetando principalmente a população idosa. Assim, é necessário identificar eficientemente indivíduos com alto risco de queda, a partir da população alvo idosa, e prepará los para superar perturbações da marcha inesperadas. Uma estratégia de prevenção de queda capaz de eficientemente e atempadamente detetar e contrariar os eventos de perdas de equilíbrio (PDE) mais frequentes pode reduzir o risco de queda. Como slips foram identificados como a causa mais prevalente de quedas, estes eventos devem ser abordados como foco principal da estratégia. No entanto, há falta de estratégias de prevenção de quedas por slip. Esta dissertação tem como objetivo o design de uma estratégia de prevenção de quedas de slips baseada na conceção das etapas de atuação e deteção. A estratégia de atuação foi delineada com base na resposta biomecânica humana a slips, onde o joelho da perna perturbada (leading) apresenta um papel proeminente para contrariar LOBs induzidas por slips. Quando uma slip é detetada, a estratégia destaca uma ortótese de joelho que providencia um torque assisstivo para prevenir a queda. A estratégia de deteção considerou as propriedades atrativas dos controladores Central Pattern Generator (CPG) para prever parâmetros da marcha. Algoritmos baseados em threshold monitorizam o erro de previsão do CPG, que aumenta após uma perturbação inesperada na marcha, para a deteção de slips. O ângulo do joelho e a velocidade angular da canela foram selecionados como os parâmetros de monitorização da marcha. Um protocolo experimental concebido para provocar perturbações de slip a sujeitos humanos permitiu a recolha de dados destas variáveis para posteriormente validar o algoritmo de deteção de perturbações. Algoritmos CPG foram capazes de produzir aproximações aceitáveis dos sinais de marcha em estado estacionário do ângulo do joelho e da velocidade angular da canela com sucesso. Além disso, o algoritmo de threshold adaptativo detetou LOBs induzidas por slips eficientemente. A melhor performance global foi obtida usando este algoritmo para monitorizar o ângulo do joelho, que detetou quase 80% (78.261%) do total de perturbações com um tempo médio de deteção (TMD) de 250 ms. Além disso, uma média de 0.652 falsas perturbações foram detetadas por cada perturbação corretamente identificada. Estes resultados sugerem uma performance aceitável de deteção de perturbações do algoritmo, de acordo com os requisitos especificados para a deteção.Every year, an estimated 684,000 fatal falls and 37.3 million non-fatal falls requiring medical attention are reported, mostly affecting the older population. Thus, it is necessary to effectively screen high fall risk individuals from targeted elderly populations and prepare them to successfully overcome unexpected gait perturbations. A fall prevention strategy capable of effectively and timely detect and counteract the most frequent loss of balance (LOB) events may reduce the fall risk. Since slips were identified as the main contributors to falls, these events should be addressed as a main focus of the strategy. Nonetheless, there is a lack of slip-induced fall prevention strategies. This dissertation aims the design of a slip-related fall prevention strategy based on the conception of an actuation and a detection stage. The actuation strategy was delineated based on the human biomechanical reactions to slips, where the perturbed (leading) leg’s knee joint presents a prominent role to counteract slip-induced LOBs. Thereby, upon the detection of a slip, this strategy highlighted a knee orthotic device that provides an assistive torque to prevent the falls. The detection strategy considered the attractive properties of biological-inspired Central Pattern Generator (CPG) controllers to predict gait parameters. Threshold-based algorithms monitored the CPG’s prediction error produced, which increases upon an unexpected gait perturbation, to perform slip detection. The knee angle and shank angular velocity were selected as the monitoring gait parameters. An experimental protocol designed to provoke slip perturbations to human subjects allowed to collect data from these variables to further validate the perturbation detection algorithm. CPG algorithms were able to successfully produce acceptable estimations of the knee angle and shank angular velocity signals during steady-state walking. Furthermore, an adaptive threshold algorithm effectively detected slip-induced LOBs. The best overall performance was obtained using this algorithm to monitor the knee angle from the perturbed leg, which detected almost 80% (78.261%) of the total perturbations with a mean detection time (MDT) of 250 ms. In addition, a mean of 0.652 false perturbations were detected for each correct perturbation identified. These results suggest an acceptable perturbation detection performance of the algorithm implemented in light of the detection requirements specified

Research & Innovation for 2009-2010

The 2009-2010 issue of Research & Innovation, a periodical focused on research at the University of Rhode Island