Feedback Control of an Exoskeleton for Paraplegics: Toward Robustly Stable Hands-free Dynamic Walking

This manuscript presents control of a high-DOF fully actuated lower-limb exoskeleton for paraplegic individuals. The key novelty is the ability for the user to walk without the use of crutches or other external means of stabilization. We harness the power of modern optimization techniques and supervised machine learning to develop a smooth feedback control policy that provides robust velocity regulation and perturbation rejection. Preliminary evaluation of the stability and robustness of the proposed approach is demonstrated through the Gazebo simulation environment. In addition, preliminary experimental results with (complete) paraplegic individuals are included for the previous version of the controller.Comment: Submitted to IEEE Control System Magazine. This version addresses reviewers' concerns about the robustness of the algorithm and the motivation for using such exoskeleton

Mechanisms of energy optimization in human walking

Humans can learn to move optimally. For many movements, we have a control strategy—or control policy—that optimizes some objective. In walking, we prefer the combination of step widths, step lengths, and speeds that optimizes the amount of energy we need. In familiar contexts, we have had many opportunities to establish this optimal control policy. But in new contexts, the nervous system must quickly learn new control policies in order to continue to move optimally. Our lab has recently demonstrated that humans can continuously optimize energetic cost during walking. This is an impressive feat given that the nervous system has tens of thousands of motor units at its disposal, and it can coordinate these motor units over millisecond timescales, which results in countless combinations of motor unit coordination. The goal of this thesis is to determine how the nervous system navigates this combinatorial problem to learn new energy optimal control policies in new walking contexts. I used three distinct studies to accomplish this goal. For the first two studies, I designed and implemented a simple mechatronic system that applies energetic penalties in the form of walking incline as a function of gait. This creates a new relationship between gait and energetic cost—or new cost landscape—that shifts the energy optimal gait. For the third study, I used exoskeletons that apply assistive torques to each ankle at each walking step to shift the energy optimal gait. The first study tested whether previous findings that people can learn to adapt their control policy when the energy optimum is shifted along step frequency generalize to a different gait parameter and to a different experimental setup. I found that, like step frequency, people can learn to adapt their control policy when the energy optimum is shifted along step width. The second study tested if and how energy optimization extends to multiple gait parameters at the same time. I found that, when the energy optimum is shifted along step width and step frequency, people are limited in their ability to optimize both gait parameters. The third study asked how people learn in which ways to optimize their policy. I found that general variability leads to specific adaptation toward optimal policies. Taken together, these findings provide insight into the mechanisms that underlie energy optimization in walking, as well as the limitations of this optimization

Design And Development of A Powered Pediatric Lower-limb Orthosis

Gait impairments from disorders such as cerebral palsy are important to address early in life. A powered lower-limb orthosis can offer therapists a rehabilitation option using robot-assisted gait training. Although there are many devices already available for the adult population, there are few powered orthoses for the pediatric population. The aim of this dissertation is to embark on the first stages of development of a powered lower-limb orthosis for gait rehabilitation and assistance of children ages 6 to 11 years with walking impairments from cerebral palsy. This dissertation presents the design requirements of the orthosis, the design and fabrication of the joint actuators, and the design and manufacturing of a provisional version of the pediatric orthosis. Preliminary results demonstrate the capabilities of the joint actuators, confirm gait tracking capabilities of the actuators in the provisional orthosis, and evaluate a standing balance control strategy on the under-actuated provisional orthosis in simulation and experiment. In addition, this dissertation presents the design methodology for an anthropometrically parametrized orthosis, the fabrication of the prototype powered orthosis using this design methodology, and experimental application of orthosis hardware in providing walking assistance with a healthy adult. The presented results suggest the developed orthosis hardware is satisfactorily capable of operation and functional with a human subject. The first stages of development in this dissertation show encouraging results and will act as a foundation for further iv development of the device for rehabilitation and assistance of children with walking impairments

General Variability Leads to Specific Adaptation Toward Energy Optimal Policies

Our nervous systems can learn optimal control policies in response to changes to our bodies, tasks, and movement contexts. For example, humans can learn to adapt their control policy in walking contexts where the energy-optimal policy is shifted along variables such as step frequency or step width. However, it is unclear how the nervous system determines which ways to adapt its control policy. Here, we asked how human participants explore through variations in their control policy to identify more optimal policies in new contexts. We created new contexts using exoskeletons that apply assistive torques to each ankle at each walking step. We analyzed four variables that spanned the levels of the whole movement, the joint, and the muscle: step frequency, ankle angle range, total soleus activity, and total medial gastrocnemius activity. We found that, across all of these analyzed variables, variability increased upon initial exposure to new contexts and then decreased with experience. This led to adaptive changes in the magnitude of specific variables, and these changes were correlated with reduced energetic cost. The timescales by which adaptive changes progressed and variability decreased were faster for some variables than others, suggesting a reduced search space within which the nervous system continues to optimize its policy. These collective findings support the principle that exploration through general variability leads to specific adaptation toward optimal movement policies

PREDICTIVE SIMULATION OF HUMAN MOVEMENT AND APPLICATIONS TO ASSISTIVE DEVICE DESIGN AND CONTROL

Predictive simulation based on dynamic optimization using musculoskeletal models is a powerful approach for studying biomechanics of human gait. Predictive simulation can be used for a variety of applications from designing assistive devices to testing theories of motor controls. However, one of the challenges in formulating the predictive dynamic optimization problem is that the cost function, which represents the underlying goal of the walking task (e.g., minimal energy consumption) is generally unknown and is assumed a priori. While different studies used different cost functions, the qualities of the gaits with those cost functions were often not provided. Therefore, this dissertation evaluates and examines different cost function forms for dynamic simulation of human walking. The problem of the walking cost function determination was cast as a bilevel optimization, which was solved using a nested evolutionary approach. The results showed cost functions based on a weighted combination of muscle-based performance criteria (e.g., metabolic cost, muscle fatigue), gait smoothness, and gait stability led to better walking solutions compared to any cost functions only based on muscle performance criteria. Further evaluations of the walking cost functions were done in the simulation cases of human walking augmented with assistive devices such as prosthesis and exoskeleton. The simulations of augmented walking were comparable to the experimental results, which suggests the potential of using the simulation approach to address problems of finding assistive device design and control

Otimização muscle-in-the-loop em tempo real para reabilitação física com um exosqueleto ativo: uma mudança de paradigma

Assisting human locomotion with a wearable robotic orthosis is still quite challenging, largely due to the complexity of the neuromusculoskeletal system, the time-varying dynamics that accompany motor adaptation, and the uniqueness of every individual’s response to the assistance given by the robot. To this day, these devices have not met their well-known promise yet, mostly due to the fact that they are not perfectly suitable for the rehabilitation of neuropathologic patients. One of the main challenges hampering this goal still relies on the interface and co-dependency between the human and the machine. Nowadays, most commercial exoskeletons replay pre-defined gait patterns, whereas research exoskeletons are switching to controllers based on optimized torque profiles. In most cases, the dynamics of the human musculoskeletal system are still ignored and do not take into account the optimal conditions for inducing a positive modulation of neuromuscular activity. This is because both rehabilitation strategies are still emphasized on the macro level of the whole joint instead of focusing on the muscles’ dynamics and activity, which are the actual anatomical elements that may need to be rehabilitated. Strategies to keep the human in the loop of the exoskeleton’s control laws in real-time may help to overcome these challenges. The main purpose of the present dissertation is to make a paradigm shift in the approach on how the assistance that is given to a subject by an exoskeleton is modelled and controlled during physical rehabilitation. Therefore, in the scope of the present work, it was intended to design, concede, implement, and validate a real-time muscle-in-the-loop optimization model to find the best assistive support ratio that would induce optimal rehabilitation conditions to a specific group of impaired muscles while having a minimum impact on the other healthy muscles. The developed optimization model was implemented in the form of a plugin and was integrated on a neuromechanical model-based interface for driving a bilateral ankle exoskeleton. Experimental pilot tests evaluated the feasibility and effectiveness of the model. Results of the most significant pilots achieved EMG reductions up to 61 ± 3 % in Soleus and 41 ± 10 % in Gastrocnemius Lateralis. Moreover, results also demonstrated the efficiency of the optimization’s specific reduction on rehabilitation by looking into the muscular fatigue after each experiment. Finally, two parallel preliminary studies emerged from the pilots, which looked at muscle adaptation, after a new assistive condition had been applied, over time and at the effect of the lateral positioning of the exoskeleton’s actuators on the leg muscles.Auxiliar a locomoção humana com uma ortose robótica ainda é bastante desafiante, em grande parte devido à complexidade do sistema neuromusculoesquelético, à dinâmica variável no tempo que acompanha a adaptação motora e à singularidade da resposta de cada indivíduo à assistência dada pelo robô. Até hoje, está por cumprir a promessa inicial destes dispositivos, principalmente devido ao facto de não serem perfeitamente adequados para a reabilitação de pacientes neuropatológicos. Um dos principais desafios que dificultam esse objetivo foca-se ainda na interface e na co-dependência entre o ser humano e a máquina. Hoje em dia, a maioria dos exoesqueletos comerciais reproduz padrões de marcha predefinidos, enquanto que os exoesqueletos em investigação estão só agora a mudar para controladores com base em perfis de binário otimizados. Na maioria dos casos, a dinâmica do sistema musculoesquelético humano ainda é ignorada e não tem em consideração as condições ideais para induzir uma modulação positiva da atividade neuromuscular. Isso ocorre porque ambas as estratégias de reabilitação ainda são enfatizadas no nível macro de toda a articulação, em vez de se concentrar na dinâmica e atividade dos músculos, que são os elementos anatómicos que realmente precisam de ser reabilitados. Estratégias para manter o ser humano em loop nos comandos que controlam o exoesqueleto em tempo real podem ajudar a superar estes desafios. O principal objetivo desta dissertação é fazer uma mudança de paradigma na abordagem em como a assistência que é dada a um sujeito por um exosqueleto é modelada e controlada durante a reabilitação física. Portanto, no contexto do presente trabalho, pretendeu-se projetar, conceder, implementar e validar um modelo de otimização muscle-in-the-loop em tempo real para encontrar a melhor relação de suporte capaz de induzir as condições ideais de reabilitação para um grupo específico de músculos fragilizados, tendo um impacto mínimo nos outros músculos saudáveis. O modelo de otimização desenvolvido foi implementado na forma de um plugin e foi integrado numa interface baseada num modelo neuromecânico para o controlo de um exoesqueleto bilateral de tornozelo. Testes experimentais piloto avaliaram a viabilidade e a eficácia do modelo. Os resultados dos testes mais significativos demonstraram reduções de EMG de até 61 ± 3 % no Soleus e 41 ± 10 % no Gastrocnemius Lateral. Adicionalmente, os resultados demonstraram também a eficiência em reabilitação da redução específica no EMG devido à otimização tendo em conta a fadiga muscular após cada teste. Finalmente, dois estudos preliminares paralelos emergiram dos testes piloto, que analisaram a adaptação muscular após uma nova condição assistiva ter sido definida ao longo do tempo e o efeito do posicionamento lateral dos atuadores do exoesqueleto nos músculos da perna.Mestrado em Engenharia Biomédic

Gait Dynamic Stability Analysis with Wearable Assistive Robots

abstract: Lower-limb wearable assistive robots could alter the users gait kinematics by inputting external power, which can be interpreted as mechanical perturbation to subject normal gait. The change in kinematics may affect the dynamic stability. This work attempts to understand the effects of different physical assistance from these robots on the gait dynamic stability. A knee exoskeleton and ankle assistive device (Robotic Shoe) are developed and used to provide walking assistance. The knee exoskeleton provides personalized knee joint assistive torque during the stance phase. The robotic shoe is a light-weighted mechanism that can store the potential energy at heel strike and release it by using an active locking mechanism at the terminal stance phase to provide push-up ankle torque and assist the toe-off. Lower-limb Kinematic time series data are collected for subjects wearing these devices in the passive and active mode. The changes of kinematics with and without these devices on lower-limb motion are first studied. Orbital stability, as one of the commonly used measure to quantify gait stability through calculating Floquet Multipliers (FM), is employed to asses the effects of these wearable devices on gait stability. It is shown that wearing the passive knee exoskeleton causes less orbitally stable gait for users, while the knee joint active assistance improves the orbital stability compared to passive mode. The robotic shoe only affects the targeted joint (right ankle) kinematics, and wearing the passive mechanism significantly increases the ankle joint FM values, which indicates less walking orbital stability. More analysis is done on a mechanically perturbed walking public data set, to show that orbital stability can quantify the effects of external mechanical perturbation on gait dynamic stability. This method can further be used as a control design tool to ensure gait stability for users of lower-limb assistive devices.Dissertation/ThesisMasters Thesis Mechanical Engineering 201