Feedback Control of an Exoskeleton for Paraplegics: Toward Robustly Stable Hands-free Dynamic Walking

This manuscript presents control of a high-DOF fully actuated lower-limb exoskeleton for paraplegic individuals. The key novelty is the ability for the user to walk without the use of crutches or other external means of stabilization. We harness the power of modern optimization techniques and supervised machine learning to develop a smooth feedback control policy that provides robust velocity regulation and perturbation rejection. Preliminary evaluation of the stability and robustness of the proposed approach is demonstrated through the Gazebo simulation environment. In addition, preliminary experimental results with (complete) paraplegic individuals are included for the previous version of the controller.Comment: Submitted to IEEE Control System Magazine. This version addresses reviewers' concerns about the robustness of the algorithm and the motivation for using such exoskeleton

Comfort-Centered Design of a Lightweight and Backdrivable Knee Exoskeleton

This paper presents design principles for comfort-centered wearable robots and their application in a lightweight and backdrivable knee exoskeleton. The mitigation of discomfort is treated as mechanical design and control issues and three solutions are proposed in this paper: 1) a new wearable structure optimizes the strap attachment configuration and suit layout to ameliorate excessive shear forces of conventional wearable structure design; 2) rolling knee joint and double-hinge mechanisms reduce the misalignment in the sagittal and frontal plane, without increasing the mechanical complexity and inertia, respectively; 3) a low impedance mechanical transmission reduces the reflected inertia and damping of the actuator to human, thus the exoskeleton is highly-backdrivable. Kinematic simulations demonstrate that misalignment between the robot joint and knee joint can be reduced by 74% at maximum knee flexion. In experiments, the exoskeleton in the unpowered mode exhibits 1.03 Nm root mean square (RMS) low resistive torque. The torque control experiments demonstrate 0.31 Nm RMS torque tracking error in three human subjects.Comment: 8 pages, 16figures, Journa

Switching Adaptive Concurrent Learning Control for Powered Rehabilitation Machines with FES

Interfacing robotic devices with humans presents significant control challenges, as the control algorithms governing these machines must accommodate for the inherent variability among individuals. This requirement necessitates the system’s ability to adapt to changes in the environment, particularly in the context of human-in-the-loop applications, wherein the system must identify specific features of the human interacting with the machine. In the field of rehabilitation, one promising approach for exercise-based rehabilitation involves the integration of hybrid rehabilitation machines, combining robotic devices such as motorized bikes and exoskeletons with functional electrical stimulation (FES) applied on lower-limb muscles. This integrated approach offers the potential for repetitive training, reduced therapist workload, improved range of motion, and therapeutic benefits. However, conducting prolonged rehabilitation sessions to maximize functional recovery using these hybrid machines imposes several difficulties. Firstly, the design and analysis of adaptive controllers are motivated, but challenges exist in coping with the inherent switching effects associated with hybrid machines. Notably, the transitions between gait phases and the dynamic switching of inputs between active lower-limb muscles and electric motors and their incorporation in the control design remain an open problem for the research community. Secondly, the system must effectively compensate for the influence of human input, which can be viewed as an external disturbance in the closed-loop system during rehabilitation. Robust methods for understanding and adapting to the variations in human input are critical for ensuring stability and accurate control of the human-robot closed-loop system. Lastly, FES-induced muscle fatigue diminishes the human torque contribution to the rehabilitation task, leading to input saturation and potential instabilities as the duration of the exercise extends. Overcoming this challenge requires the development of control algorithms that can adapt to variations in human performance by dynamically adjusting the control parameters accordingly. Consequently, the development of rehabilitative devices that effectively interface with humans requires the design and implementation of control algorithms capable of adapting to users with varying muscle and kinematic characteristics. In this regard, adaptive-based control methods provide tools for addressing the uncertainties in human-robot dynamics within exercise-based rehabilitation using FES, while ensuring stability and robustness in the human-robot closed-loop system. This dissertation develops adaptive controllers to enhance the effectiveness of exercise-based rehabilitation using FES. The objectives include the design and evaluation of adaptive control algorithms that effectively handle the switching effects inherent in hybrid machines, adapt to compensate for human input, and account for input saturation due to muscle fatigue. The control designs leverage kinematic and torque feedback and ensure the stability of the human-robot closed-loop system. These controllers have the potential to significantly enhance the practicality and effectiveness of assistive technologies in both clinical and community settings. In Chapter 1, the motivation to design switching adaptive closed-loop controllers for motorized FES-cycling and powered exoskeletons is described. A survey of closed-loop kinematic control methods related to the tracking objectives in the subsequent chapters of the dissertation is also introduced. In Chapter 2, the dynamic models for cycling and bipedal walking are described: (i) a stationary FES-cycling model with nonlinear dynamics and switched control inputs are introduced based on published literature. The muscle stimulation pattern is defined based on the kinematic effectiveness of the rider, which depends on the crank angle. (ii) A phase-dependent bipedal walking system model with switched dynamics is introduced to control a 4-degrees-of-freedom (DoF) lower-limb exoskeleton assuming single stance support. Moreover, the experimental setup of the cycle-rider and lower-limb exoskeleton system are described. Chapter 3 presents a switched concurrent learning adaptive controller for cadence tracking using the cycle-rider model. The control design is decoupled for the muscles and electric motor. An FES controller is developed with minimal parameters, capable of generating bounded muscle responses with an adjustable saturation limit. The electric motor controller employs an adaptive-based method that estimates uncertain parameters in the cycle-rider system and leverages the muscle input as a feedforward term to improve the tracking of crank trajectories. The adaptive motor controller and saturated muscle controller are implemented in able-bodied individuals and people with movement disorders. Three cycling trials were conducted to demonstrate the feasibility of tracking different crank trajectories with the same set of control parameters across all participants. The developed adaptive controller requires minimal tuning and handles rider uncertainty while ensuring predictable and satisfactory performance. This result has the potential to facilitate the widespread implementation of adaptive closed-loop controllers for FES-cycling systems in real clinical and home-based scenarios. Chapter 4 presents an integral torque tracking controller with anti-windup compensation, which achieves the dual objectives of kinematic and torque tracking (i.e., power tracking) for FES cycling. Designing an integral torque tracking controller to avoid feedback of high-order derivatives poses a significant challenge, as the integration action in the muscle loop can induce error buildup; demanding high FES input on the muscle. This can cause discomfort and accelerate muscle fatigue, thereby limiting the practical utility of the power tracking controller. To address this issue, this chapter builds upon the adaptive control for cadence tracking developed in Chapter 3 and integrates a novel torque tracking controller that allows for input saturation in the FES controller. By doing so, the controller achieves cadence and torque tracking while preventing error buildup. The analysis rigorously considers the saturation effect, and preliminary experimental results in able-bodied individuals demonstrate its feasibility. In Chapter 5, a switched concurrent learning adaptive controller is developed to achieve kinematic tracking throughout the step cycle for treadmill-based walking with a 4-DoF lower-limb hybrid exoskeleton. The developed controller leverages a phase-dependent human-exoskeleton model presented in Chapter 2. A multiple-Lyapunov stability analysis with a dwell time condition is developed to ensure exponential kinematic tracking and parameter estimation. The controller is tested in two able-bodied individuals for a six-minute walking trial and the performance of the controller is compared with a gradient descent classical adaptive controller. Chapter 6 highlights the contributions of the developed control methods and provides recommendations for future research directions

Towards a human-in-the-loop control for a smart orthotic system

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Eletrónica Médica)Stroke is the main cause of paralysis. This pathology has provoked a considerable increase of persons with motor impairments. With a therapy focused on each clinical case, the total or partial recovery can be achieved. Powered orthoses have been developed to promote an effective recover, based on repetitive gait training and user’s active participation. Many control approaches have been developed to control these devices, but none of them promotes an user-oriented strategy focused to the user’s needs. In an attempt of solving this issue, a new approach named Human-in-the-loop is emerging. This strategy allows the adaptation of some assistive parameters based on the user’s energetic cost, promoting a therapy tailored to each end-user needs. However, to estimate the energy expenditure, the use of non-ergonomic sensors, not suitable for clinical context, is required. Thus, it is necessary to find new ways of estimating energy expenditure using wearable and comfortable sensors. In this dissertation, the first steps to introduce the Human-in-the-loop strategy into a powered orthosis are presented. For this purpose, two strategies were developed: a strategy that allows the angular trajectory adaptation in real-time and other that promotes a stiffness adaptation all over the gait cycle. Both strategies were validated with healthy subjects. In the first strategy, the orthosis was able to modify its assistance in a fraction of microseconds, and the end-users were able to follow her with a median error below 10%. Regarding the second strategy, the results show that the orthosis allowed an effective change in the systems’ interaction stiffness, promoting an active participation of each user during its assistance. The energetic impact of using the robotic assistive device is also presented. As it promotes an energy expenditure augmentation in more than 30% in comparison to walk without the device, the necessity of implementing the Human-in-the-loop strategy was highlighted. In an attempt of finding an ergonomic technique to estimate the energetic cost, the use of machine learning algorithms was tested. The results, obtained with a MLP and a LSTM, prove that it is possible to estimate the energy expenditure with a mean error close to 11%. Future work consists in the implementation of the model in real-time and the collection of more data with the aforementioned control approaches, in a way of constructing a more robust model.O AVC é uma das maiores causas de paralisia. Esta patologia, cada vez mais com maior incidência nos jovens, tem provocado um aumento considerável de pessoas com problemas de mobilidade. Com uma terapia focada a cada caso clínico, a recuperação total ou parcial pode ser conseguida. As ortóteses ativas têm vindo a ser desenvolvidas com o propósito de promover uma recuperação eficaz, baseada em treinos repetitivos e numa participação ativa dos utilizadores. Várias abordagens de controlo têm vindo a ser desenvolvidas para controlar estes dispositivos, mas nenhuma delas promove uma estratégia orientada às necessidades do utilizador. Na tentativa de solucionar este problema, uma nova abordagem, designada por Human-in-the-loop está a emergir. Baseada no custo energético, esta estratégia permite adaptar parâmetros da assistência, promovendo uma terapia focada e direcionada a cada utilizador. No entanto, para estimar o custo energético, recorre-se ao uso de sensores que não são adequados para contexto clínico. Assim, torna-se necessário estudar novas formas de estimar o custo energético. Nesta dissertação são apresentados os primeiros passos para introduzir o controlo Human-in-the-loop numa ortótese ativa. Para isso, duas estratégias foram apresentadas: uma estratégia que permite adaptar a trajetória angular da ortótese, em tempo real, e outra que promove a adaptação da complacência do sistema ao longo do ciclo da marcha. Ambas foram validadas com sujeitos saudáveis. Relativamente à primeira abordagem, a ortótese foi capaz de modificar a sua assistência em microssegundos, e os utilizadores foram capazes de a seguir com um erro mediano inferior a 10%. No que diz respeito à segunda abordagem, os resultados mostram que a ortótese promoveu uma alteração eficaz da complacência de interação, promovendo uma participação ativa do utilizador durante a sua assistência. O impacto energético do uso do sistema robótico é, também, apresentado. Promovendo um aumento do custo energético em mais de 30%, a necessidade da estratégia Human-in-the-loop foi realçada. Na tentativa de encontrar uma técnica para estimar o custo energético, recorreu-se ao uso de machine learning. Os resultados, obtidos com uma MLP e uma LSTM, provam que é possível estimar o custo energético com um erro médio próximo dos 11%. Trabalho futuro passa pela implementação do modelo em tempo real e a recolha de mais dados com as abordagens de controlo apresentadas, de forma a construir um modelo mais robusto

Evaluation of Optimal Control Approaches for Predicting Active Knee-Ankle-Foot-Orthosis Motion for Individuals With Spinal Cord Injury

Gait restoration of individuals with spinal cord injury can be partially achieved using active orthoses or exoskeletons. To improve the walking ability of each patient as much as possible, it is important to personalize the parameters that define the device actuation. This study investigates whether using an optimal control-based predictive simulation approach to personalize pre-defined knee trajectory parameters for an active knee-ankle-foot orthosis (KAFO) used by spinal cord injured (SCI) subjects could potentially be an alternative to the current trial-and-error approach. We aimed to find the knee angle trajectory that produced an improved orthosis-assisted gait pattern compared to the one with passive support (locked knee). We collected experimental data from a healthy subject assisted by crutches and KAFOs (with locked knee and with knee flexion assistance) and from an SCI subject assisted by crutches and KAFOs (with locked knee). First, we compared different cost functions and chose the one that produced results closest to experimental locked knee walking for the healthy subject (angular coordinates mean RMSE was 5.74°). For this subject, we predicted crutch-orthosis-assisted walking imposing a pre-defined knee angle trajectory for different maximum knee flexion parameter values, and results were evaluated against experimental data using that same pre-defined knee flexion trajectories in the real device. Finally, using the selected cost function, gait cycles for different knee flexion assistance were predicted for an SCI subject. We evaluated changes in four clinically relevant parameters: foot clearance, stride length, cadence, and hip flexion ROM. Simulations for different values of maximum knee flexion showed variations of these parameters that were consistent with experimental data for the healthy subject (e.g., foot clearance increased/decreased similarly in experimental and predicted motions) and were reasonable for the SCI subject (e.g., maximum parameter values were found for moderate knee flexion). Although more research is needed before this method can be applied to choose optimal active orthosis controller parameters for specific subjects, these findings suggest that optimal control prediction of crutch-orthosis-assisted walking using biomechanical models might be used in place of the trial-and-error method to select the best maximum knee flexion angle during gait for a specific SCI subject.Peer ReviewedPostprint (published version