Master of Science

thesisParkinson Disease (PD) is a progressive and chronic movement disorder that affects an individual's ability to walk and move naturally. Research shows that training using virtual reality can offer improvements over traditional therapy and decrease the effects of some PD symptoms. In an effort to address the need for such therapeutic intervention, a Virtual Reality (VR) rehabilitation simulator was developed using 3D graphical displays in concert with haptic Smart Shoes. The system creates challenging virtual terrain to safely train participants in situations that demand greater balance and neuromuscular control. As part of this effort, an Ankle Foot Simulator (AFS) was created to mimic human gait, including ankle and foot response to a variety of terrain features. This thesis describes the development and testing of a novel AFS robot designed to mimic human gait and evaluate Smart Shoe behavior and response to perturbations. The major design requirement for the AFS robot is to reproduce natural gait dynamics by: 1) matching complex trajectories of the ankle, 2) generating Ground Reaction Forces (GRF) during normal walking gait, and 3) mimicking foot/ankle dynamics such as ankle roll over. This thesis focuses on the design and control of the AFS to achieve sufficient Range of Motion (ROM) to mimic human gait, including extreme ankle rollover, while providing appropriately fast dynamics, sufficient load capacity, and high repeatability. Design aspects of the AFS include 1) forward and inverse kinematic derivations of the ankle mechanism, 2) derivations of feedforward components of the control algorithms, and 3) mapping ankle mechanism actuator forces to ankle moments. The AFS robot tracks ankle position and orientation data to within 5.5 mm and 5.5 degrees. The AFS is also able to reproduce GRFs, including dorsal/plantar flexion and inversion/eversion ankle moments with an r2 value of 0.82 or more. The AFS also demonstrates passive ankle stiffness. To improve performance of the AFS, an iterative learning controller is suggested for future work

Switching Adaptive Concurrent Learning Control for Powered Rehabilitation Machines with FES

Interfacing robotic devices with humans presents significant control challenges, as the control algorithms governing these machines must accommodate for the inherent variability among individuals. This requirement necessitates the system’s ability to adapt to changes in the environment, particularly in the context of human-in-the-loop applications, wherein the system must identify specific features of the human interacting with the machine. In the field of rehabilitation, one promising approach for exercise-based rehabilitation involves the integration of hybrid rehabilitation machines, combining robotic devices such as motorized bikes and exoskeletons with functional electrical stimulation (FES) applied on lower-limb muscles. This integrated approach offers the potential for repetitive training, reduced therapist workload, improved range of motion, and therapeutic benefits. However, conducting prolonged rehabilitation sessions to maximize functional recovery using these hybrid machines imposes several difficulties. Firstly, the design and analysis of adaptive controllers are motivated, but challenges exist in coping with the inherent switching effects associated with hybrid machines. Notably, the transitions between gait phases and the dynamic switching of inputs between active lower-limb muscles and electric motors and their incorporation in the control design remain an open problem for the research community. Secondly, the system must effectively compensate for the influence of human input, which can be viewed as an external disturbance in the closed-loop system during rehabilitation. Robust methods for understanding and adapting to the variations in human input are critical for ensuring stability and accurate control of the human-robot closed-loop system. Lastly, FES-induced muscle fatigue diminishes the human torque contribution to the rehabilitation task, leading to input saturation and potential instabilities as the duration of the exercise extends. Overcoming this challenge requires the development of control algorithms that can adapt to variations in human performance by dynamically adjusting the control parameters accordingly. Consequently, the development of rehabilitative devices that effectively interface with humans requires the design and implementation of control algorithms capable of adapting to users with varying muscle and kinematic characteristics. In this regard, adaptive-based control methods provide tools for addressing the uncertainties in human-robot dynamics within exercise-based rehabilitation using FES, while ensuring stability and robustness in the human-robot closed-loop system. This dissertation develops adaptive controllers to enhance the effectiveness of exercise-based rehabilitation using FES. The objectives include the design and evaluation of adaptive control algorithms that effectively handle the switching effects inherent in hybrid machines, adapt to compensate for human input, and account for input saturation due to muscle fatigue. The control designs leverage kinematic and torque feedback and ensure the stability of the human-robot closed-loop system. These controllers have the potential to significantly enhance the practicality and effectiveness of assistive technologies in both clinical and community settings. In Chapter 1, the motivation to design switching adaptive closed-loop controllers for motorized FES-cycling and powered exoskeletons is described. A survey of closed-loop kinematic control methods related to the tracking objectives in the subsequent chapters of the dissertation is also introduced. In Chapter 2, the dynamic models for cycling and bipedal walking are described: (i) a stationary FES-cycling model with nonlinear dynamics and switched control inputs are introduced based on published literature. The muscle stimulation pattern is defined based on the kinematic effectiveness of the rider, which depends on the crank angle. (ii) A phase-dependent bipedal walking system model with switched dynamics is introduced to control a 4-degrees-of-freedom (DoF) lower-limb exoskeleton assuming single stance support. Moreover, the experimental setup of the cycle-rider and lower-limb exoskeleton system are described. Chapter 3 presents a switched concurrent learning adaptive controller for cadence tracking using the cycle-rider model. The control design is decoupled for the muscles and electric motor. An FES controller is developed with minimal parameters, capable of generating bounded muscle responses with an adjustable saturation limit. The electric motor controller employs an adaptive-based method that estimates uncertain parameters in the cycle-rider system and leverages the muscle input as a feedforward term to improve the tracking of crank trajectories. The adaptive motor controller and saturated muscle controller are implemented in able-bodied individuals and people with movement disorders. Three cycling trials were conducted to demonstrate the feasibility of tracking different crank trajectories with the same set of control parameters across all participants. The developed adaptive controller requires minimal tuning and handles rider uncertainty while ensuring predictable and satisfactory performance. This result has the potential to facilitate the widespread implementation of adaptive closed-loop controllers for FES-cycling systems in real clinical and home-based scenarios. Chapter 4 presents an integral torque tracking controller with anti-windup compensation, which achieves the dual objectives of kinematic and torque tracking (i.e., power tracking) for FES cycling. Designing an integral torque tracking controller to avoid feedback of high-order derivatives poses a significant challenge, as the integration action in the muscle loop can induce error buildup; demanding high FES input on the muscle. This can cause discomfort and accelerate muscle fatigue, thereby limiting the practical utility of the power tracking controller. To address this issue, this chapter builds upon the adaptive control for cadence tracking developed in Chapter 3 and integrates a novel torque tracking controller that allows for input saturation in the FES controller. By doing so, the controller achieves cadence and torque tracking while preventing error buildup. The analysis rigorously considers the saturation effect, and preliminary experimental results in able-bodied individuals demonstrate its feasibility. In Chapter 5, a switched concurrent learning adaptive controller is developed to achieve kinematic tracking throughout the step cycle for treadmill-based walking with a 4-DoF lower-limb hybrid exoskeleton. The developed controller leverages a phase-dependent human-exoskeleton model presented in Chapter 2. A multiple-Lyapunov stability analysis with a dwell time condition is developed to ensure exponential kinematic tracking and parameter estimation. The controller is tested in two able-bodied individuals for a six-minute walking trial and the performance of the controller is compared with a gradient descent classical adaptive controller. Chapter 6 highlights the contributions of the developed control methods and provides recommendations for future research directions

Evolvability signatures of generative encodings: beyond standard performance benchmarks

Evolutionary robotics is a promising approach to autonomously synthesize machines with abilities that resemble those of animals, but the field suffers from a lack of strong foundations. In particular, evolutionary systems are currently assessed solely by the fitness score their evolved artifacts can achieve for a specific task, whereas such fitness-based comparisons provide limited insights about how the same system would evaluate on different tasks, and its adaptive capabilities to respond to changes in fitness (e.g., from damages to the machine, or in new situations). To counter these limitations, we introduce the concept of "evolvability signatures", which picture the post-mutation statistical distribution of both behavior diversity (how different are the robot behaviors after a mutation?) and fitness values (how different is the fitness after a mutation?). We tested the relevance of this concept by evolving controllers for hexapod robot locomotion using five different genotype-to-phenotype mappings (direct encoding, generative encoding of open-loop and closed-loop central pattern generators, generative encoding of neural networks, and single-unit pattern generators (SUPG)). We observed a predictive relationship between the evolvability signature of each encoding and the number of generations required by hexapods to adapt from incurred damages. Our study also reveals that, across the five investigated encodings, the SUPG scheme achieved the best evolvability signature, and was always foremost in recovering an effective gait following robot damages. Overall, our evolvability signatures neatly complement existing task-performance benchmarks, and pave the way for stronger foundations for research in evolutionary robotics.Comment: 24 pages with 12 figures in the main text, and 4 supplementary figures. Accepted at Information Sciences journal (in press). Supplemental videos are available online at, see http://goo.gl/uyY1R

Biologically-plausible six-legged running : control and simulation

Thesis (M.Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2003.Includes bibliographical references (p. 63-66).This thesis presents a controller which produces a stable, dynamic 1.4 meter per second run in a simulated twelve degree of freedom six-legged robot. The algorithm is relatively simple; it consists of only a few hand-tuned feedback loops and is defined by a total of 13 parameters. The control utilizes no vestibular-type inputs to actively control orientation. Evidence from perturbation, robustness, motion analysis, and parameter sensitivity tests indicate a high degree of stability in the simulated gait. The control approach generates a run with an aerial phase, utilizes force information to signal aerial phase leg retraction, has a forward running velocity determined by a single parameter, and couples stance and swing legs using angular momentum information. Both the hypotheses behind the control and the resulting gait are argued to be plausible models of biological locomotion.by Matthew David Malchano.M.Eng

Hierarchical Control for Bipedal Locomotion using Central Pattern Generators and Neural Networks

The complexity of bipedal locomotion may be attributed to the difficulty in synchronizing joint movements while at the same time achieving high-level objectives such as walking in a particular direction. Artificial central pattern generators (CPGs) can produce synchronized joint movements and have been used in the past for bipedal locomotion. However, most existing CPG-based approaches do not address the problem of high-level control explicitly. We propose a novel hierarchical control mechanism for bipedal locomotion where an optimized CPG network is used for joint control and a neural network acts as a high-level controller for modulating the CPG network. By separating motion generation from motion modulation, the high-level controller does not need to control individual joints directly but instead can develop to achieve a higher goal using a low-dimensional control signal. The feasibility of the hierarchical controller is demonstrated through simulation experiments using the Neuro-Inspired Companion (NICO) robot. Experimental results demonstrate the controller's ability to function even without the availability of an exact robot model.Comment: In: Proceedings of the Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob), Oslo, Norway, Aug. 19-22, 201

Locomoção bípede adaptativa a partir de uma única demonstração usando primitivas de movimento

Doutoramento em Engenharia EletrotécnicaEste trabalho aborda o problema de capacidade de imitação da locomoção humana através da utilização de trajetórias de baixo nível codificadas com primitivas de movimento e utilizá-las para depois generalizar para novas situações, partindo apenas de uma demonstração única. Assim, nesta linha de pensamento, os principais objetivos deste trabalho são dois: o primeiro é analisar, extrair e codificar demonstrações efetuadas por um humano, obtidas por um sistema de captura de movimento de forma a modelar tarefas de locomoção bípede. Contudo, esta transferência não está limitada à simples reprodução desses movimentos, requerendo uma evolução das capacidades para adaptação a novas situações, assim como lidar com perturbações inesperadas. Assim, o segundo objetivo é o desenvolvimento e avaliação de uma estrutura de controlo com capacidade de modelação das ações, de tal forma que a demonstração única apreendida possa ser modificada para o robô se adaptar a diversas situações, tendo em conta a sua dinâmica e o ambiente onde está inserido. A ideia por detrás desta abordagem é resolver o problema da generalização a partir de uma demonstração única, combinando para isso duas estruturas básicas. A primeira consiste num sistema gerador de padrões baseado em primitivas de movimento utilizando sistemas dinâmicos (DS). Esta abordagem de codificação de movimentos possui propriedades desejáveis que a torna ideal para geração de trajetórias, tais como a possibilidade de modificar determinados parâmetros em tempo real, tais como a amplitude ou a frequência do ciclo do movimento e robustez a pequenas perturbações. A segunda estrutura, que está embebida na anterior, é composta por um conjunto de osciladores acoplados em fase que organizam as ações de unidades funcionais de forma coordenada. Mudanças em determinadas condições, como o instante de contacto ou impactos com o solo, levam a modelos com múltiplas fases. Assim, em vez de forçar o movimento do robô a situações pré-determinadas de forma temporal, o gerador de padrões de movimento proposto explora a transição entre diferentes fases que surgem da interação do robô com o ambiente, despoletadas por eventos sensoriais. A abordagem proposta é testada numa estrutura de simulação dinâmica, sendo que várias experiências são efetuadas para avaliar os métodos e o desempenho dos mesmos.This work addresses the problem of learning to imitate human locomotion actions through low-level trajectories encoded with motion primitives and generalizing them to new situations from a single demonstration. In this line of thought, the main objectives of this work are twofold: The first is to analyze, extract and encode human demonstrations taken from motion capture data in order to model biped locomotion tasks. However, transferring motion skills from humans to robots is not limited to the simple reproduction, but requires the evaluation of their ability to adapt to new situations, as well as to deal with unexpected disturbances. Therefore, the second objective is to develop and evaluate a control framework for action shaping such that the single-demonstration can be modulated to varying situations, taking into account the dynamics of the robot and its environment. The idea behind the approach is to address the problem of generalization from a single-demonstration by combining two basic structures. The first structure is a pattern generator system consisting of movement primitives learned and modelled by dynamical systems (DS). This encoding approach possesses desirable properties that make them well-suited for trajectory generation, namely the possibility to change parameters online such as the amplitude and the frequency of the limit cycle and the intrinsic robustness against small perturbations. The second structure, which is embedded in the previous one, consists of coupled phase oscillators that organize actions into functional coordinated units. The changing contact conditions plus the associated impacts with the ground lead to models with multiple phases. Instead of forcing the robot’s motion into a predefined fixed timing, the proposed pattern generator explores transition between phases that emerge from the interaction of the robot system with the environment, triggered by sensor-driven events. The proposed approach is tested in a dynamics simulation framework and several experiments are conducted to validate the methods and to assess the performance of a humanoid robot