Biomechatronics: Harmonizing Mechatronic Systems with Human Beings

This eBook provides a comprehensive treatise on modern biomechatronic systems centred around human applications. A particular emphasis is given to exoskeleton designs for assistance and training with advanced interfaces in human-machine interaction. Some of these designs are validated with experimental results which the reader will find very informative as building-blocks for designing such systems. This eBook will be ideally suited to those researching in biomechatronic area with bio-feedback applications or those who are involved in high-end research on manmachine interfaces. This may also serve as a textbook for biomechatronic design at post-graduate level

Assist-as-needed EMG-based control strategy for wearable powered assistive devices

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Eletrónica Médica)Robotic-based gait rehabilitation and assistance using Wearable Powered Assistive Devices (WPADs), such as orthosis and exoskeletons, has been growing in the rehabilitation area to recover and augment the motor function of neurologically impaired subjects. These WPADs should provide a personalized assistance, since physical condition and muscular fatigue modify from patient to patient. In this field, electromyography (EMG) signals have been used to control WPADs given their ability to infer the user’s motion intention. However, in cases of motor disability conditions, EMG signals present lower magnitudes when compared to EMG signals under healthy conditions. Thus, the use of WPADs managed by EMG signals may not have potential to provide the assistance that the patient requires. The main goal of this dissertation aims the development of an Assisted-As-Needed (AAN) EMG-based control strategy for a future insertion in a Smart Active Orthotic System (SmartOs). To achieve this goal, the following elements were developed and validated: (i) an EMG system to acquire muscle activity signals from the most relevant muscles during the motion of the ankle joint; (ii) machine learning-based tool for ankle joint torque estimation to serve as reference in the AAN EMG-based control strategy; and (iii) a tool for real EMG-based torque estimation using Tibialis Anterior (TA) and Gastrocnemius Lateralis (GASL) muscles and real ankle joint angles. EMG system showed satisfactory pattern correlations with a commercial system. The reference ankle joint torque was generated based on predicted reference ankle joint kinematics, walking speed information (from 1 to 4 km/h) and anthropometric data (body height from 1.51 m to 1.83 m and body mass from 52.0 kg to 83.7 kg), using five machine learning algorithms: Support Vector Regression (SVR), Random Forest (RF), Multilayer Perceptron (MLP), Long-Short Term Memory (LSTM) and Convolutional Neural Network (CNN). CNN provided the best performance, predicting the reference ankle joint torque with fitting curves ranging from 74.7 to 89.8 % and Normalized Root Mean Square Errors (NRMSEs) between 3.16 and 8.02 %. EMG-based torque estimation beneficiates of a higher number of muscles, since EMG data from TA and GASL are not enough to estimate the real ankle joint torque.A assistência e reabilitação robótica usando dispositivos de assistência ativos vestíveis (WPADs), como ortóteses e exosqueletos, tem crescido na área da reabilitação com o fim de recuperar e aumentar a função motora de sujeitos com alterações neurológicas. Estes dispositivos devem fornecer uma assistência personalizada, uma vez que a condição física e a fadiga muscular variam de paciente para paciente. Nesta área, sinais de eletromiografia (EMG) têm sido usados para controlar WPADs, dada a sua capacidade de inferir a intenção de movimento do utilizador. Contudo, em casos de deficiência motora, os sinais de EMG apresentam menor amplitude quando comparados com sinais de EMG em condições saudáveis e, portanto, o uso de WPADs geridos por sinais de EMG pode não oferecer a assistência que o paciente necessita. O principal objetivo desta dissertação visa o desenvolvimento de uma estratégia de controlo baseada em EMG capaz de fornecer assistência quando necessário, para futura integração num sistema ortótico ativo e inteligente (SmartOs). Para atingir este objetivo foram desenvolvidos e validados os seguintes elementos: (i) sistema de EMG para adquirir sinais de atividade muscular dos músculos mais relevantes no movimento da articulação do tornozelo; (ii) ferramenta de machine learning para estimação do binário da articulação do tornozelo para servir como referência na estratégia de controlo; e (iii) ferramenta de estimação do binário real do tornozelo considerando sinais de EMG dos músculos Tibialis Anterior (TA) e Gastrocnemius Lateralis (GASL) e ângulo real do tornozelo. O sistema de EMG apresentou correlações satisfatórias com um sistema comercial. O binário de referência para o tornozelo foi gerado com base no ângulo de referência da mesma articulação, velocidade de marcha (de 1 até 4 km/h) e dados antropométricos (alturas de 1.51 m até 1.83 e massas de 52.0 kg até 83.7 kg), usando cinco algoritmos de machine learning: Support Vector Machine, Random Forest, Multilayer Perceptron, Long-Short Term Memory e Convolutional Neural Network. CNN apresentou a melhor performance, prevendo binários de referência do tornozelo com um fit entre 74.7 e 89.8 % e Normalized Root Mean Square Errors (NRMSE) entre 3.16 e 8.02 %. A estimativa do torque com base em sinais de EMG requer a inclusão de um maior número de músculos, uma vez que sinais de EMG dos músculos TA e GASL não foram suficientes

Are Functional Measures Sufficient to Capture Acceptance? A Qualitative Study on Lower Limb Exoskeleton Use for Older People

Lower limb exoskeletons (LLE) are robotic devices developed to assist walk. In the field of healthcare, this technology has been available for almost a decade, yet it still faces important acceptance issues. While LLE were first developed for patients with spinal cord injuries, we expect their use to expand to everyday settings to benefit other populations, namely that of older people with reduced mobility (RM). We propose a qualitative approach to unearth key psychosocial themes on the acceptance of LLE in daily living for older people. The study analyses perceptions of older people with RM, as well as their entourage, including informal and professional caregivers. Using a grounded theory approach we analysed 12 semi-structured interviews with older people with RM; 2 focus groups with informal caregivers, and 2 focus groups with professional caregivers. LLE were introduced to participants through photo-elicitation. Older people with RM believed that LLE would increase their autonomy. They also perceived that using LLE would make them feel less of a burden for their entourage. Beyond these expected benefits, results captured participants' ambivalence, dependent on their experiences of the ageing process and perceptions on the human-machine interaction. Informal caregivers highlighted that LLE could provide important relief related to the burden of care. Nonetheless, professional caregivers raised the fear of LLE leading to dehumanization of care. While each group had specific concerns on how LLE use would impact their lives, psychosocial considerations played a key role in LLE acceptance

An admittance shaping controller for exoskeleton assistance of the lower extremities

We present a method for lower-limb exoskeleton control that defines assistance as a desired dynamic response for the human leg. Wearing the exoskeleton can be seen as replacing the leg's natural admittance with the equivalent admittance of the coupled system. The control goal is to make the leg obey an admittance model defined by target values of natural frequency, peak magnitude and zero-frequency response. No estimation of muscle torques or motion intent is necessary. Instead, the controller scales up the coupled system's sensitivity transfer function by means of a compensator employing positive feedback. This approach increases the leg's mobility and makes the exoskeleton an active device capable of performing net positive work on the limb. Although positive feedback is usually considered destabilizing, here performance and robust stability are successfully achieved through a constrained optimization that maximizes the system's gain margins while ensuring the desired location of its dominant poles

Human Activity Recognition and Control of Wearable Robots

abstract: Wearable robotics has gained huge popularity in recent years due to its wide applications in rehabilitation, military, and industrial fields. The weakness of the skeletal muscles in the aging population and neurological injuries such as stroke and spinal cord injuries seriously limit the abilities of these individuals to perform daily activities. Therefore, there is an increasing attention in the development of wearable robots to assist the elderly and patients with disabilities for motion assistance and rehabilitation. In military and industrial sectors, wearable robots can increase the productivity of workers and soldiers. It is important for the wearable robots to maintain smooth interaction with the user while evolving in complex environments with minimum effort from the user. Therefore, the recognition of the user's activities such as walking or jogging in real time becomes essential to provide appropriate assistance based on the activity. This dissertation proposes two real-time human activity recognition algorithms intelligent fuzzy inference (IFI) algorithm and Amplitude omega ($A \omega$) algorithm to identify the human activities, i.e., stationary and locomotion activities. The IFI algorithm uses knee angle and ground contact forces (GCFs) measurements from four inertial measurement units (IMUs) and a pair of smart shoes. Whereas, the $A \omega$ algorithm is based on thigh angle measurements from a single IMU. This dissertation also attempts to address the problem of online tuning of virtual impedance for an assistive robot based on real-time gait and activity measurement data to personalize the assistance for different users. An automatic impedance tuning (AIT) approach is presented for a knee assistive device (KAD) in which the IFI algorithm is used for real-time activity measurements. This dissertation also proposes an adaptive oscillator method known as amplitude omega adaptive oscillator ($A\omega AO$) method for HeSA (hip exoskeleton for superior augmentation) to provide bilateral hip assistance during human locomotion activities. The $A \omega$ algorithm is integrated into the adaptive oscillator method to make the approach robust for different locomotion activities. Experiments are performed on healthy subjects to validate the efficacy of the human activities recognition algorithms and control strategies proposed in this dissertation. Both the activity recognition algorithms exhibited higher classification accuracy with less update time. The results of AIT demonstrated that the KAD assistive torque was smoother and EMG signal of Vastus Medialis is reduced, compared to constant impedance and finite state machine approaches. The $A\omega AO$ method showed real-time learning of the locomotion activities signals for three healthy subjects while wearing HeSA. To understand the influence of the assistive devices on the inherent dynamic gait stability of the human, stability analysis is performed. For this, the stability metrics derived from dynamical systems theory are used to evaluate unilateral knee assistance applied to the healthy participants.Dissertation/ThesisDoctoral Dissertation Aerospace Engineering 201

Joint Trajectory Generation and High-level Control for Patient-tailored Robotic Gait Rehabilitation

This dissertation presents a group of novel methods for robot-based gait rehabilitation which were developed aiming to offer more individualized therapies based on the specific condition of each patient, as well as to improve the overall rehabilitation experience for both patient and therapist. A novel methodology for gait pattern generation is proposed, which offers estimated hip and knee joint trajectories corresponding to healthy walking, and allows the therapist to graphically adapt the reference trajectories in order to fit better the patient's needs and disabilities. Additionally, the motion controllers for the hip and knee joints, mobile platform, and pelvic mechanism of an over-ground gait rehabilitation robotic system are also presented, as well as some proposed methods for assist as needed therapy. Two robot-patient synchronization approaches are also included in this work, together with a novel algorithm for online hip trajectory adaptation developed to reduce obstructive forces applied to the patient during therapy with compliant robotic systems. Finally, a prototype graphical user interface for the therapist is also presented

Applied Safety Critical Control

There is currently a clear gap between control-theoretical results and the reality of robotic implementation, in the sense that it is very difficult to transfer analytical guarantees to practical ones. This is especially problematic when trying to design safety-critical systems where failure is not an option. While there is a vast body of work on safety and reliability in control theory, very little of it is actually used in practice where safety margins are typically empiric and/or heuristic. Nevertheless, it is still widely accepted that a solution to these problems can only emerge from rigorous analysis, mathematics, and methods. In this work, we therefore seek to help bridge this gap by revisiting and expanding existing theoretical results in light of the complexity of hardware implementation. To that end, we begin by making a clear theoretical distinction between systems and models, and outline how the two need to be related for guarantees to transfer from the latter to the former. We then formalize various imperfections of reality that need to be accounted for at a model level to provide theoretical results with better applicability. We then discuss the reality of digital controller implementation and present the mathematical constraints that theoretical control laws must satisfy for them to be implementable on real hardware. In light of these discussions, we derive new realizable set-invariance conditions that, if properly enforced, can guarantee safety with an arbitrary high levels of confidence. We then discuss how these conditions can be rigorously enforced in a systematic and minimally invasive way through convex optimization-based Safety Filters. Multiple safety filter formulations are proposed with varying levels of complexity and applicability. To enable the use of these safety filters, a new algorithm is presented to compute appropriate control invariant sets and guarantee feasibility of the optimization problem defining these filters. The effectiveness of this approach is demonstrated in simulation on a nonlinear inverted pendulum and experimentally on a simple vehicle. The aptitude of the framework to handle a system's dynamics uncertainty is illustrated by varying the mass of the vehicle and showcasing when safety is conserved. Then, the aptitude of this approach to provide guarantees that account for controller implementation's constraints is illustrated by varying the frequency of the control loop and again showcasing when safety is conserved. In the second part of this work, we revisit the safety filtering approach in a way that addresses the scalability issues of the first part of this work. There are two main approaches to safety-critical control. The first one relies on computation of control invariant sets and was presented in the first part of this work. The second approach draws from the topic of optimal control and relies on the ability to realize Model-Predictive-Controllers online to guarantee the safety of a system. In that online approach, safety is ensured at a planning stage by solving the control problem subject for some explicitly defined constraints on the state and control input. Both approaches have distinct advantages but also major drawbacks that hinder their practical effectiveness, namely scalability for the first one and computational complexity for the second one. We therefore present an approach that draws from the advantages of both approaches to deliver efficient and scalable methods of ensuring safety for nonlinear dynamical systems. In particular, we show that identifying a backup control law that stabilizes the system is in fact sufficient to exploit some of the set-invariance conditions presented in the first part of this work. Indeed, one only needs to be able to numerically integrate the closed-loop dynamics of the system over a finite horizon under this backup law to compute all the information necessary for evaluating the regulation map and enforcing safety. The effect of relaxing the stabilization requirements of the backup law is also studied, and weaker but more practical safety guarantees are brought forward. We then explore the relationship between the optimality of the backup law and how conservative the resulting safety filter is. Finally, methods of selecting a safe input with varying levels of trade-off between conservativeness and computational complexity are proposed and illustrated on multiple robotic systems, namely: a two-wheeled inverted pendulum (Segway), an industrial manipulator, a quadrotor, and a lower body exoskeleton.</p

Sensor-Based Adaptive Control and Optimization of Lower-Limb Prosthesis.

Recent developments in prosthetics have enabled the development of powered prosthetic ankles (PPA). The advent of such technologies drastically improved impaired gait by increasing balance and reducing metabolic energy consumption by providing net positive power. However, control challenges limit performance and feasibility of today’s devices. With addition of sensors and motors, PPA systems should continuously make control decisions and adapt the system by manipulating control parameters of the prostheses. There are multiple challenges in optimization and control of PPAs. A prominent challenge is the objective setup of the system and calibration parameters to fit each subject. Another is whether it is possible to detect changes in intention and terrain before prosthetic use and how the system should react and adapt to it. In the first part of this study, a model for energy expenditure was proposed using electromyogram (EMG) signals from the residual lower-limbs PPA users. The proposed model was optimized to minimize energy expenditure. Optimization was performed using a modified Nelder-Mead approach with a Latin Hypercube sampling. Results of the proposed method were compared to expert values and it was shown to be a feasible alternative for tuning in a shorter time. In the second part of the study, the control challenges regarding lack of adaptivity for PPAs was investigated. The current PPA system used is enhanced with impedance-controlled parameters that allow the system to provide different assistance. However, current systems are set to a fixed value and fail to acknowledge various terrain and intentions throughout the day. In this study, a pseudo-real-time adaptive control system was proposed to predict the changes in the gait and provide a smoother gait. The proposed control system used physiological, kinetic, and kinematic data and fused them to predict the change. The prediction was done using machine learning-based methods. Results of the study showed an accuracy of up to 89.7 percent for prediction of change for four different cases

Legged locomotion over irregular terrains: State of the art of human and robot performance

Legged robotic technologies have moved out of the lab to operate in real environments, characterized by a wide variety of unpredictable irregularities and disturbances, all this in close proximity with humans. Demonstrating the ability of current robots to move robustly and reliably in these conditions is becoming essential to prove their safe operation. Here, we report an in-depth literature review aimed at verifying the existence of common or agreed protocols and metrics to test the performance of legged system in realistic environments. We primarily focused on three types of robotic technologies, i.e., hexapods, quadrupeds and bipeds. We also included a comprehensive overview on human locomotion studies, being it often considered the gold standard for performance, and one of the most important sources of bioinspiration for legged machines. We discovered that very few papers have rigorously studied robotic locomotion under irregular terrain conditions. On the contrary, numerous studies have addressed this problem on human gait, being nonetheless of highly heterogeneous nature in terms of experimental design. This lack of agreed methodology makes it challenging for the community to properly assess, compare and predict the performance of existing legged systems in real environments. On the one hand, this work provides a library of methods, metrics and experimental protocols, with a critical analysis on the limitations of the current approaches and future promising directions. On the other hand, it demonstrates the existence of an important lack of benchmarks in the literature, and the possibility of bridging different disciplines, e.g., the human and robotic, towards the definition of standardized procedure that will boost not only the scientific development of better bioinspired solutions, but also their market uptake

Quaternion Backpropagation

Quaternion valued neural networks experienced rising popularity and interest from researchers in the last years, whereby the derivatives with respect to quaternions needed for optimization are calculated as the sum of the partial derivatives with respect to the real and imaginary parts. However, we can show that product- and chain-rule does not hold with this approach. We solve this by employing the GHRCalculus and derive quaternion backpropagation based on this. Furthermore, we experimentally prove the functionality of the derived quaternion backpropagation