Biomechatronics: Harmonizing Mechatronic Systems with Human Beings

This eBook provides a comprehensive treatise on modern biomechatronic systems centred around human applications. A particular emphasis is given to exoskeleton designs for assistance and training with advanced interfaces in human-machine interaction. Some of these designs are validated with experimental results which the reader will find very informative as building-blocks for designing such systems. This eBook will be ideally suited to those researching in biomechatronic area with bio-feedback applications or those who are involved in high-end research on manmachine interfaces. This may also serve as a textbook for biomechatronic design at post-graduate level

Development of Digital Control Systems for Wearable Mechatronic Devices: Applications in Musculoskeletal Rehabilitation of the Upper Limb

The potential for wearable mechatronic systems to assist with musculoskeletal rehabilitation of the upper limb has grown with the technology. One limiting factor to realizing the benefits of these devices as motion therapy tools is within the development of digital control solutions. Despite many device prototypes and research efforts in the surrounding fields, there are a lack of requirements, details, assessments, and comparisons of control system characteristics, components, and architectures in the literature. Pairing this with the complexity of humans, the devices, and their interactions makes it a difficult task for control system developers to determine the best solution for their desired applications. The objective of this thesis is to develop, evaluate, and compare control system solutions that are capable of tracking motion through the control of wearable mechatronic devices. Due to the immaturity of these devices, the design, implementation, and testing processes for the control systems is not well established. In order to improve the efficiency and effectiveness of these processes, control system development and evaluation tools have been proposed. The Wearable Mechatronics-Enabled Control Software framework was developed to enable the implementation and comparison of different control software solutions presented in the literature. This framework reduces the amount of restructuring and modification required to complete these development tasks. An integration testing protocol was developed to isolate different aspects of the control systems during testing. A metric suite is proposed that expands on the existing literature and allows for the measurement of more control characteristics. Together, these tools were used ii ABSTRACT iii to developed, evaluate, and compare control system solutions. Using the developed control systems, a series of experiments were performed that involved tracking elbow motion using wearable mechatronic elbow devices. The accuracy and repeatability of the motion tracking performances, the adaptability of the control models, and the resource utilization of the digital systems were measured during these experiments. Statistical analysis was performed on these metrics to compare between experimental factors. The results of the tracking performances show some of the highest accuracies for elbow motion tracking with these devices. The statistical analysis revealed many factors that significantly impact the tracking performance, such as visual feedback, motion training, constrained motion, motion models, motion inputs, actuation components, and control outputs. Furthermore, the completion of the experiments resulted in three first-time studies, such as the comparison of muscle activation models and the quantification of control system task timing and data storage needs. The successes of these experiments highlight that accurate motion tracking, using biological signals of the user, is possible, but that many more efforts are needed to obtain control solutions that are robust to variations in the motion and characteristics of the user. To guide the future development of these control systems, a national survey was conducted of therapists regarding their patient data collection and analysis methods. From the results of this survey, a series of requirements for software systems, that allow therapists to interact with the control systems of these devices, were collected. Increasing the participation of therapists in the development processes of wearable assistive devices will help to produce better requirements for developers. This will allow the customization of control systems for specific therapies and patient characteristics, which will increase the benefit and adoption rate of these devices within musculoskeletal rehabilitation programs

Upper limb soft robotic wearable devices: a systematic review

Introduction: Soft robotic wearable devices, referred to as exosuits, can be a valid alternative to rigid exoskeletons when it comes to daily upper limb support. Indeed, their inherent flexibility improves comfort, usability, and portability while not constraining the user’s natural degrees of freedom. This review is meant to guide the reader in understanding the current approaches across all design and production steps that might be exploited when developing an upper limb robotic exosuit. Methods: The literature research regarding such devices was conducted in PubMed, Scopus, and Web of Science. The investigated features are the intended scenario, type of actuation, supported degrees of freedom, low-level control, high-level control with a focus on intention detection, technology readiness level, and type of experiments conducted to evaluate the device. Results: A total of 105 articles were collected, describing 69 different devices. Devices were grouped according to their actuation type. More than 80% of devices are meant either for rehabilitation, assistance, or both. The most exploited actuation types are pneumatic (52%) and DC motors with cable transmission (29%). Most devices actuate 1 (56%) or 2 (28%) degrees of freedom, and the most targeted joints are the elbow and the shoulder. Intention detection strategies are implemented in 33% of the suits and include the use of switches and buttons, IMUs, stretch and bending sensors, EMG and EEG measurements. Most devices (75%) score a technology readiness level of 4 or 5. Conclusion: Although few devices can be considered ready to reach the market, exosuits show very high potential for the assistance of daily activities. Clinical trials exploiting shared evaluation metrics are needed to assess the effectiveness of upper limb exosuits on target users

Detection of intention level in response to task difficulty from EEG signals

We present an approach that enables detecting intention levels of subjects in response to task difficulty utilizing an electroencephalogram (EEG) based brain-computer interface (BCI). In particular, we use linear discriminant analysis (LDA) to classify event-related synchronization (ERS) and desynchronization (ERD) patterns associated with right elbow flexion and extension movements, while lifting different weights. We observe that it is possible to classify tasks of varying difficulty based on EEG signals. Additionally, we also present a correlation analysis between intention levels detected from EEG and surface electromyogram (sEMG) signals. Our experimental results suggest that it is possible to extract the intention level information from EEG signals in response to task difficulty and indicate some level of correlation between EEG and EMG. With a view towards detecting patients' intention levels during rehabilitation therapies, the proposed approach has the potential to ensure active involvement of patients throughout exercise routines and increase the efficacy of robot assisted therapies

Development of a hybrid robotic system based on an adaptive and associative assistance for rehabilitation of reaching movement after stroke

Stroke causes irreversible neurological damage. Depending on the location and the size of this brain injury, different body functions could result affected. One of the most common consequences is motor impairments. The level of motor impairment affectation varies between post-stroke subjects, but often, it hampers the execution of most activities of daily living. Consequently, the quality of life of the stroke population is severely decreased. The rehabilitation of the upper-limb motor functions has gained special attention in the scientific community due the poor reported prognosis of post-stroke patients for recovering normal upper-extremity function after standard rehabilitation therapy. Driven by the advance of technology and the design of new rehabilitation methods, the use of robot devices, functional electrical stimulation and brain-computer interfaces as a neuromodulation system is proposed as a novel and promising rehabilitation tools. Although the uses of these technologies present potential benefits with respect to standard rehabilitation methods, there still are some milestones to be addressed for the consolidation of these methods and techniques in clinical settings. Mentioned evidences reflect the motivation for this dissertation. This thesis presents the development and validation of a hybrid robotic system based on an adaptive and associative assistance for rehabilitation of reaching movements in post-stroke subjects. The hybrid concept refers the combined use of robotic devices with functional electrical stimulation. Adaptive feature states a tailored assistance according to the users’ motor residual capabilities, while the associative term denotes a precise pairing between the users’ motor intent and the peripheral hybrid assistance. The development of the hybrid platform comprised the following tasks: 1. The identification of the current challenges for hybrid robotic system, considering twofold perspectives: technological and clinical. The hybrid systems submitted in literature were critically reviewed for such purpose. These identified features will lead the subsequent development and method framed in this work. 2. The development and validation of a hybrid robotic system, combining a mechanical exoskeleton with functional electrical stimulation to assist the execution of functional reaching movements. Several subsystems are integrated within the hybrid platform, which interact each other to cooperatively complement the rehabilitation task. Complementary, the implementation of a controller based on functional electrical stimulation to dynamically adjust the level of assistance is addressed. The controller is conceived to tackle one of the main limitations when using electrical stimulation, i.e. the highly nonlinear and time-varying muscle response. An experimental procedure was conducted with healthy and post-stroke patients to corroborate the technical feasibility and the usability evaluation of the system. 3. The implementation of an associative strategy within the hybrid platform. Three different strategies based on electroencephalography and electromyography signals were analytically compared. The main idea is to provide a precise temporal association between the hybrid assistance delivered at the periphery (arm muscles) and the users’ own intention to move and to configure a feasible clinical setup to be use in real rehabilitation scenarios. 4. Carry out a comprehensive pilot clinical intervention considering a small cohort of patient with post-stroke patients to evaluate the different proposed concepts and assess the feasibility of using the hybrid system in rehabilitation settings. In summary, the works here presented prove the feasibility of using the hybrid robotic system as a rehabilitative tool with post-stroke subjects. Moreover, it is demonstrated the adaptive controller is able to adjust the level of assistance to achieve successful tracking movement with the affected arm. Remarkably, the accurate association in time between motor cortex activation, represented through the motor-related cortical potential measured with electroencephalography, and the supplied hybrid assistance during the execution of functional (multidegree of freedom) reaching movement facilitate distributed cortical plasticity. These results encourage the validation of the overall hybrid concept in a large clinical trial including an increased number of patients with a control group, in order to achieve more robust clinical results and confirm the presented herein.Programa Oficial de Doctorado en Ingeniería Eléctrica, Electrónica y AutomáticaPresidente: Ramón Ceres Ruiz.- Secretario: Luis Enrique Moreno Lorente.- Vocal: Antonio Olivier

Intelligent upper-limb exoskeleton using deep learning to predict human intention for sensory-feedback augmentation

The age and stroke-associated decline in musculoskeletal strength degrades the ability to perform daily human tasks using the upper extremities. Although there are a few examples of exoskeletons, they need manual operations due to the absence of sensor feedback and no intention prediction of movements. Here, we introduce an intelligent upper-limb exoskeleton system that uses cloud-based deep learning to predict human intention for strength augmentation. The embedded soft wearable sensors provide sensory feedback by collecting real-time muscle signals, which are simultaneously computed to determine the user's intended movement. The cloud-based deep-learning predicts four upper-limb joint motions with an average accuracy of 96.2% at a 200-250 millisecond response rate, suggesting that the exoskeleton operates just by human intention. In addition, an array of soft pneumatics assists the intended movements by providing 897 newton of force and 78.7 millimeter of displacement at maximum. Collectively, the intent-driven exoskeleton can augment human strength by 5.15 times on average compared to the unassisted exoskeleton. This report demonstrates an exoskeleton robot that augments the upper-limb joint movements by human intention based on a machine-learning cloud computing and sensory feedback.Comment: 15 pages, 6 figures, 1 table, Submitted for possible publicatio

Biosignal‐based human–machine interfaces for assistance and rehabilitation : a survey

As a definition, Human–Machine Interface (HMI) enables a person to interact with a device. Starting from elementary equipment, the recent development of novel techniques and unobtrusive devices for biosignals monitoring paved the way for a new class of HMIs, which take such biosignals as inputs to control various applications. The current survey aims to review the large literature of the last two decades regarding biosignal‐based HMIs for assistance and rehabilitation to outline state‐of‐the‐art and identify emerging technologies and potential future research trends. PubMed and other databases were surveyed by using specific keywords. The found studies were further screened in three levels (title, abstract, full‐text), and eventually, 144 journal papers and 37 conference papers were included. Four macrocategories were considered to classify the different biosignals used for HMI control: biopotential, muscle mechanical motion, body motion, and their combinations (hybrid systems). The HMIs were also classified according to their target application by considering six categories: prosthetic control, robotic control, virtual reality control, gesture recognition, communication, and smart environment control. An ever‐growing number of publications has been observed over the last years. Most of the studies (about 67%) pertain to the assistive field, while 20% relate to rehabilitation and 13% to assistance and rehabilitation. A moderate increase can be observed in studies focusing on robotic control, prosthetic control, and gesture recognition in the last decade. In contrast, studies on the other targets experienced only a small increase. Biopotentials are no longer the leading control signals, and the use of muscle mechanical motion signals has experienced a considerable rise, especially in prosthetic control. Hybrid technologies are promising, as they could lead to higher performances. However, they also increase HMIs’ complex-ity, so their usefulness should be carefully evaluated for the specific application

Reviewing high-level control techniques on robot-assisted upper-limb rehabilitation

This paper presents a comprehensive review of high-level control techniques for upper-limb robotic training. It aims to compare and discuss the potentials of these different control algorithms, and specify future research direction. Included studies mainly come from selected papers in four review articles. To make selected studies complete and comprehensive, especially some recently-developed upper-limb robotic devices, a search was further conducted in IEEE Xplore, Google Scholar, Scopus and Web of Science using keywords (‘upper limb*’ or ‘upper body*’) and (‘rehabilitation*’ or ‘treatment*’) and (‘robot*’ or ‘device*’ or ‘exoskeleton*’). The search is limited to English-language articles published between January 2013 and December 2017. Valuable references in related publications were also screened. Comparative analysis shows that high-level interaction control strategies can be implemented in a range of methods, mainly including impedance/admittance based strategies, adaptive control techniques, and physiological signal control. Even though the potentials of existing interactive control strategies have been demonstrated, it is hard to identify the one leading to maximum encouragement from human users. However, it is reasonable to suggest that future studies should combine different control strategies to be application specific, and deliver appropriate robotic assistance based on physical disability levels of human users