Systematic Review of Intelligent Algorithms in Gait Analysis and Prediction for Lower Limb Robotic Systems

The rate of development of robotic technologies has been meteoric, as a result of compounded advancements in hardware and software. Amongst these robotic technologies are active exoskeletons and orthoses, used in the assistive and rehabilitative fields. Artificial intelligence techniques are increasingly being utilised in gait analysis and prediction. This review paper systematically explores the current use of intelligent algorithms in gait analysis for robotic control, specifically the control of active lower limb exoskeletons and orthoses. Two databases, IEEE and Scopus, were screened for papers published between 1989 to May 2020. 41 papers met the eligibility criteria and were included in this review. 66.7% of the identified studies used classification models for the classification of gait phases and locomotion modes. Meanwhile, 33.3% implemented regression models for the estimation/prediction of kinematic parameters such as joint angles and trajectories, and kinetic parameters such as moments and torques. Deep learning algorithms have been deployed in ∼15% of the machine learning implementations. Other methodological parameters were reviewed, such as the sensor selection and the sample sizes used for training the models

Achieving Practical Functional Electrical Stimulation-driven Reaching Motions In An Individual With Tetraplegia

Functional electrical stimulation (FES) is a promising technique for restoring the ability to complete reaching motions to individuals with tetraplegia due to a spinal cord injury (SCI). FES has proven to be a successful technique for controlling many functional tasks such as grasping, standing, and even limited walking. However, translating these successes to reaching motions has proven difficult due to the complexity of the arm and the goaldirected nature of reaching motions. The state-of-the-art systems either use robots to assist the FES-driven reaching motions or control the arm of healthy subjects to complete planar motions. These controllers do not directly translate to controlling the full-arm of an individual with tetraplegia because the muscle capabilities of individuals with spinal cord injuries are unique and often limited due to muscle atrophy and the loss of function caused by lower motor neuron damage. This dissertation aims to develop a full-arm FES-driven reaching controller that is capable of achieving 3D reaching motions in an individual with a spinal cord injury. Aim 1 was to develop a complete-arm FES-driven reaching controller that can hold static hand positions for an individual with high tetraplegia due to SCI. We developed a combined feedforward-feedback controller which used the subject-specific model to automatically determine the muscle stimulation commands necessary to hold a desired static hand position. Aim 2 was to develop a subject-specific model-based control strategy to use FES to drive the arm of an individual with high tetraplegia due to SCI along a desired path in the subject’s workspace. We used trajectory optimization to find feasible trajectories which explicitly account for the unique muscle characteristics and the simulated arm dynamics of our subject with tetraplegia. We then developed a model predictive control controller to iii control the arm along the desired trajectory. The controller developed in this dissertation is a significant step towards restoring full arm reaching function to individuals with spinal cord injuries

Deep learning for gait prediction: an application to exoskeletons for children with neurological disorders

Cerebral Palsy, a non-progressive neurological disorder, is a lifelong condition. While it has no cure, clinical intervention aims to minimise the impact of the disability on individuals' lives. Wearable robotic devices, like exoskeletons, have been rapidly advancing and proving to be effective in rehabilitating individuals with gait pathologies. The utilization of artificial intelligence (AI) algorithms in controlling exoskeletons, particularly at the supervisory level, has emerged as a valuable approach. These algorithms rely on input from onboard sensors to predict gait phase, user intention, or joint kinematics. Using AI to improve the control of robotic devices not only enhances human-robot interaction but also has the potential to improve user comfort and functional outcomes of rehabilitation, and reduce accidents and injuries. In this research study, a comprehensive systematic literature review is conducted, exploring the various applications of AI in lower-limb robotic control. This review focuses on methodological parameters such as sensor usage, training demographics, sample size, and types of models while identifying gaps in the existing literature. Building on the findings of the review, subsequent research leveraged the power of deep learning to predict gait trajectories for the application of rehabilitative exoskeleton control. This study addresses a gap in the existing literature by focusing on predicting pathological gait trajectories, which exhibit higher inter- and intra-subject variability compared to the gait of healthy individuals. The research focused on the gait of children with neurological disorders, particularly Cerebral Palsy, as they stand to benefit greatly from rehabilitative exoskeletons. State-of-the-art deep learning algorithms, including transformers, fully connected neural networks, convolutional neural networks, and long short-term memory networks, were implemented for gait trajectory prediction. This research presents findings on the performance of these models for short-term and long-term recursive predictions, the impact of varying input and output window sizes on prediction errors, the effect of adding variable levels of Gaussian noise, and the robustness of the models in predicting gait at speeds within and outside the speed range of the training set. Moreover, the research outlines a methodology for optimising the stability of long-term forecasts and provides a comparative analysis of gait trajectory forecasting for typically developing children and children with Cerebral Palsy. A novel approach to generating adaptive trajectories for children with Cerebral Palsy, which can serve as reference trajectories for position-controlled exoskeletons, is also presented

Energy Regeneration and Environment Sensing for Robotic Leg Prostheses and Exoskeletons

Robotic leg prostheses and exoskeletons can provide powered locomotor assistance to older adults and/or persons with physical disabilities. However, limitations in automated control and energy-efficient actuation have impeded their transition from research laboratories to real-world environments. With regards to control, the current automated locomotion mode recognition systems being developed rely on mechanical, inertial, and/or neuromuscular sensors, which inherently have limited prediction horizons (i.e., analogous to walking blindfolded). Inspired by the human vision-locomotor control system, here a multi-generation environment sensing and classification system powered by computer vision and deep learning was developed to predict the oncoming walking environments prior to physical interaction, therein allowing for more accurate and robust high-level control decisions. To support this initiative, the “ExoNet” database was developed – the largest and most diverse open-source dataset of wearable camera images of indoor and outdoor real-world walking environments, which were annotated using a novel hierarchical labelling architecture. Over a dozen state-of-the-art deep convolutional neural networks were trained and tested on ExoNet for large-scale image classification and automatic feature engineering. The benchmarked CNN architectures and their environment classification predictions were then quantitatively evaluated and compared using an operational metric called “NetScore”, which balances the classification accuracy with the architectural and computational complexities (i.e., important for onboard real-time inference with mobile computing devices). Of the benchmarked CNN architectures, the EfficientNetB0 network achieved the highest test accuracy; VGG16 the fastest inference time; and MobileNetV2 the best NetScore. These comparative results can inform the optimal architecture design or selection depending on the desired performance of an environment classification system. With regards to energetics, backdriveable actuators with energy regeneration can improve the energy efficiency and extend the battery-powered operating durations by converting some of the otherwise dissipated energy during negative mechanical work into electrical energy. However, the evaluation and control of these regenerative actuators has focused on steady-state level-ground walking. To encompass real-world community mobility more broadly, here an energy regeneration system, featuring mathematical and computational models of human and wearable robotic systems, was developed to simulate energy regeneration and storage during other locomotor activities of daily living, specifically stand-to-sit movements. Parameter identification and inverse dynamic simulations of subject-specific optimized biomechanical models were used to calculate the negative joint mechanical work and power while sitting down (i.e., the mechanical energy theoretically available for electrical energy regeneration). These joint mechanical energetics were then used to simulate a robotic exoskeleton being backdriven and regenerating energy. An empirical characterization of an exoskeleton was carried out using a joint dynamometer system and an electromechanical motor model to calculate the actuator efficiency and to simulate energy regeneration and storage with the exoskeleton parameters. The performance calculations showed that regenerating electrical energy during stand-to-sit movements provide small improvements in energy efficiency and battery-powered operating durations. In summary, this research involved the development and evaluation of environment classification and energy regeneration systems to improve the automated control and energy-efficient actuation of next-generation robotic leg prostheses and exoskeletons for real-world locomotor assistance

Bio-Inspired Robotics

Modern robotic technologies have enabled robots to operate in a variety of unstructured and dynamically-changing environments, in addition to traditional structured environments. Robots have, thus, become an important element in our everyday lives. One key approach to develop such intelligent and autonomous robots is to draw inspiration from biological systems. Biological structure, mechanisms, and underlying principles have the potential to provide new ideas to support the improvement of conventional robotic designs and control. Such biological principles usually originate from animal or even plant models, for robots, which can sense, think, walk, swim, crawl, jump or even fly. Thus, it is believed that these bio-inspired methods are becoming increasingly important in the face of complex applications. Bio-inspired robotics is leading to the study of innovative structures and computing with sensory–motor coordination and learning to achieve intelligence, flexibility, stability, and adaptation for emergent robotic applications, such as manipulation, learning, and control. This Special Issue invites original papers of innovative ideas and concepts, new discoveries and improvements, and novel applications and business models relevant to the selected topics of ``Bio-Inspired Robotics''. Bio-Inspired Robotics is a broad topic and an ongoing expanding field. This Special Issue collates 30 papers that address some of the important challenges and opportunities in this broad and expanding field

On the Utility of Representation Learning Algorithms for Myoelectric Interfacing

Electrical activity produced by muscles during voluntary movement is a reflection of the firing patterns of relevant motor neurons and, by extension, the latent motor intent driving the movement. Once transduced via electromyography (EMG) and converted into digital form, this activity can be processed to provide an estimate of the original motor intent and is as such a feasible basis for non-invasive efferent neural interfacing. EMG-based motor intent decoding has so far received the most attention in the field of upper-limb prosthetics, where alternative means of interfacing are scarce and the utility of better control apparent. Whereas myoelectric prostheses have been available since the 1960s, available EMG control interfaces still lag behind the mechanical capabilities of the artificial limbs they are intended to steer—a gap at least partially due to limitations in current methods for translating EMG into appropriate motion commands. As the relationship between EMG signals and concurrent effector kinematics is highly non-linear and apparently stochastic, finding ways to accurately extract and combine relevant information from across electrode sites is still an active area of inquiry.This dissertation comprises an introduction and eight papers that explore issues afflicting the status quo of myoelectric decoding and possible solutions, all related through their use of learning algorithms and deep Artificial Neural Network (ANN) models. Paper I presents a Convolutional Neural Network (CNN) for multi-label movement decoding of high-density surface EMG (HD-sEMG) signals. Inspired by the successful use of CNNs in Paper I and the work of others, Paper II presents a method for automatic design of CNN architectures for use in myocontrol. Paper III introduces an ANN architecture with an appertaining training framework from which simultaneous and proportional control emerges. Paper Iv introduce a dataset of HD-sEMG signals for use with learning algorithms. Paper v applies a Recurrent Neural Network (RNN) model to decode finger forces from intramuscular EMG. Paper vI introduces a Transformer model for myoelectric interfacing that do not need additional training data to function with previously unseen users. Paper vII compares the performance of a Long Short-Term Memory (LSTM) network to that of classical pattern recognition algorithms. Lastly, paper vIII describes a framework for synthesizing EMG from multi-articulate gestures intended to reduce training burden

Computational Intelligence in Electromyography Analysis

Electromyography (EMG) is a technique for evaluating and recording the electrical activity produced by skeletal muscles. EMG may be used clinically for the diagnosis of neuromuscular problems and for assessing biomechanical and motor control deficits and other functional disorders. Furthermore, it can be used as a control signal for interfacing with orthotic and/or prosthetic devices or other rehabilitation assists. This book presents an updated overview of signal processing applications and recent developments in EMG from a number of diverse aspects and various applications in clinical and experimental research. It will provide readers with a detailed introduction to EMG signal processing techniques and applications, while presenting several new results and explanation of existing algorithms. This book is organized into 18 chapters, covering the current theoretical and practical approaches of EMG research

Proceedings of the 2021 DigitalFUTURES

This open access book is a compilation of selected papers from 2021 DigitalFUTURES—The 3rd International Conference on Computational Design and Robotic Fabrication (CDRF 2021). The work focuses on novel techniques for computational design and robotic fabrication. The contents make valuable contributions to academic researchers, designers, and engineers in the industry. As well, readers encounter new ideas about understanding material intelligence in architecture

Digital Interaction and Machine Intelligence

This book is open access, which means that you have free and unlimited access. This book presents the Proceedings of the 9th Machine Intelligence and Digital Interaction Conference. Significant progress in the development of artificial intelligence (AI) and its wider use in many interactive products are quickly transforming further areas of our life, which results in the emergence of various new social phenomena. Many countries have been making efforts to understand these phenomena and find answers on how to put the development of artificial intelligence on the right track to support the common good of people and societies. These attempts require interdisciplinary actions, covering not only science disciplines involved in the development of artificial intelligence and human-computer interaction but also close cooperation between researchers and practitioners. For this reason, the main goal of the MIDI conference held on 9-10.12.2021 as a virtual event is to integrate two, until recently, independent fields of research in computer science: broadly understood artificial intelligence and human-technology interaction