IMU-based Deep Neural Networks for Locomotor Intention Prediction

This paper focuses on the design and comparison of different deep neural networks for the real-time prediction of locomotor intentions by using data from inertial measurement units. The deep neural network architectures are convolutional neural networks, recurrent neural networks, and convolutional recurrent neural networks. The input to the architectures are features in the time domain, which have been derived either from one inertial measurement unit placed on the upper right leg of ten healthy subjects, or two inertial measurement units placed on both the upper and lower right leg of ten healthy subjects. The study shows that a WaveNet, i.e., a full convolutional neural network, achieves a peak F1-score of 87.17% in the case of one IMU, and a peak of 97.88% in the case of two IMUs, with a 5-fold cross-validation

IMU-Based Classification of Locomotion Modes, Transitions, and Gait Phases with Convolutional Recurrent Neural Networks

This paper focuses on the classification of seven locomotion modes (sitting, standing, level ground walking, ramp ascent and descent, stair ascent and descent), the transitions among these modes, and the gait phases within each mode, by only using data in the frequency domain from one or two inertial measurement units. Different deep neural network configurations are investigated and compared by combining convolutional and recurrent layers. The results show that a system composed of a convolutional neural network followed by a long short-term memory network is able to classify with a mean [Formula: see text]-score of 0.89 and 0.91 for ten healthy subjects, and of 0.92 and 0.95 for one osseointegrated transfemoral amputee subject (excluding the gait phases because they are not labeled in the data-set), using one and two inertial measurement units, respectively, with a 5-fold cross-validation. The promising results obtained in this study pave the way for using deep learning for the control of transfemoral prostheses with a minimum number of inertial measurement units

Sensor Fusion Representation of Locomotion Biomechanics with Applications in the Control of Lower Limb Prostheses

Free locomotion and movement in diverse environments are significant concerns for individuals with amputation who need independence in daily living activities. As users perform community ambulation, they face changing contexts that challenge what the typical passive prosthesis can offer. This problem rises opportunities for developing intelligent robotic systems that assist the locomotion with the least possible interruptions for direct input during operation. The use of multiple sensors to detect the user's intent and locomotion parameters is a promising technique that could provide a fast and natural response to the prostheses. However, the use of these sensors still requires a thorough investigation before they can be translated into practical settings. In addition, the dynamic change of context during locomotion should translate to adjustment in the device's response. To achieve the scaling rules for this modulation, a rich biomechanics dataset of community ambulation would provide a source of quantitative criteria to generate bioinspired controllers. This dissertation produces a better understanding of the characteristics of community ambulation from two different perspectives: the biomechanics of human motion and the sensory signals that can be captured by wearable technology. By studying human locomotion in diverse environments, including walking on stairs, ramps, and level ground, this work generated a comprehensive open-source dataset containing the biomechanics and signals from wearable sensors during locomotion, evaluating the effects of changing the locomotion context within the ambulation mode. With the multimodal dataset, I developed and evaluated a combined strategy for ambulation mode classification and the estimation of locomotion parameters, including the walking speed, stair height, ramp slope, and biological moment. Finally, by combining this knowledge and incorporating both the biomechanics insight with the machine learning-based inference in the frame of impedance control, I propose novel methods to improve the performance of lower-limb robotics with a focus on powered prostheses.Ph.D