Wearable inertial sensor system towards daily human kinematic gait analysis: benchmarking analysis to MVN BIOMECH

This paper presents a cost- and time-effective wearable inertial sensor system, the InertialLAB. It includes gyroscopes and accelerometers for the real-time monitoring of 3D-angular velocity and 3D-acceleration of up to six lower limbs and trunk segment and sagittal joint angle up to six joints. InertialLAB followed an open architecture with a low computational load to be executed by wearable processing units up to 200 Hz for fostering kinematic gait data to third-party systems, advancing similar commercial systems. For joint angle estimation, we developed a trigonometric method based on the segments’ orientation previously computed by fusion-based methods. The validation covered healthy gait patterns in varying speed and terrain (flat, ramp, and stairs) and including turns, extending the experiments approached in the literature. The benchmarking analysis to MVN BIOMECH reported that InertialLAB provides more reliable measures in stairs than in flat terrain and ramp. The joint angle time-series of InertialLAB showed good waveform similarity (>0.898) with MVN BIOMECH, resulting in high reliability and excellent validity. User-independent neural network regression models successfully minimized the drift errors observed in InertialLAB’s joint angles (NRMSE < 0.092). Further, users ranked InertialLAB as good in terms of usability. InertialLAB shows promise for daily kinematic gait analysis and real-time kinematic feedback for wearable third-party systems.This work has been supported in part by the Fundação para a Ciência e Tecnologia (FCT) with the Reference Scholarship under Grant SFRH/BD/108309/2015 and SFRH/BD/147878/2019, by the FEDER Funds through the Programa Operacional Regional do Norte and national funds from FCT with the project SmartOs under Grant NORTE-01-0145-FEDER-030386, and through the COMPETE 2020—Programa Operacional Competitividade e Internacionalização (POCI)—with the Reference Project under Grant POCI-01-0145-FEDER-006941

Towards a human-in-the-loop control for a smart orthotic system

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Eletrónica Médica)Stroke is the main cause of paralysis. This pathology has provoked a considerable increase of persons with motor impairments. With a therapy focused on each clinical case, the total or partial recovery can be achieved. Powered orthoses have been developed to promote an effective recover, based on repetitive gait training and user’s active participation. Many control approaches have been developed to control these devices, but none of them promotes an user-oriented strategy focused to the user’s needs. In an attempt of solving this issue, a new approach named Human-in-the-loop is emerging. This strategy allows the adaptation of some assistive parameters based on the user’s energetic cost, promoting a therapy tailored to each end-user needs. However, to estimate the energy expenditure, the use of non-ergonomic sensors, not suitable for clinical context, is required. Thus, it is necessary to find new ways of estimating energy expenditure using wearable and comfortable sensors. In this dissertation, the first steps to introduce the Human-in-the-loop strategy into a powered orthosis are presented. For this purpose, two strategies were developed: a strategy that allows the angular trajectory adaptation in real-time and other that promotes a stiffness adaptation all over the gait cycle. Both strategies were validated with healthy subjects. In the first strategy, the orthosis was able to modify its assistance in a fraction of microseconds, and the end-users were able to follow her with a median error below 10%. Regarding the second strategy, the results show that the orthosis allowed an effective change in the systems’ interaction stiffness, promoting an active participation of each user during its assistance. The energetic impact of using the robotic assistive device is also presented. As it promotes an energy expenditure augmentation in more than 30% in comparison to walk without the device, the necessity of implementing the Human-in-the-loop strategy was highlighted. In an attempt of finding an ergonomic technique to estimate the energetic cost, the use of machine learning algorithms was tested. The results, obtained with a MLP and a LSTM, prove that it is possible to estimate the energy expenditure with a mean error close to 11%. Future work consists in the implementation of the model in real-time and the collection of more data with the aforementioned control approaches, in a way of constructing a more robust model.O AVC é uma das maiores causas de paralisia. Esta patologia, cada vez mais com maior incidência nos jovens, tem provocado um aumento considerável de pessoas com problemas de mobilidade. Com uma terapia focada a cada caso clínico, a recuperação total ou parcial pode ser conseguida. As ortóteses ativas têm vindo a ser desenvolvidas com o propósito de promover uma recuperação eficaz, baseada em treinos repetitivos e numa participação ativa dos utilizadores. Várias abordagens de controlo têm vindo a ser desenvolvidas para controlar estes dispositivos, mas nenhuma delas promove uma estratégia orientada às necessidades do utilizador. Na tentativa de solucionar este problema, uma nova abordagem, designada por Human-in-the-loop está a emergir. Baseada no custo energético, esta estratégia permite adaptar parâmetros da assistência, promovendo uma terapia focada e direcionada a cada utilizador. No entanto, para estimar o custo energético, recorre-se ao uso de sensores que não são adequados para contexto clínico. Assim, torna-se necessário estudar novas formas de estimar o custo energético. Nesta dissertação são apresentados os primeiros passos para introduzir o controlo Human-in-the-loop numa ortótese ativa. Para isso, duas estratégias foram apresentadas: uma estratégia que permite adaptar a trajetória angular da ortótese, em tempo real, e outra que promove a adaptação da complacência do sistema ao longo do ciclo da marcha. Ambas foram validadas com sujeitos saudáveis. Relativamente à primeira abordagem, a ortótese foi capaz de modificar a sua assistência em microssegundos, e os utilizadores foram capazes de a seguir com um erro mediano inferior a 10%. No que diz respeito à segunda abordagem, os resultados mostram que a ortótese promoveu uma alteração eficaz da complacência de interação, promovendo uma participação ativa do utilizador durante a sua assistência. O impacto energético do uso do sistema robótico é, também, apresentado. Promovendo um aumento do custo energético em mais de 30%, a necessidade da estratégia Human-in-the-loop foi realçada. Na tentativa de encontrar uma técnica para estimar o custo energético, recorreu-se ao uso de machine learning. Os resultados, obtidos com uma MLP e uma LSTM, provam que é possível estimar o custo energético com um erro médio próximo dos 11%. Trabalho futuro passa pela implementação do modelo em tempo real e a recolha de mais dados com as abordagens de controlo apresentadas, de forma a construir um modelo mais robusto

Fall prevention strategy for an active orthotic system

Dissertação de mestrado integrado em Engenharia Biomédica (especialização em Eletrónica Médica)Todos os anos, são reportadas cerca de 684,000 quedas fatais e 37.3 milhões de quedas não fatais que requerem atenção médica, afetando principalmente a população idosa. Assim, é necessário identificar eficientemente indivíduos com alto risco de queda, a partir da população alvo idosa, e prepará los para superar perturbações da marcha inesperadas. Uma estratégia de prevenção de queda capaz de eficientemente e atempadamente detetar e contrariar os eventos de perdas de equilíbrio (PDE) mais frequentes pode reduzir o risco de queda. Como slips foram identificados como a causa mais prevalente de quedas, estes eventos devem ser abordados como foco principal da estratégia. No entanto, há falta de estratégias de prevenção de quedas por slip. Esta dissertação tem como objetivo o design de uma estratégia de prevenção de quedas de slips baseada na conceção das etapas de atuação e deteção. A estratégia de atuação foi delineada com base na resposta biomecânica humana a slips, onde o joelho da perna perturbada (leading) apresenta um papel proeminente para contrariar LOBs induzidas por slips. Quando uma slip é detetada, a estratégia destaca uma ortótese de joelho que providencia um torque assisstivo para prevenir a queda. A estratégia de deteção considerou as propriedades atrativas dos controladores Central Pattern Generator (CPG) para prever parâmetros da marcha. Algoritmos baseados em threshold monitorizam o erro de previsão do CPG, que aumenta após uma perturbação inesperada na marcha, para a deteção de slips. O ângulo do joelho e a velocidade angular da canela foram selecionados como os parâmetros de monitorização da marcha. Um protocolo experimental concebido para provocar perturbações de slip a sujeitos humanos permitiu a recolha de dados destas variáveis para posteriormente validar o algoritmo de deteção de perturbações. Algoritmos CPG foram capazes de produzir aproximações aceitáveis dos sinais de marcha em estado estacionário do ângulo do joelho e da velocidade angular da canela com sucesso. Além disso, o algoritmo de threshold adaptativo detetou LOBs induzidas por slips eficientemente. A melhor performance global foi obtida usando este algoritmo para monitorizar o ângulo do joelho, que detetou quase 80% (78.261%) do total de perturbações com um tempo médio de deteção (TMD) de 250 ms. Além disso, uma média de 0.652 falsas perturbações foram detetadas por cada perturbação corretamente identificada. Estes resultados sugerem uma performance aceitável de deteção de perturbações do algoritmo, de acordo com os requisitos especificados para a deteção.Every year, an estimated 684,000 fatal falls and 37.3 million non-fatal falls requiring medical attention are reported, mostly affecting the older population. Thus, it is necessary to effectively screen high fall risk individuals from targeted elderly populations and prepare them to successfully overcome unexpected gait perturbations. A fall prevention strategy capable of effectively and timely detect and counteract the most frequent loss of balance (LOB) events may reduce the fall risk. Since slips were identified as the main contributors to falls, these events should be addressed as a main focus of the strategy. Nonetheless, there is a lack of slip-induced fall prevention strategies. This dissertation aims the design of a slip-related fall prevention strategy based on the conception of an actuation and a detection stage. The actuation strategy was delineated based on the human biomechanical reactions to slips, where the perturbed (leading) leg’s knee joint presents a prominent role to counteract slip-induced LOBs. Thereby, upon the detection of a slip, this strategy highlighted a knee orthotic device that provides an assistive torque to prevent the falls. The detection strategy considered the attractive properties of biological-inspired Central Pattern Generator (CPG) controllers to predict gait parameters. Threshold-based algorithms monitored the CPG’s prediction error produced, which increases upon an unexpected gait perturbation, to perform slip detection. The knee angle and shank angular velocity were selected as the monitoring gait parameters. An experimental protocol designed to provoke slip perturbations to human subjects allowed to collect data from these variables to further validate the perturbation detection algorithm. CPG algorithms were able to successfully produce acceptable estimations of the knee angle and shank angular velocity signals during steady-state walking. Furthermore, an adaptive threshold algorithm effectively detected slip-induced LOBs. The best overall performance was obtained using this algorithm to monitor the knee angle from the perturbed leg, which detected almost 80% (78.261%) of the total perturbations with a mean detection time (MDT) of 250 ms. In addition, a mean of 0.652 false perturbations were detected for each correct perturbation identified. These results suggest an acceptable perturbation detection performance of the algorithm implemented in light of the detection requirements specified

A Generalized Method for Predictive Simulation-Based Lower Limb Prosthesis Design

Lower limb prostheses are designed to replace the functions and form of the missing biological anatomy. These functions are hypothesized to improve user outcome measures which are negatively affected by receiving an amputation – such as metabolic cost of transport, preferred walking speed, and perceived discomfort during walking. However, the effect of these design functions on the targeted outcome measures is highly variable, suggesting that these relationships are not fully understood. Biomechanics simulation and modeling tools are increasingly capable of analyzing the effects of a design on the resulting user gait. In this work, prothesis-aided gait is optimized in simulation to reduce both muscle effort and peak loads on the residual limb using a generalized prosthesis model. Compared to a traditional revolute powered ankle joint model, a two degree-of freedom generalized model reduced muscle activations by 50% and peak loads by 15%. Simulated prosthesis behaviors corresponding to the optimal gait patterns were translated into a two degree-of-freedom ankle-foot prosthesis design with powered bidirectional linear translation and plantarflexion. The prototype is capable of delivering up to 171 N-m of plantarflexion torque and 499 N of translation force, with 15° dorsi-/35° plantarflexion and 10 cm translation range of motion. The mass and height of the ankle-foot are 2.29 kg and 19.5 cm, respectively. The mass of the entire system including the wearable offboard system is 8.58 kg. This platform is designed to emulate the behavior of the simulated prosthesis, as well as be configurable to emulate alternate behaviors obtained from simulations with different optimization objectives. The prototype is controlled to replicate simulated walking patterns using a high level finite state controller, mid-level stiffness controller, and low level load controller. Closed loop load control has bandwidth of 15 Hz in translation and 7.2 Hz in flexion. Load tracking during walking with a single able-bodied human subject ranges from 93 to 159 N in translation and 4.6 to 21.3 N-m in flexion. The contribution of this work is to provide a framework for predictive simulation-based prosthesis design, evidence of its practical implementation, and the experimental tools to validate future predictive simulation studies

Design of an Elastic Actuation System for a Gait-Assistive Active Orthosis for Incomplete Spinal Cord Injured Subjects

A spinal cord injury severely reduces the quality of life of affected people. Following the injury, limitations of the ability to move may occur due to the disruption of the motor and sensory functions of the nervous system depending on the severity of the lesion. An active stance-control knee-ankle-foot orthosis was developed and tested in earlier works to aid incomplete SCI subjects by increasing their mobility and independence. This thesis aims at the incorporation of elastic actuation into the active orthosis to utilise advantages of the compliant system regarding efficiency and human-robot interaction as well as the reproduction of the phyisological compliance of the human joints. Therefore, a model-based procedure is adapted to the design of an elastic actuation system for a gait-assisitve active orthosis. A determination of the optimal structure and parameters is undertaken via optimisation of models representing compliant actuators with increasing level of detail. The minimisation of the energy calculated from the positive amount of power or from the absolute power of the actuator generating one human-like gait cycle yields an optimal series stiffness, which is similar to the physiological stiffness of the human knee during the stance phase. Including efficiency factors for components, especially the consideration of the electric model of an electric motor yields additional information. A human-like gait cycle contains high torque and low velocities in the stance phase and lower torque combined with high velocities during the swing. Hence, the efficiency of an electric motor with a gear unit is only high in one of the phases. This yields a conceptual design of a series elastic actuator with locking of the actuator position during the stance phase. The locked position combined with the series compliance allows a reproduction of the characteristics of the human gait cycle during the stance phase. Unlocking the actuator position for the swing phase enables the selection of an optimal gear ratio to maximise the recuperable energy. To evaluate the developed concept, a laboratory specimen based on an electric motor, a harmonic drive gearbox, a torsional series spring and an electromagnetic brake is designed and appropriate components are selected. A control strategy, based on impedance control, is investigated and extended with a finite state machine to activate the locking mechanism. The control scheme and the laboratory specimen are implemented at a test bench, modelling the foot and shank as a pendulum articulated at the knee. An identification of parameters yields high and nonlinear friction as a problem of the system, which reduces the energy efficiency of the system and requires appropriate compensation. A comparison between direct and elastic actuation shows similar results for both systems at the test bench, showing that the increased complexity due to the second degree of freedom and the elastic behaviour of the actuator is treated properly. The final proof of concept requires the implementation at the active orthosis to emulate uncertainties and variations occurring during the human gait

Locomotion Traces Data Mining for Supporting Frail People with Cognitive Impairment

The rapid increase in the senior population is posing serious challenges to national healthcare systems. Hence, innovative tools are needed to early detect health issues, including cognitive decline. Several clinical studies show that it is possible to identify cognitive impairment based on the locomotion patterns of older people. Thus, this thesis at first focused on providing a systematic literature review of locomotion data mining systems for supporting Neuro-Degenerative Diseases (NDD) diagnosis, identifying locomotion anomaly indicators and movement patterns for discovering low-level locomotion indicators, sensor data acquisition, and processing methods, as well as NDD detection algorithms considering their pros and cons. Then, we investigated the use of sensor data and Deep Learning (DL) to recognize abnormal movement patterns in instrumented smart-homes. In order to get rid of the noise introduced by indoor constraints and activity execution, we introduced novel visual feature extraction methods for locomotion data. Our solutions rely on locomotion traces segmentation, image-based extraction of salient features from locomotion segments, and vision-based DL. Furthermore, we proposed a data augmentation strategy to increase the volume of collected data and generalize the solution to different smart-homes with different layouts. We carried out extensive experiments with a large real-world dataset acquired in a smart-home test-bed from older people, including people with cognitive diseases. Experimental comparisons show that our system outperforms state-of-the-art methods