Instrumentation and validation of a robotic cane for transportation and fall prevention in patients with affected mobility

Dissertação de mestrado integrado em Engenharia Física, (especialização em Dispositivos, Microssistemas e Nanotecnologias)O ato de andar é conhecido por ser a forma primitiva de locomoção do ser humano, sendo que este traz muitos benefícios que motivam um estilo de vida saudável e ativo. No entanto, há condições de saúde que dificultam a realização da marcha, o que por consequência pode resultar num agravamento da saúde, e adicionalmente, levar a um maior risco de quedas. Nesse sentido, o desenvolvimento de um sistema de deteção e prevenção de quedas, integrado num dispositivo auxiliar de marcha, seria essencial para reduzir estes eventos de quedas e melhorar a qualidade de vida das pessoas. Para ultrapassar estas necessidades e limitações, esta dissertação tem como objetivo validar e instrumentar uma bengala robótica, denominada Anti-fall Robotic Cane (ARCane), concebida para incorporar um sistema de deteção de quedas e um mecanismo de atuação que possibilite a prevenção de quedas, ao mesmo tempo que assiste a marcha. Para esse fim, foi realizada uma revisão do estado da arte em bengalas robóticas para adquirir um conhecimento amplo e aprofundado dos componentes, mecanismos e estratégias utilizadas, bem como os protocolos experimentais, principais resultados, limitações e desafios em dispositivos existentes. Numa primeira fase, foi estipulado o objetivo de: (i) adaptar a missão do produto; (ii) estudar as necessidades do consumidor; e (iii) atualizar as especificações alvo da ARCane, continuação do trabalho de equipa, para obter um produto com design e engenharia compatível com o mercado. Foi depois estabelecida a arquitetura de hardware e discutidos os componentes a ser instrumentados na ARCane. Em seguida foram realizados testes de interoperabilidade a fim de validar o funcionamento singular e coletivo dos componentes. Relativamente ao controlo de movimento, foi desenvolvido um sistema inovador, de baixo custo e intuitivo, capaz de detetar a intenção do movimento e de reconhecer as fases da marcha do utilizador. Esta implementação foi validada com seis voluntários saudáveis que realizaram testes de marcha com a ARCane para testar sua operabilidade num ambiente de contexto real. Obteve-se uma precisão de 97% e de 90% em relação à deteção da intenção de movimento e ao reconhecimento da fase da marcha do utilizador. Por fim, foi projetado um método de deteção de quedas e mecanismo de prevenção de quedas para futura implementação na ARCane. Foi ainda proposta uma melhoria do método de deteção de quedas, de modo a superar as limitações associadas, bem como a proposta de dispositivos de deteção a serem implementados na ARCane para obter um sistema completo de deteção de quedas.The act of walking is known to be the primitive form of the human being, and it brings many benefits that motivate a healthy and active lifestyle. However, there are health conditions that make walking difficult, which, consequently, can result in worse health and, in addition, lead to a greater risk of falls. Thus, the development of a fall detection and prevention system integrated with a walking aid would be essential to reduce these fall events and improve people quality of life. To overcome these needs and limitations, this dissertation aims to validate and instrument a cane-type robot, called Anti-fall Robotic Cane (ARCane), designed to incorporate a fall detection system and an actuation mechanism that allow the prevention of falls, while assisting the gait. Therefore, a State-of-the-Art review concerning robotic canes was carried out to acquire a broad and in-depth knowledge of the used components, mechanisms and strategies, as well as the experimental protocols, main results, limitations and challenges on existing devices. On a first stage, it was set an objective to (i) enhance the product's mission statement; (ii) study the consumer needs; and (iii) update the target specifications of the ARCane, extending teamwork, to obtain a product with a market-compatible design and engineering that meets the needs and desires of the ARCane users. It was then established the hardware architecture of the ARCane and discussed the electronic components that will instrument the control, sensory, actuator and power units, being afterwards subjected to interoperability tests to validate the singular and collective functioning of cane components altogether. Regarding the motion control of robotic canes, an innovative, cost-effective and intuitive motion control system was developed, providing user movement intention recognition, and identification of the user's gait phases. This implementation was validated with six healthy volunteers who carried out gait trials with the ARCane, in order to test its operability in a real context environment. An accuracy of 97% was achieved for user motion intention recognition and 90% for user gait phase recognition, using the proposed motion control system. Finally, it was idealized a fall detection method and fall prevention mechanism for a future implementation in the ARCane, based on methods applied to robotic canes in the literature. It was also proposed an improvement of the fall detection method in order to overcome its associated limitations, as well as detection devices to be implemented into the ARCane to achieve a complete fall detection system

Concept and prototype development of adaptive touch walking support robot for maximizing human physical potential

We propose a new walking support robot concept, “Nimbus Guardian,” designed to enhance the mobility of both healthy and frail elderly individuals who can walk independently. The proposed robot differs from traditional walker-type or cane-type aids by offering adaptive, minimal touch support based on the user's walking dynamics. Our goal is to realize versatile touch to the user as a preliminary study for developing the adaptive touch walking support robot. To achieve this, we have established a categorization system for walking support touch, outlining the specific types of assistance required for our robot. Based on these categorization, we have developed a prototype that improves the versatility of touch support (touch point, force, and initiator), adapting to the user's body. Our prototype is equipped to offer multiple touch support parts, adjusting to the user's physique. For versatile touch capabilities, we designed a motion control algorithm that includes a controller which directs the robot's wheel movements according to the chosen support points, and a state machine that provides multiple arm placements and movements. We have experimentally implemented this motion control algorithm in our prototype. Through experiments, we verified the touch versatility and discussed the prototype's utility and potential for further development

Instrumentation of a cane to detect and prevent falls

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Eletrónica Médica)The number of falls is growing as the main cause of injuries and deaths in the geriatric community. As a result, the cost of treating the injuries associated with falls is also increasing. Thus, the development of fall-related strategies with the capability of real-time monitoring without user restriction is imperative. Due to their advantages, daily life accessories can be a solution to embed fall-related systems, and canes are no exception. Moreover, gait assessment might be capable of enhancing the capability of cane usage for older cane users. Therefore, reducing, even more, the possibility of possible falls amongst them. Summing up, it is crucial the development of strategies that recognize states of fall, the step before a fall (pre-fall step) and the different cane events continuously throughout a stride. This thesis aims to develop strategies capable of identifying these situations based on a cane system that collects both inertial and force information, the Assistive Smart Cane (ASCane). The strategy regarding the detection of falls consisted of testing the data acquired with the ASCane with three different fixed multi-threshold fall detection algorithms, one dynamic multi-threshold and machine learning methods from the literature. They were tested and modified to account the use of a cane. The best performance resulted in a sensitivity and specificity of 96.90% and 98.98%, respectively. For the detection of the different cane events in controlled and real-life situations, a state-of-the-art finite-state-machine gait event detector was modified to account the use of a cane and benchmarked against a ground truth system. Moreover, a machine learning study was completed involving eight feature selection methods and nine different machine learning classifiers. Results have shown that the accuracy of the classifiers was quite acceptable and presented the best results with 98.32% of overall accuracy for controlled situations and 94.82% in daily-life situations. Regarding pre-fall step detection, the same machine learning approach was accomplished. The models were very accurate (Accuracy = 98.15%) and with the implementation of an online post-processing filter, all the false positive detections were eliminated, and a fall was able to be detected 1.019s before the end of the corresponding pre-fall step and 2.009s before impact.O número de quedas tornou-se uma das principais causas de lesões e mortes na comunidade geriátrica. Como resultado, o custo do tratamento das lesões também aumenta. Portanto, é necessário o desenvolvimento de estratégias relacionadas com quedas e que exibam capacidade de monitorização em tempo real sem colocar restrições ao usuário. Devido às suas vantagens, os acessórios do dia-a-dia podem ser uma solução para incorporar sistemas relacionados com quedas, sendo que as bengalas não são exceção. Além disso, a avaliação da marcha pode ser capaz de aprimorar a capacidade de uso de uma bengala para usuários mais idosos. Desta forma, é crucial o desenvolvimento de estratégias que reconheçam estados de queda, do passo anterior a uma queda e dos diferentes eventos da marcha de uma bengala. Esta dissertação tem como objetivo desenvolver estratégias capazes de identificar as situações anteriormente descritas com base num sistema incorporado numa bengala que coleta informações inerciais e de força, a Assistive Smart Cane (ASCane). A estratégia referente à deteção de quedas consistiu em testar os dados adquiridos através da ASCane com três algoritmos de deteção de quedas (baseados em thresholds fixos), com um algoritmo de thresholds dinâmicos e diferentes classificadores de machine learning encontrados na literatura. Estes métodos foram testados e modificados para dar conta do uso de informação adquirida através de uma bengala. O melhor desempenho alcançado em termos de sensibilidade e especificidade foi de 96,90% e 98,98%, respetivamente. Relativamente à deteção dos diferentes eventos da ASCane em situações controladas e da vida real, um detetor de eventos da marcha foi e comparado com um sistema de ground truth. Além disso, foi também realizado um estudo de machine learning envolvendo oito métodos de seleção de features e nove classificadores diferentes de machine learning. Os resultados mostraram que a precisão dos classificadores foi bastante aceitável e apresentou, como melhores resultados, 98,32% de precisão para situações controladas e 94.82% para situações do dia-a-dia. No que concerne à deteção de passos pré-queda, a mesma abordagem de machine learning foi realizada. Os modelos foram precisos (precisão = 98,15%) e com a implementação de um filtro de pós-processamento, todas as deteções de falsos positivos foram eliminadas e uma queda foi passível de ser detetada 1,019s antes do final do respetivo passo de pré-queda e 2.009s antes do impacto

Design Principles for FES Concept Development

© Cranfield University 2013. All rights reserved. No part of this publication may be reproduced without the written permission of the copyright owner.A variety of pathologies can cause injury to the spinal cord and hinder movement. A range of equipment is available to help spinal injury sufferers move their affected limbs. One method of rehabilitation is functional electrical stimulation (FES). FES is a technique where small electrical currents are applied to the surface of the user’s legs to stimulate the muscles. Studies have demonstrated the benefits of using this method and it has also been incorporated into a number of devices. The aim of the project was to produce a number of designs for a new device that uses FES technology. The project was completed in conjunction with an industrial partner. A review of the literature and consultation with industrial experts suggested a number of ways current devices could be improved. These included encouraging the user to lean forwards while walking and powering the device using a more ergonomic method. A group of designers were used to produce designs that allowed the user to walk with a more natural gait and avoided cumbersome power packs. The most effective of these designs were combined to form one design that solved both problems. A 3-dimensional model of this design was simulated using computer-aided design software. Groups of engineers, scientists and consumers were also invited to provide input on how a new device should function. Each of these groups provided a design that reflected their specific needs, depending on their experience with similar technology. Low level prototypes were produced of these designs. A group of designers were also used to design concepts for a functional electrical stimulation device based on an introduction given by industry experts. Each of the designs was presented to experienced professionals to obtain feedback. A set of guidelines were also produced during the project that instructed how to create the designs

Development and evaluation of a haptic framework supporting telerehabilitation robotics and group interaction

Telerehabilitation robotics has grown remarkably in the past few years. It can provide intensive training to people with special needs remotely while facilitating therapists to observe the whole process. Telerehabilitation robotics is a promising solution supporting routine care which can help to transform face-to-face and one-on-one treatment sessions that require not only intensive human resource but are also restricted to some specialised care centres to treatments that are technology-based (less human involvement) and easy to access remotely from anywhere. However, there are some limitations such as network latency, jitter, and delay of the internet that can affect negatively user experience and quality of the treatment session. Moreover, the lack of social interaction since all treatments are performed over the internet can reduce motivation of the patients. As a result, these limitations are making it very difficult to deliver an efficient recovery plan. This thesis developed and evaluated a new framework designed to facilitate telerehabilitation robotics. The framework integrates multiple cutting-edge technologies to generate playful activities that involve group interaction with binaural audio, visual, and haptic feedback with robot interaction in a variety of environments. The research questions asked were: 1) Can activity mediated by technology motivate and influence the behaviour of users, so that they engage in the activity and sustain a good level of motivation? 2) Will working as a group enhance users’ motivation and interaction? 3) Can we transfer real life activity involving group interaction to virtual domain and deliver it reliably via the internet? There were three goals in this work: first was to compare people’s behaviours and motivations while doing the task in a group and on their own; second was to determine whether group interaction in virtual and reala environments was different from each other in terms of performance, engagement and strategy to complete the task; finally was to test out the effectiveness of the framework based on the benchmarks generated from socially assistive robotics literature. Three studies have been conducted to achieve the first goal, two with healthy participants and one with seven autistic children. The first study observed how people react in a challenging group task while the other two studies compared group and individual interactions. The results obtained from these studies showed that the group interactions were more enjoyable than individual interactions and most likely had more positive effects in terms of user behaviours. This suggests that the group interaction approach has the potential to motivate individuals to make more movements and be more active and could be applied in the future for more serious therapy. Another study has been conducted to measure group interaction’s performance in virtual and real environments and pointed out which aspect influences users’ strategy for dealing with the task. The results from this study helped to form a better understanding to predict a user’s behaviour in a collaborative task. A simulation has been run to compare the results generated from the predictor and the real data. It has shown that, with an appropriate training method, the predictor can perform very well. This thesis has demonstrated the feasibility of group interaction via the internet using robotic technology which could be beneficial for people who require social interaction (e.g. stroke patients and autistic children) in their treatments without regular visits to the clinical centres

Enhanced Living Environments

This open access book was prepared as a Final Publication of the COST Action IC1303 “Algorithms, Architectures and Platforms for Enhanced Living Environments (AAPELE)”. The concept of Enhanced Living Environments (ELE) refers to the area of Ambient Assisted Living (AAL) that is more related with Information and Communication Technologies (ICT). Effective ELE solutions require appropriate ICT algorithms, architectures, platforms, and systems, having in view the advance of science and technology in this area and the development of new and innovative solutions that can provide improvements in the quality of life for people in their homes and can reduce the financial burden on the budgets of the healthcare providers. The aim of this book is to become a state-of-the-art reference, discussing progress made, as well as prompting future directions on theories, practices, standards, and strategies related to the ELE area. The book contains 12 chapters and can serve as a valuable reference for undergraduate students, post-graduate students, educators, faculty members, researchers, engineers, medical doctors, healthcare organizations, insurance companies, and research strategists working in this area

Otimização muscle-in-the-loop em tempo real para reabilitação física com um exosqueleto ativo: uma mudança de paradigma

Assisting human locomotion with a wearable robotic orthosis is still quite challenging, largely due to the complexity of the neuromusculoskeletal system, the time-varying dynamics that accompany motor adaptation, and the uniqueness of every individual’s response to the assistance given by the robot. To this day, these devices have not met their well-known promise yet, mostly due to the fact that they are not perfectly suitable for the rehabilitation of neuropathologic patients. One of the main challenges hampering this goal still relies on the interface and co-dependency between the human and the machine. Nowadays, most commercial exoskeletons replay pre-defined gait patterns, whereas research exoskeletons are switching to controllers based on optimized torque profiles. In most cases, the dynamics of the human musculoskeletal system are still ignored and do not take into account the optimal conditions for inducing a positive modulation of neuromuscular activity. This is because both rehabilitation strategies are still emphasized on the macro level of the whole joint instead of focusing on the muscles’ dynamics and activity, which are the actual anatomical elements that may need to be rehabilitated. Strategies to keep the human in the loop of the exoskeleton’s control laws in real-time may help to overcome these challenges. The main purpose of the present dissertation is to make a paradigm shift in the approach on how the assistance that is given to a subject by an exoskeleton is modelled and controlled during physical rehabilitation. Therefore, in the scope of the present work, it was intended to design, concede, implement, and validate a real-time muscle-in-the-loop optimization model to find the best assistive support ratio that would induce optimal rehabilitation conditions to a specific group of impaired muscles while having a minimum impact on the other healthy muscles. The developed optimization model was implemented in the form of a plugin and was integrated on a neuromechanical model-based interface for driving a bilateral ankle exoskeleton. Experimental pilot tests evaluated the feasibility and effectiveness of the model. Results of the most significant pilots achieved EMG reductions up to 61 ± 3 % in Soleus and 41 ± 10 % in Gastrocnemius Lateralis. Moreover, results also demonstrated the efficiency of the optimization’s specific reduction on rehabilitation by looking into the muscular fatigue after each experiment. Finally, two parallel preliminary studies emerged from the pilots, which looked at muscle adaptation, after a new assistive condition had been applied, over time and at the effect of the lateral positioning of the exoskeleton’s actuators on the leg muscles.Auxiliar a locomoção humana com uma ortose robótica ainda é bastante desafiante, em grande parte devido à complexidade do sistema neuromusculoesquelético, à dinâmica variável no tempo que acompanha a adaptação motora e à singularidade da resposta de cada indivíduo à assistência dada pelo robô. Até hoje, está por cumprir a promessa inicial destes dispositivos, principalmente devido ao facto de não serem perfeitamente adequados para a reabilitação de pacientes neuropatológicos. Um dos principais desafios que dificultam esse objetivo foca-se ainda na interface e na co-dependência entre o ser humano e a máquina. Hoje em dia, a maioria dos exoesqueletos comerciais reproduz padrões de marcha predefinidos, enquanto que os exoesqueletos em investigação estão só agora a mudar para controladores com base em perfis de binário otimizados. Na maioria dos casos, a dinâmica do sistema musculoesquelético humano ainda é ignorada e não tem em consideração as condições ideais para induzir uma modulação positiva da atividade neuromuscular. Isso ocorre porque ambas as estratégias de reabilitação ainda são enfatizadas no nível macro de toda a articulação, em vez de se concentrar na dinâmica e atividade dos músculos, que são os elementos anatómicos que realmente precisam de ser reabilitados. Estratégias para manter o ser humano em loop nos comandos que controlam o exoesqueleto em tempo real podem ajudar a superar estes desafios. O principal objetivo desta dissertação é fazer uma mudança de paradigma na abordagem em como a assistência que é dada a um sujeito por um exosqueleto é modelada e controlada durante a reabilitação física. Portanto, no contexto do presente trabalho, pretendeu-se projetar, conceder, implementar e validar um modelo de otimização muscle-in-the-loop em tempo real para encontrar a melhor relação de suporte capaz de induzir as condições ideais de reabilitação para um grupo específico de músculos fragilizados, tendo um impacto mínimo nos outros músculos saudáveis. O modelo de otimização desenvolvido foi implementado na forma de um plugin e foi integrado numa interface baseada num modelo neuromecânico para o controlo de um exoesqueleto bilateral de tornozelo. Testes experimentais piloto avaliaram a viabilidade e a eficácia do modelo. Os resultados dos testes mais significativos demonstraram reduções de EMG de até 61 ± 3 % no Soleus e 41 ± 10 % no Gastrocnemius Lateral. Adicionalmente, os resultados demonstraram também a eficiência em reabilitação da redução específica no EMG devido à otimização tendo em conta a fadiga muscular após cada teste. Finalmente, dois estudos preliminares paralelos emergiram dos testes piloto, que analisaram a adaptação muscular após uma nova condição assistiva ter sido definida ao longo do tempo e o efeito do posicionamento lateral dos atuadores do exoesqueleto nos músculos da perna.Mestrado em Engenharia Biomédic

Machine Performers: Agents in a Multiple Ontological State

In this thesis, the author explores and develops new attributes for machine performers and merges the trans-disciplinary fields of the performing arts and artificial intelligence. The main aim is to redefine the term “embodiment” for robots on the stage and to demonstrate that this term requires broadening in various fields of research. This redefining has required a multifaceted theoretical analysis of embodiment in the field of artificial intelligence (e.g. the uncanny valley), as well as the construction of new robots for the stage by the author. It is hoped that these practical experimental examples will generate more research by others in similar fields. Even though the historical lineage of robotics is engraved with theatrical strategies and dramaturgy, further application of constructive principles from the performing arts and evidence from psychology and neurology can shift the perception of robotic agents both on stage and in other cultural environments. In this light, the relation between representation, movement and behaviour of bodies has been further explored to establish links between constructed bodies (as in artificial intelligence) and perceived bodies (as performers on the theatrical stage). In the course of this research, several practical works have been designed and built, and subsequently presented to live audiences and research communities. Audience reactions have been analysed with surveys and discussions. Interviews have also been conducted with choreographers, curators and scientists about the value of machine performers. The main conclusions from this study are that fakery and mystification can be used as persuasive elements to enhance agency. Morphologies can also be applied that tightly couple brain and sensorimotor actions and lead to a stronger stage presence. In fact, if this lack of presence is left out of human replicants, it causes an “uncanny” lack of agency. Furthermore, the addition of stage presence leads to stronger identification from audiences, even for bodies dissimilar to their own. The author demonstrates that audience reactions are enhanced by building these effects into machine body structures: rather than identification through mimicry, this causes them to have more unambiguously biological associations. Alongside these traits, atmospheres such as those created by a cast of machine performers tend to cause even more intensely visceral responses. In this thesis, “embodiment” has emerged as a paradigm shift – as well as within this shift – and morphological computing has been explored as a method to deepen this visceral immersion. Therefore, this dissertation considers and builds machine performers as “true” performers for the stage, rather than mere objects with an aura. Their singular and customized embodiment can enable the development of non-anthropocentric performances that encompass the abstract and conceptual patterns in motion and generate – as from human performers – empathy, identification and experiential reactions in live audiences

Error minimising gradients for improving cerebellar model articulation controller performance

In motion control applications where the desired trajectory velocity exceeds an actuator’s maximum velocity limitations, large position errors will occur between the desired and actual trajectory responses. In these situations standard control approaches cannot predict the output saturation of the actuator and thus the associated error summation cannot be minimised.An adaptive feedforward control solution such as the Cerebellar Model Articulation Controller (CMAC) is able to provide an inherent level of prediction for these situations, moving the system output in the direction of the excessive desired velocity before actuator saturation occurs. However the pre-empting level of a CMAC is not adaptive, and thus the optimal point in time to start moving the system output in the direction of the excessive desired velocity remains unsolved. While the CMAC can adaptively minimise an actuator’s position error, the minimisation of the summation of error over time created by the divergence of the desired and actual trajectory responses requires an additional adaptive level of control.This thesis presents an improved method of training CMACs to minimise the summation of error over time created when the desired trajectory velocity exceeds the actuator’s maximum velocity limitations. This improved method called the Error Minimising Gradient Controller (EMGC) is able to adaptively modify a CMAC’s training signal so that the CMAC will start to move the output of the system in the direction of the excessive desired velocity with an optimised pre-empting level.The EMGC was originally created to minimise the loss of linguistic information conveyed through an actuated series of concatenated hand sign gestures reproducing deafblind sign language. The EMGC concept however is able to be implemented on any system where the error summation associated with excessive desired velocities needs to be minimised, with the EMGC producing an improved output approximation over using a CMAC alone.In this thesis, the EMGC was tested and benchmarked against a feedforward / feedback combined controller using a CMAC and PID controller. The EMGC was tested on an air-muscle actuator for a variety of situations comprising of a position discontinuity in a continuous desired trajectory. Tested situations included various discontinuity magnitudes together with varying approach and departure gradient profiles.Testing demonstrated that the addition of an EMGC can reduce a situation’s error summation magnitude if the base CMAC controller has not already provided a prior enough pre-empting output in the direction of the situation. The addition of an EMGC to a CMAC produces an improved approximation of reproduced motion trajectories, not only minimising position error for a single sampling instance, but also over time for periodic signals