Instrumentation and validation of a robotic cane for transportation and fall prevention in patients with affected mobility

Dissertação de mestrado integrado em Engenharia Física, (especialização em Dispositivos, Microssistemas e Nanotecnologias)O ato de andar é conhecido por ser a forma primitiva de locomoção do ser humano, sendo que este traz muitos benefícios que motivam um estilo de vida saudável e ativo. No entanto, há condições de saúde que dificultam a realização da marcha, o que por consequência pode resultar num agravamento da saúde, e adicionalmente, levar a um maior risco de quedas. Nesse sentido, o desenvolvimento de um sistema de deteção e prevenção de quedas, integrado num dispositivo auxiliar de marcha, seria essencial para reduzir estes eventos de quedas e melhorar a qualidade de vida das pessoas. Para ultrapassar estas necessidades e limitações, esta dissertação tem como objetivo validar e instrumentar uma bengala robótica, denominada Anti-fall Robotic Cane (ARCane), concebida para incorporar um sistema de deteção de quedas e um mecanismo de atuação que possibilite a prevenção de quedas, ao mesmo tempo que assiste a marcha. Para esse fim, foi realizada uma revisão do estado da arte em bengalas robóticas para adquirir um conhecimento amplo e aprofundado dos componentes, mecanismos e estratégias utilizadas, bem como os protocolos experimentais, principais resultados, limitações e desafios em dispositivos existentes. Numa primeira fase, foi estipulado o objetivo de: (i) adaptar a missão do produto; (ii) estudar as necessidades do consumidor; e (iii) atualizar as especificações alvo da ARCane, continuação do trabalho de equipa, para obter um produto com design e engenharia compatível com o mercado. Foi depois estabelecida a arquitetura de hardware e discutidos os componentes a ser instrumentados na ARCane. Em seguida foram realizados testes de interoperabilidade a fim de validar o funcionamento singular e coletivo dos componentes. Relativamente ao controlo de movimento, foi desenvolvido um sistema inovador, de baixo custo e intuitivo, capaz de detetar a intenção do movimento e de reconhecer as fases da marcha do utilizador. Esta implementação foi validada com seis voluntários saudáveis que realizaram testes de marcha com a ARCane para testar sua operabilidade num ambiente de contexto real. Obteve-se uma precisão de 97% e de 90% em relação à deteção da intenção de movimento e ao reconhecimento da fase da marcha do utilizador. Por fim, foi projetado um método de deteção de quedas e mecanismo de prevenção de quedas para futura implementação na ARCane. Foi ainda proposta uma melhoria do método de deteção de quedas, de modo a superar as limitações associadas, bem como a proposta de dispositivos de deteção a serem implementados na ARCane para obter um sistema completo de deteção de quedas.The act of walking is known to be the primitive form of the human being, and it brings many benefits that motivate a healthy and active lifestyle. However, there are health conditions that make walking difficult, which, consequently, can result in worse health and, in addition, lead to a greater risk of falls. Thus, the development of a fall detection and prevention system integrated with a walking aid would be essential to reduce these fall events and improve people quality of life. To overcome these needs and limitations, this dissertation aims to validate and instrument a cane-type robot, called Anti-fall Robotic Cane (ARCane), designed to incorporate a fall detection system and an actuation mechanism that allow the prevention of falls, while assisting the gait. Therefore, a State-of-the-Art review concerning robotic canes was carried out to acquire a broad and in-depth knowledge of the used components, mechanisms and strategies, as well as the experimental protocols, main results, limitations and challenges on existing devices. On a first stage, it was set an objective to (i) enhance the product's mission statement; (ii) study the consumer needs; and (iii) update the target specifications of the ARCane, extending teamwork, to obtain a product with a market-compatible design and engineering that meets the needs and desires of the ARCane users. It was then established the hardware architecture of the ARCane and discussed the electronic components that will instrument the control, sensory, actuator and power units, being afterwards subjected to interoperability tests to validate the singular and collective functioning of cane components altogether. Regarding the motion control of robotic canes, an innovative, cost-effective and intuitive motion control system was developed, providing user movement intention recognition, and identification of the user's gait phases. This implementation was validated with six healthy volunteers who carried out gait trials with the ARCane, in order to test its operability in a real context environment. An accuracy of 97% was achieved for user motion intention recognition and 90% for user gait phase recognition, using the proposed motion control system. Finally, it was idealized a fall detection method and fall prevention mechanism for a future implementation in the ARCane, based on methods applied to robotic canes in the literature. It was also proposed an improvement of the fall detection method in order to overcome its associated limitations, as well as detection devices to be implemented into the ARCane to achieve a complete fall detection system

Implementation of target tracking in Smart Wheelchair Component System

Independent mobility is critical to individuals of any age. While the needs of many individuals with disabilities can be satisfied with power wheelchairs, some members of the disabled community find it difficult or impossible to operate a standard power wheelchair. This population includes, but is not limited to, individuals with low vision, visual field neglect, spasticity, tremors, or cognitive deficits. To meet the needs of this population, our group is involved in developing cost effective modularly designed Smart Wheelchairs. Our objective is to develop an assistive navigation system which will seamlessly integrate into the lifestyle of individual with disabilities and provide safe and independent mobility and navigation without imposing an excessive physical or cognitive load. The Smart Wheelchair Component System (SWCS) can be added to a variety of commercial power wheelchairs with minimal modification to provide navigation assistance. Previous versions of the SWCS used acoustic and infrared rangefinders to identify and avoid obstacles, but these sensors do not lend themselves to many desirable higher-level behaviors. To achieve these higher level behaviors we integrated a Continuously Adapted Mean Shift (CAMSHIFT) target tracking algorithm into the SWCS, along with the Minimal Vector Field Histogram (MVFH) obstacle avoidance algorithm. The target tracking algorithm provides the basis for two distinct operating modes: (1) a "follow-the-leader" mode, and (2) a "move to stationary target" mode.The ability to track a stationary or moving target will make smart wheelchairs more useful as a mobility aid, and is also expected to be useful for wheeled mobility training and evaluation. In addition to wheelchair users, the caregivers, clinicians, and transporters who provide assistance to wheelchair users will also realize beneficial effects of providing safe and independent mobility to wheelchair users which will reduce the level of assistance needed by wheelchair users

A survey on bio-signal analysis for human-robot interaction

The use of bio-signals analysis in human-robot interaction is rapidly increasing. There is an urgent demand for it in various applications, including health care, rehabilitation, research, technology, and manufacturing. Despite several state-of-the-art bio-signals analyses in human-robot interaction (HRI) research, it is unclear which one is the best. In this paper, the following topics will be discussed: robotic systems should be given priority in the rehabilitation and aid of amputees and disabled people; second, domains of feature extraction approaches now in use, which are divided into three main sections (time, frequency, and time-frequency). The various domains will be discussed, then a discussion of each domain's benefits and drawbacks, and finally, a recommendation for a new strategy for robotic systems

An Incremental Navigation Localization Methodology for Application to Semi-Autonomous Mobile Robotic Platforms to Assist Individuals Having Severe Motor Disabilities.

In the present work, the author explores the issues surrounding the design and development of an intelligent wheelchair platform incorporating the semi-autonomous system paradigm, to meet the needs of individuals with severe motor disabilities. The author presents a discussion of the problems of navigation that must be solved before any system of this type can be instantiated, and enumerates the general design issues that must be addressed by the designers of systems of this type. This discussion includes reviews of various methodologies that have been proposed as solutions to the problems considered. Next, the author introduces a new navigation method, called Incremental Signature Recognition (ISR), for use by semi-autonomous systems in structured environments. This method is based on the recognition, recording, and tracking of environmental discontinuities: sensor reported anomalies in measured environmental parameters. The author then proposes a robust, redundant, dynamic, self-diagnosing sensing methodology for detecting and compensating for hidden failures of single sensors and sensor idiosyncrasies. This technique is optimized for the detection of spatial discontinuity anomalies. Finally, the author gives details of an effort to realize a prototype ISR based system, along with insights into the various implementation choices made

Design and Control of a Knee Exoskeleton for Assistance and Power Augmentation

Thanks to the technological advancements, assistive lower limb exoskeletons are moving from laboratory settings to daily life scenarios. This dissertation makes a contribution toward the development of assistive/power augmentation knee exoskeletons with an improved wearability, ergonomics and intuitive use. In particular, the design and the control of a novel knee exoskeleton system, the iT-Knee Bipedal System, is presented. It is composed by: a novel mechanism to transmit the assistance generated by the exoskeleton to the knee joint in a more ergonomic manner; a novel method that requires limited information to estimate online the torques experienced by the ankles, knees and hips of a person wearing the exoskeleton; a novel sensor system for shoes able to track the feet orientation and monitor their full contact wrench with the ground. In particular, the iT-Knee exoskeleton, the main component of the aforementioned system, is introduced. It is a novel six degree of freedom knee exoskeleton module with under-actuated kinematics, able to assist the flexion/extension motion of the knee while all the other joint\u2019s movements are accommodated. Thanks to its mechanism, the system: solves the problem of the alignment between the joint of the user and the exoskeleton; it automatically adjusts to different users\u2019 size; reduces the undesired forces and torques exchanged between the attachment points of its structure and the user\u2019s skin. From a control point of view, a novel approach to address difficulties arising in real life scenarios (i.e. noncyclic locomotion activity, unexpected terrain or unpredicted interactions with the surroundings) is presented. It is based on a method that estimates online the torques experienced by a person at his ankles, knees and hips with the major advantage that does not rely on any information of the user\u2019s upper body (i.e. pose, weight and center of mass location) or on any interaction of the user\u2019s upper body with the environment (i.e. payload handling or pushing and pulling task). This is achieved v by monitoring the full contact wrench of the subject with the ground and applying an inverse dynamic approach to the lower body segments. To track the full contact wrench between the subject\u2019s feet and the ground, a novel add on system for shoes has been developed. The iT-Shoe is adjustable to different user\u2019s size and accommodates the plantar flexion of the foot. It tracks the interactions and the orientation of the foot thanks to two 6axis Force/Torque sensors, developed in-house, with dedicated embedded MEMS IMUs placed at the toe and heel area. Different tasks and ground conditions were tested to validate and highlight the potentiality of the proposed knee exoskeleton system. The experimental results obtained and the feedback collected confirm the validity of the research conducted toward the design of more ergonomic and intuitive to use exoskeletons

IMPORTANT FACTORS IN THE DESIGN OF ASSISTIVE TECHNOLOGY TO AVOID THE STIGMATIZATION OF USERS

abstract: Some disabled users of assistive technologies (AT) have expressed concerns that their use of those AT devices brings particular attention to their disability and, in doing so, stigmatizes them in the eyes of their peers. This research studies how a wide range of design factors, influence how positively or negatively users of wearable technologies are perceived, by others. These factors are studied by asking survey respondents to estimate the degree to which they perceive disabilities in users of various products. The survey was given to 34 undergraduate Product Design students, and employed 40 pictures, each of which showed one person using a product. Some of these products were assistive technology devices, and some were not. Respondents used a five-bubble Likert scale to indicate the level of disability that they perceived in this person. Data analysis was done using SPSS software. The results showed that the gender of the respondent was not a significant factor in the respondent's estimation of the level of disability. However, the cultural background of the respondent was found to be significant in the respondent's estimates of disability for seven of the 40 pictures. The results also indicated that the size of AT, its familiarity to the mainstream population, its wearable location on the user's body, the perceived power of the user, the degree to which the AT device seemed to empower the user, the degree to which the AT device was seen as a vehicle for assertion of the user's individuality, and the successfulness of attempts to disguise the AT as some mainstream product reduced the perceived disability of the user. In contrast, symbols or stereotypes of disability, obstructing visibility of the face, an awkward complex design, a mismatch between the product's design and its context of use, and covering of the head were factors that focused attention on, and increased the perception of, the user's disability. These factors are summarized in a set of guidelines to help AT designers develop products that minimize the perceived disability and the resulting stigmatization of the user.Dissertation/ThesisM.S.D. Design 201

Mechanisms of energy optimization in human walking

Humans can learn to move optimally. For many movements, we have a control strategy—or control policy—that optimizes some objective. In walking, we prefer the combination of step widths, step lengths, and speeds that optimizes the amount of energy we need. In familiar contexts, we have had many opportunities to establish this optimal control policy. But in new contexts, the nervous system must quickly learn new control policies in order to continue to move optimally. Our lab has recently demonstrated that humans can continuously optimize energetic cost during walking. This is an impressive feat given that the nervous system has tens of thousands of motor units at its disposal, and it can coordinate these motor units over millisecond timescales, which results in countless combinations of motor unit coordination. The goal of this thesis is to determine how the nervous system navigates this combinatorial problem to learn new energy optimal control policies in new walking contexts. I used three distinct studies to accomplish this goal. For the first two studies, I designed and implemented a simple mechatronic system that applies energetic penalties in the form of walking incline as a function of gait. This creates a new relationship between gait and energetic cost—or new cost landscape—that shifts the energy optimal gait. For the third study, I used exoskeletons that apply assistive torques to each ankle at each walking step to shift the energy optimal gait. The first study tested whether previous findings that people can learn to adapt their control policy when the energy optimum is shifted along step frequency generalize to a different gait parameter and to a different experimental setup. I found that, like step frequency, people can learn to adapt their control policy when the energy optimum is shifted along step width. The second study tested if and how energy optimization extends to multiple gait parameters at the same time. I found that, when the energy optimum is shifted along step width and step frequency, people are limited in their ability to optimize both gait parameters. The third study asked how people learn in which ways to optimize their policy. I found that general variability leads to specific adaptation toward optimal policies. Taken together, these findings provide insight into the mechanisms that underlie energy optimization in walking, as well as the limitations of this optimization

A hybrid brain-computer interface based on motor intention and visual working memory

Non-invasive electroencephalography (EEG) based brain-computer interface (BCI) is able to provide alternative means for people with disabilities to communicate with and control over external assistive devices. A hybrid BCI is designed and developed for following two types of system (control and monitor). Our first goal is to create a signal decoding strategy that allows people with limited motor control to have more command over potential prosthetic devices. Eight healthy subjects were recruited to perform visual cues directed reaching tasks. Eye and motion artifacts were identified and removed to ensure that the subjects\u27 visual fixation to the target locations would have little or no impact on the final result. We applied a Fisher Linear Discriminate (FLD) analysis for single-trial classification of the EEG to decode the intended arm movement in the left, right, and forward directions (before the onsets of actual movements). The mean EEG signal amplitude near the PPC region 271-310 ms after visual stimulation was found to be the dominant feature for best classification results. A signal scaling factor developed was found to improve the classification accuracy from 60.11% to 93.91% in the two-class (left versus right) scenario. This result demonstrated great promises for BCI neuroprosthetics applications, as motor intention decoding can be served as a prelude to the classification of imagined motor movement to assist in motor disable rehabilitation, such as prosthetic limb or wheelchair control. The second goal is to develop the adaptive training for patients with low visual working memory (VWM) capacity to improve cognitive abilities and healthy individuals who seek to enhance their intellectual performance. VWM plays a critical role in preserving and processing information. It is associated with attention, perception and reasoning, and its capacity can be used as a predictor of cognitive abilities. Recent evidence has suggested that with training, one can enhance the VWM capacity and attention over time. Not only can these studies reveal the characteristics of VWM load and the influences of training, they may also provide effective rehabilitative means for patients with low VWM capacity. However, few studies have investigated VWM over a long period of time, beyond 5-weeks. In this study, a combined behavioral approach and EEG was used to investigate VWM load, gain, and transfer. The results reveal that VWM capacity is directly correlated to the reaction time and contralateral delay amplitude (CDA). The approximate magic number 4 was observed through the event-related potentials (ERPs) waveforms, where the average capacity is 2.8-item from 15 participants. In addition, the findings indicate that VWM capacity can be improved through adaptive training. Furthermore, after training exercises, participants from the training group are able to improve their performance accuracies dramatically compared to the control group. Adaptive training gains on non-trained tasks can also be observed at 12 weeks after training. Therefore, we conclude that all participants can benefit from training gains, and augmented VWM capacity can be sustained over a long period of time. Our results suggest that this form of training can significantly improve cognitive function and may be useful for enhancing the user performance on neuroprosthetics device