Online control of a mobility assistance smart walker

Dissertação de mestrado integrado em Engenharia BiomédicaThis work presents the NeoASAS project that was developed at the Bioengineering Group, Consejo Superior de Investigaciones Cientificas (CSIC) in Madrid. Further, it continued with adaptations and improvements at Minho University with the Adaptive System Behavior Group (ASBG) in Guimarães, being designated by ASBGo Project. These developments include the conceptual design, implementation and validation of Smart Walkers with a new interface approach integrated into these devices. This interface is based on a joystick and it is intended to extract the user’s movement intentions. It was designed to be user-friendly and efficient, meeting usability aspects and focused on a commercial implementation, but not being demanding at the user cognitive level. Considering the ASBGo walker, the overall assemblage, mechanical adjustments, electronics and computing have been performed. First, a review about the mobility assistive devices is presented, specially focused on Smart Walkers. Despite the intensive research, in current literature, there are not many works providing a "point of the situation", and explaining the role that robotics can play in this domain. Healthy users performed preliminary sets of experiments with each walker, which showed the sensibility of the joystick to extract command intentions from the user. These signals presented a higher frequency component that was attenuated by a Benedict-Bordner g-h filter, considering the NeoASAS walker and by a Butterworth circuit, considering the ASBGo walker. These methodologies offer a cancelation of the undesired components from joystick data, allowing the system to extract in real-time user’s commands. Based on this identification, an approach to the control architecture based on a fuzzy logic algorithm was developed, in order to allow the control of the walkers’ motors. In addition, a set of sensors were integrated on the walker for safety reasons: an infrared sensor to detect if the user is falling forwards; two force sensors to make sure that the user is properly grabbing the hand support; and two force sensors in the support forearms to verify if the user is with his forearms properly supported. This will make sure that the device stops when one of these situations happens. Thus, an assistive device to provide safety and natural manoeuvrability was conceived and offers a certain degree of intelligence in assistance and decision-making. These results will be used to advance towards a commercial product with an affordable cost, but presenting high reliability and safety. The motivation is that this will contribute to improve rehabilitation purposes by promoting ambulatory daily exercises and thus extend users’ independent living.Este trabalho apresenta o projecto NeoASAS desenvolvido no Grupo de Bioengenharia, do Consejo Superior de Investigaciones Cientificas (CSIC) em Madrid. Este teve continuidade com adaptações e melhorias na Universidade do Minho com o grupo Adaptative System Behaviour (ASBG) em Guimarães, sendo designado por projecto ASBGo. Estes desenvolvimentos incluem o projecto concetual, implementação e validação de andarilhos inteligentes com uma nova interface integrada nestes dispositivos. Esta interface é baseada num joystick e tem como objetivo a extração de intenções de comando do utilizador, sendo intuitiva e eficiente. Atende a aspectos de usabilidade e está focada numa aplicação comercial, não sendo exigente a nível cognitivo. Considerando o andarilho ASBGo, foi realizada a construção deste, bem como, ajustes mecânicos, eletrónicos e programação. É apresentada uma revisão sobre os dispositivos de assistência à marcha, tendo especial enfoque os andarilhos. Apesar da intensa investigação, na literatura não existem trabalhos que apresentem o ponto de situação desta área, bem como o seu papel na robótica de reabilitação. Depois foram realizados testes com utilizadores, mostrando a sensibilidade que o joytick tem na identificação de inteções de comando do utilizador. Além disso, os sinais apresentam uma componente de alta frequência que foi atenuada, no caso do NeoASAS, com um filtro g-h Benedict-Bordner, e no caso do ASBGo, através de um filtro Butterworth implementado em hardware. As metodologias apresentadas oferecem um cancelamento componentes indesejáveis, permitindo ao sistema a extração das intenções de comando do utilizador em tempo real. Desta forma, uma arquitetura de controlo baseada em fuzzy logic foi desenvolvida de maneira a fornecer uma assistência segura ao utilizador, através do controlo dos motores. Foram também integrados um conjunto de sensores no andarilho por razões de segurança: um sensor infravermelho para detetar a queda frontal do utilizador, dois sensores de força nos apoios de mão para detetar se o utilizador está a agarrá-los, e dois sensores de força nos suportes de antebraço para certificar que o utilizador está devidamente apoiado. Assim, foi concebido um dispositivo que garante a segurança do utilizador e oferece um certo grau de inteligência e tomada de decisão. Estes resultados serão utilizados para a criação de um produto comercial com custo acessível, mas com alta confiabilidade. A motivação deste trabalho reflete-se na contribuição que este dispositivo terá na melhoria da reabilitação e desenvolvimento de dispositivos ambulatórios para promover exercicios diários, e melhorar a vida dos utilizadores

Advances in Robot Navigation

Robot navigation includes different interrelated activities such as perception - obtaining and interpreting sensory information; exploration - the strategy that guides the robot to select the next direction to go; mapping - the construction of a spatial representation by using the sensory information perceived; localization - the strategy to estimate the robot position within the spatial map; path planning - the strategy to find a path towards a goal location being optimal or not; and path execution, where motor actions are determined and adapted to environmental changes. This book integrates results from the research work of authors all over the world, addressing the abovementioned activities and analyzing the critical implications of dealing with dynamic environments. Different solutions providing adaptive navigation are taken from nature inspiration, and diverse applications are described in the context of an important field of study: social robotics

Classificação de pacientes para adaptação de cadeira de rodas inteligente

Doutoramento em Engenharia InformáticaA importância e preocupação dedicadas à autonomia e independência das pessoas idosas e dos pacientes que sofrem de algum tipo de deficiência tem vindo a aumentar significativamente ao longo das últimas décadas. As cadeiras de rodas inteligentes (CRI) são tecnologias que podem ajudar este tipo de população a aumentar a sua autonomia, sendo atualmente uma área de investigação bastante ativa. Contudo, a adaptação das CRIs a pacientes específicos e a realização de experiências com utilizadores reais são assuntos de estudo ainda muito pouco aprofundados. A cadeira de rodas inteligente, desenvolvida no âmbito do Projeto IntellWheels, é controlada a alto nível utilizando uma interface multimodal flexível, recorrendo a comandos de voz, expressões faciais, movimentos de cabeça e através de joystick. Este trabalho teve como finalidade a adaptação automática da CRI atendendo às características dos potenciais utilizadores. Foi desenvolvida uma metodologia capaz de criar um modelo do utilizador. A investigação foi baseada num sistema de recolha de dados que permite obter e armazenar dados de voz, expressões faciais, movimentos de cabeça e do corpo dos pacientes. A utilização da CRI pode ser efetuada em diferentes situações em ambiente real e simulado e um jogo sério foi desenvolvido permitindo especificar um conjunto de tarefas a ser realizado pelos utilizadores. Os dados foram analisados recorrendo a métodos de extração de conhecimento, de modo a obter o modelo dos utilizadores. Usando os resultados obtidos pelo sistema de classificação, foi criada uma metodologia que permite selecionar a melhor interface e linguagem de comando da cadeira para cada utilizador. A avaliação para validação da abordagem foi realizada no âmbito do Projeto FCT/RIPD/ADA/109636/2009 - "IntellWheels - Intelligent Wheelchair with Flexible Multimodal Interface". As experiências envolveram um vasto conjunto de indivíduos que sofrem de diversos níveis de deficiência, em estreita colaboração com a Escola Superior de Tecnologia de Saúde do Porto e a Associação do Porto de Paralisia Cerebral. Os dados recolhidos através das experiências de navegação na CRI foram acompanhados por questionários preenchidos pelos utilizadores. Estes dados foram analisados estatisticamente, a fim de provar a eficácia e usabilidade na adequação da interface da CRI ao utilizador. Os resultados mostraram, em ambiente simulado, um valor de usabilidade do sistema de 67, baseado na opinião de uma amostra de pacientes que apresentam os graus IV e V (os mais severos) de Paralisia Cerebral. Foi também demonstrado estatisticamente que a interface atribuída automaticamente pela ferramenta tem uma avaliação superior à sugerida pelos técnicos de Terapia Ocupacional, mostrando a possibilidade de atribuir automaticamente uma linguagem de comando adaptada a cada utilizador. Experiências realizadas com distintos modos de controlo revelaram a preferência dos utilizadores por um controlo compartilhado com um nível de ajuda associado ao nível de constrangimento do paciente. Em conclusão, este trabalho demonstra que é possível adaptar automaticamente uma CRI ao utilizador com claros benefícios a nível de usabilidade e segurança.The importance and concern given to the autonomy and independence of elderly people and patients suffering from some kind of disability has been growing significantly in the last few decades. Intelligent wheelchairs (IW) are technologies that can increase the autonomy and independence of this kind of population and are nowadays a very active research area. However, the adaptations to users’ specificities and experiments with real users are topics that lack deeper studies. The intelligent wheelchair, developed in the context of the IntellWheels project, is controlled at a high-level through a flexible multimodal interface, using voice commands, facial expressions, head movements and joystick as its main input modalities. This work intended to develop a system enabling the automatic adaptation, to the user characteristics, of the previously developed intelligent wheelchair. A methodology was created enabling the creation of a user model. The research was based on the development of a data gathering system, enabling the collection and storage of data from voice commands, facial expressions, head and body movements from several patients with distinct disabilities such as Cerebral Palsy. The wheelchair can be used in different situations in real and simulated environments and a serious game was developed where different tasks may be performed by users. Data was analysed using knowledge discovery methods in order to create an automatic patient classification system. Based on the classification system, a methodology was developed enabling to select the best wheelchair interface and command language for each patient. Evaluation was performed in the context of Project FCT/RIPD/ADA/109636/ 2009 – “IntellWheels – Intelligent Wheelchair with Flexible Multimodal Interface”. Experiments were conducted, using a large set of patients suffering from severe physical constraints in close collaboration with Escola Superior de Tecnologia de Saúde do Porto and Associação do Porto de Paralisia Cerebral. The experiments using the intelligent wheelchair were followed by user questionnaires. The results were statistically analysed in order to prove the effectiveness and usability of the adaptation of the Intelligent Wheelchair multimodal interface to the user characteristics. The results obtained in a simulated environment showed a 67 score on the system usability scale based in the opinion of a sample of cerebral palsy patients with the most severe cases IV and V of the Gross Motor Function Scale. It was also statistically demonstrated that the data analysis system advised the use of an adapted interface with higher evaluation than the one suggested by the occupational therapists, showing the usefulness of defining a command language adapted to each user. Experiments conducted with distinct control modes revealed the users' preference for a shared control with an aid level taking into account the level of constraint of the patient. In conclusion, this work demonstrates that it is possible to adapt an intelligent wheelchair to the user with clear usability and safety benefits

Climbing and Walking Robots

With the advancement of technology, new exciting approaches enable us to render mobile robotic systems more versatile, robust and cost-efficient. Some researchers combine climbing and walking techniques with a modular approach, a reconfigurable approach, or a swarm approach to realize novel prototypes as flexible mobile robotic platforms featuring all necessary locomotion capabilities. The purpose of this book is to provide an overview of the latest wide-range achievements in climbing and walking robotic technology to researchers, scientists, and engineers throughout the world. Different aspects including control simulation, locomotion realization, methodology, and system integration are presented from the scientific and from the technical point of view. This book consists of two main parts, one dealing with walking robots, the second with climbing robots. The content is also grouped by theoretical research and applicative realization. Every chapter offers a considerable amount of interesting and useful information

Effort reduction and collision avoidance for powered wheelchairs : SCAD assistive mobility system

The new research described in this dissertation created systems and methods to assist wheelchair users and provide them with new realistic and interesting driving opportunities. The work also created and applied novel effort reduction and collision avoidance systems and some new electronic interactive devices. A Scanning Collision Avoidance Device (SCAD) was created that attached to standard powered wheelchairs to help prevent children from driving into things. Initially, mechanical bumpers were used but they made many wheelchairs unwieldy, so a novel system that rotated a single ultra-sonic transducer was created. The SCAD provided wheelchair guidance and assisted with steering. Optical side object detectors were included to cover blind spots and also assist with doorway navigation. A steering lockout mode was also included for training, which stopped the wheelchair from driving towards a detected object. Some drivers did not have sufficient manual dexterity to operate a reverse control. A reverse turn manoeuvring mode was added that applied a sequential reverse and turn function, enabling a driver to escape from a confined situation by operating a single turn control. A new generation of Proportional SCAD was created that operated with proportional control inputs rather than switches and new systems were created to reduce veer, including effort reduction systems. New variable switches were created that provided variable speed control in place of standard digital switches and all that research reduced the number of control actions required by a driver. Finally, some new systems were created to motivate individuals to try new activities. These included a track guided train and an adventure playground that including new interactive systems. The research was initially inspired by the needs of young people at Chailey Heritage, the novel systems provided new and more autonomous driving opportunities for many powered wheelchair users in less structured environments.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Advances in Human-Robot Interaction

Rapid advances in the field of robotics have made it possible to use robots not just in industrial automation but also in entertainment, rehabilitation, and home service. Since robots will likely affect many aspects of human existence, fundamental questions of human-robot interaction must be formulated and, if at all possible, resolved. Some of these questions are addressed in this collection of papers by leading HRI researchers