40 research outputs found

    An Evolutionary Perspective for Network Centric Therapy through Wearable and Wireless Systems for Reflex, Gait, and Movement Disorder Assessment with Machine Learning

    Get PDF
    Wearable and wireless systems have progressively evolved to achieve the capabilities of Network Centric Therapy. Network Centric Therapy comprises the application of wearable and wireless inertial sensors for the quantification of human movement, such as reflex response, gait, and movement disorders, with machine learning classification representing advanced diagnostics. With wireless access to a functional Cloud computing environment Network Centric Therapy enables subjects to be evaluated at any location of choice with Internet connectivity and expert medical post-processing resources situated anywhere in the world. The evolutionary origins leading to the presence of Network Centric Therapy are detailed. With the historical perspective and state of the art presented, future concepts are addressed

    Energy Regeneration and Environment Sensing for Robotic Leg Prostheses and Exoskeletons

    Get PDF
    Robotic leg prostheses and exoskeletons can provide powered locomotor assistance to older adults and/or persons with physical disabilities. However, limitations in automated control and energy-efficient actuation have impeded their transition from research laboratories to real-world environments. With regards to control, the current automated locomotion mode recognition systems being developed rely on mechanical, inertial, and/or neuromuscular sensors, which inherently have limited prediction horizons (i.e., analogous to walking blindfolded). Inspired by the human vision-locomotor control system, here a multi-generation environment sensing and classification system powered by computer vision and deep learning was developed to predict the oncoming walking environments prior to physical interaction, therein allowing for more accurate and robust high-level control decisions. To support this initiative, the “ExoNet” database was developed – the largest and most diverse open-source dataset of wearable camera images of indoor and outdoor real-world walking environments, which were annotated using a novel hierarchical labelling architecture. Over a dozen state-of-the-art deep convolutional neural networks were trained and tested on ExoNet for large-scale image classification and automatic feature engineering. The benchmarked CNN architectures and their environment classification predictions were then quantitatively evaluated and compared using an operational metric called “NetScore”, which balances the classification accuracy with the architectural and computational complexities (i.e., important for onboard real-time inference with mobile computing devices). Of the benchmarked CNN architectures, the EfficientNetB0 network achieved the highest test accuracy; VGG16 the fastest inference time; and MobileNetV2 the best NetScore. These comparative results can inform the optimal architecture design or selection depending on the desired performance of an environment classification system. With regards to energetics, backdriveable actuators with energy regeneration can improve the energy efficiency and extend the battery-powered operating durations by converting some of the otherwise dissipated energy during negative mechanical work into electrical energy. However, the evaluation and control of these regenerative actuators has focused on steady-state level-ground walking. To encompass real-world community mobility more broadly, here an energy regeneration system, featuring mathematical and computational models of human and wearable robotic systems, was developed to simulate energy regeneration and storage during other locomotor activities of daily living, specifically stand-to-sit movements. Parameter identification and inverse dynamic simulations of subject-specific optimized biomechanical models were used to calculate the negative joint mechanical work and power while sitting down (i.e., the mechanical energy theoretically available for electrical energy regeneration). These joint mechanical energetics were then used to simulate a robotic exoskeleton being backdriven and regenerating energy. An empirical characterization of an exoskeleton was carried out using a joint dynamometer system and an electromechanical motor model to calculate the actuator efficiency and to simulate energy regeneration and storage with the exoskeleton parameters. The performance calculations showed that regenerating electrical energy during stand-to-sit movements provide small improvements in energy efficiency and battery-powered operating durations. In summary, this research involved the development and evaluation of environment classification and energy regeneration systems to improve the automated control and energy-efficient actuation of next-generation robotic leg prostheses and exoskeletons for real-world locomotor assistance

    Data and Sensor Fusion Using FMG, sEMG and IMU Sensors for Upper Limb Prosthesis Control

    Get PDF
    Whether someone is born with a missing limb or an amputation occurs later in life, living with this disability can be extremely challenging. The robotic prosthetic devices available today are capable of giving users more functionality, but the methods available to control these prostheses restrict their use to simple actions, and are part of the reason why users often reject prosthetic technologies. Using multiple myography modalities has been a promising approach to address these control limitations; however, only two myography modalities have been rigorously tested so far, and while the results have shown improvements, they have not been robust enough for out-of-lab use. In this work, a novel multi-modal device that allows data to be collected from three myography modalities was created. Force myography (FMG), surface electromyography (sEMG), and inertial measurement unit (IMU) sensors were integrated into a wearable armband and used to collect signal data while subjects performed gestures important for the activities of daily living. An established machine learning algorithm was used to decipher the signals to predict the user\u27s intent/gesture being held, which could be used to control a prosthetic device. Using all three modalities provided statistically-significant improvements over most other modality combinations, as it provided the most accurate and consistent classification results. This work provides justification for using three sensing modalities and future work is suggested to explore this modality combination to decipher more complex actions and tasks with more sophisticated pattern recognition algorithms

    XXII International Conference on Mechanics in Medicine and Biology - Abstracts Book

    Get PDF
    This book contain the abstracts presented the XXII ICMMB, held in Bologna in September 2022. The abstracts are divided following the sessions scheduled during the conference

    Upper extremity electromyography signal feature extraction and classification

    Get PDF

    IoT and Sensor Networks in Industry and Society

    Get PDF
    The exponential progress of Information and Communication Technology (ICT) is one of the main elements that fueled the acceleration of the globalization pace. Internet of Things (IoT), Artificial Intelligence (AI) and big data analytics are some of the key players of the digital transformation that is affecting every aspect of human's daily life, from environmental monitoring to healthcare systems, from production processes to social interactions. In less than 20 years, people's everyday life has been revolutionized, and concepts such as Smart Home, Smart Grid and Smart City have become familiar also to non-technical users. The integration of embedded systems, ubiquitous Internet access, and Machine-to-Machine (M2M) communications have paved the way for paradigms such as IoT and Cyber Physical Systems (CPS) to be also introduced in high-requirement environments such as those related to industrial processes, under the forms of Industrial Internet of Things (IIoT or I2oT) and Cyber-Physical Production Systems (CPPS). As a consequence, in 2011 the German High-Tech Strategy 2020 Action Plan for Germany first envisioned the concept of Industry 4.0, which is rapidly reshaping traditional industrial processes. The term refers to the promise to be the fourth industrial revolution. Indeed, the first industrial revolution was triggered by water and steam power. Electricity and assembly lines enabled mass production in the second industrial revolution. In the third industrial revolution, the introduction of control automation and Programmable Logic Controllers (PLCs) gave a boost to factory production. As opposed to the previous revolutions, Industry 4.0 takes advantage of Internet access, M2M communications, and deep learning not only to improve production efficiency but also to enable the so-called mass customization, i.e. the mass production of personalized products by means of modularized product design and flexible processes. Less than five years later, in January 2016, the Japanese 5th Science and Technology Basic Plan took a further step by introducing the concept of Super Smart Society or Society 5.0. According to this vision, in the upcoming future, scientific and technological innovation will guide our society into the next social revolution after the hunter-gatherer, agrarian, industrial, and information eras, which respectively represented the previous social revolutions. Society 5.0 is a human-centered society that fosters the simultaneous achievement of economic, environmental and social objectives, to ensure a high quality of life to all citizens. This information-enabled revolution aims to tackle today’s major challenges such as an ageing population, social inequalities, depopulation and constraints related to energy and the environment. Accordingly, the citizens will be experiencing impressive transformations into every aspect of their daily lives. This book offers an insight into the key technologies that are going to shape the future of industry and society. It is subdivided into five parts: the I Part presents a horizontal view of the main enabling technologies, whereas the II-V Parts offer a vertical perspective on four different environments. The I Part, dedicated to IoT and Sensor Network architectures, encompasses three Chapters. In Chapter 1, Peruzzi and Pozzebon analyse the literature on the subject of energy harvesting solutions for IoT monitoring systems and architectures based on Low-Power Wireless Area Networks (LPWAN). The Chapter does not limit the discussion to Long Range Wise Area Network (LoRaWAN), SigFox and Narrowband-IoT (NB-IoT) communication protocols, but it also includes other relevant solutions such as DASH7 and Long Term Evolution MAchine Type Communication (LTE-M). In Chapter 2, Hussein et al. discuss the development of an Internet of Things message protocol that supports multi-topic messaging. The Chapter further presents the implementation of a platform, which integrates the proposed communication protocol, based on Real Time Operating System. In Chapter 3, Li et al. investigate the heterogeneous task scheduling problem for data-intensive scenarios, to reduce the global task execution time, and consequently reducing data centers' energy consumption. The proposed approach aims to maximize the efficiency by comparing the cost between remote task execution and data migration. The II Part is dedicated to Industry 4.0, and includes two Chapters. In Chapter 4, Grecuccio et al. propose a solution to integrate IoT devices by leveraging a blockchain-enabled gateway based on Ethereum, so that they do not need to rely on centralized intermediaries and third-party services. As it is better explained in the paper, where the performance is evaluated in a food-chain traceability application, this solution is particularly beneficial in Industry 4.0 domains. Chapter 5, by De Fazio et al., addresses the issue of safety in workplaces by presenting a smart garment that integrates several low-power sensors to monitor environmental and biophysical parameters. This enables the detection of dangerous situations, so as to prevent or at least reduce the consequences of workers accidents. The III Part is made of two Chapters based on the topic of Smart Buildings. In Chapter 6, Petroșanu et al. review the literature about recent developments in the smart building sector, related to the use of supervised and unsupervised machine learning models of sensory data. The Chapter poses particular attention on enhanced sensing, energy efficiency, and optimal building management. In Chapter 7, Oh examines how much the education of prosumers about their energy consumption habits affects power consumption reduction and encourages energy conservation, sustainable living, and behavioral change, in residential environments. In this Chapter, energy consumption monitoring is made possible thanks to the use of smart plugs. Smart Transport is the subject of the IV Part, including three Chapters. In Chapter 8, Roveri et al. propose an approach that leverages the small world theory to control swarms of vehicles connected through Vehicle-to-Vehicle (V2V) communication protocols. Indeed, considering a queue dominated by short-range car-following dynamics, the Chapter demonstrates that safety and security are increased by the introduction of a few selected random long-range communications. In Chapter 9, Nitti et al. present a real time system to observe and analyze public transport passengers' mobility by tracking them throughout their journey on public transport vehicles. The system is based on the detection of the active Wi-Fi interfaces, through the analysis of Wi-Fi probe requests. In Chapter 10, Miler et al. discuss the development of a tool for the analysis and comparison of efficiency indicated by the integrated IT systems in the operational activities undertaken by Road Transport Enterprises (RTEs). The authors of this Chapter further provide a holistic evaluation of efficiency of telematics systems in RTE operational management. The book ends with the two Chapters of the V Part on Smart Environmental Monitoring. In Chapter 11, He et al. propose a Sea Surface Temperature Prediction (SSTP) model based on time-series similarity measure, multiple pattern learning and parameter optimization. In this strategy, the optimal parameters are determined by means of an improved Particle Swarm Optimization method. In Chapter 12, Tsipis et al. present a low-cost, WSN-based IoT system that seamlessly embeds a three-layered cloud/fog computing architecture, suitable for facilitating smart agricultural applications, especially those related to wildfire monitoring. We wish to thank all the authors that contributed to this book for their efforts. We express our gratitude to all reviewers for the volunteering support and precious feedback during the review process. We hope that this book provides valuable information and spurs meaningful discussion among researchers, engineers, businesspeople, and other experts about the role of new technologies into industry and society

    Mining the brain to predict gait characteristics: a BCI study

    Get PDF
    Tese de mestrado integrado em Engenharia Biomédica e Biofísica, apresentada à Universidade de Lisboa, através da Faculdade de Ciências, em 2018A locomoção é uma das atividades mais comuns e relevantes da vida quotidiana, sendo que envolve a ativação dos sistemas nervoso e músculo-esquelético. Os distúrbios da locomoção são comuns principalmente na população idosa, sendo que frequentemente estão associados a uma diminuição da qualidade de vida. A ocorrência destes distúrbios aumenta com a idade, estimando-se que aproximadamente 10% das pessoas com idades entre 60 e 69 anos sofram de algum tipo de distúrbio da locomoção, enquanto esse número aumenta para mais de 60% em pessoas com idade superior a 80 anos. Os padrões da locomoção são influenciados por doenças, condições físicas, personalidade e humor, sendo que um padrão anormal ocorre quando uma pessoa não é capaz de andar da maneira usual, maioritariamente devido a lesões, doenças ou outras condições subjacentes. As causas dos distúrbios da marcha incluem condições neurológicas e músculo-esqueléticas. Um grande número de condições neurológicas pode causar um padrão de marcha anormal, como por exemplo um acidente vascular cerebral, paralisia cerebral ou a doença de Parkinson. Por outro lado, as causas músculo-esqueléticas devem-se principalmente a doenças ósseas ou musculares. A avaliação ou análise da marcha, inclui a medição, descrição e avaliação das variáveis que caracterizam a locomoção humana. Como resultado, este estudo permite o diagnóstico de várias condições, bem como avaliar a progressão da reabilitação e desenvolver estratégias de intervenção. Convencionalmente, a marcha é estudada subjetivamente com protocolos observacionais. No entanto, recentemente foram desenvolvidos métodos mais objetivos e viáveis. Os métodos de análise da marcha podem ser classificados em laboratoriais ou portáteis. Embora a análise baseada em laboratório utilize equipamentos especializados, os sistemas portáteis permitem o estudo da marcha em ambientes naturais e durante atividades da vida diária. A análise laboratorial da marcha é baseada principalmente em informações de imagem e vídeo, embora sensores de piso e placas de força também sejam comuns. Por outro lado, os sistemas portáteis consistem em um ou vários sensores, ligados ao corpo. A adaptação da locomoção é um dos mais relevantes conceitos na análise da mesma, sendo que a sua origem e dinâmica neuronal têm sido amplamente estudadas nos últimos anos. A adaptação da marcha reflete a capacidade de um sujeito em mudar de velocidade e direção, manter o equilíbrio ou evitar obstáculos. Em termos da reabilitação neurológica, a adaptação da locomoção interfere na dinâmica neuronal, permitindo que os pacientes restaurem certas funções motoras. Atualmente, os dispositivos robóticos para membros inferiores e os exoesqueletos são cada vez mais usados não só para facilitar a reabilitação motora, mas também para apoiar as funções da vida diária. No entanto, a sua eficiência e segurança depende da sua eficácia em detetar a intenção humana de mover e adaptar a locomoção. Recentemente, foi demonstrado que o ritmo auditivo tem um forte efeito no sistema motor. Consequentemente, a adaptação tem sido estudada com base em ritmos auditivos, onde os pacientes seguem tons de estimulação para melhorar a coordenação da marcha. A imagem motora (MI), uma prática emergente em BCI, ou interface cérebro-máquina, é definida como a atividade de simular mentalmente uma determinada ação, sem a execução real do movimento. O desempenho da classificação da MI é importante para desenvolver ambientes robustos de interface cérebro-máquina, para neuro-reabilitação de pacientes e controle de próteses robóticas. O desempenho da classificação da MI é importante para desenvolver ambientes robustos de interface cérebro-máquina, para neuro-reabilitação de pacientes e controle de próteses robóticas, uma vez que, estudos anteriores, concluíram que realizar uma sessão de MI ativa parcialmente as mesmas regiões cerebrais que o desempenho da tarefa real. Inicialmente, a tarefas de MI centravam-se apenas nos movimentos dos membros superiores, no entanto, recentemente, estas começaram também a focar-se nos movimentos dos membros inferiores, de modo a estudar a locomoção humana. A deteção da intenção motora em tarefas de MI enfrenta vários desafios, mesmo para duas classes (esquerda / direita, por exemplo), sendo que um dos principais desafios se deve ao número, localização e tipo de elétrodos de EEG usados. Recentemente, um número crescente de estudos investigou a atividade cerebral durante a locomoção humana. Esses estudos, baseados maioritariamente no EEG, encontraram várias relações entre regiões cerebrais e ações ou movimentos específicos. Por exemplo, concluiu-se que a atividade cerebral aumenta durante a caminhada ou a preparação para caminhar e que a potência nas bandas μ e β diminui durante a execução voluntária do movimento. Em termos de adaptação da marcha, foi demonstrado que a atividade eletrocortical varia de acordo com a tarefa motora executada. Recentemente, as Interfaces Cérebro-Máquina permitiram o desenvolvimento de novas terapias de reabilitação para restaurar as funções motoras em pessoas com deficiências na locomoção, envolvendo o SNC para ativar dispositivos externos. Na primeira parte desta tese, foram realizadas várias tarefas de MI, juntamente com os movimentos reais dos membros inferiores, de modo a comparar o desempenho da classificação de um sistema wireless de 16 elétrodos secos com um sistema wireless de 32 elétrodos com gel condutor. A extração e classificação das características do sinal foram também avaliadas com mais de um método (LDA e CSP). No final, a combinação de um filtro beta passa-banda com um filtro RCSP mostrou a melhor taxa de classificação. Embora durante a aquisição do EEG todos os canais tenham sido utilizados, durante os métodos de processamento, foram escolhidas duas configurações específicas, onde os elétrodos foram selecionados de acordo com sua posição relativamente ao córtex motor. Desde modo, infere-se que uma seleção cuidada da localização dos elétrodos é mais importante do que ter um denso mapa de elétrodos, o que torna os sistemas EEG mais confortáveis e de fácil utilização. Os resultados mostram também a viabilidade do uso doméstico de sistemas de elétrodos secos com um reduzido número de sensores, e a possibilidade de diferenciar entre as tarefas de MI (esquerda e direita), para ambos os membros, com uma precisão relativamente alta. Por outro lado, a segunda parte desta tese apresenta um esquema de adaptação da marcha em ambientes naturais. De modo a avaliar a adaptação da marcha, os sujeitos seguem um tom rítmico que alterna entre três modos distintos (lento, normal e acelerado). As características da locomoção foram extraídas com base numa câmara RGB, sendo que os sinais de EEG foram monitorados simultaneamente. De seguida, estas características bem como as informações do tempo de reação foram utilizadas para extrair as etapas de adaptação da marcha versus etapas de não adaptação. De modo a remover os artefactos presentes no EEG, devidos maioritariamente ao movimento do sujeito, o sinal for filtrado com uma filtro passa-banda e sujeito a uma análise de componentes independentes (ICA). Posteriormente, as características de adaptação da marcha do EEG foram investigadas com base em dois problemas de classificação: i) classificação dos passos em direito ou esquerdo e ii) etapas de adaptação versus não adaptação da marcha. As características foram extraídas com base em padrões espaciais comuns (CSP) e padrões espaciais comuns regularizados (RCSP). Os resultados mostram que é possível discriminar com sucesso a adaptação versus não adaptação com mais de 90% de precisão. Este procedimento permite a monitoração dos participantes em ambientes mais realistas, sem a necessidade de equipamentos especializados, como sensores de pressão. Este método demonstrou que é possível detetar a adaptação com mais de 90% de precisão, quando os participantes tentam adaptar sua velocidade de marcha para uma velocidade maior ou menor.Gait adaptation is one of the most relevant concepts in gait analysis and its neuronal origin and dynamics has been extensively studied in the past few years. In terms of neurorehabilitation, gait adaptation perturbs neuronal dynamics and allows patients to restore some of their motor functions. In fact, lower-limbs robotic devices and exoskeletons are increasingly used to facilitate rehabilitation as well as supporting daily life functions. However, their efficiency and safety depend on how well they can detect the human intention to move and adapt the gait. Motor imagery (MI), an emerging practise in Brain Computer Interface (BCI), is defined as the activity of mentally simulating a given action, without the actual execution of the movement. MI classification performance is important in order to develop robust brain computer interface environments for neuro-rehabilitation of patients and robotic prosthesis control. In the first section of this thesis, it was performed a number of motor imagery tasks along with actual movements of the limbs to compare the classification performance of a dry 16-channel and a wet, 32-channel, wireless (Electroencephalography) EEG system. Results showed the feasibility of home use of dry electrode systems with a small number of sensors, and the possibility to discriminate between left and right MI tasks for both arms and legs, with a relatively high accuracy. The second part of this thesis presents a gait adaptation scheme in natural settings. This procedure allows the monitorization of subjects in more realistic environments without the requirement of specialized equipment such as treadmill and foot pressure sensors. Gait characteristics were extracted based on a single RGB camera, and EEG signals are monitored simultaneously. This method demonstrated that it is possible to detect adaptation steps with more than 90% accuracy, when subjects tries to adapt their walking speed to a higher or lower speed

    Proceedings of the 1st European conference on disability, virtual reality and associated technologies (ECDVRAT 1996)

    Get PDF
    The proceedings of the conferenc

    Biomechatronics: Harmonizing Mechatronic Systems with Human Beings

    Get PDF
    This eBook provides a comprehensive treatise on modern biomechatronic systems centred around human applications. A particular emphasis is given to exoskeleton designs for assistance and training with advanced interfaces in human-machine interaction. Some of these designs are validated with experimental results which the reader will find very informative as building-blocks for designing such systems. This eBook will be ideally suited to those researching in biomechatronic area with bio-feedback applications or those who are involved in high-end research on manmachine interfaces. This may also serve as a textbook for biomechatronic design at post-graduate level

    Ameliorating integrated sensor drift and imperfections: an adaptive "neural" approach

    Get PDF
    corecore