Virtual Reality Games for Motor Rehabilitation

This paper presents a fuzzy logic based method to track user satisfaction without the need for devices to monitor users physiological conditions. User satisfaction is the key to any product’s acceptance; computer applications and video games provide a unique opportunity to provide a tailored environment for each user to better suit their needs. We have implemented a non-adaptive fuzzy logic model of emotion, based on the emotional component of the Fuzzy Logic Adaptive Model of Emotion (FLAME) proposed by El-Nasr, to estimate player emotion in UnrealTournament 2004. In this paper we describe the implementation of this system and present the results of one of several play tests. Our research contradicts the current literature that suggests physiological measurements are needed. We show that it is possible to use a software only method to estimate user emotion

Intelligent signal processing for digital healthcare monitoring

Ein gesunder Gang ist ein komplexer Prozess und erfordert ein Gleichgewicht zwischen verschiedenen neurophysiologischen Systemen im Körper und gilt als wesentlicher Indikator für den physischen und kognitiven Gesundheitszustand einer Person. Folglich würden Anwendungen im Bereich der Bioinformatik und des Gesundheitswesens erheblich von den Informationen profitieren, die sich aus einer längeren oder ständigen Überwachung des Gangs, der Gewohnheiten und des Verhaltens von Personen unter ihren natürlichen Lebensbedingungen und bei ihren täglichen Aktivitäten mit Hilfe intelligenter Geräte ergeben. Vergleicht man Trägheitsmess- und stationäre Sensorsysteme, so bieten erstere hervorragende Möglichkeiten für Ganganalyseanwendungen und bieten mehrere Vorteile wie geringe Größe, niedriger Preis, Mobilität und sind leicht in tragbare Systeme zu integrieren. Die zweiten gelten als der Goldstandard, sind aber teuer und für Messungen im Freien ungeeignet. Diese Arbeit konzentriert sich auf die Verbesserung der Zeit und Qualität der Gangrehabilitation nach einer Operation unter Verwendung von Inertialmessgeräten, indem sie eine neuartige Metrik zur objektiven Bewertung des Fortschritts der Gangrehabilitation in realen Umgebungen liefert und die Anzahl der verwendeten Sensoren für praktische, reale Szenarien reduziert. Daher wurden die experimentellen Messungen für eine solche Analyse in einer stark kontrollierten Umgebung durchgeführt, um die Datenqualität zu gewährleisten. In dieser Arbeit wird eine neue Gangmetrik vorgestellt, die den Rehabilitationsfortschritt anhand kinematischer Gangdaten von Aktivitäten in Innen- und Außenbereichen quantifiziert und verfolgt. In dieser Arbeit wird untersucht, wie Signalverarbeitung und maschinelles Lernen formuliert und genutzt werden können, um robuste Methoden zur Bewältigung von Herausforderungen im realen Leben zu entwickeln. Es wird gezeigt, dass der vorgeschlagene Ansatz personalisiert werden kann, um den Fortschritt der Gangrehabilitation zu verfolgen. Ein weiteres Thema dieser Arbeit ist die erfolgreiche Anwendung von Methoden des maschinellen Lernens auf die Ganganalyse aufgrund der großen Datenmenge, die von den tragbaren Sensorsystemen erzeugt wird. In dieser Arbeit wird das neuartige Konzept des ``digitalen Zwillings'' vorgestellt, das die Anzahl der verwendeten Wearable-Sensoren in einem System oder im Falle eines Sensorausfalls reduziert. Die Evaluierung der vorgeschlagenen Metrik mit gesunden Teilnehmern und Patienten unter Verwendung statistischer Signalverarbeitungs- und maschineller Lernmethoden hat gezeigt, dass die Einbeziehung der extrahierten Signalmerkmale in realen Szenarien robust ist, insbesondere für das Szenario mit Rehabilitations-Gehübungen in Innenräumen. Die Methodik wurde auch in einer klinischen Studie evaluiert und lieferte eine gute Leistung bei der Überwachung des Rehabilitationsfortschritts verschiedener Patienten. In dieser Arbeit wird ein Prototyp einer mobilen Anwendung zur objektiven Bewertung des Rehabilitationsfortschritts in realen Umgebungen vorgestellt

Human-robot interaction for assistive robotics

This dissertation presents an in-depth study of human-robot interaction (HRI) withapplication to assistive robotics. In various studies, dexterous in-hand manipulation is included, assistive robots for Sit-To-stand (STS) assistance along with the human intention estimation. In Chapter 1, the background and issues of HRI are explicitly discussed. In Chapter 2, the literature review introduces the recent state-of-the-art research on HRI, such as physical Human-Robot Interaction (HRI), robot STS assistance, dexterous in hand manipulation and human intention estimation. In Chapter 3, various models and control algorithms are described in detail. Chapter 4 introduces the research equipment. Chapter 5 presents innovative theories and implementations of HRI in assistive robotics, including a general methodology of robotic assistance from the human perspective, novel hardware design, robotic sit-to-stand (STS) assistance, human intention estimation, and control

Generalized Activity Assessment computed fully distributed within a Wireless Body Area Network

Currently available wearables are usually based on a single sensor node with integrated capabilities for classifying different activities. The next generation of cooperative wearables could be able to identify not only activities, but also to evaluate them qualitatively using the data of several sensor nodes attached to the body, to provide detailed feedback for the improvement of the execution. Especially within the application domains of sports and health-care, such immediate feedback to the execution of body movements is crucial for (re-)learning and improving motor skills. To enable such systems for a broad range of activities, generalized approaches for human motion assessment within sensor networks are required. In this paper, we present a generalized trainable activity assessment chain (AAC) for the online assessment of periodic human activity within a wireless body area network. AAC evaluates the execution of separate movements of a prior trained activity on a fine-grained quality scale. We connect qualitative assessment with human knowledge by projecting the AAC on the hierarchical decomposition of motion performed by the human body as well as establishing the assessment on a kinematic evaluation of biomechanically distinct motion fragments. We evaluate AAC in a real-world setting and show that AAC successfully delimits the movements of correctly performed activity from faulty executions and provides detailed reasons for the activity assessment

Objective assessment of movement disabilities using wearable sensors

The research presents a series of comprehensive analyses based on inertial measurements obtained from wearable sensors to quantitatively describe and assess human kinematic performance in certain tasks that are most related to daily life activities. This is not only a direct application of human movement analysis but also very pivotal in assessing the progression of patients undergoing rehabilitation services. Moreover, the detailed analysis will provide clinicians with greater insights to capture movement disorders and unique ataxic features regarding axial abnormalities which are not directly observed by the clinicians

Wearable inertial sensors and range of motion metrics in physical therapy remote support

Abstract. The practice of physiotherapy diagnoses patient ailments which are often treated by the daily repetition of prescribed physiotherapeutic exercise. The effectiveness of the exercise regime is dependent on regular daily repetition of the regime and the correct execution of the prescribed exercises. Patients often have issues learning unfamiliar exercises and performing the exercise with good technique. This design science research study examines a back squat classifier design to appraise patient exercise regime away from the physiotherapy practice. The scope of the exercise appraisal is limited to one exercise, the back squat. Kinematic data captured with commercial inertial sensors is presented to a small group of physiotherapists to illustrate the potential of the technology to measure range of motion (ROM) for back squat appraisal. Opinions are considered from two fields of physiotherapy, general musculoskeletal and post-operative rehabilitation. While the exercise classifier is considered not suitable for post-operative rehabilitation, the opinions expressed for use in general musculoskeletal physiotherapy are positive. Kinematic data captured with gyroscope sensors in the sagittal plane is analysed with Matlab to develop a method for back squat exercise recognition and appraisal. The artefact, a back squat classifier with appraisal features is constructed from Matlab scripts which are proven to be effective with kinematic data from a novice athlete

Surface Electromyography and Artificial Intelligence for Human Activity Recognition - A Systematic Review on Methods, Emerging Trends Applications, Challenges, and Future Implementation

Human activity recognition (HAR) has become increasingly popular in recent years due to its potential to meet the growing needs of various industries. Electromyography (EMG) is essential in various clinical and biological settings. It is a metric that helps doctors diagnose conditions that affect muscle activation patterns and monitor patients’ progress in rehabilitation, disease diagnosis, motion intention recognition, etc. This review summarizes the various research papers based on HAR with EMG. Over recent years, the integration of Artificial Intelligence (AI) has catalyzed remarkable advancements in the classification of biomedical signals, with a particular focus on EMG data. Firstly, this review meticulously curates a wide array of research papers that have contributed significantly to the evolution of EMG-based activity recognition. By surveying the existing literature, we provide an insightful overview of the key findings and innovations that have propelled this field forward. It explore the various approaches utilized for preprocessing EMG signals, including noise reduction, baseline correction, filtering, and normalization, ensure that the EMG data is suitably prepared for subsequent analysis. In addition, we unravel the multitude of techniques employed to extract meaningful features from raw EMG data, encompassing both time-domain and frequency-domain features. These techniques are fundamental to achieving a comprehensive characterization of muscle activity patterns. Furthermore, we provide an extensive overview of both Machine Learning (ML) and Deep Learning (DL) classification methods, showcasing their respective strengths, limitations, and real-world applications in recognizing diverse human activities from EMG signals. In examining the hardware infrastructure for HAR with EMG, the synergy between hardware and software is underscored as paramount for enabling real-time monitoring. Finally, we also discovered open issues and future research direction that may point to new lines of inquiry for ongoing research toward EMG-based detection.publishedVersio

Safe Haptics-enabled Patient-Robot Interaction for Robotic and Telerobotic Rehabilitation of Neuromuscular Disorders: Control Design and Analysis

Motivation: Current statistics show that the population of seniors and the incidence rate of age-related neuromuscular disorders are rapidly increasing worldwide. Improving medical care is likely to increase the survival rate but will result in even more patients in need of Assistive, Rehabilitation and Assessment (ARA) services for extended periods which will place a significant burden on the world\u27s healthcare systems. In many cases, the only alternative is limited and often delayed outpatient therapy. The situation will be worse for patients in remote areas. One potential solution is to develop technologies that provide efficient and safe means of in-hospital and in-home kinesthetic rehabilitation. In this regard, Haptics-enabled Interactive Robotic Neurorehabilitation (HIRN) systems have been developed. Existing Challenges: Although there are specific advantages with the use of HIRN technologies, there still exist several technical and control challenges, e.g., (a) absence of direct interactive physical interaction between therapists and patients; (b) questionable adaptability and flexibility considering the sensorimotor needs of patients; (c) limited accessibility in remote areas; and (d) guaranteeing patient-robot interaction safety while maximizing system transparency, especially when high control effort is needed for severely disabled patients, when the robot is to be used in a patient\u27s home or when the patient experiences involuntary movements. These challenges have provided the motivation for this research. Research Statement: In this project, a novel haptics-enabled telerobotic rehabilitation framework is designed, analyzed and implemented that can be used as a new paradigm for delivering motor therapy which gives therapists direct kinesthetic supervision over the robotic rehabilitation procedure. The system also allows for kinesthetic remote and ultimately in-home rehabilitation. To guarantee interaction safety while maximizing the performance of the system, a new framework for designing stabilizing controllers is developed initially based on small-gain theory and then completed using strong passivity theory. The proposed control framework takes into account knowledge about the variable biomechanical capabilities of the patient\u27s limb(s) in absorbing interaction forces and mechanical energy. The technique is generalized for use for classical rehabilitation robotic systems to realize patient-robot interaction safety while enhancing performance. In the next step, the proposed telerobotic system is studied as a modality of training for classical HIRN systems. The goal is to first model and then regenerate the prescribed kinesthetic supervision of an expert therapist. To broaden the population of patients who can use the technology and HIRN systems, a new control strategy is designed for patients experiencing involuntary movements. As the last step, the outcomes of the proposed theoretical and technological developments are translated to designing assistive mechatronic tools for patients with force and motion control deficits. This study shows that proper augmentation of haptic inputs can not only enhance the transparency and safety of robotic and telerobotic rehabilitation systems, but it can also assist patients with force and motion control deficiencies