Protocol for PD SENSORS:Parkinson’s Disease Symptom Evaluation in a Naturalistic Setting producing Outcomes measuRes using SPHERE technology. An observational feasibility study of multi-modal multi-sensor technology to measure symptoms and activities of daily living in Parkinson’s disease

Introduction The impact of disease-modifying agents on disease progression in Parkinson’s disease is largely assessed in clinical trials using clinical rating scales. These scales have drawbacks in terms of their ability to capture the fluctuating nature of symptoms while living in a naturalistic environment. The SPHERE (Sensor Platform for HEalthcare in a Residential Environment) project has designed a multi-sensor platform with multimodal devices designed to allow continuous, relatively inexpensive, unobtrusive sensing of motor, non-motor and activities of daily living metrics in a home or a home-like environment. The aim of this study is to evaluate how the SPHERE technology can measure aspects of Parkinson’s disease.Methods and analysis This is a small-scale feasibility and acceptability study during which 12 pairs of participants (comprising a person with Parkinson’s and a healthy control participant) will stay and live freely for 5 days in a home-like environment embedded with SPHERE technology including environmental, appliance monitoring, wrist-worn accelerometry and camera sensors. These data will be collected alongside clinical rating scales, participant diary entries and expert clinician annotations of colour video images. Machine learning will be used to look for a signal to discriminate between Parkinson’s disease and control, and between Parkinson’s disease symptoms ‘on’ and ‘off’ medications. Additional outcome measures including bradykinesia, activity level, sleep parameters and some activities of daily living will be explored. Acceptability of the technology will be evaluated qualitatively using semi-structured interviews.Ethics and dissemination Ethical approval has been given to commence this study; the results will be disseminated as widely as appropriate

Objective Assessment of the Finger Tapping Task in Parkinson's Disease and Control Subjects using Azure Kinect and Machine Learning

Parkinson's disease (PD) is characterised by a progressive worsening of motor functionalities. In particular, limited hand dexterity strongly correlates with PD diagnosis and staging. Objective detection of alterations in hand motor skills would allow, for example, prompt identification of the disease, its symptoms and the definition of adequate medical treatments. Among the clinical assessment tasks to diagnose and stage PD from hand impairment, the Finger Tapping (FT) task is a well-established tool. This preliminary study exploits a single RGB-Depth camera (Azure Kinect) and Google MediaPipe Hands to track and assess the Finger Tapping task. The system includes several stages. First, hand movements are tracked from FT video recordings and used to extract a series of clinically-relevant features. Then, the most significant features are selected and used to train and test several Machine Learning (ML) models, to distinguish subjects with PD from healthy controls. To test the proposed system, 35 PD subjects and 60 healthy volunteers were recruited. The best-performing ML model achieved a 94.4% Accuracy and 98.4% Fl score in a Leave-One-Subject-Out validation. Moreover, different clusters with respect to spatial and temporal variability in the FT trials among PD subjects were identified. This result suggests the possibility of exploiting the proposed system to perform an even finer identification of subgroups among the PD population

Clinical Decision Support Systems with Game-based Environments, Monitoring Symptoms of Parkinson’s Disease with Exergames

Parkinson’s Disease (PD) is a malady caused by progressive neuronal degeneration, deriving in several physical and cognitive symptoms that worsen with time. Like many other chronic diseases, it requires constant monitoring to perform medication and therapeutic adjustments. This is due to the significant variability in PD symptomatology and progress between patients. At the moment, this monitoring requires substantial participation from caregivers and numerous clinic visits. Personal diaries and questionnaires are used as data sources for medication and therapeutic adjustments. The subjectivity in these data sources leads to suboptimal clinical decisions. Therefore, more objective data sources are required to better monitor the progress of individual PD patients. A potential contribution towards more objective monitoring of PD is clinical decision support systems. These systems employ sensors and classification techniques to provide caregivers with objective information for their decision-making. This leads to more objective assessments of patient improvement or deterioration, resulting in better adjusted medication and therapeutic plans. Hereby, the need to encourage patients to actively and regularly provide data for remote monitoring remains a significant challenge. To address this challenge, the goal of this thesis is to combine clinical decision support systems with game-based environments. More specifically, serious games in the form of exergames, active video games that involve physical exercise, shall be used to deliver objective data for PD monitoring and therapy. Exergames increase engagement while combining physical and cognitive tasks. This combination, known as dual-tasking, has been proven to improve rehabilitation outcomes in PD: recent randomized clinical trials on exergame-based rehabilitation in PD show improvements in clinical outcomes that are equal or superior to those of traditional rehabilitation. In this thesis, we present an exergame-based clinical decision support system model to monitor symptoms of PD. This model provides both objective information on PD symptoms and an engaging environment for the patients. The model is elaborated, prototypically implemented and validated in the context of two of the most prominent symptoms of PD: (1) balance and gait, as well as (2) hand tremor and slowness of movement (bradykinesia). While balance and gait affections increase the risk of falling, hand tremors and bradykinesia affect hand dexterity. We employ Wii Balance Boards and Leap Motion sensors, and digitalize aspects of current clinical standards used to assess PD symptoms. In addition, we present two dual-tasking exergames: PDDanceCity for balance and gait, and PDPuzzleTable for tremor and bradykinesia. We evaluate the capability of our system for assessing the risk of falling and the severity of tremor in comparison with clinical standards. We also explore the statistical significance and effect size of the data we collect from PD patients and healthy controls. We demonstrate that the presented approach can predict an increased risk of falling and estimate tremor severity. Also, the target population shows a good acceptance of PDDanceCity and PDPuzzleTable. In summary, our results indicate a clear feasibility to implement this system for PD. Nevertheless, long-term randomized clinical trials are required to evaluate the potential of PDDanceCity and PDPuzzleTable for physical and cognitive rehabilitation effects

Sistema para análise automatizada de movimento durante a marcha usando uma câmara RGB-D

Nowadays it is still common in clinical practice to assess the gait (or way of walking) of a given subject through the visual observation and use of a rating scale, which is a subjective approach. However, sensors including RGB-D cameras, such as the Microsoft Kinect, can be used to obtain quantitative information that allows performing gait analysis in a more objective way. The quantitative gait analysis results can be very useful for example to support the clinical assessment of patients with diseases that can affect their gait, such as Parkinson’s disease. The main motivation of this thesis was thus to provide support to gait assessment, by allowing to carry out quantitative gait analysis in an automated way. This objective was achieved by using 3-D data, provided by a single RGB-D camera, to automatically select the data corresponding to walking and then detect the gait cycles performed by the subject while walking. For each detected gait cycle, we obtain several gait parameters, which are used together with anthropometric measures to automatically identify the subject being assessed. The automated gait data selection relies on machine learning techniques to recognize three different activities (walking, standing, and marching), as well as two different positions of the subject in relation to the camera (facing the camera and facing away from it). For gait cycle detection, we developed an algorithm that estimates the instants corresponding to given gait events. The subject identification based on gait is enabled by a solution that was also developed by relying on machine learning. The developed solutions were integrated into a system for automated gait analysis, which we found to be a viable alternative to gold standard systems for obtaining several spatiotemporal and some kinematic gait parameters. Furthermore, the system is suitable for use in clinical environments, as well as ambulatory scenarios, since it relies on a single markerless RGB-D camera that is less expensive, more portable, less intrusive and easier to set up, when compared with the gold standard systems (multiple cameras and several markers attached to the subject’s body).Atualmente ainda é comum na prática clínica avaliar a marcha (ou o modo de andar) de uma certa pessoa através da observação visual e utilização de uma escala de classificação, o que é uma abordagem subjetiva. No entanto, existem sensores incluindo câmaras RGB-D, como a Microsoft Kinect, que podem ser usados para obter informação quantitativa que permite realizar a análise da marcha de um modo mais objetivo. Os resultados quantitativos da análise da marcha podem ser muito úteis, por exemplo, para apoiar a avaliação clínica de pessoas com doenças que podem afetar a sua marcha, como a doença de Parkinson. Assim, a principal motivação desta tese foi fornecer apoio à avaliação da marcha, permitindo realizar a análise quantitativa da marcha de forma automatizada. Este objetivo foi atingido usando dados em 3-D, fornecidos por uma única câmara RGB-D, para automaticamente selecionar os dados correspondentes a andar e, em seguida, detetar os ciclos de marcha executados pelo sujeito durante a marcha. Para cada ciclo de marcha identificado, obtemos vários parâmetros de marcha, que são usados em conjunto com medidas antropométricas para identificar automaticamente o sujeito que está a ser avaliado. A seleção automatizada de dados de marcha usa técnicas de aprendizagem máquina para reconhecer três atividades diferentes (andar, estar parado em pé e marchar), bem como duas posições diferentes do sujeito em relação à câmara (de frente para a câmara e de costas para ela). Para a deteção dos ciclos da marcha, desenvolvemos um algoritmo que estima os instantes correspondentes a determinados eventos da marcha. A identificação do sujeito com base na sua marcha é realizada usando uma solução que também foi desenvolvida com base em aprendizagem máquina. As soluções desenvolvidas foram integradas num sistema de análise automatizada de marcha, que demonstrámos ser uma alternativa viável a sistemas padrão de referência para obter vários parâmetros de marcha espácio-temporais e alguns parâmetros angulares. Além disso, o sistema é adequado para uso em ambientes clínicos, bem como em cenários ambulatórios, pois depende de apenas de uma câmara RGB-D que não usa marcadores e é menos dispendiosa, mais portátil, menos intrusiva e mais fácil de configurar, quando comparada com os sistemas padrão de referência (múltiplas câmaras e vários marcadores colocados no corpo do sujeito).Programa Doutoral em Informátic

Recognizing Activities of Daily Living of People with Parkinson's

Tese de mestrado, Informática, Universidade de Lisboa, Faculdade de Ciências, 2022Parkinson's disease is a common neurodegenerative disease that affects a large part of the world's population. This disease involves a lot of symptoms, however the most prevalent is the change in the patient's movements or even the loss of functionality. There is no treatment, however it exists medication that relieves and reduces the symptoms for a period. A Parkinson’s patient needs to be watched by clinicians to understand if the medication is working correctly and to analyse the disease progression. The current way of doing this evaluation is at clinics where the patient needs to go to the clinic or to live there. With this into consideration it was requested a monitoring system of activities of daily living for Parkinson’s patient. The monitoring system consists in a mobile application in an Android smartphone serving as a diary for the patient of clinician to record the activities done at that moment. With this application, the patient needs to wear an accelerometer in the wrist to gather the acceleration in the 3-axis. The application besides the monitoring function, it gives the ability to the clinician to schedule lists of activities for the patient to do during the day, allowing the clinician to have some control. We carried out a study with 10 healthy participants which used the monitorization system for 3 days each. The patient would worn the accelerometer and record the activities that they would do throughout the day, was asked a minimum of 5 activities per day. Alongside this recording it was schedule 1 list of activities to be carried out each day, this list only had motor activities such as walk, sit down, and stand up. At the end of each participant study, it was made a questionnaire with standard usability questions and an interview that helped us understand if the system was reliable or not

Feedback Paradigm for Rehabilitation of People with Parkinson’s Disease

abstract: Parkinson's disease (PD) is a neurodegenerative disorder that produces a characteristic set of neuromotor deficits that sometimes includes reduced amplitude and velocity of movement. Several studies have shown that people with PD improved their motor performance when presented with external cues. Other work has demonstrated that high velocity and large amplitude exercises can increase the amplitude and velocity of movement in simple carryover tasks in the upper and lower extremities. Although the cause for these effects is not known, improvements due to cueing suggest that part of the neuromotor deficit in PD is in the integration of sensory feedback to produce motor commands. Previous studies have documented some somatosensory deficits, but only limited information is available regarding the nature and magnitude of sensorimotor deficits in the shoulder of people with PD. The goals of this research were to characterize the sensorimotor impairment in the shoulder joint of people with PD and to investigate the use of visual feedback and large amplitude/high velocity exercises to target PD-related motor deficits. Two systems were designed and developed to use visual feedback to assess the ability of participants to accurately adjust limb placement or limb movement velocity and to encourage improvements in performance of these tasks. Each system was tested on participants with PD, age-matched control subjects and young control subjects to characterize and compare limb placement and velocity control capabilities. Results demonstrated that participants with PD were less accurate at placing their limbs than age-matched or young control subjects, but that their performance improved over the course of the test session such that by the end, the participants with PD performed as well as controls. For the limb velocity feedback task, participants with PD and age-matched control subjects were less accurate than young control subjects, but at the end of the session, participants with PD and age-matched control subjects were as accurate as the young control subjects. This study demonstrates that people with PD were able to improve their movement patterns based on visual feedback of performance and suggests that this feedback paradigm may be useful in exercise programs for people with PD.Dissertation/ThesisDoctoral Dissertation Bioengineering 201

Development of Markerless Systems for Automatic Analysis of Movements and Facial Expressions: Applications in Neurophysiology

This project is focused on the development of markerless methods for studying facial expressions and movements in neurology, focusing on Parkinson’s disease (PD) and disorders of consciousness (DOC). PD is a neurodegenerative illness that affects around 2% of the population over 65 years old. Impairments of voice/speech are among the main signs of PD. This set of impairments is called hypokinetic dysarthria, because of the reduced range of movements involved in speech. This reduction can be visible also in other facial muscles, leading to a hypomimia. Despite the high percentage of patients that suffer from dysarthria and hypomimia, only a few of them undergo speech therapy with the aim to improve the dynamic of articulatory/facial movements. The main reason is the lack of low cost methodologies that could be implemented at home. DOC after coma are Vegetative State (VS), characterized by the absence of self-awareness and awareness of the environment, and Minimally Conscious State (MCS), in which certain behaviors are sufficiently reproducible to be distinguished from reflex responses. The differential diagnosis between VS and MCS can be hard and prone to a high rate of misdiagnosis (~40%). This differential diagnosis is mainly based on neuro-behavioral scales. A key role to plan the rehabilitation in DOC patients is played by the first diagnosis after coma. In fact, MCS patients are more prone to a consciousness recovery than VS patients. Concerning PD the aim is the development of contactless systems that could be used to study symptoms related to speech and facial movements/expressions. The methods proposed here, based on acoustical analysis and video processing techniques could support patients during speech therapy also at home. Concerning DOC patients the project is focused on the assessment of reflex and cognitive responses to standardized stimuli. This would allow objectifying the perceptual analysis performed by clinicians

Low-Cost Objective Measurement of Prehension Skills

This thesis aims to explore the feasibility of using low-cost, portable motion capture tools for the quantitative assessment of sequential 'reach-to-grasp' and repetitive 'finger-tapping' movements in neurologically intact and deficit populations, both in clinical and non-clinical settings. The research extends the capabilities of an existing optoelectronic postural sway assessment tool (PSAT) into a more general Boxed Infrared Gross Kinematic Assessment Tool (BIGKAT) to evaluate prehensile control of hand movements outside the laboratory environment. The contributions of this work include the validation of BIGKAT against a high-end motion capture system (Optotrak) for accuracy and precision in tracking kinematic data. BIGKAT was subsequently applied to kinematically resolve prehensile movements, where concurrent recordings with Optotrak demonstrate similar statistically significant results for five kinematic measures, two spatial measures (Maximum Grip Aperture – MGA, Peak Velocity – PV) and three temporal measures (Movement Time – MT, Time to MGA – TMGA, Time to PV – TPV). Regression analysis further establishes a strong relationship between BIGKAT and Optotrak, with nearly unity slope and low y-intercept values. Results showed reliable performance of BIGKAT and its ability to produce similar statistically significant results as Optotrak. BIGKAT was also applied to quantitatively assess bradykinesia in Parkinson's patients during finger-tapping movements. The system demonstrated significant differences between PD patients and healthy controls in key kinematic measures, paving the way for potential clinical applications. The study characterized kinematic differences in prehensile control in different sensory environments using a Virtual Reality head mounted display and finger tracking system (the Leap Motion), emphasizing the importance of sensory information during hand movements. This highlighted the role of hand vision and haptic feedback during initial and final phases of prehensile movement trajectory. The research also explored marker-less pose estimation using deep learning tools, specifically DeepLabCut (DLC), for reach-to-grasp tracking. Despite challenges posed by COVID-19 limitations on data collection, the study showed promise in scaling reaching and grasping components but highlighted the need for diverse datasets to resolve kinematic differences accurately. To facilitate the assessment of prehension activities, an Event Detection Tool (EDT) was developed, providing temporal measures for reaction time, reaching time, transport time, and movement time during object grasping and manipulation. Though initial pilot data was limited, the EDT holds potential for insights into disease progression and movement disorder severity. Overall, this work contributes to the advancement of low-cost, portable solutions for quantitatively assessing upper-limb movements, demonstrating the potential for wider clinical use and guiding future research in the field of human movement analysis