Supervised classification of bradykinesia for Parkinson's disease diagnosis from smartphone videos

Slowness of movement, known as bradykinesia, is an important early symptom of Parkinson's disease. This symptom is currently assessed subjectively by clinical experts. However, expert assessment has been shown to be subject to inter-rater variability. We propose a low-cost, contactless system using smarthphone videos to automatically determine the presence of bradykinesia. Using 70 videos recorded in a pilot study, we predicted the presence of bradykinesia with an estimated test accuracy of 0.79 and the presence of Parkinson's disease with estimated test accuracy 0.63. Even on a small set of pilot data this accuracy is comparable to that recorded by blinded human experts

Supervised Classification of Bradykinesia for Parkinson's Disease Diagnosis from Smartphone Videos

Slowness of movement, known as bradykinesia, is an important early symptom of Parkinson's disease. This symptom is currently assessed subjectively by clinical experts. However, expert assessment has been shown to be subject to inter-rater variability. We propose a low-cost, contactless system using smarthphone videos to automatically determine the presence of bradykinesia. Using 70 videos recorded in a pilot study, we predicted the presence of bradykinesia with an estimated test accuracy of 0.79 and the presence of Parkinson's disease with estimated test accuracy 0.63. Even on a small set of pilot data this accuracy is comparable to that recorded by blinded human experts

The discerning eye of computer vision: can it measure Parkinson's finger tap bradykinesia?

Objective: The worldwide prevalence of Parkinson's disease is increasing. There is urgent need for new tools to objectively measure the condition. Existing methods to record the cardinal motor feature of the condition, bradykinesia, using wearable sensors or smartphone apps have not reached large-scale, routine use. We evaluate new computer vision (artificial intelligence) technology, DeepLabCut, as a contactless method to quantify measures related to Parkinson's bradykinesia from smartphone videos of finger tapping. Methods: Standard smartphone video recordings of 133 hands performing finger tapping (39 idiopathic Parkinson's patients and 30 controls) were tracked on a frame-by-frame basis with DeepLabCut. Objective computer measures of tapping speed, amplitude and rhythm were correlated with clinical ratings made by 22 movement disorder neurologists using the Modified Bradykinesia Rating Scale (MBRS) and Movement Disorder Society revision of the Unified Parkinson's Disease Rating Scale (MDS-UPDRS). Results: DeepLabCut reliably tracked and measured finger tapping in standard smartphone video. Computer measures correlated well with clinical ratings of bradykinesia (Spearman coefficients): -0.74 speed, 0.66 amplitude, -0.65 rhythm for MBRS; -0.56 speed, 0.61 amplitude, -0.50 rhythm for MDS-UPDRS; -0.69 combined for MDS-UPDRS. All p Conclusion: New computer vision software, DeepLabCut, can quantify three measures related to Parkinson's bradykinesia from smartphone videos of finger tapping. Objective 'contactless' measures of standard clinical examinations were not previously possible with wearable sensors (accelerometers, gyroscopes, infrared markers). DeepLabCut requires only conventional video recording of clinical examination and is entirely 'contactless'. This next generation technology holds potential for Parkinson's and other neurological disorders with altered movements

Free-living monitoring of Parkinson’s disease: lessons from the field

Wearable technology comprises miniaturized sensors (e.g. accelerometers) worn on the body and/or paired with mobile devices (e.g. smart phones) allowing continuous patient monitoring in unsupervised, habitual environments (termed free-living). Wearable technologies are revolutionising approaches to healthcare due to their utility, accessibility and affordability. They are positioned to transform Parkinson’s disease (PD) management through provision of individualised, comprehensive, and representative data. This is particularly relevant in PD where symptoms are often triggered by task and free-living environmental challenges that cannot be replicated with sufficient veracity elsewhere. This review concerns use of wearable technology in free-living environments for people with PD. It outlines the potential advantages of wearable technologies and evidence for these to accurately detect and measure clinically relevant features including motor symptoms, falls risk, freezing of gait, gait, functional mobility and physical activity. Technological limitations and challenges are highlighted and advances concerning broader aspects are discussed. Recommendations to overcome key challenges are made. To date there is no fully validated system to monitor clinical features or activities in free living environments. Robust accuracy and validity metrics for some features have been reported, and wearable technology may be used in these cases with a degree of confidence. Utility and acceptability appears reasonable, although testing has largely been informal. Key recommendations include adopting a multi-disciplinary approach for standardising definitions, protocols and outcomes. Robust validation of developed algorithms and sensor-based metrics is required along with testing of utility. These advances are required before widespread clinical adoption of wearable technology can be realise

Clinical Decision Support Systems with Game-based Environments, Monitoring Symptoms of Parkinson’s Disease with Exergames

Parkinson’s Disease (PD) is a malady caused by progressive neuronal degeneration, deriving in several physical and cognitive symptoms that worsen with time. Like many other chronic diseases, it requires constant monitoring to perform medication and therapeutic adjustments. This is due to the significant variability in PD symptomatology and progress between patients. At the moment, this monitoring requires substantial participation from caregivers and numerous clinic visits. Personal diaries and questionnaires are used as data sources for medication and therapeutic adjustments. The subjectivity in these data sources leads to suboptimal clinical decisions. Therefore, more objective data sources are required to better monitor the progress of individual PD patients. A potential contribution towards more objective monitoring of PD is clinical decision support systems. These systems employ sensors and classification techniques to provide caregivers with objective information for their decision-making. This leads to more objective assessments of patient improvement or deterioration, resulting in better adjusted medication and therapeutic plans. Hereby, the need to encourage patients to actively and regularly provide data for remote monitoring remains a significant challenge. To address this challenge, the goal of this thesis is to combine clinical decision support systems with game-based environments. More specifically, serious games in the form of exergames, active video games that involve physical exercise, shall be used to deliver objective data for PD monitoring and therapy. Exergames increase engagement while combining physical and cognitive tasks. This combination, known as dual-tasking, has been proven to improve rehabilitation outcomes in PD: recent randomized clinical trials on exergame-based rehabilitation in PD show improvements in clinical outcomes that are equal or superior to those of traditional rehabilitation. In this thesis, we present an exergame-based clinical decision support system model to monitor symptoms of PD. This model provides both objective information on PD symptoms and an engaging environment for the patients. The model is elaborated, prototypically implemented and validated in the context of two of the most prominent symptoms of PD: (1) balance and gait, as well as (2) hand tremor and slowness of movement (bradykinesia). While balance and gait affections increase the risk of falling, hand tremors and bradykinesia affect hand dexterity. We employ Wii Balance Boards and Leap Motion sensors, and digitalize aspects of current clinical standards used to assess PD symptoms. In addition, we present two dual-tasking exergames: PDDanceCity for balance and gait, and PDPuzzleTable for tremor and bradykinesia. We evaluate the capability of our system for assessing the risk of falling and the severity of tremor in comparison with clinical standards. We also explore the statistical significance and effect size of the data we collect from PD patients and healthy controls. We demonstrate that the presented approach can predict an increased risk of falling and estimate tremor severity. Also, the target population shows a good acceptance of PDDanceCity and PDPuzzleTable. In summary, our results indicate a clear feasibility to implement this system for PD. Nevertheless, long-term randomized clinical trials are required to evaluate the potential of PDDanceCity and PDPuzzleTable for physical and cognitive rehabilitation effects

Exploration of digital biomarkers in chronic low back pain and Parkinson’s disease

Chronic pain and Parkinson’s disease are illnesses with personal disease progression, symptoms, and the experience of these. The ability to measure and monitor the symptoms by digitally and remotely is still limited. The aim was to study the usability and feasibility of real-world data from wearables, mobile devices, and patients in exploring digital biomarkers in these diseases. The key hypothesis was that this allows us to measure, analyse and detect clinically valid digital signals in movement, heart rate and skin conductance data. The laboratory grade data in chronic pain were collected in an open feasibility study by using a program and built-in sensors in virtual reality devices. The real-world data were collected with a randomized clinical study by clinical assessments, built-in sensors, and two wearables. The laboratory grade dataset in Parkinson’s disease was obtained from Michael J. Fox Foundation. It contained sensor data from three wearables with clinical assessments. The real-world data were collected with a clinical study by clinical assessments, a wearable, and a mobile application. With both diseases the laboratory grade data were first explored, before the real-world data were analyzed. The classification of chronic pain patients with the laboratory grade movement data was possible with a high accuracy. A novel real-world digital signal that correlates with clinical outcomes was found in chronic low back pain patients. A model that was able to detect different movement states was developed with laboratory grade Parkinson’s disease data. A detection of these states followed by the quantification of symptoms was found to be a potential method for the future. The usability of data collection methods in both diseases were found promising. In the future the analyses of movement data in these diseases could be further researched and validated as a movement based digital biomarkers to be used as a surrogate or additional endpoint. Combining the data science with the optimal usability enables the exploitation of digital biomarkers in clinical trials and treatment.Digitaalisten biomarkkereiden tunnistaminen kroonisessä alaselkäkivussa ja Parkinsonin taudissa Krooninen kipu ja Parkinsonin tauti ovat oireiden, oirekokemuksen sekä taudin kehittymisen osalta yksilöllisiä sairauksia. Kyky mitata ja seurata oireita etänä on vielä alkeellista. Väitöskirjassa tutkittiin kaupallisten mobiili- ja älylaitteiden hyödyntämistä digitaalisten biomarkkereiden löytämisessä näissä taudeissa. Pääolettamus oli, että kaupallisten älylaitteiden avulla kyetään tunnistamaan kliinisesti hyödyllisiä digitaalisia signaaleja. Kroonisen kivun laboratorio-tasoinen data kerättiin tätä varten kehitettyä ohjelmistoa sekä kaupallisia antureita käyttäen. Reaaliaikainen kipudata kerättiin erillisen hoito-ohjelmiston tehoa ja turvallisuutta mitanneessa kliinisessä tutkimuksessa sekä kliinisiä arviointeja että anturidataa hyödyntäen. Laboratorio-tasoinena datana Parkinsonin taudissa käytettiin Michael J. Fox Foundationin kolmella eri älylaitteella ja kliinisin arvioinnein kerättyä dataa. Reaaliaikainen data kerättiin käyttäen kliinisia arviointeja, älyranneketta ja mobiilisovellusta. Molempien indikaatioiden kohdalla laboratoriodatalle tehtyä eksploratiivista analyysia hyödynnettiin itse reaaliaikaisen datan analysoinnissa. Kipupotilaiden tunnistaminen laboratorio-tasoisesta liikedatasta oli mahdollista korkealla tarkkuudella. Reaaliaikaisesta liikedatasta löytyi uusi kliinisten arviointien kanssa korreloiva digitaalinen signaali. Parkinsonin taudin datasta kehitettiin uusi liiketyyppien tunnistamiseen tarkoitettu koneoppimis-malli. Sen hyödyntäminen liikedatan liiketyyppien tunnistamisessa ennen varsinaista oireiden mittausta on lupaava menetelmä. Käytettävyys molempien tautien reaaliaikaisissa mittausmenetelmissä havaittiin toimivaksi. Reaaliaikaiseen, kaupallisin laittein kerättävään liikedataan pohjautuvat digitaaliset biomarkkerit ovat lupaava kohde jatkotutkimukselle. Uusien analyysimenetelmien yhdistäminen optimaaliseen käytettävyyteen mahdollistaa tulevaisuudessa digitaalisten biomarkkereiden hyödyntämisen sekä kroonisten tautien kliinisessä tutkimuksessa että itse hoidossa

Low-Cost Objective Measurement of Prehension Skills

This thesis aims to explore the feasibility of using low-cost, portable motion capture tools for the quantitative assessment of sequential 'reach-to-grasp' and repetitive 'finger-tapping' movements in neurologically intact and deficit populations, both in clinical and non-clinical settings. The research extends the capabilities of an existing optoelectronic postural sway assessment tool (PSAT) into a more general Boxed Infrared Gross Kinematic Assessment Tool (BIGKAT) to evaluate prehensile control of hand movements outside the laboratory environment. The contributions of this work include the validation of BIGKAT against a high-end motion capture system (Optotrak) for accuracy and precision in tracking kinematic data. BIGKAT was subsequently applied to kinematically resolve prehensile movements, where concurrent recordings with Optotrak demonstrate similar statistically significant results for five kinematic measures, two spatial measures (Maximum Grip Aperture – MGA, Peak Velocity – PV) and three temporal measures (Movement Time – MT, Time to MGA – TMGA, Time to PV – TPV). Regression analysis further establishes a strong relationship between BIGKAT and Optotrak, with nearly unity slope and low y-intercept values. Results showed reliable performance of BIGKAT and its ability to produce similar statistically significant results as Optotrak. BIGKAT was also applied to quantitatively assess bradykinesia in Parkinson's patients during finger-tapping movements. The system demonstrated significant differences between PD patients and healthy controls in key kinematic measures, paving the way for potential clinical applications. The study characterized kinematic differences in prehensile control in different sensory environments using a Virtual Reality head mounted display and finger tracking system (the Leap Motion), emphasizing the importance of sensory information during hand movements. This highlighted the role of hand vision and haptic feedback during initial and final phases of prehensile movement trajectory. The research also explored marker-less pose estimation using deep learning tools, specifically DeepLabCut (DLC), for reach-to-grasp tracking. Despite challenges posed by COVID-19 limitations on data collection, the study showed promise in scaling reaching and grasping components but highlighted the need for diverse datasets to resolve kinematic differences accurately. To facilitate the assessment of prehension activities, an Event Detection Tool (EDT) was developed, providing temporal measures for reaction time, reaching time, transport time, and movement time during object grasping and manipulation. Though initial pilot data was limited, the EDT holds potential for insights into disease progression and movement disorder severity. Overall, this work contributes to the advancement of low-cost, portable solutions for quantitatively assessing upper-limb movements, demonstrating the potential for wider clinical use and guiding future research in the field of human movement analysis

Study and characterisation of the prodromal motor phase of Parkinson’s Disease

There is sufficient evidence that a neurodegenerative process in Parkinson’s Disease (PD) starts many years before the clinical diagnosis. The progression of PD is generally slow and, because it is diagnosed based on established motor features, it is probable that subtle motor manifestations appear in the pre-diagnostic phase of PD. Isolated rapid eye movement (REM) sleep behaviour disorder (iRBD) is a condition known to be part of the prodromal phase of PD. The PREDICT-PD study is a population-based cohort which aims to identify individuals at risk of PD based on the presence and absence of risk factors. The first project of this thesis investigated the association between first presentation of motor symptoms (tremor, rigidity and balance difficulties) and subsequent PD in a large primary care dataset in East London, including almost 3 decades of clinical information from over a million individuals. People who went on to develop PD reported motor symptoms up to 10 years before PD diagnosis. Tremor had the highest association with future PD followed by balance difficulties and rigidity. The second project aimed to identify the range of motor features in the elderly population participating in the PREDICT-PD cohort study and document their rate of progression over time. People classified as having a higher risk of future PD (using the PREDICT-PD algorithm) were more likely to have early parkinsonian signs than the lower risk group. Six years later, they also showed a bigger motor decline compared with people in the lower risk group. The third project was focused on developing two new objective motor tools, the Distal Finger Tapping test and the Slow-Motion Analysis of Repetitive Tapping. Both tests were able to detect abnormal patterns of movement amongst people with early PD. Finally, a motor battery was created and implemented in a group of patients with iRBD. A higher proportion of patients with iRBD had early parkinsonian signs compared with controls. The motor battery was able to detect early patterns of motor dysfunction not captured by standardised clinical scales. The work presented in this thesis demonstrates that motor features start in the pre-diagnostic phase of PD and describes new motor signatures in the prodromal phase of PD

Objective assessment of upper limb motor symptoms in Parkinson's Disease using body-worn sensors

MD ThesisBackground There is a need for an objective method of symptom assessment in Parkinson's disease (PD) to enable better treatment decisions and to aid evaluation of new treatments. Current assessment methods; patient-completed symptom diaries and clinical rating scales, have limitations. Accelerometers (sensors capable of capturing data on human movement) and analysis using artificial neural networks (ANNs) have shown potential as a method of motor symptom evaluation in PD. It is unknown whether symptom monitoring with body-worn sensors is acceptable to PD patients due to a lack of previous research. Methods 34 participants with PD wore bilateral wrist-worn accelerometers for 4 hours in a research facility (phase 1) and then for 7 days in their homes (phase 2) whilst also completing symptom diaries. An ANN designed to predict a patient’s motor status, was developed and trained based on accelerometer data during phase 2. ANN performance was evaluated (leave-one-out approach) against patient-completed symptom diaries during phase 2, and against clinician rating of disease state during phase 1 observations. Participants’ views regarding the sensors were obtained via a Likert-style questionnaire completed after each phase. Differences in responses between phases were assessed for using the Wilcoxon rank-sum test. Results ANN-derived values of the proportion of time in each disease state (phase 2), showed strong, significant correlations with values derived from patient-completed symptom diaries. ANN disease state recognition during phase 1 was sub-optimal. High concordance with sensors was seen. Prolonged wearing of the sensors did not adversely affect participants’ opinions on the wearability of the sensors, when compared to their responses following phase 1 Conclusions Accelerometers and ANNs produced results comparable to those of symptom diaries. Our findings suggest that long-term monitoring with wrist-worn sensors is acceptable to PD patients