A quality control check to ensure comparability of stereophotogrammetric data between session and systems

Optoelectronic stereophotogrammetric (SP) systems are widely used in human movement research for clinical diagnostics, interventional applications, and as a reference system for validating alternative technologies. Regardless of the application, SP systems exhibit different random and systematic errors depending on camera specifications, system setup and laboratory environment, which hinders comparing SP data between sessions and across different systems. While many methods have been proposed to quantify and report the errors of SP systems, they are rarely utilized due to their complexity and need for additional equipment. In response, an easy-to-use quality control (QC) check has been designed that can be completed immediately prior to a data collection. This QC check requires minimal training for the operator and no additional equipment. In addition, a custom graphical user interface ensures automatic processing of the errors in an easy-to-read format for immediate interpretation. On initial deployment in a multicentric study, the check (i) proved to be feasible to perform in a short timeframe with minimal burden to the operator, and (ii) quantified the level of random and systematic errors between sessions and systems, ensuring comparability of data in a variety of protocol setups, including repeated measures, longitudinal studies and multicentric studies

On the use of wearable sensors as mobility biomarkers in the marketing authorization of new drugs: a regulatory perspective

The loss of mobility is a common trait in multiple health conditions (e.g., Parkinson's disease) and is associated with reduced quality of life. In this context, being able to monitor mobility in the real world, is important. Until recently, the technology was not mature enough for this; but today, miniaturized sensors and novel algorithms promise to monitor mobility accurately and continuously in the real world, also in pathological populations. However, before any such methodology can be employed to support the development and testing of new drugs in clinical trials, they need to be qualified by the competent regulatory agencies (e.g., European Medicines Agency). Nonetheless, to date, only very narrow scoped requests for regulatory qualification were successful. In this work, the Mobilise-D Consortium shares its positive experience with the European regulator, summarizing the two requests for Qualification Advice for the Mobilise-D methodologies submitted in October 2019 and June 2020, as well as the feedback received, which resulted in two Letters of Support publicly available for consultation on the website of the European Medicines Agency. Leveraging on this experience, we hereby propose a refined qualification strategy for the use of digital mobility outcome (DMO) measures as monitoring biomarkers for mobility in drug trials

Mobilise-D insights to estimate real-world walking speed in multiple conditions with a wearable device

This study aimed to validate a wearable device's walking speed estimation pipeline, considering complexity, speed, and walking bout duration. The goal was to provide recommendations on the use of wearable devices for real-world mobility analysis. Participants with Parkinson's Disease, Multiple Sclerosis, Proximal Femoral Fracture, Chronic Obstructive Pulmonary Disease, Congestive Heart Failure, and healthy older adults (n = 97) were monitored in the laboratory and the real-world (2.5 h), using a lower back wearable device. Two walking speed estimation pipelines were validated across 4408/1298 (2.5 h/laboratory) detected walking bouts, compared to 4620/1365 bouts detected by a multi-sensor reference system. In the laboratory, the mean absolute error (MAE) and mean relative error (MRE) for walking speed estimation ranged from 0.06 to 0.12 m/s and - 2.1 to 14.4%, with ICCs (Intraclass correlation coefficients) between good (0.79) and excellent (0.91). Real-world MAE ranged from 0.09 to 0.13, MARE from 1.3 to 22.7%, with ICCs indicating moderate (0.57) to good (0.88) agreement. Lower errors were observed for cohorts without major gait impairments, less complex tasks, and longer walking bouts. The analytical pipelines demonstrated moderate to good accuracy in estimating walking speed. Accuracy depended on confounding factors, emphasizing the need for robust technical validation before clinical application.Trial registration: ISRCTN - 12246987

On the use of wearable sensors as mobility biomarkers in the marketing authorization of new drugs: a regulatory perspective

The loss of mobility is a common trait in multiple health conditions (e.g., Parkinson's disease) and is associated with reduced quality of life. In this context, being able to monitor mobility in the real world, is important. Until recently, the technology was not mature enough for this; but today, miniaturized sensors and novel algorithms promise to monitor mobility accurately and continuously in the real world, also in pathological populations. However, before any such methodology can be employed to support the development and testing of new drugs in clinical trials, they need to be qualified by the competent regulatory agencies (e.g., European Medicines Agency). Nonetheless, to date, only very narrow scoped requests for regulatory qualification were successful. In this work, the Mobilise-D Consortium shares its positive experience with the European regulator, summarizing the two requests for Qualification Advice for the Mobilise-D methodologies submitted in October 2019 and June 2020, as well as the feedback received, which resulted in two Letters of Support publicly available for consultation on the website of the European Medicines Agency. Leveraging on this experience, we hereby propose a refined qualification strategy for the use of digital mobility outcome (DMO) measures as monitoring biomarkers for mobility in drug trials

An Algorithm for Accurate Marker-Based Gait Event Detection in Healthy and Pathological Populations During Complex Motor Tasks

There is growing interest in the quantification of gait as part of complex motor tasks. This requires gait events (GEs) to be detected under conditions different from straight walking. This study aimed to propose and validate a new marker-based GE detection method, which is also suitable for curvilinear walking and step negotiation. The method was first tested against existing algorithms using data from healthy young adults (YA, n = 20) and then assessed in data from 10 individuals from the following five cohorts: older adults, chronic obstructive pulmonary disease, multiple sclerosis, Parkinson’s disease, and proximal femur fracture. The propagation of the errors associated with GE detection on the calculation of stride length, duration, speed, and stance/swing durations was investigated. All participants performed a variety of motor tasks including curvilinear walking and step negotiation, while reference GEs were identified using a validated methodology exploiting pressure insole signals. Sensitivity, positive predictive values (PPV), F1-score, bias, precision, and accuracy were calculated. Absolute agreement [intraclass correlation coefficient (ICC2,1)] between marker-based and pressure insole stride parameters was also tested. In the YA cohort, the proposed method outperformed the existing ones, with sensitivity, PPV, and F1 scores ≥ 99% for both GEs and conditions, with a virtually null bias (<10 ms). Overall, temporal inaccuracies minimally impacted stride duration, length, and speed (median absolute errors ≤1%). Similar algorithm performances were obtained for all the other five cohorts in GE detection and propagation to the stride parameters, where an excellent absolute agreement with the pressure insoles was also found (ICC2,1=0.817− 0.999). In conclusion, the proposed method accurately detects GE from marker data under different walking conditions and for a variety of gait impairments

A multi-sensor wearable system for the assessment of diseased gait in real-world conditions

Introduction: Accurately assessing people’s gait, especially in real-world conditions and in case of impaired mobility, is still a challenge due to intrinsic and extrinsic factors resulting in gait complexity. To improve the estimation of gait-related digital mobility outcomes (DMOs) in real-world scenarios, this study presents a wearable multi-sensor system (INDIP), integrating complementary sensing approaches (two plantar pressure insoles, three inertial units and two distance sensors). Methods: The INDIP technical validity was assessed against stereophotogrammetry during a laboratory experimental protocol comprising structured tests (including continuous curvilinear and rectilinear walking and steps) and a simulation of daily-life activities (including intermittent gait and short walking bouts). To evaluate its performance on various gait patterns, data were collected on 128 participants from seven cohorts: healthy young and older adults, patients with Parkinson’s disease, multiple sclerosis, chronic obstructive pulmonary disease, congestive heart failure, and proximal femur fracture. Moreover, INDIP usability was evaluated by recording 2.5-h of real-world unsupervised activity. Results and discussion: Excellent absolute agreement (ICC >0.95) and very limited mean absolute errors were observed for all cohorts and digital mobility outcomes (cadence ≤0.61 steps/min, stride length ≤0.02 m, walking speed ≤0.02 m/s) in the structured tests. Larger, but limited, errors were observed during the daily-life simulation (cadence 2.72–4.87 steps/min, stride length 0.04–0.06 m, walking speed 0.03–0.05 m/s). Neither major technical nor usability issues were declared during the 2.5-h acquisitions. Therefore, the INDIP system can be considered a valid and feasible solution to collect reference data for analyzing gait in real-world conditions

Walking on common ground: a cross-disciplinary scoping review on the clinical utility of digital mobility outcomes

Physical mobility is essential to health, and patients often rate it as a high-priority clinical outcome. Digital mobility outcomes (DMOs), such as real-world gait speed or step count, show promise as clinical measures in many medical conditions. However, current research is nascent and fragmented by discipline. This scoping review maps existing evidence on the clinical utility of DMOs, identifying commonalities across traditional disciplinary divides. In November 2019, 11 databases were searched for records investigating the validity and responsiveness of 34 DMOs in four diverse medical conditions (Parkinson’s disease, multiple sclerosis, chronic obstructive pulmonary disease, hip fracture). Searches yielded 19,672 unique records. After screening, 855 records representing 775 studies were included and charted in systematic maps. Studies frequently investigated gait speed (70.4% of studies), step length (30.7%), cadence (21.4%), and daily step count (20.7%). They studied differences between healthy and pathological gait (36.4%), associations between DMOs and clinical measures (48.8%) or outcomes (4.3%), and responsiveness to interventions (26.8%). Gait speed, step length, cadence, step time and step count exhibited consistent evidence of validity and responsiveness in multiple conditions, although the evidence was inconsistent or lacking for other DMOs. If DMOs are to be adopted as mainstream tools, further work is needed to establish their predictive validity, responsiveness, and ecological validity. Cross-disciplinary efforts to align methodology and validate DMOs may facilitate their adoption into clinical practice

Connecting real-world digital mobility assessment to clinical outcomes for regulatory and clinical endorsement–the Mobilise-D study protocol

Background The development of optimal strategies to treat impaired mobility related to ageing and chronic disease requires better ways to detect and measure it. Digital health technology, including body worn sensors, has the potential to directly and accurately capture real-world mobility. Mobilise-D consists of 34 partners from 13 countries who are working together to jointly develop and implement a digital mobility assessment solution to demonstrate that real-world digital mobility outcomes have the potential to provide a better, safer, and quicker way to assess, monitor, and predict the efficacy of new interventions on impaired mobility. The overarching objective of the study is to establish the clinical validity of digital outcomes in patient populations impacted by mobility challenges, and to support engagement with regulatory and health technology agencies towards acceptance of digital mobility assessment in regulatory and health technology assessment decisions. Methods/design The Mobilise-D clinical validation study is a longitudinal observational cohort study that will recruit 2400 participants from four clinical cohorts. The populations of the Innovative Medicine Initiative-Joint Undertaking represent neurodegenerative conditions (Parkinson’s Disease), respiratory disease (Chronic Obstructive Pulmonary Disease), neuro-inflammatory disorder (Multiple Sclerosis), fall-related injuries, osteoporosis, sarcopenia, and frailty (Proximal Femoral Fracture). In total, 17 clinical sites in ten countries will recruit participants who will be evaluated every six months over a period of two years. A wide range of core and cohort specific outcome measures will be collected, spanning patient-reported, observer-reported, and clinician-reported outcomes as well as performance-based outcomes (physical measures and cognitive/mental measures). Daily-living mobility and physical capacity will be assessed directly using a wearable device. These four clinical cohorts were chosen to obtain generalizable clinical findings, including diverse clinical, cultural, geographical, and age representation. The disease cohorts include a broad and heterogeneous range of subject characteristics with varying chronic care needs, and represent different trajectories of mobility disability. Discussion The results of Mobilise-D will provide longitudinal data on the use of digital mobility outcomes to identify, stratify, and monitor disability. This will support the development of widespread, cost-effective access to optimal clinical mobility management through personalised healthcare. Further, Mobilise-D will provide evidence-based, direct measures which can be endorsed by regulatory agencies and health technology assessment bodies to quantify the impact of disease-modifying interventions on mobility

Design and validation of a multi-task, multi-context protocol for real-world gait simulation

Background: Measuring mobility in daily life entails dealing with confounding factors arising from multiple sources, including pathological characteristics, patient specific walking strategies, environment/context, and purpose of the task. The primary aim of this study is to propose and validate a protocol for simulating real-world gait accounting for all these factors within a single set of observations, while ensuring minimisation of participant burden and safety. Methods: The protocol included eight motor tasks at varying speed, incline/steps, surface, path shape, cognitive demand, and included postures that may abruptly alter the participants’ strategy of walking. It was deployed in a convenience sample of 108 participants recruited from six cohorts that included older healthy adults (HA) and participants with potentially altered mobility due to Parkinson’s disease (PD), multiple sclerosis (MS), proximal femoral fracture (PFF), chronic obstructive pulmonary disease (COPD) or congestive heart failure (CHF). A novelty introduced in the protocol was the tiered approach to increase difficulty both within the same task (e.g., by allowing use of aids or armrests) and across tasks. Results: The protocol proved to be safe and feasible (all participants could complete it and no adverse events were recorded) and the addition of the more complex tasks allowed a much greater spread in walking speeds to be achieved compared to standard straight walking trials. Furthermore, it allowed a representation of a variety of daily life relevant mobility aspects and can therefore be used for the validation of monitoring devices used in real life. Conclusions: The protocol allowed for measuring gait in a variety of pathological conditions suggests that it can also be used to detect changes in gait due to, for example, the onset or progression of a disease, or due to therapy. Trial registration: ISRCTN—12246987