Symbol Digit Modalities Test Variant in a Smartphone App for Persons With Multiple Sclerosis:Validation Study

Contains fulltext : 225747.pdf (publisher's version ) (Open Access)17 p

A two-minute walking test with a smartphone app for persons with multiple sclerosis:Validation study

BACKGROUND: Walking disturbances are a common dysfunction in persons with multiple sclerosis (MS). The 2-Minute Walking Test (2MWT) is widely used to quantify walking speed. We implemented a smartphone-based 2MWT (s2MWT) in MS sherpa, an app for persons with MS. When performing the s2MWT, users of the app are instructed to walk as fast as safely possible for 2 minutes in the open air, while the app records their movement and calculates the distance walked. OBJECTIVE: The aim of this study is to investigate the concurrent validity and test-retest reliability of the MS sherpa s2MWT. METHODS: We performed a validation study on 25 persons with relapsing-remitting MS and 79 healthy control (HC) participants. In the HC group, 21 participants were matched to the persons with MS based on age, gender, and education and these followed the same assessment schedule as the persons with MS (the HC-matched group), whereas 58 participants had a less intense assessment schedule to determine reference values (the HC-normative group). Intraclass correlation coefficients (ICCs) were determined between the distance measured by the s2MWT and the distance measured using distance markers on the pavement during these s2MWT assessments. ICCs were also determined for test-retest reliability and derived from 10 smartphone tests per study participant, with 3 days in between each test. We interviewed 7 study participants with MS regarding their experiences with the s2MWT. RESULTS: In total, 755 s2MWTs were completed. The adherence rate for the persons with MS and the participants in the HC-matched group was 92.4% (425/460). The calculated distance walked on the s2MWT was, on average, 8.43 m or 5% (SD 18.9 m or 11%) higher than the distance measured using distance markers (n=43). An ICC of 0.817 was found for the concurrent validity of the s2MWT in the combined analysis of persons with MS and HC participants. Average ICCs of 9 test-retest reliability analyses of the s2MWT for persons with MS and the participants in the HC-matched group were 0.648 (SD 0.150) and 0.600 (SD 0.090), respectively, whereas the average ICC of 2 test-retest reliability analyses of the s2MWT for the participants in the HC-normative group was 0.700 (SD 0.029). The interviewed study participants found the s2MWT easy to perform, but they also expressed that the test results can be confronting and that a pressure to reach a certain distance can be experienced. CONCLUSIONS: The high correlation between s2MWT distance and the conventional 2MWT distance indicates a good concurrent validity. Similarly, high correlations underpin a good test-retest reliability of the s2MWT. We conclude that the s2MWT can be used to measure the distance that the persons with MS walk in 2 minutes outdoors near their home, from which both clinical studies and clinical practice can benefit

A two-minute walking test with a smartphone app for persons with multiple sclerosis:Validation study

Background: Walking disturbances are a common dysfunction in persons with multiple sclerosis (MS). The 2-Minute Walking Test (2MWT) is widely used to quantify walking speed. We implemented a smartphone-based 2MWT (s2MWT) in MS sherpa, an app for persons with MS. When performing the s2MWT, users of the app are instructed to walk as fast as safely possible for 2 minutes in the open air, while the app records their movement and calculates the distance walked.Objective: The aim of this study is to investigate the concurrent validity and test-retest reliability of the MS sherpa s2MWT.Methods: We performed a validation study on 25 persons with relapsing-remitting MS and 79 healthy control (HC) participants. In the HC group, 21 participants were matched to the persons with MS based on age, gender, and education and these followed the same assessment schedule as the persons with MS (the HC-matched group), whereas 58 participants had a less intense assessment schedule to determine reference values (the HC-normative group). Intraclass correlation coefficients (ICCs) were determined between the distance measured by the s2MWT and the distance measured using distance markers on the pavement during these s2MWT assessments. ICCs were also determined for test-retest reliability and derived from 10 smartphone tests per study participant, with 3 days in between each test. We interviewed 7 study participants with MS regarding their experiences with the s2MWT.Results: In total, 755 s2MWTs were completed. The adherence rate for the persons with MS and the participants in the HC-matched group was 92.4% (425/460). The calculated distance walked on the s2MWT was, on average, 8.43 m or 5% (SD 18.9 m or 11%) higher than the distance measured using distance markers (n=43). An ICC of 0.817 was found for the concurrent validity of the s2MWT in the combined analysis of persons with MS and HC participants. Average ICCs of 9 test-retest reliability analyses of the s2MWT for persons with MS and the participants in the HC-matched group were 0.648 (SD 0.150) and 0.600 (SD 0.090), respectively, whereas the average ICC of 2 test-retest reliability analyses of the s2MWT for the participants in the HC-normative group was 0.700 (SD 0.029). The interviewed study participants found the s2MWT easy to perform, but they also expressed that the test results can be confronting and that a pressure to reach a certain distance can be experienced.Conclusions: The high correlation between s2MWT distance and the conventional 2MWT distance indicates a good concurrent validity. Similarly, high correlations underpin a good test-retest reliability of the s2MWT. We conclude that the s2MWT can be used to measure the distance that the persons with MS walk in 2 minutes outdoors near their home, from which both clinical studies and clinical practice can benefit.</p

The potential impact of digital biomarkers in multiple sclerosis in the netherlands: An early health technology assessment of ms sherpa

(1) Background: Monitoring of Multiple Sclerosis (MS) with eHealth interventions or digital biomarkers provides added value to the current care path. Evidence in the literature is currently scarce. MS sherpa is an eHealth intervention with digital biomarkers, aimed at monitoring symptom progression and disease activity. To show the added value of digital biomarker–based eHealth interventions to the MS care path, an early Health Technology Assessment (eHTA) was performed, with MS sherpa as an example, to assess the potential impact on treatment switches. (2) Methods: The eHTA was performed according to the Dutch guidelines for health economic evaluations. A decision analytic MS model was used to estimate the costs and benefits of MS standard care with and without use of MS sherpa, expressed in incremental cost-effectiveness ratios (ICERs) from both societal and health care perspectives. The efficacy of MS sherpa on early detection of active disease and the initiation of a treatment switch were modeled for a range of assumed efficacy (5%, 10%, 15%, 20%). (3) Results: From a societal perspective, for the efficacy of 15% or 20%, MS sherpa became dominant, which means cost-saving compared to the standard of care. MS sherpa is cost-effective in the 5% and 10% scenarios (ICERs EUR 14,535 and EUR 4069, respectively). From the health care perspective, all scenarios were cost-effective. Sensitivity analysis showed that increasing the efficacy of MS sherpa in detecting active disease early leading to treatment switches be the most impactful factor in the MS model. (4) Conclusions: The results indicate the potential of eHealth interventions to be cost-effective or even cost-saving in the MS care path. As such, digital biomarker–based eHealth interventions, like MS sherpa, are promising cost-effective solutions in optimizing MS disease management for people with MS, by detecting active disease early and helping neurologists in decisions on treatment switch

The potential impact of digital biomarkers in multiple sclerosis in the netherlands

(1) Background: Monitoring of Multiple Sclerosis (MS) with eHealth interventions or digital biomarkers provides added value to the current care path. Evidence in the literature is currently scarce. MS sherpa is an eHealth intervention with digital