Classifying depression symptom severity: Assessment of speech representations in personalized and generalized machine learning models

There is an urgent need for new methods that improve the management and treatment of Major Depressive Disorder (MDD). Speech has long been regarded as a promising digital marker in this regard, with many works highlighting that speech changes associated with MDD can be captured through machine learning models. Typically, findings are based on cross-sectional data, with little work exploring the advantages of personalization in building more robust and reliable models. This work assesses the strengths of different combinations of speech representations and machine learning models, in personalized and generalized settings in a two-class depression severity classification paradigm. Key results on a longitudinal dataset highlight the benefits of personalization. Our strongest performing model set-up utilized self-supervised learning features and convolutional neural network (CNN) and long short-term memory (LSTM) back-end

Automatic Assessment of the 2-Minute Walk Distance for Remote Monitoring of People with Multiple Sclerosis

The aim of this study was to investigate the feasibility of automatically assessing the 2-Minute Walk Distance (2MWD) for monitoring people with multiple sclerosis (pwMS). For 154 pwMS, MS-related clinical outcomes as well as the 2MWDs as evaluated by clinicians and derived from accelerometer data were collected from a total of 323 periodic clinical visits. Accelerometer data from a wearable device during 100 home-based 2MWD assessments were also acquired. The error in estimating the 2MWD was validated for walk tests performed at hospital, and then the correlation (r) between clinical outcomes and home-based 2MWD assessments was evaluated. Robust performance in estimating the 2MWD from the wearable device was obtained, yielding an error of less than 10% in about two-thirds of clinical visits. Correlation analysis showed that there is a strong association between the actual and the estimated 2MWD obtained either at hospital (r = 0.71) or at home (r = 0.58). Furthermore, the estimated 2MWD exhibits moderate-to-strong correlation with various MS-related clinical outcomes, including disability and fatigue severity scores. Automatic assessment of the 2MWD in pwMS is feasible with the usage of a consumer-friendly wearable device in clinical and non-clinical settings. Wearable devices can also enhance the assessment of MS-related clinical outcomes

Automatic assessment of the 2-minute walk distance for remote monitoring of people with multiple sclerosis

The aim of this study was to investigate the feasibility of automatically assessing the 2-Minute Walk Distance (2MWD) for monitoring people with multiple sclerosis (pwMS). For 154 pwMS, MS-related clinical outcomes as well as the 2MWDs as evaluated by clinicians and derived from accelerometer data were collected from a total of 323 periodic clinical visits. Accelerometer data from a wearable device during 100 home-based 2MWD assessments were also acquired. The error in estimating the 2MWD was validated for walk tests performed at hospital, and then the correlation (r) between clinical outcomes and home-based 2MWD assessments was evaluated. Robust performance in estimating the 2MWD from the wearable device was obtained, yielding an error of less than 10% in about two-thirds of clinical visits. Correlation analysis showed that there is a strong association between the actual and the estimated 2MWD obtained either at hospital (r = 0.71) or at home (r = 0.58). Furthermore, the estimated 2MWD exhibits moderate-to-strong correlation with various MS-related clinical outcomes, including disability and fatigue severity scores. Automatic assessment of the 2MWD in pwMS is feasible with the usage of a consumer-friendly wearable device in clinical and non-clinical settings. Wearable devices can also enhance the assessment of MS-related clinical outcomes

The Association Between Home Stay and Symptom Severity in Major Depressive Disorder: Preliminary Findings From a Multicenter Observational Study Using Geolocation Data From Smartphones

BACKGROUND: Most smartphones and wearables are currently equipped with location sensing (using GPS and mobile network information), which enables continuous location tracking of their users. Several studies have reported that various mobility metrics, as well as home stay, that is, the amount of time an individual spends at home in a day, are associated with symptom severity in people with major depressive disorder (MDD). Owing to the use of small and homogeneous cohorts of participants, it is uncertain whether the findings reported in those studies generalize to a broader population of individuals with MDD symptoms. OBJECTIVE: The objective of this study is to examine the relationship between the overall severity of depressive symptoms, as assessed by the 8-item Patient Health Questionnaire, and median daily home stay over the 2 weeks preceding the completion of a questionnaire in individuals with MDD. METHODS: We used questionnaire and geolocation data of 164 participants with MDD collected in the observational Remote Assessment of Disease and Relapse-Major Depressive Disorder study. The participants were recruited from three study sites: King's College London in the United Kingdom (109/164, 66.5%); Vrije Universiteit Medisch Centrum in Amsterdam, the Netherlands (17/164, 10.4%); and Centro de Investigación Biomédica en Red in Barcelona, Spain (38/164, 23.2%). We used a linear regression model and a resampling technique (n=100 draws) to investigate the relationship between home stay and the overall severity of MDD symptoms. Participant age at enrollment, gender, occupational status, and geolocation data quality metrics were included in the model as additional explanatory variables. The 95% 2-sided CIs were used to evaluate the significance of model variables. RESULTS: Participant age and severity of MDD symptoms were found to be significantly related to home stay, with older (95% CI 0.161-0.325) and more severely affected individuals (95% CI 0.015-0.184) spending more time at home. The association between home stay and symptoms severity appeared to be stronger on weekdays (95% CI 0.023-0.178, median 0.098; home stay: 25th-75th percentiles 17.8-22.8, median 20.9 hours a day) than on weekends (95% CI -0.079 to 0.149, median 0.052; home stay: 25th-75th percentiles 19.7-23.5, median 22.3 hours a day). Furthermore, we found a significant modulation of home stay by occupational status, with employment reducing home stay (employed participants: 25th-75th percentiles 16.1-22.1, median 19.7 hours a day; unemployed participants: 25th-75th percentiles 20.4-23.5, median 22.6 hours a day). CONCLUSIONS: Our findings suggest that home stay is associated with symptom severity in MDD and demonstrate the importance of accounting for confounding factors in future studies. In addition, they illustrate that passive sensing of individuals with depression is feasible and could provide clinically relevant information to monitor the course of illness in patients with MDD

Associations between depression symptom severity and daily-life gait characteristics derived from long-term acceleration signals in real-world settings

Background Gait is an essential manifestation of depression. However, the gait characteristics of daily walking and their relationships with depression are yet to be fully explored. Objective: This study aimed to explore associations between depression symptom severity and daily-life gait characteristics derived from acceleration signals in real-world settings. Methods We used two ambulatory datasets (N=71 and N=215) whose acceleration signals were collected by wearable devices and mobile phones, respectively. We extracted 12 daily-life gait features to describe the distribution and variance of gait cadence and force over a long-term period. Spearman coefficients and linear mixed-effect models were used to explore the associations between daily-life gait features and depression symptom severity measured by GDS-15 and PHQ-8 self-reported questionnaires. The likelihood ratio (LR) test was used to test whether daily-life gait features could provide additional information relative to the laboratory gait features. Results Higher depression symptom severity was found to be significantly associated with lower gait cadence of high-performance walking (segments with faster walking speed) over a long-term period in both datasets. The linear regression model with long-term daily-life gait features ( =0.30) fitted depression scores significantly better (LR test: P value = .001) than the model with only laboratory gait features ( =0.06). Conclusion This study indicated that the significant links between daily-life walking characteristics and depression symptom severity could be captured by both wearable devices and mobile phones. The daily-life gait patterns could provide additional information for predicting depression symptom severity relative to laboratory walking. These findings may contribute to developing clinical tools to remotely monitor mental health in real-world settings

Multilingual markers of depression in remotely collected speech samples: A preliminary analysis

Background: Speech contains neuromuscular, physiological and cognitive components, and so is a potential biomarker of mental disorders. Previous studies indicate that speaking rate and pausing are associated with major depressive disorder (MDD). However, results are inconclusive as many studies are small and underpowered and do not include clinical samples. These studies have also been unilingual and use speech collected in controlled settings. If speech markers are to help understand the onset and progress of MDD, we need to uncover markers that are robust to language and establish the strength of associations in real-world data. // Methods: We collected speech data in 585 participants with a history of MDD in the United Kingdom, Spain, and Netherlands as part of the RADAR-MDD study. Participants recorded their speech via smartphones every two weeks for 18 months. Linear mixed models were used to estimate the strength of specific markers of depression from a set of 28 speech features. // Results: Increased depressive symptoms were associated with speech rate, articulation rate and intensity of speech elicited from a scripted task. These features had consistently stronger effect sizes than pauses. // Limitations: Our findings are derived at the cohort level so may have limited impact on identifying intra-individual speech changes associated with changes in symptom severity. The analysis of features averaged over the entire recording may have underestimated the importance of some features. // Conclusions: Participants with more severe depressive symptoms spoke more slowly and quietly. Our findings are from a real-world, multilingual, clinical dataset so represent a step-change in the usefulness of speech as a digital phenotype of MDD

Identifying depression-related topics in smartphone-collected free-response speech recordings using an automatic speech recognition system and a deep learning topic model

Language use has been shown to correlate with depression, but large-scale validation is needed. Traditional methods like clinic studies are expensive. So, natural language processing has been employed on social media to predict depression, but limitations remain-lack of validated labels, biased user samples, and no context. Our study identified 29 topics in 3919 smartphone-collected speech recordings from 265 participants using the Whisper tool and BERTopic model. Six topics with a median PHQ-8 greater than or equal to 10 were regarded as risk topics for depression: No Expectations, Sleep, Mental Therapy, Haircut, Studying, and Coursework. To elucidate the topic emergence and associations with depression, we compared behavioral (from wearables) and linguistic characteristics across identified topics. The correlation between topic shifts and changes in depression severity over time was also investigated, indicating the importance of longitudinally monitoring language use. We also tested the BERTopic model on a similar smaller dataset (356 speech recordings from 57 participants), obtaining some consistent results. In summary, our findings demonstrate specific speech topics may indicate depression severity. The presented data-driven workflow provides a practical approach to collecting and analyzing large-scale speech data from real-world settings for digital health research

The utility of wearable devices in assessing ambulatory impairments of people with multiple sclerosis in free-living conditions

Background and objectives Multiple sclerosis (MS) is a progressive inflammatory and neurodegenerative disease of the central nervous system affecting over 2.5 million people globally. In-clinic six-minute walk test (6MWT) is a widely used objective measure to evaluate the progression of MS. Yet, it has limitations such as the need for a clinical visit and a proper walkway. The widespread use of wearable devices capable of depicting patients’ activity profiles has the potential to assess the level of MS-induced disability in free-living conditions. Methods In this work, we extracted 96 features in different temporal granularities (from minute-level to day-level) from wearable data and explored their utility in estimating 6MWT scores in a European (Italy, Spain, and Denmark) MS cohort of 337 participants over an average of 10 months’ duration. We combined these features with participants’ demographics using three regression models including elastic net, gradient boosted trees and random forest. In addition, we quantified the individual feature's contribution using feature importance in these regression models, linear mixed-effects models, generalized estimating equations, and correlation-based feature selection (CFS). Results The results showed promising estimation performance with R2 of 0.30, which was derived using random forest after CFS. This model was able to distinguish the participants with low disability from those with high disability. Furthermore, we observed that the minute-level (≤ 8 minutes) step count, particularly those capturing the upper end of the step count distribution, had a stronger association with 6MWT. The use of a walking aid was indicative of ambulatory function measured through 6MWT. Conclusions This study demonstrates the utility of wearables devices in assessing ambulatory impairments in people with MS in free-living conditions and provides a basis for future investigation into the clinical relevance

Long-term participant retention and engagement patterns in an app and wearable-based multinational remote digital depression study

Recent growth in digital technologies has enabled the recruitment and monitoring of large and diverse populations in remote health studies. However, the generalizability of inference drawn from remotely collected health data could be severely impacted by uneven participant engagement and attrition over the course of the study. We report findings on long-term participant retention and engagement patterns in a large multinational observational digital study for depression containing active (surveys) and passive sensor data collected via Android smartphones, and Fitbit devices from 614 participants for up to 2 years. Majority of participants (67.6%) continued to remain engaged in the study after 43 weeks. Unsupervised clustering of participants' study apps and Fitbit usage data showed 3 distinct engagement subgroups for each data stream. We found: (i) the least engaged group had the highest depression severity (4 PHQ8 points higher) across all data streams; (ii) the least engaged group (completed 4 bi-weekly surveys) took significantly longer to respond to survey notifications (3.8 h more) and were 5 years younger compared to the most engaged group (completed 20 bi-weekly surveys); and (iii) a considerable proportion (44.6%) of the participants who stopped completing surveys after 8 weeks continued to share passive Fitbit data for significantly longer (average 42 weeks). Additionally, multivariate survival models showed participants' age, ownership and brand of smartphones, and recruitment sites to be associated with retention in the study. Together these findings could inform the design of future digital health studies to enable equitable and balanced data collection from diverse populations

Challenges in Using mHealth Data From Smartphones and Wearable Devices to Predict Depression Symptom Severity: Retrospective Analysis

BACKGROUND: Major depressive disorder (MDD) affects millions of people worldwide, but timely treatment is not often received owing in part to inaccurate subjective recall and variability in the symptom course. Objective and frequent MDD monitoring can improve subjective recall and help to guide treatment selection. Attempts have been made, with varying degrees of success, to explore the relationship between the measures of depression and passive digital phenotypes (features) extracted from smartphones and wearables devices to remotely and continuously monitor changes in symptomatology. However, a number of challenges exist for the analysis of these data. These include maintaining participant engagement over extended time periods and therefore understanding what constitutes an acceptable threshold of missing data; distinguishing between the cross-sectional and longitudinal relationships for different features to determine their utility in tracking within-individual longitudinal variation or screening individuals at high risk; and understanding the heterogeneity with which depression manifests itself in behavioral patterns quantified by the passive features. OBJECTIVE: We aimed to address these 3 challenges to inform future work in stratified analyses. METHODS: Using smartphone and wearable data collected from 479 participants with MDD, we extracted 21 features capturing mobility, sleep, and smartphone use. We investigated the impact of the number of days of available data on feature quality using the intraclass correlation coefficient and Bland-Altman analysis. We then examined the nature of the correlation between the 8-item Patient Health Questionnaire (PHQ-8) depression scale (measured every 14 days) and the features using the individual-mean correlation, repeated measures correlation, and linear mixed effects model. Furthermore, we stratified the participants based on their behavioral difference, quantified by the features, between periods of high (depression) and low (no depression) PHQ-8 scores using the Gaussian mixture model. RESULTS: We demonstrated that at least 8 (range 2-12) days were needed for reliable calculation of most of the features in the 14-day time window. We observed that features such as sleep onset time correlated better with PHQ-8 scores cross-sectionally than longitudinally, whereas features such as wakefulness after sleep onset correlated well with PHQ-8 longitudinally but worse cross-sectionally. Finally, we found that participants could be separated into 3 distinct clusters according to their behavioral difference between periods of depression and periods of no depression. CONCLUSIONS: This work contributes to our understanding of how these mobile health-derived features are associated with depression symptom severity to inform future work in stratified analyses