Automated detection of mild cognitive impairment and dementia from voice recordings: A natural language processing approach

INTRODUCTION: Automated computational assessment of neuropsychological tests would enable widespread, cost-effective screening for dementia. METHODS: A novel natural language processing approach is developed and validated to identify different stages of dementia based on automated transcription of digital voice recordings of subjects' neuropsychological tests conducted by the Framingham Heart Study (n = 1084). Transcribed sentences from the test were encoded into quantitative data and several models were trained and tested using these data and the participants' demographic characteristics. RESULTS: Average area under the curve (AUC) on the held-out test data reached 92.6%, 88.0%, and 74.4% for differentiating Normal cognition from Dementia, Normal or Mild Cognitive Impairment (MCI) from Dementia, and Normal from MCI, respectively. DISCUSSION: The proposed approach offers a fully automated identification of MCI and dementia based on a recorded neuropsychological test, providing an opportunity to develop a remote screening tool that could be adapted easily to any language.AG054156 - NIA NIH HHS; RF1 AG062109 - NIA NIH HHS; AG049810 - NIA NIH HHS; U19 AG068753 - NIA NIH HHS; HHSN268201500001I - NHLBI NIH HHS; R01 AG016495 - NIA NIH HHS; UL54 TR004130 - NIH HHS; R01 GM135930 - NIGMS NIH HHS; RF1 AG072654 - NIA NIH HHS; AARG-NTF-20-643020 - Alzheimer's Association; R21-CA253498 - NIH HHS; AG033040 - NIA NIH HHS; AG068753 - NIA NIH HHS; R01-HL159620 - NIH HHS; AG016495 - NIA NIH HHS; R01 GM135930 - NIH HHS; AG008122 - NIA NIH HHS; R01 AG033040 - NIA NIH HHS; R56 AG062109 - NIA NIH HHS; AG062109 - NIA NIH HHS; CCF-2200052 - National Science Foundation; IIS-1914792 - National Science Foundation; DMS-1664644 - National Science FoundationAccepted manuscrip

Association between acoustic features and brain volumes: the Framingham Heart Study

IntroductionAlthough brain magnetic resonance imaging (MRI) is a valuable tool for investigating structural changes in the brain associated with neurodegeneration, the development of non-invasive and cost-effective alternative methods for detecting early cognitive impairment is crucial. The human voice has been increasingly used as an indicator for effectively detecting cognitive disorders, but it remains unclear whether acoustic features are associated with structural neuroimaging.MethodsThis study aims to investigate the association between acoustic features and brain volume and compare the predictive power of each for mild cognitive impairment (MCI) in a large community-based population. The study included participants from the Framingham Heart Study (FHS) who had at least one voice recording and an MRI scan. Sixty-five acoustic features were extracted with the OpenSMILE software (v2.1.3) from each voice recording. Nine MRI measures were derived according to the FHS MRI protocol. We examined the associations between acoustic features and MRI measures using linear regression models adjusted for age, sex, and education. Acoustic composite scores were generated by combining acoustic features significantly associated with MRI measures. The MCI prediction ability of acoustic composite scores and MRI measures were compared by building random forest models and calculating the mean area under the receiver operating characteristic curve (AUC) of 10-fold cross-validation.ResultsThe study included 4,293 participants (age 57 ± 13 years, 53.9% women). During 9.3 ± 3.7 years follow-up, 106 participants were diagnosed with MCI. Seven MRI measures were significantly associated with more than 20 acoustic features after adjusting for multiple testing. The acoustic composite scores can improve the AUC for MCI prediction to 0.794, compared to 0.759 achieved by MRI measures.DiscussionWe found multiple acoustic features were associated with MRI measures, suggesting the potential for using acoustic features as easily accessible digital biomarkers for the early diagnosis of MCI

Association Between Acoustic Features and Neuropsychological Test Performance in the Framingham Heart Study: Observational Study

BackgroundHuman voice has increasingly been recognized as an effective indicator for the detection of cognitive disorders. However, the association of acoustic features with specific cognitive functions and mild cognitive impairment (MCI) has yet to be evaluated in a large community-based population. ObjectiveThis study aimed to investigate the association between acoustic features and neuropsychological (NP) tests across multiple cognitive domains and evaluate the added predictive power of acoustic composite scores for the classification of MCI. MethodsThis study included participants without dementia from the Framingham Heart Study, a large community-based cohort with longitudinal surveillance for incident dementia. For each participant, 65 low-level acoustic descriptors were derived from voice recordings of NP test administration. The associations between individual acoustic descriptors and 18 NP tests were assessed with linear mixed-effect models adjusted for age, sex, and education. Acoustic composite scores were then built by combining acoustic features significantly associated with NP tests. The added prediction power of acoustic composite scores for prevalent and incident MCI was also evaluated. ResultsThe study included 7874 voice recordings from 4950 participants (age: mean 62, SD 14 years; 4336/7874, 55.07% women), of whom 453 were diagnosed with MCI. In all, 8 NP tests were associated with more than 15 acoustic features after adjusting for multiple testing. Additionally, 4 of the acoustic composite scores were significantly associated with prevalent MCI and 7 were associated with incident MCI. The acoustic composite scores can increase the area under the curve of the baseline model for MCI prediction from 0.712 to 0.755. ConclusionsMultiple acoustic features are significantly associated with NP test performance and MCI, which can potentially be used as digital biomarkers for early cognitive impairment monitoring

Digital sleep measures and white matter health in the Framingham Heart Study.

AimImpaired sleep quality and sleep oxygenation are common sleep pathologies. This study assessed the impact of these abnormalities on white matter (WM) integrity in an epidemiological cohort.MethodsThe target population was the Framingham Heart Study Generation-2/Omni-1 Cohorts. Magnetic resonance imaging (diffusion tensor imaging) was used to assess WM integrity. Wearable digital devices were used to assess sleep quality: the (M1-SleepImage™ system) and the Nonin WristOx for nocturnal oxygenation. The M1 device collects trunk actigraphy and the electrocardiogram (ECG); sleep stability indices were computed using cardiopulmonary coupling using the ECG. Two nights of recording were averaged.ResultsStable sleep was positively associated with WM health. Actigraphic periods of wake during the sleep period were associated with increased mean diffusivity. One marker of sleep fragmentation which covaries with respiratory chemoreflex activation was associated with reduced fractional anisotropy and increased mean diffusivity. Both oxygen desaturation index and oxygen saturation time under 90% were associated with pathological directions of diffusion tensor imaging signals. Gender differences were noted across most variables, with female sex showing the larger and significant impact.ConclusionsSleep quality assessed by a novel digital analysis and sleep hypoxia was associated with WM injury, especially in women

Associations Between the Digital Clock Drawing Test and Brain Volume: Large Community-Based Prospective Cohort (Framingham Heart Study)

BackgroundThe digital Clock Drawing Test (dCDT) has been recently used as a more objective tool to assess cognition. However, the association between digitally obtained clock drawing features and structural neuroimaging measures has not been assessed in large population-based studies. ObjectiveWe aimed to investigate the association between dCDT features and brain volume. MethodsThis study included participants from the Framingham Heart Study who had both a dCDT and magnetic resonance imaging (MRI) scan, and were free of dementia or stroke. Linear regression models were used to assess the association between 18 dCDT composite scores (derived from 105 dCDT raw features) and brain MRI measures, including total cerebral brain volume (TCBV), cerebral white matter volume, cerebral gray matter volume, hippocampal volume, and white matter hyperintensity (WMH) volume. Classification models were also built from clinical risk factors, dCDT composite scores, and MRI measures to distinguish people with mild cognitive impairment (MCI) from those whose cognition was intact. ResultsA total of 1656 participants were included in this study (mean age 61 years, SD 13 years; 50.9% women), with 23 participants diagnosed with MCI. All dCDT composite scores were associated with TCBV after adjusting for multiple testing (P value <.05/18). Eleven dCDT composite scores were associated with cerebral white matter volume, but only 1 dCDT composite score was associated with cerebral gray matter volume. None of the dCDT composite scores was associated with hippocampal volume or WMH volume. The classification model for differentiating MCI and normal cognition participants, which incorporated age, sex, education, MRI measures, and dCDT composite scores, showed an area under the curve of 0.897. ConclusionsdCDT composite scores were significantly associated with multiple brain MRI measures in a large community-based cohort. The dCDT has the potential to be used as a cognitive assessment tool in the clinical diagnosis of MCI

Design and Feasibility Analysis of a Smartphone‐Based Digital Cognitive Assessment Study in the Framingham Heart Study

Background Smartphone‐based digital technology is increasingly being recognized as a cost‐effective, scalable, and noninvasive method of collecting longitudinal cognitive and behavioral data. Accordingly, a state‐of‐the‐art 3‐year longitudinal project focused on collecting multimodal digital data for early detection of cognitive impairment was developed. Methods and Results A smartphone application collected 2 modalities of cognitive data, digital voice and screen‐based behaviors, from the FHS (Framingham Heart Study) multigenerational Generation 2 (Gen 2) and Generation 3 (Gen 3) cohorts. To understand the feasibility of conducting a smartphone‐based study, participants completed a series of questions about their smartphone and app use, as well as sensory and environmental factors that they encountered while completing the tasks on the app. Baseline data collected to date were from 537 participants (mean age=66.6 years, SD=7.0; 58.47% female). Across the younger participants from the Gen 3 cohort (n=455; mean age=60.8 years, SD=8.2; 59.12% female) and older participants from the Gen 2 cohort (n=82; mean age=74.2 years, SD=5.8; 54.88% female), an average of 76% participants agreed or strongly agreed that they felt confident about using the app, 77% on average agreed or strongly agreed that they were able to use the app on their own, and 81% on average rated the app as easy to use. Conclusions Based on participant ratings, the study findings are promising. At baseline, the majority of participants are able to complete the app‐related tasks, follow the instructions, and encounter minimal barriers to completing the tasks independently. These data provide evidence that designing and collecting smartphone application data in an unsupervised, remote, and naturalistic setting in a large, community‐based population is feasible

Comparing Cognitive Tests and Smartphone‐Based Assessment in 2 US Community‐Based Cohorts

Background Smartphone‐based cognitive assessments have emerged as promising tools, bridging gaps in accessibility and reducing bias in Alzheimer disease and related dementia research. However, their congruence with traditional neuropsychological tests and usefulness in diverse cohorts remain underexplored. Methods and Results A total of 406 FHS (Framingham Heart Study) and 59 BHS (Bogalusa Heart Study) participants with traditional neuropsychological tests and digital assessments using the Defense Automated Neurocognitive Assessment (DANA) smartphone protocol were included. Regression models investigated associations between DANA task digital measures and a neuropsychological global cognitive Z score (Global Cognitive Score [GCS]), and neuropsychological domain‐specific Z scores. FHS participants’ mean age was 57 (SD, 9.75) years, and 44% (179) were men. BHS participants' mean age was 49 (4.4) years, and 28% (16) were men. Participants in both cohorts with the lowest neuropsychological performance (lowest quartile, GCS1) demonstrated lower DANA digital scores. In the FHS, GCS1 participants had slower average response times and decreased cognitive efficiency scores in all DANA tasks (P<0.05). In BHS, participants in GCS1 had slower average response times and decreased cognitive efficiency scores for DANA Code Substitution and Go/No‐Go tasks, although this was not statistically significant. In both cohorts, GCS was significantly associated with DANA tasks, such that higher GCS correlated with faster average response times (P<0.05) and increased cognitive efficiency (all P<0.05) in the DANA Code Substitution task. Conclusions Our findings demonstrate that smartphone‐based cognitive assessments exhibit concurrent validity with a composite measure of traditional neuropsychological tests. This supports the potential of using smartphone‐based assessments in cognitive screening across diverse populations and the scalability of digital assessments to community‐dwelling individuals