CORE
🇺🇦
make metadata, not war
Services
Services overview
Explore all CORE services
Access to raw data
API
Dataset
FastSync
Content discovery
Recommender
Discovery
OAI identifiers
OAI Resolver
Managing content
Dashboard
Bespoke contracts
Consultancy services
Support us
Support us
Membership
Sponsorship
Community governance
Advisory Board
Board of supporters
Research network
About
About us
Our mission
Team
Blog
FAQs
Contact us
Technology and Dementia Preconference
Authors
V. Rentoumi Vassiliou, E. Demiraj, A. Pittaras, N. Mandalis, P. Alexandridou, M. Kemp, H. Eleftheriou, I. Danezi, M. Hatzopoulou, M. Kamtsadeli, V. Paliouras, G. Papatriantafyllou, J.D.
Publication date
1 January 2021
Publisher
Abstract
BACKGROUND: Various neurodegenerative and psychiatric diseases are related with changes in spoken language [1], although they have seldom been investigated. We evaluate the effectiveness of our language-agnostic Machine Learning (ML) system to detect subtle changes in spoken language that manifest early signs of cognitive decline, thus assisting with its diagnosis. We evaluate our methodology using recordings of speech samples from multiple languages obtained from patient cohorts in early stages of cognitive decline and matched healthy controls. METHOD: Our methodology involves capturing patient audio recordings while they are performing one or more predefined cognitive assessment tasks, involving, e.g., the description of a picture or recounting of an everyday activity. Afterwards, multi-language audio recordings and generated transcripts are analyzed with audio and NLP feature extraction methods [3], ranging from semantic, morpho-syntactic, phonological representations of the input, as well as, more sophisticated linguistic measures. The feature pool is filtered by a Pearson's rho threshold of 0.85. We build a Random Forest classifier out of 100 Decision trees, using the Gini impurity criterion, 5-fold cross-validation for training, elimination and composition-based feature selection, as well as post-selection retraining / fine-tuning. The model's diagnostic performance is evaluated on a test set unseen during training. RESULT: Our results are validated against the diagnosis that is provided by medical experts. Our performance in terms of accuracy (∼82%), f1 (84%) and ROC-AUC score (∼82%) are clear indicators of the effectiveness of speech analysis towards detecting cognitive decline. Moreover, our tree-based classifier produces probability scores that closely follow the proportion of pathological cases in the input data, with a correlation of 94%. CONCLUSION: In the current evaluation we verified our conjectures regarding the strong capacity of speech to predict cognitive decline. Audio analysis and machine learning are proven to be invaluable tools in the prediction of early signs of cognitive decline, which are coupled with a wide spectrum of neurodegenerative and psychiatric diseases. [1] Boschi, Veronica, et al., Frontiers in psychology 8 (2017): 269. [2] Vassiliki Rentoumi et al., Alzheimer's & Dementia, Wiley, volume 16, 2020. [3] Alberdi, Ane et al., Artificial intelligence in medicine 71 (2016): 1-29. © 2021 the Alzheimer's Association
Similar works
Full text
Available Versions
Pergamos : Unified Institutional Repository / Digital Library Platform of the National and Kapodistrian University of Athens
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:lib.uoa.gr:uoadl:2996963
Last time updated on 10/02/2023