Initial assessment of reliability of a self-administered web-based neuropsychological test battery

AbstractIntroductionWeb-based neuropsychological testing can be an important tool in meeting the increasing demands for neuropsychological assessment in the clinic and in large research studies. The primary aim of this study was to investigate practice effects and reliability of self-administered web-based neuropsychological tests in Memoro. Due to lack of consistent analysis and reporting of reliability in the literature, especially intraclass correlation coefficients (ICC), we highlight how using different ICC measures results in different estimates of reliability.Method61 (31 females) participants (mean age 53.3 years) completed the Memoro tests twice with a median of 14 days between testing.ResultsPractice effects were detected for all cognitive measures (d = 0.32–0.61), most pronounced for memory measures. Reliability estimated using two-way random effects single measure absolute agreement ICC(2,1) were between 0.55 and 0.74. Two-way mixed effects average measure consistency ICC(3,2), ranged from 0.79 to 0.89. Reliability was highest for the processing speed task and lower for the memory tasks.ConclusionsMemoro tests had test-retest reliability similar to that of traditional, computerized and web-based test batteries used clinically and in research. It is important to carefully choose and specify the ICC implemented, as ICC(2,1) and ICC(3,2) give different results and reflect reliability of different measures

Adolescent brain cognitive development (ABCD) study: Overview of substance use assessment methods.

One of the objectives of the Adolescent Brain Cognitive Development (ABCD) Study (https://abcdstudy.org/) is to establish a national longitudinal cohort of 9 and 10 year olds that will be followed for 10 years in order to prospectively study the risk and protective factors influencing substance use and its consequences, examine the impact of substance use on neurocognitive, health and psychosocial outcomes, and to understand the relationship between substance use and psychopathology. This article provides an overview of the ABCD Study Substance Use Workgroup, provides the goals for the workgroup, rationale for the substance use battery, and includes details on the substance use module methods and measurement tools used during baseline, 6-month and 1-year follow-up assessment time-points. Prospective, longitudinal assessment of these substance use domains over a period of ten years in a nationwide sample of youth presents an unprecedented opportunity to further understand the timing and interactive relationships between substance use and neurocognitive, health, and psychopathology outcomes in youth living in the United States

Examining the link between information processing speed and executive functioning in multiple sclerosis

Slowed information processing speed (IPS) is frequently reported in those with multiple sclerosis (MS), and at least 20% are compromised on some aspect of executive functioning also. However, any relationship between these two processes has not been examined. The Sternberg Memory Scanning Test, Processing Speed Index (WAIS-III), Delis Kaplan Executive Function System (D.KEFS), and Working Memory Index (WMS-III) were administered to 90 participants with MS. Their performance on the PSI was significantly below the normative scores but no deficits in memory scanning speed were evident. The initial response speed of the Sternberg and the PSI were more closely related to D.KEFS performance, particularly in timed tasks with a high cognitive demand (switching tasks). In contrast, memory scanning speed was related to working memory. This study reinforces the link between IPS and working memory in MS, and supports the suggestion that IPS is not a unitary construct

Remote Neuropsychological Assessment: Does Mode of Administration Matter?

Neuropsychology relies heavily on standardization of administration to increase the validity, reliability, sensitivity, and specificity of an assessment instrument. The COVID-19 pandemic has rapidly increased the need to be able to provide neuropsychological assessments remotely. Teleneuropsychology can be conducted through various avenues, including telephone, computerized, and televideo modalities. Given neuropsychology\u27s reliance on standardization for proper use of normative data that accompanies individual assessments, the question arises how mode of administration impacts the validity, reliability, sensitivity, and specificity of an assessment instrument. The literature review summarizes the research conducted regarding the validity, reliability, sensitivity, and specificity of telephone neuropsychological assessments, computerized neuropsychological assessments, and televideo neuropsychological assessments. Additionally, the literature review aims to provide guidelines for best practice for each mode of administration for practicing neuropsychologists

A novel computer adaptive word list memory test optimized for remote assessment: Psychometric properties and associations with neurodegenerative biomarkers in older women without dementia

Introduction: This study established the psychometric properties and preliminary validity of the Stricker Learning Span (SLS), a novel computer adaptive word list memory test designed for remote assessment and optimized for smartphone use. Methods: Women enrolled in the Mayo Clinic Specialized Center of Research Excellence (SCORE) were recruited via e-mail or phone to complete two remote cognitive testing sessions. Convergent validity was assessed through correlation with previously administered in-person neuropsychological tests (n = 96, ages 55-79) and criterion validity through associations with magnetic resonance imaging measures of neurodegeneration sensitive to Alzheimer\u27s disease (n = 47). Results: SLS performance significantly correlated with the Auditory Verbal Learning Test and measures of neurodegeneration (temporal meta-regions of interest and entorhinal cortical thickness, adjusting for age and education). Test-retest reliabilities across two sessions were 0.71-0.76 (two-way mixed intraclass correlation coefficients). Discussion: The SLS is a valid and reliable self-administered memory test that shows promise for remote assessment of aging and neurodegenerative disorders

Examining User Feedback of a Teleneuropsychological Platform in a mixed sample of Norwegians and Polish People in Norway

Denne studien forsøker å utforske brukernes tilfredshet og tilbakemeldinger ved bruk av telenevropsykologiske tester blant norske og polske deltakere bosatt i Norge, samt å undersøke potensielle forskjeller i kognitive vurderinger for norsk for polske og norske deltakere. Sosiale medieinnlegg ble brukt for å rekruttere deltakere, noe som resulterte i 37 påmeldinger, hvorav åtte deltakere fullførte testene og bruker-tilfredshetsundersøkelsen, som resulterte i en svarprosent på 22%. Utvalget inkluderte én person som ønsket sammenligning med biologiske menn og syv med biologiske kvinner. Polske deltakere utgjorde 25% av utvalget. Deltakernes alder varierte fra 18 til 69 år, og 75% hadde fullført 16 års utdanning eller mer. TeleNP-testene ble utført ved hjelp av Mindmores screeningsbatteri i den norske versjonen. Flertallet av testene ble automatisk scoret, og brukernes opplevelser ble vurdert på en Likert-skala (0-4), og kvalitative tilbakemeldinger ble samlet inn gjennom åpne tekstspørsmål. Totalt sett rapporterte deltakerne om en positiv brukeropplevelse. Imidlertid opplevde polske deltakere lavere brukertilfredshet og flere tekniske vanskeligheter sammenlignet med de norske deltakerne. Gjennomsnittlig Z-score for kognitive funksjoner var noe under de svenske normative verdiene: Hukommelse z=-0.43; Oppmerksomhet og Tempo z=-0.49; Eksekutive funksjoner z=-0.37. Denne studien belyser potensialet for telenevropsykologisk testing i Norge. Imidlertid krever det lille utvalget forsiktighet ved tolkning av resultatene. Videre forskning med større og mer variert utvalg er nødvendig for å trekke mer definitive konklusjoner.Hovedoppgave psykologprogrammetPROPSY317PRPSY