Development and psychometric testing of an instrument to evaluate cognitive skills of evidence based practice in student health professionals

<p>Abstract</p> <p>Background</p> <p>Health educators need rigorously developed instruments to evaluate cognitive skills relating to evidence based practice (EBP). Previous EBP evaluation instruments have focused on the acquisition and appraisal of the evidence and are largely based in the medical profession. The aim of this study was to develop and validate an EBP evaluation instrument to assess EBP cognitive skills for entry-level health professional disciplines.</p> <p>Methods</p> <p>The Fresno test of competence in evidence based medicine was considered in the development of the 'Knowledge of Research Evidence Competencies' instrument (K-REC). The K-REC was reviewed for content validity. Two cohorts of entry-level students were recruited for the pilot study, those who had been exposed to EBP training (physiotherapy students, n = 24), and who had not been exposed to EBP training (human movement students, n = 76). The K-REC was administered to one cohort of students (n = 24) on two testing occasions to evaluate test-retest reliability. Two raters independently scored the first test occasion (n = 24) to evaluate the inter-rater reliability of the marking guidelines. Construct validity was assessed by comparison of the two groups, 'exposed' and 'non-exposed', and the percentage of students achieving a 'pass' score in each of these groups. Item difficulty was established.</p> <p>Results</p> <p>Among the 100 participants (24 EBP 'exposed', and 76 EBP 'non-exposed' students), there was a statistically significant (<it>p </it>< 0.0001) difference in the total K-REC scores. The test-retest and inter-rater reliability of the individual items and total scores ranged from moderate to excellent (measured by Cohen's Kappa and ICC, range: 0.62 to perfect agreement).</p> <p>Conclusions</p> <p>The K-REC instrument is a valid and reliable evaluation instrument of cognitive skills of EBP in entry-level student health professionals. The instrument is quick to disseminate and easy to score, making it a suitable instrument for health educators to employ to evaluate students' knowledge of EBP or in the evaluation of entry-level EBP training.</p

Dysconnection in schizophrenia: from abnormal synaptic plasticity to failures of self-monitoring

Over the last 2 decades, a large number of neurophysiological and neuroimaging studies of patients with schizophrenia have furnished in vivo evidence for dysconnectivity, ie, abnormal functional integration of brain processes. While the evidence for dysconnectivity in schizophrenia is strong, its etiology, pathophysiological mechanisms, and significance for clinical symptoms are unclear. First, dysconnectivity could result from aberrant wiring of connections during development, from aberrant synaptic plasticity, or from both. Second, it is not clear how schizophrenic symptoms can be understood mechanistically as a consequence of dysconnectivity. Third, if dysconnectivity is the primary pathophysiology, and not just an epiphenomenon, then it should provide a mechanistic explanation for known empirical facts about schizophrenia. This article addresses these 3 issues in the framework of the dysconnection hypothesis. This theory postulates that the core pathology in schizophrenia resides in aberrant N-methyl-D-aspartate receptor (NMDAR)–mediated synaptic plasticity due to abnormal regulation of NMDARs by neuromodulatory transmitters like dopamine, serotonin, or acetylcholine. We argue that this neurobiological mechanism can explain failures of self-monitoring, leading to a mechanistic explanation for first-rank symptoms as pathognomonic features of schizophrenia, and may provide a basis for future diagnostic classifications with physiologically defined patient subgroups. Finally, we test the explanatory power of our theory against a list of empirical facts about schizophrenia

Development and evaluation of a risk algorithm predicting alcohol dependence after early onset of regular alcohol use

The ESEMeD project is funded by the European Commission (Contracts QLG5-1999-01042; SANCO 2004123 and EAHC 20081308). The Portuguese Mental Health Study was carried out by the Department of Mental Health, Faculty of Medical Sciences, NOVA University of Lisbon, with collaboration of the Portuguese Catholic University, and was funded by Champalimaud Foundation, Gulbenkian Foundation, Foundation for Science and Technology (FCT) and Ministry of Health.Aims: Likelihood of alcohol dependence (AD) is increased among people who transition to greater levels of alcohol involvement at a younger age. Indicated interventions delivered early may be effective in reducing risk, but could be costly. One way to increase cost-effectiveness would be to develop a prediction model that targeted interventions to the subset of youth with early alcohol use who are at highest risk of subsequent AD. Design: A prediction model was developed for DSM-IV AD onset by age 25 years using an ensemble machine-learning algorithm known as ‘Super Learner’. Shapley additive explanations (SHAP) assessed variable importance. Setting and Participants: Respondents reporting early onset of regular alcohol use (i.e. by 17 years of age) who were aged 25 years or older at interview from 14 representative community surveys conducted in 13 countries as part of WHO's World Mental Health Surveys. Measurements: The primary outcome to be predicted was onset of life-time DSM-IV AD by age 25 as measured using the Composite International Diagnostic Interview, a fully structured diagnostic interview. Findings: AD prevalence by age 25 was 5.1% among the 10 687 individuals who reported drinking alcohol regularly by age 17. The prediction model achieved an external area under the curve [0.78; 95% confidence interval (CI) = 0.74–0.81] higher than any individual candidate risk model (0.73–0.77) and an area under the precision-recall curve of 0.22. Overall calibration was good [integrated calibration index (ICI) = 1.05%]; however, miscalibration was observed at the extreme ends of the distribution of predicted probabilities. Interventions provided to the 20% of people with highest risk would identify 49% of AD cases and require treating four people without AD to reach one with AD. Important predictors of increased risk included younger onset of alcohol use, males, higher cohort alcohol use and more mental disorders. Conclusions: A risk algorithm can be created using data collected at the onset of regular alcohol use to target youth at highest risk of alcohol dependence by early adulthood. Important considerations remain for advancing the development and practical implementation of such models.publishersversionepub_ahead_of_prin

Development and evaluation of a risk algorithm predicting alcohol dependence after early onset of regular alcohol use

The ESEMeD project is funded by the European Commission (Contracts QLG5-1999-01042; SANCO 2004123 and EAHC 20081308). The Portuguese Mental Health Study was carried out by the Department of Mental Health, Faculty of Medical Sciences, NOVA University of Lisbon, with collaboration of the Portuguese Catholic University, and was funded by Champalimaud Foundation, Gulbenkian Foundation, Foundation for Science and Technology (FCT) and Ministry of Health.Aims: Likelihood of alcohol dependence (AD) is increased among people who transition to greater levels of alcohol involvement at a younger age. Indicated interventions delivered early may be effective in reducing risk, but could be costly. One way to increase cost-effectiveness would be to develop a prediction model that targeted interventions to the subset of youth with early alcohol use who are at highest risk of subsequent AD. Design: A prediction model was developed for DSM-IV AD onset by age 25 years using an ensemble machine-learning algorithm known as ‘Super Learner’. Shapley additive explanations (SHAP) assessed variable importance. Setting and Participants: Respondents reporting early onset of regular alcohol use (i.e. by 17 years of age) who were aged 25 years or older at interview from 14 representative community surveys conducted in 13 countries as part of WHO's World Mental Health Surveys. Measurements: The primary outcome to be predicted was onset of life-time DSM-IV AD by age 25 as measured using the Composite International Diagnostic Interview, a fully structured diagnostic interview. Findings: AD prevalence by age 25 was 5.1% among the 10 687 individuals who reported drinking alcohol regularly by age 17. The prediction model achieved an external area under the curve [0.78; 95% confidence interval (CI) = 0.74–0.81] higher than any individual candidate risk model (0.73–0.77) and an area under the precision-recall curve of 0.22. Overall calibration was good [integrated calibration index (ICI) = 1.05%]; however, miscalibration was observed at the extreme ends of the distribution of predicted probabilities. Interventions provided to the 20% of people with highest risk would identify 49% of AD cases and require treating four people without AD to reach one with AD. Important predictors of increased risk included younger onset of alcohol use, males, higher cohort alcohol use and more mental disorders. Conclusions: A risk algorithm can be created using data collected at the onset of regular alcohol use to target youth at highest risk of alcohol dependence by early adulthood. Important considerations remain for advancing the development and practical implementation of such models.publishersversionepub_ahead_of_prin

The Epidemiology of Alcohol Use Disorders Cross-Nationally: Findings from the World Mental Health Surveys

Background: Prevalences of Alcohol Use Disorders (AUDs) and Mental Health Disorders (MHDs) in many individual countries have been reported but there are few cross-national studies. The WHO World Mental Health (WMH) Survey Initiative standardizes methodological factors facilitating comparison of the prevalences and associated factors of AUDs in a large number of countries to identify differences and commonalities. Methods: Lifetime and 12-month prevalence estimates of DSM-IV AUDs, MHDs, and associations were assessed in the 29 WMH surveys using the WHO CIDI 3.0. Results: Prevalence estimates of alcohol use and AUD across countries and WHO regions varied widely. Mean lifetime prevalence of alcohol use in all countries combined was 80%, ranging from 3.8% to 97.1%. Combined average population lifetime and 12-month prevalence of AUDs were 8.6% and 2.2% respectively and 10.7% and 4.4% among non-abstainers. Of individuals with a lifetime AUD, 43.9% had at least one lifetime MHD and 17.9% of respondents with a lifetime MHD had a lifetime AUD. For most comorbidity combinations, the MHD preceded the onset of the AUD. AUD prevalence was much higher for men than women. 15% of all lifetime AUD cases developed before age 18. Higher household income and being older at time of interview, married, and more educated, were associated with a lower risk for lifetime AUD and AUD persistence. Conclusions: Prevalence of alcohol use and AUD is high overall, with large variation worldwide. The WMH surveys corroborate the wide geographic consistency of a number of well-documented clinical and epidemiological findings and patterns

Association of Cohort and Individual Substance Use With Risk of Transitioning to Drug Use, Drug Use Disorder, and Remission From Disorder: Findings From the World Mental Health Surveys

Importance: Limited empirical research has examined the extent to which cohort-level prevalence of substance use is associated with the onset of drug use and transitioning into greater involvement with drug use. Objective: To use cross-national data to examine time-space variation in cohort-level drug use to assess its associations with onset and transitions across stages of drug use, abuse, dependence, and remission. Design, Setting, and Participants: The World Health Organization World Mental Health Surveys carried out cross-sectional general population surveys in 25 countries using a consistent research protocol and assessment instrument. Adults from representative household samples were interviewed face-to-face in the community in relation to drug use disorders. The surveys were conducted between 2001 and 2015. Data analysis was performed from July 2017 to July 2018. Main Outcomes and Measures: Data on timing of onset of lifetime drug use, DSM-IV drug use disorders, and remission from these disorders was assessed using the Composite International Diagnostic Interview. Associations of cohort-level alcohol prevalence and drug use prevalence were examined as factors associated with these transitions. Results: Among the 90 027 respondents (48.1% [SE, 0.2%] men; mean [SE] age, 42.1 [0.1] years), 1 in 4 (24.8% [SE, 0.2%]) reported either illicit drug use or extramedical use of prescription drugs at some point in their lifetime, but with substantial time-space variation in this prevalence. Among users, 9.1% (SE, 0.2%) met lifetime criteria for abuse, and 5.0% (SE, 0.2%) met criteria for dependence. Individuals who used 2 or more drugs had an increased risk of both abuse (odds ratio, 5.17 [95% CI, 4.66-5.73]; P \u3c .001) and dependence (odds ratio, 5.99 [95% CI, 5.02-7.16]; P \u3c .001) and reduced probability of remission from abuse (odds ratio, 0.86 [95% CI, 0.76-0.98]; P = .02). Birth cohort prevalence of drug use was also significantly associated with both initiation and illicit drug use transitions; for example, after controlling for individuals’ experience of substance use and demographics, for each additional 10% of an individual’s cohort using alcohol, a person’s odds of initiating drug use increased by 28% (odds ratio, 1.28 [95% CI, 1.26-1.31]). Each 10% increase in a cohort’s use of drug increased individual risk by 12% (1.12 [95% CI, 1.11-1.14]). Conclusions and Relevance: Birth cohort substance use is associated with drug use involvement beyond the outcomes of individual histories of alcohol and other drug use. This has important implications for understanding pathways into and out of problematic drug use

The descriptive epidemiology of DSM-IV Adult ADHD in the World Health Organization World Mental Health Surveys

We previously reported on the cross-national epidemiology of ADHD from the first 10 countries in the WHO World Mental Health (WMH) Surveys. The current report expands those previous findings to the 20 nationally or regionally representative WMH surveys that have now collected data on adult ADHD. The Composite International Diagnostic Interview (CIDI) was administered to 26,744 respondents in these surveys in high-, upper-middle-, and low-/lower-middle-income countries (68.5% mean response rate). Current DSM-IV/CIDI adult ADHD prevalence averaged 2.8% across surveys and was higher in high (3.6%)- and upper-middle (3.0%)- than low-/lower-middle (1.4%)-income countries. Conditional prevalence of current ADHD averaged 57.0% among childhood cases and 41.1% among childhood subthreshold cases. Adult ADHD was significantly related to being male, previously married, and low education. Adult ADHD was highly comorbid with DSM-IV/CIDI anxiety, mood, behavior, and substance disorders and significantly associated with role impairments (days out of role, impaired cognition, and social interactions) when controlling for comorbidities. Treatment seeking was low in all countries and targeted largely to comorbid conditions rather than to ADHD. These results show that adult ADHD is prevalent, seriously impairing, and highly comorbid but vastly under-recognized and undertreated across countries and cultures

2 Drug Abuse Heterogeneity and the Search for Subtypes 1. SUBSTANCE ABUSE AND HETEROGENEITY

Progress in treating health problems is often made by determining the critical commonalities and differences among the phenomena of interest, using observations to discriminate subtypes, and then determining the underlying mechanisms and etiologies of the subtypes. These causal attributions typically become the distinguishing principles on which the sub-categories are based. When the identified subtypes indicate varying etiological factors, there may be varying subtype-specific indicated interventions. In such cases, differential diagnosis then becomes a primary step in formulating optimal treatment. The benefits of specifying the subtype