Effects of organizationally endorsed coaching on performance and validity of situational judgment tests

There is growing interest in organizationally provided or organizationally endorsed coaching. However, little is known about the effects of such coaching on test scores in operational settings. This study reports on an examination of such a program in the context of the use of a situational judgment test (SJT) for medical school admissions. We examine the effects of multiple types of coaching methods on SJT scores and on their construct-related and predictive validities. Results suggest that (1) commercial coaching techniques may not be as effective as previously thought, whereas organizationally provided methods may be more effective, and that (2) the criterion-related validity of the SJT scores is not degraded by the availability of coaching. Generally, this study illustrates that concerns about potential unfairness of coaching can be countered by making effective coaching available to all examinees, in the form of organizationally endorsed coaching

The Value of p-Value in Biomedical Research

Significance tests and the corresponding p-values play a crucial role in decision making. In this commentary the meaning, interpretation and misinterpretation of p-values is presented. Alternatives for evaluating the reported evidence are also discussed

Pilot study of an interactive voice response system to improve medication refill compliance

<p>Abstract</p> <p>Background</p> <p>Sub-optimal adherence to prescribed medications is well documented. Barriers to medication adherence include medication side effects, cost, and forgetting to take or refill medications. Interactive Voice Response (IVR) systems show promise as a tool for reminding individuals to take or refill medications. This pilot study evaluated the feasibility and acceptability of using an IVR system for prescription refill and daily medication reminders. We tested two novel features: personalized, medication-specific reminder messages and communication via voice recognition.</p> <p>Methods</p> <p>Patients enrolled in a study of electronic prescribing and medication management in Quebec, Canada who were taking chronic disease-related drugs were eligible to participate. Consenting patients had their demographic, telephone, and medication information transferred to an IVR system, which telephoned patients to remind them to take mediations and/or refill their prescriptions. Facilitators and barriers of the IVR system use and acceptability of the IVR system were assessed through a structured survey and open-ended questions administered by telephone interview.</p> <p>Results</p> <p>Of the 528 eligible patients who were contacted, 237 refused and 291 consented; 99 participants had started the pilot study when it was terminated because of physician and participant complaints. Thirty-eight participants completed the follow-up interview. The majority found the IVR system's voice acceptable, and did not have problems setting up the time and location of reminder calls. However, many participants experienced technical problems when called for reminders, such as incorrect time of calls and voice recognition difficulties. In addition, most participants had already refilled their prescriptions when they received the reminder calls, reporting that they did not have difficulties remembering to refill prescriptions on their own. Also, participants were not receptive to speaking to an automated voice system.</p> <p>Conclusion</p> <p>IVR systems designed to improve medication compliance must address key technical and performance issues and target those individuals with reported memory difficulties or complex medication regimens in order to improve the utility of the system. Future research should also identify characteristics of medication users who are more likely to be receptive to IVR technology.</p

Style, Function and Cultural Transmission

Recent evolutionary approaches to the understanding of lithic variability take us back to long-standing issues in lithic studies to do with the claimed contrast between style and function and the Binford-Bordes debate of the 1960s concerning the factors that affect inter-assemblage variation. In fact, the style and function contrast is an unhelpful one, not least when considering the question of convergence. Taking the definition of style as ‘a way of doing’, all functions are carried out in locally specific ways that have a transmission history, although the extent to which the history of the attributes relevant to the function have been subject to random drift and innovation patterns, as opposed to selection, will vary. Moreover, in a subtractive technology like lithics the extent to which a transmission signal will be visible in an attribute like the angle of a cutting edge is unclear. The contrasting view is that, in the case of lithics, functional requirements will always call into existence the technical innovations to satisfy them, which in any case are not that difficult to find. The paper addresses these and related issues with reference to previous work by Shennan and colleagues on the use of material culture to identify within and between group variation, the extent to which isolation-by-distance in space and time can account for the similarities and differences between assemblages, and the role of phylogenetic methods

National Origin and Behavioural Problems of Toddlers: The Role of Family Risk Factors and Maternal Immigration Characteristics

In many societies the prevalence of behavioural problems in school-aged children varies by national origin. We examined the association between national origin and behavioural problems in 1½-year-old children. Data on maternal national origin and the Child Behavior Checklist for toddlers (n = 4943) from a population-based cohort in the Netherlands were used. Children from various non-Dutch backgrounds all had a significantly higher mean behavioural problem score. After adjustment for family risk factors, like family income and maternal psychopathology, the differences attenuated, but remained statistically significant. Non-Dutch mothers with immigration risk factors, such as older age at immigration or no good Dutch language skills, reported significantly more behavioural problems in their offspring. In conclusion, the present study indicated more behavioural problems in immigrant toddlers from various backgrounds. Researchers and policymakers aiming to tackle disparities in behavioural problems should take into account that risks associated with national origin are intertwined with unfavourable family and immigration characteristics

Self-Guided Psychological Treatment for Depressive Symptoms: A Meta-Analysis

Background: A number of trials have examined the effects of self-guided psychological intervention, without any contact between the participants and a therapist or coach. The results and sizes of these trials have been mixed. This is the first quantitative meta-analysis, aimed at organizing and evaluating the literature, and estimating effect size. Method: We conducted systematic literature searches in PubMed, PsycINFO and Embase up to January 2010, and identified additional studies through earlier meta-analyses, and the references of included studies. We identified seven randomized controlled trials that met our inclusion criteria, with a total of 1,362 respondents. The overall quality of the studies was high. A post-hoc power calculation showed that the studies had sufficient statistical power to detect an effect size of d = 0.19. Results: The overall mean effect size indicating the difference between self-guided psychological treatment and control groups at post-test was d = 0.28 (pless than0.001), which corresponds to a NNT of 6.41. At 4 to 12 months follow-up the effect size was d = 0.23. There was no indication for significant publication bias. Conclusions: We found evidence that self-guided psychological treatment has a small but significant effect on participants with increased levels of depressive symptomatology.Original Publication:Pim Cuijpers, Tara Donker, Robert Johansson, David C. Mohr, Annemieke van Straten and Gerhard Andersson, Self-Guided Psychological Treatment for Depressive Symptoms: A Meta-Analysis, 2011, PLoS ONE, (6), 6.http://dx.doi.org/10.1371/journal.pone.0021274Copyright: Public Library of Science (PLoS)http://www.plos.org

Diagnostic accuracy of cerebrospinal fluid protein markers for sporadic Creutzfeldt-Jakob disease in Canada: a 6-year prospective study

<p>Abstract</p> <p>Background</p> <p>To better characterize the value of cerebrospinal fluid (CSF) proteins as diagnostic markers in a clinical population of subacute encephalopathy patients with relatively low prevalence of sporadic Creutzfeldt-Jakob disease (sCJD), we studied the diagnostic accuracies of several such markers (14-3-3, tau and S100B) in 1000 prospectively and sequentially recruited Canadian patients with clinically suspected sCJD.</p> <p>Methods</p> <p>The study included 127 patients with autopsy-confirmed sCJD (prevalence = 12.7%) and 873 with probable non-CJD diagnoses. Standard statistical measures of diagnostic accuracy were employed, including sensitivity (Se), specificity (Sp), predictive values (PVs), likelihood ratios (LRs), and Receiver Operating Characteristic (ROC) analysis.</p> <p>Results</p> <p>At optimal cutoff thresholds (empirically selected for 14-3-3, assayed by immunoblot; 976 pg/mL for tau and 2.5 ng/mL for S100B, both assayed by ELISA), Se and Sp respectively were 0.88 (95% CI, 0.81-0.93) and 0.72 (0.69-0.75) for 14-3-3; 0.91 (0.84-0.95) and 0.88 (0.85-0.90) for tau; and 0.87 (0.80-0.92) and 0.87 (0.84-0.89) for S100B. The observed differences in Sp between 14-3-3 and either of the other 2 markers were statistically significant. Positive LRs were 3.1 (2.8-3.6) for 14-3-3; 7.4 (6.9-7.8) for tau; and 6.6 (6.1-7.1) for S100B. Negative LRs were 0.16 (0.10-0.26) for 14-3-3; 0.10 (0.06-0.20) for tau; and 0.15 (0.09-0.20) for S100B. Estimates of areas under ROC curves were 0.947 (0.931-0.961) for tau and 0.908 (0.888-0.926) for S100B. Use of interval LRs (iLRs) significantly enhanced accuracy for patient subsets [<it>e.g</it>., 41/120 (34.2%) of tested sCJD patients displayed tau levels > 10,000 pg/mL, with an iLR of 56.4 (22.8-140.0)], as did combining tau and S100B [<it>e.g</it>., for tau > 976 pg/mL and S100B > 2.5 ng/mL, positive LR = 18.0 (12.9-25.0) and negative LR = 0.02 (0.01-0.09)].</p> <p>Conclusions</p> <p>CSF 14-3-3, tau and S100B proteins are useful diagnostic markers of sCJD even in a low-prevalence clinical population. CSF tau showed better overall diagnostic accuracy than 14-3-3 or S100B. Reporting of quantitative assay results and combining tau with S100B could enhance case definitions used in diagnosis and surveillance of sCJD.</p