A latent trait look at pretest-posttest validation of criterion-referenced test items

Since Cox and Vargas (1966) introduced their pretest-posttest validity index for criterion-referenced test items, a great number of additions and modifications have followed. All are based on the idea of gain scoring; that is, they are computed from the differences between proportions of pretest and posttest item responses. Although the method is simple and generally considered as the prototype of criterion-referenced item analysis, it has many and serious disadvantages. Some of these go back to the fact that it leads to indices based on a dual test administration- and population-dependent item p values. Others have to do with the global information about the discriminating power that these indices provide, the implicit weighting they suppose, and the meaningless maximization of posttest scores they lead to. Analyzing the pretest-posttest method from a latent trait point of view, it is proposed to replace indices like Cox and Vargas’ Dpp by an evaluation of the item information function for the mastery score. An empirical study was conducted to compare the differences in item selection between both methods

Enhancement of toxin- and virus-neutralizing capacity of single-domain antibody fragments by N-glycosylation

Single-domain antibody fragments (VHHs) have several beneficial properties as compared to conventional antibody fragments. However, their small size complicates their toxin- and virus-neutralizing capacity. We isolated 27 VHHs binding Escherichia coli heat-labile toxin and expressed these in Saccharomyces cerevisiae. The most potent neutralizing VHH (LT109) was N-glycosylated, resulting in a large increase in molecular mass. This suggests that N-glycosylation of LT109 improves its neutralizing capacity. Indeed, deglycosylation of LT109 decreased its neutralizing capacity three- to fivefold. We also studied the effect of glycosylation of two previously isolated VHHs on their ability to neutralize foot-and-mouth disease virus. For this purpose, these VHHs that lacked potential N-glycosylation sites were genetically fused to another VHH that was known to be glycosylated. The resulting fusion proteins were also N-glycosylated. They neutralized the virus at at least fourfold-lower VHH concentrations as compared to the single, non-glycosylated VHHs and at at least 50-fold-lower VHH concentrations as compared to their deglycosylated counterparts. Thus, we have shown that N-glycosylation of VHHs contributes to toxin- and virus-neutralizing capacity

Item response analysis of the Positive and Negative Syndrome Scale

<p>Abstract</p> <p>Background</p> <p>Statistical models based on item response theory were used to examine (a) the performance of individual Positive and Negative Syndrome Scale (PANSS) items and their options, (b) the effectiveness of various subscales to discriminate among individual differences in symptom severity, and (c) the appropriateness of cutoff scores recently recommended by Andreasen and her colleagues (2005) to establish symptom remission.</p> <p>Methods</p> <p>Option characteristic curves were estimated using a nonparametric item response model to examine the probability of endorsing each of 7 options within each of 30 PANSS items as a function of standardized, overall symptom severity. Our data were baseline PANSS scores from 9205 patients with schizophrenia or schizoaffective disorder who were enrolled between 1995 and 2003 in either a large, naturalistic, observational study or else in 1 of 12 randomized, double-blind, clinical trials comparing olanzapine to other antipsychotic drugs.</p> <p>Results</p> <p>Our analyses show that the majority of items forming the Positive and Negative subscales of the PANSS perform very well. We also identified key areas for improvement or revision in items and options within the General Psychopathology subscale. The Positive and Negative subscale scores are not only more discriminating of individual differences in symptom severity than the General Psychopathology subscale score, but are also more efficient on average than the 30-item total score. Of the 8 items recently recommended to establish symptom remission, 1 performed markedly different from the 7 others and should either be deleted or rescored requiring that patients achieve a lower score of 2 (rather than 3) to signal remission.</p> <p>Conclusion</p> <p>This first item response analysis of the PANSS supports its sound psychometric properties; most PANSS items were either very good or good at assessing overall severity of illness. These analyses did identify some items which might be further improved for measuring individual severity differences or for defining remission thresholds. Findings also suggest that the Positive and Negative subscales are more sensitive to change than the PANSS total score and, thus, may constitute a "mini PANSS" that may be more reliable, require shorter administration and training time, and possibly reduce sample sizes needed for future research.</p

Use of NON-PARAMETRIC Item Response Theory to develop a shortened version of the Positive and Negative Syndrome Scale (PANSS)

<p>Abstract</p> <p>Background</p> <p>Nonparametric item response theory (IRT) was used to examine (a) the performance of the 30 Positive and Negative Syndrome Scale (PANSS) items and their options ((levels of severity), (b) the effectiveness of various subscales to discriminate among differences in symptom severity, and (c) the development of an abbreviated PANSS (Mini-PANSS) based on IRT and a method to link scores to the original PANSS.</p> <p>Methods</p> <p>Baseline PANSS scores from 7,187 patients with Schizophrenia or Schizoaffective disorder who were enrolled between 1995 and 2005 in psychopharmacology trials were obtained. Option characteristic curves (OCCs) and Item Characteristic Curves (ICCs) were constructed to examine the probability of rating each of seven options within each of 30 PANSS items as a function of subscale severity, and summed-score linking was applied to items selected for the Mini-PANSS.</p> <p>Results</p> <p>The majority of items forming the Positive and Negative subscales (i.e. 19 items) performed very well and discriminate better along symptom severity compared to the General Psychopathology subscale. Six of the seven Positive Symptom items, six of the seven Negative Symptom items, and seven out of the 16 General Psychopathology items were retained for inclusion in the Mini-PANSS. Summed score linking and linear interpolation was able to produce a translation table for comparing total subscale scores of the Mini-PANSS to total subscale scores on the original PANSS. Results show scores on the subscales of the Mini-PANSS can be linked to scores on the original PANSS subscales, with very little bias.</p> <p>Conclusions</p> <p>The study demonstrated the utility of non-parametric IRT in examining the item properties of the PANSS and to allow selection of items for an abbreviated PANSS scale. The comparisons between the 30-item PANSS and the Mini-PANSS revealed that the shorter version is comparable to the 30-item PANSS, but when applying IRT, the Mini-PANSS is also a good indicator of illness severity.</p

The influence of micrometastases on prognosis and survival in stage I-II colon cancer patients: the Enroute⊕ Study

<p>Abstract</p> <p>Background</p> <p>The presence of lymph node metastases remains the most reliable prognostic predictor and the gold indicator for adjuvant treatment in colon cancer (CC). In spite of a potentially curative resection, 20 to 30% of CC patients testing negative for lymph node metastases (i.e. pN0) will subsequently develop locoregional and/or systemic metastases within 5 years. The presence of occult nodal isolated tumor cells (ITCs) and/or micrometastases (MMs) at the time of resection predisposes CC patients to high risk for disease recurrence. These pN0_micro+patients harbouring occult micrometastases may benefit from adjuvant treatment. The purpose of the present study is to delineate the subset of pN0 patients with micrometastases (pN0_micro+) and evaluate the benefits from adjuvant chemotherapy in pN0_micro+CC patients.</p> <p>Methods/design</p> <p>EnRoute+ is an open label, multicenter, randomized controlled clinical trial. All CC patients (age above 18 years) without synchronous locoregional lymph node and/or systemic metastases (clinical stage I-II disease) and operated upon with curative intent are eligible for inclusion. All resected specimens of patients are subject to an <it>ex vivo </it>sentinel lymph node mapping procedure (SLNM) following curative resection. The investigation for micrometastases in pN0 patients is done by extended serial sectioning and immunohistochemistry for pan-cytokeratin in sentinel lymph nodes which are tumour negative upon standard pathological examination. Patients with ITC/MM-positive sentinel lymph nodes (pN0_micro+) are randomized for adjuvant chemotherapy following the CAPOX treatment scheme or observation. The primary endpoint is 3-year disease free survival (DFS).</p> <p>Discussion</p> <p>The EnRoute+ study is designed to improve prognosis in high-risk stage I/II pN0 _micro+CC patients by reducing disease recurrence by adjuvant chemotherapy.</p> <p>Trial Registration</p> <p>ClinicalTrials.gov: <a href="http://www.clinicaltrials.gov/ct2/show/NCT01097265">NCT01097265</a></p

Guidelines on acute gastroenteritis in children: a critical appraisal of their quality and applicability in primary care

<p>Abstract</p> <p>Background</p> <p>Reasons for poor guideline adherence in acute gastroenteritis (AGE) in children in high-income countries are unclear, but may be due to inconsistency between guideline recommendations, lack of evidence, and lack of generalizability of the recommendations to general practice. The aim of this study was to assess the quality of international guidelines on AGE in children and investigate the generalizability of the recommendations to general practice.</p> <p>Methods</p> <p>Guidelines were retrieved from websites of professional medical organisations and websites of institutes involved in guideline development. In addition, a systematic search of the literature was performed. Articles were selected if they were a guideline, consensus statement or care protocol.</p> <p>Results</p> <p>Eight guidelines met the inclusion criteria, the quality of the guidelines varied. 242 recommendations on diagnosis and management were found, of which 138 (57%) were based on evidence.</p> <p>There is a large variety in the classification of symptoms to different categories of dehydration. No signs are generalizable to general practice.</p> <p>It is consistently recommended to use hypo-osmolar ORS, however, the recommendations on ORS-dosage are not evidence based and are inconsistent. One of 14 evidence based recommendations on therapy of AGE is based on outpatient research and is therefore generalizable to general practice.</p> <p>Conclusions</p> <p>The present study shows considerable variation in the quality of guidelines on AGE in children, as well as inconsistencies between the recommendations. It remains unclear how to asses the extent of dehydration and determine the preferred treatment or referral of a young child with AGE presenting in general practice.</p