Standard setting: Comparison of two methods

BACKGROUND: The outcome of assessments is determined by the standard-setting method used. There is a wide range of standard – setting methods and the two used most extensively in undergraduate medical education in the UK are the norm-reference and the criterion-reference methods. The aims of the study were to compare these two standard-setting methods for a multiple-choice question examination and to estimate the test-retest and inter-rater reliability of the modified Angoff method. METHODS: The norm – reference method of standard -setting (mean minus 1 SD) was applied to the 'raw' scores of 78 4th-year medical students on a multiple-choice examination (MCQ). Two panels of raters also set the standard using the modified Angoff method for the same multiple-choice question paper on two occasions (6 months apart). We compared the pass/fail rates derived from the norm reference and the Angoff methods and also assessed the test-retest and inter-rater reliability of the modified Angoff method. RESULTS: The pass rate with the norm-reference method was 85% (66/78) and that by the Angoff method was 100% (78 out of 78). The percentage agreement between Angoff method and norm-reference was 78% (95% CI 69% – 87%). The modified Angoff method had an inter-rater reliability of 0.81 – 0.82 and a test-retest reliability of 0.59–0.74. CONCLUSION: There were significant differences in the outcomes of these two standard-setting methods, as shown by the difference in the proportion of candidates that passed and failed the assessment. The modified Angoff method was found to have good inter-rater reliability and moderate test-retest reliability

Relaxation of Terrace-width Distributions: Physical Information from Fokker-Planck Time

Recently some of us have constructed a Fokker-Planck formalism to describe the equilibration of the terrace-width distribution of a vicinal surface from an arbitrary initial configuration. However, the meaning of the associated relaxation time, related to the strength of the random noise in the underlying Langevin equation, was rather unclear. Here we present a set of careful kinetic Monte Carlo simulations that demonstrate convincingly that the time constant shows activated behavior with a barrier that has a physically plausible dependence on the energies of the governing microscopic model. Furthermore, the Fokker-Planck time at least semiquantitatively tracks the actual physical time.Comment: 11 pages, 7 color figure

Modifying Hofstee standard setting for assessments that vary in difficulty, and to determine boundaries for different levels of achievement.

BACKGROUND: Fixed mark grade boundaries for non-linear assessment scales fail to account for variations in assessment difficulty. Where assessment difficulty varies more than ability of successive cohorts or the quality of the teaching, anchoring grade boundaries to median cohort performance should provide an effective method for setting standards. METHODS: This study investigated the use of a modified Hofstee (MH) method for setting unsatisfactory/satisfactory and satisfactory/excellent grade boundaries for multiple choice question-style assessments, adjusted using the cohort median to obviate the effect of subjective judgements and provision of grade quotas. RESULTS: Outcomes for the MH method were compared with formula scoring/correction for guessing (FS/CFG) for 11 assessments, indicating that there were no significant differences between MH and FS/CFG in either the effective unsatisfactory/satisfactory grade boundary or the proportion of unsatisfactory graded candidates (p > 0.05). However the boundary for excellent performance was significantly higher for MH (p < 0.01), and the proportion of candidates returned as excellent was significantly lower (p < 0.01). MH also generated performance profiles and pass marks that were not significantly different from those given by the Ebel method of criterion-referenced standard setting. CONCLUSIONS: This supports MH as an objective model for calculating variable grade boundaries, adjusted for test difficulty. Furthermore, it easily creates boundaries for unsatisfactory/satisfactory and satisfactory/excellent performance that are protected against grade inflation. It could be implemented as a stand-alone method of standard setting, or as part of the post-examination analysis of results for assessments for which pre-examination criterion-referenced standard setting is employed

“Early Rupture of Membranes” during Induced Labor as a Risk Factor for Cesarean Delivery in Term Nulliparas

OBJECTIVE: To determine if "early rupture of membranes" (early ROM) during induction of labor is associated with an increased risk of cesarean section in term nulliparas. STUDY DESIGN: The rate of cesarean section and the timing of ROM during the course of labor were examined in term singleton nulliparas whose labor was induced. Cases were divided into 2 groups according the timing of ROM: 1)"early ROM", defined as ROM at a cervical dilatation<4 cm during labor; and 2) "late ROM", ROM at a cervical dilatation≥4 cm during labor. Nonparametric techniques were used for statistical analysis. RESULTS: 1) In a total of 500 cases of study population, "early ROM" occurred in 43% and the overall cesarean section rate was 15.8%; 2) patients with "early ROM" had a higher rate of cesarean section and cesarean section due to failure to progress than did those with "late ROM" (overall cesarean section rate: 24%[51/215] vs. 10%[28/285], p<0.01; cesarean section rate due to failure to progress: 18%[38/215] vs. 8%[22/285], p<0.01 for each) and this difference remained significant after adjusting for confounding variables. CONCLUSION: "Early ROM" during the course of induced labor is a risk factor for cesarean section in term singleton nulliparas

THE IMPACT OF DIETARY PROTEIN OR AMINO ACID SUPPLEMENTATION ON MUSCLE MASS AND STRENGTH IN ELDERLY PEOPLE: INDIVIDUAL PARTICIPANT DATA AND META-ANALYSIS OF RCT’S

Objectives Increasing protein or amino acid intake has been promoted as a promising strategy to increase muscle mass and strength in elderly people, however, long-term intervention studies show inconsistent findings. Therefore, we aim to determine the impact of protein or amino acid supplementation compared to placebo on muscle mass and strength in older adults by combining the results from published trials in a metaanalysis and pooled individual participant data analysis. Design We searched Medline and Cochrane databases and performed a meta-analysis on eight available trials on the effect of protein or amino acid supplementation on muscle mass and strength in older adults. Furthermore, we pooled individual data of six of these randomized double-blind placebo-controlled trials. The main outcomes were change in lean body mass and change in muscle strength for both the meta-analysis and the pooled analysis. Results The meta-analysis of eight studies (n=557) showed no significant positive effects of protein or amino acid supplementation on lean body mass (mean difference: 0.014 kg: 95% CI -0.152; 0.18), leg press strength (mean difference: 2.26 kg: 95% CI -0.56; 5.08), leg extension strength (mean difference: 0.75 kg: 95% CI: -1.96, 3.47) or handgrip strength (mean difference: -0.002 kg: 95% CI -0.182; 0.179). Likewise, the pooled analysis showed no significant difference between protein and placebo treatment on lean body mass (n=412: p=0.78), leg press strength (n=121: p=0.50), leg extension strength (n=121: p=0.16) and handgrip strength (n=318: p=0.37). Conclusions There is currently no evidence to suggest that protein or amino acid supplementation without concomitant nutritional or exercise interventions increases muscle mass or strength in predominantly healthy elderly people

Fibroblasts from patients with major depressive disorder show distinct transcriptional response to metabolic stressors

Major depressive disorder (MDD) is increasingly viewed as interplay of environmental stressors and genetic predisposition, and recent data suggest that the disease affects not only the brain, but the entire body. As a result, we aimed at determining whether patients with major depression have aberrant molecular responses to stress in peripheral tissues. We examined the effects of two metabolic stressors, galactose (GAL) or reduced lipids (RL), on the transcriptome and miRNome of human fibroblasts from 16 pairs of patients with MDD and matched healthy controls (CNTR). Our results demonstrate that both MDD and CNTR fibroblasts had a robust molecular response to GAL and RL challenges. Most importantly, a significant part (messenger RNAs (mRNAs): 26-33%; microRNAs (miRNAs): 81-90%) of the molecular response was only observed in MDD, but not in CNTR fibroblasts. The applied metabolic challenges uncovered mRNA and miRNA signatures, identifying responses to each stressor characteristic for the MDD fibroblasts. The distinct responses of MDD fibroblasts to GAL and RL revealed an aberrant engagement of molecular pathways, such as apoptosis, regulation of cell cycle, cell migration, metabolic control and energy production. In conclusion, the metabolic challenges evoked by GAL or RL in dermal fibroblasts exposed adaptive dysfunctions on mRNA and miRNA levels that are characteristic for MDD. This finding underscores the need to challenge biological systems to bring out disease-specific deficits, which otherwise might remain hidden under resting conditions

Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock, 2012

OBJECTIVE: To provide an update to the "Surviving Sepsis Campaign Guidelines for Management of Severe Sepsis and Septic Shock," last published in 2008. DESIGN: A consensus committee of 68 international experts representing 30 international organizations was convened. Nominal groups were assembled at key international meetings (for those committee members attending the conference). A formal conflict of interest policy was developed at the onset of the process and enforced throughout. The entire guidelines process was conducted independent of any industry funding. A stand-alone meeting was held for all subgroup heads, co- and vice-chairs, and selected individuals. Teleconferences and electronic-based discussion among subgroups and among the entire committee served as an integral part of the development. METHODS: The authors were advised to follow the principles of the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system to guide assessment of quality of evidence from high (A) to very low (D) and to determine the strength of recommendations as strong (1) or weak (2). The potential drawbacks of making strong recommendations in the presence of low-quality evidence were emphasized. Recommendations were classified into three groups: (1) those directly targeting severe sepsis; (2) those targeting general care of the critically ill patient and considered high priority in severe sepsis; and (3) pediatric considerations. RESULTS: Key recommendations and suggestions, listed by category, include: early quantitative resuscitation of the septic patient during the first 6 h after recognition (1C); blood cultures before antibiotic therapy (1C); imaging studies performed promptly to confirm a potential source of infection (UG); administration of broad-spectrum antimicrobials therapy within 1 h of the recognition of septic shock (1B) and severe sepsis without septic shock (1C) as the goal of therapy; reassessment of antimicrobial therapy daily for de-escalation, when appropriate (1B); infection source control with attention to the balance of risks and benefits of the chosen method within 12 h of diagnosis (1C); initial fluid resuscitation with crystalloid (1B) and consideration of the addition of albumin in patients who continue to require substantial amounts of crystalloid to maintain adequate mean arterial pressure (2C) and the avoidance of hetastarch formulations (1B); initial fluid challenge in patients with sepsis-induced tissue hypoperfusion and suspicion of hypovolemia to achieve a minimum of 30 mL/kg of crystalloids (more rapid administration and greater amounts of fluid may be needed in some patients (1C); fluid challenge technique continued as long as hemodynamic improvement is based on either dynamic or static variables (UG); norepinephrine as the first-choice vasopressor to maintain mean arterial pressure ≥65 mmHg (1B); epinephrine when an additional agent is needed to maintain adequate blood pressure (2B); vasopressin (0.03 U/min) can be added to norepinephrine to either raise mean arterial pressure to target or to decrease norepinephrine dose but should not be used as the initial vasopressor (UG); dopamine is not recommended except in highly selected circumstances (2C); dobutamine infusion administered or added to vasopressor in the presence of (a) myocardial dysfunction as suggested by elevated cardiac filling pressures and low cardiac output, or (b) ongoing signs of hypoperfusion despite achieving adequate intravascular volume and adequate mean arterial pressure (1C); avoiding use of intravenous hydrocortisone in adult septic shock patients if adequate fluid resuscitation and vasopressor therapy are able to restore hemodynamic stability (2C); hemoglobin target of 7-9 g/dL in the absence of tissue hypoperfusion, ischemic coronary artery disease, or acute hemorrhage (1B); low tidal volume (1A) and limitation of inspiratory plateau pressure (1B) for acute respiratory distress syndrome (ARDS); application of at least a minimal amount of positive end-expiratory pressure (PEEP) in ARDS (1B); higher rather than lower level of PEEP for patients with sepsis-induced moderate or severe ARDS (2C); recruitment maneuvers in sepsis patients with severe refractory hypoxemia due to ARDS (2C); prone positioning in sepsis-induced ARDS patients with a PaO (2)/FiO (2) ratio of ≤100 mm Hg in facilities that have experience with such practices (2C); head-of-bed elevation in mechanically ventilated patients unless contraindicated (1B); a conservative fluid strategy for patients with established ARDS who do not have evidence of tissue hypoperfusion (1C); protocols for weaning and sedation (1A); minimizing use of either intermittent bolus sedation or continuous infusion sedation targeting specific titration endpoints (1B); avoidance of neuromuscular blockers if possible in the septic patient without ARDS (1C); a short course of neuromuscular blocker (no longer than 48 h) for patients with early ARDS and a PaO (2)/FI O (2) 180 mg/dL, targeting an upper blood glucose ≤180 mg/dL (1A); equivalency of continuous veno-venous hemofiltration or intermittent hemodialysis (2B); prophylaxis for deep vein thrombosis (1B); use of stress ulcer prophylaxis to prevent upper gastrointestinal bleeding in patients with bleeding risk factors (1B); oral or enteral (if necessary) feedings, as tolerated, rather than either complete fasting or provision of only intravenous glucose within the first 48 h after a diagnosis of severe sepsis/septic shock (2C); and addressing goals of care, including treatment plans and end-of-life planning (as appropriate) (1B), as early as feasible, but within 72 h of intensive care unit admission (2C). Recommendations specific to pediatric severe sepsis include: therapy with face mask oxygen, high flow nasal cannula oxygen, or nasopharyngeal continuous PEEP in the presence of respiratory distress and hypoxemia (2C), use of physical examination therapeutic endpoints such as capillary refill (2C); for septic shock associated with hypovolemia, the use of crystalloids or albumin to deliver a bolus of 20 mL/kg of crystalloids (or albumin equivalent) over 5-10 min (2C); more common use of inotropes and vasodilators for low cardiac output septic shock associated with elevated systemic vascular resistance (2C); and use of hydrocortisone only in children with suspected or proven "absolute"' adrenal insufficiency (2C). CONCLUSIONS: Strong agreement existed among a large cohort of international experts regarding many level 1 recommendations for the best care of patients with severe sepsis. Although a significant number of aspects of care have relatively weak support, evidence-based recommendations regarding the acute management of sepsis and septic shock are the foundation of improved outcomes for this important group of critically ill patients