Chapter 1: Introduction to the Methods Guide for Medical Test Reviews

Evaluation of medical tests presents challenges distinct from those involved in the evaluation of therapies; in particular, the very great importance of context and the dearth of comprehensive RCTs aimed at comparing the clinical outcomes of different tests and test strategies. Available guidance provides some suggestions: 1) Use of the PICOTS typology for clarifying the context relevant to the review, and 2) use of an organizing framework for classifying the types of medical test evaluation studies and their relationship to potential key questions. However, there is a diversity of recommendations for reviewers of medical tests and a proliferation of concepts, terms, and methods. As a contribution to the field, this Methods Guide for Medical Test Reviews seeks to provide practical guidance for achieving the goals of clarity, consistency, tractability, and usefulness

Severity Assessment of Lower Respiratory Tract Infection in Malawi: Derivation of a Novel Index (SWAT-Bp) Which Outperforms CRB-65

OBJECTIVE: To assess the validity of CRB-65 (Confusion, Respiratory rate >30 breaths/min, BP<90/60 mmHg, age >65 years) as a pneumonia severity index in a Malawian hospital population, and determine whether an alternative score has greater accuracy in this setting. DESIGN: Forty three variables were prospectively recorded during the first 48 hours of admission in all patients admitted to Queen Elizabeth Central Hospital, Malawi, for management of lower respiratory tract infection over a two month period (N = 240). Calculation of sensitivity and specificity for CRB-65 in predicting mortality was followed by multivariate modeling to create a score with superior performance in this population. RESULTS: Median age 37, HIV prevalence 79.9%, overall mortality 18.3%. CRB-65 predicted mortality poorly, indicated by the area under the ROC curve of 0.649. Independent predictors of death were: Male sex, “S” (AOR 2.6); Wasting, “W” (AOR 6.6); non-ambulatory, “A” (AOR 2.5); Temp >38°C or <35°C, “T” (AOR 3.2); BP<100/60, “Bp” (AOR 3.7). Combining these factors to form a severity index (SWAT-Bp) predicted mortality with high sensitivity and specificity (AUC: 0.867). Mortality for scores 0–5 was 0%, 3.3%, 7.4%, 29.2%, 61.5% and 87.5% respectively. A score ≥3 was 84% sensitive and 77% specific for mortality prediction, with a negative predictive value of 95.8%. CONCLUSION: CRB-65 performs poorly in this population. The SWAT-Bp score can accurately stratify patients; ≤2 indicates non-severe infection (mortality 4.4%) and ≥3 severe illness (mortality 45%)

The factor structure of the Forms of Self-Criticising/Attacking & Self-Reassuring Scale in thirteen distinct populations

There is considerable evidence that self-criticism plays a major role in the vulnerability to and recovery from psychopathology. Methods to measure this process, and its change over time, are therefore important for research in psychopathology and well-being. This study examined the factor structure of a widely used measure, the Forms of Self-Criticising/Attacking & Self-Reassuring Scale in thirteen nonclinical samples (N = 7510) from twelve different countries: Australia (N = 319), Canada (N = 383), Switzerland (N = 230), Israel (N = 476), Italy (N = 389), Japan (N = 264), the Netherlands (N = 360), Portugal (N = 764), Slovakia (N = 1326), Taiwan (N = 417), the United Kingdom 1 (N = 1570), the United Kingdom 2 (N = 883), and USA (N = 331). This study used more advanced analyses than prior reports: a bifactor item-response theory model, a two-tier item-response theory model, and a non-parametric item-response theory (Mokken) scale analysis. Although the original three-factor solution for the FSCRS (distinguishing between Inadequate-Self, Hated-Self, and Reassured-Self) had an acceptable fit, two-tier models, with two general factors (Self-criticism and Self-reassurance) demonstrated the best fit across all samples. This study provides preliminary evidence suggesting that this two-factor structure can be used in a range of nonclinical contexts across countries and cultures. Inadequate-Self and Hated-Self might not by distinct factors in nonclinical samples. Future work may benefit from distinguishing between self-correction versus shame-based self-criticism.Peer reviewe

Follow-up of phase I trial of adalimumab and rosiglitazone in FSGS: III. Report of the FONT study group

Abstract Background Patients with resistant primary focal segmental glomerulosclerosis (FSGS) are at high risk of progression to chronic kidney disease stage V. Antifibrotic agents may slow or halt this process. We present outcomes of follow-up after a Phase I trial of adalimumab and rosiglitazone, antifibrotic drugs tested in the Novel Therapies in Resistant FSGS (FONT) study. Methods 21 patients -- 12 males and 9 females, age 16.0 ± 7.5 yr, and estimated GFR (GFRe) 121 ± 56 mL/min/1.73 m2 -- received adalimumab (n = 10), 24 mg/m2 every 14 days or rosiglitazone (n = 11), 3 mg/m2 per day for 16 weeks. The change in GFRe per month prior to entry and after completion of the Phase I trial was compared. Results 19 patients completed the 16-week FONT treatment phase. The observation period pre-FONT was 18.3 ± 10.2 months and 16.1 ± 5.7 months after the study. A similar percentage of patients, 71% and 56%, in the rosiglitazone and adalimumab cohorts, respectively, had stabilization in GFRe, defined as a reduced negative slope of the line plotting GFRe versus time without requiring renal replacement therapy after completion of the FONT treatment period (P = 0.63). Conclusion Nearly 50% of patients with resistant FSGS who receive novel antifibrotic agents may have a legacy effect with delayed deterioration in kidney function after completion of therapy. Based on this proof-of-concept preliminary study, we recommend long-term follow-up of patients enrolled in clinical trials to ascertain a more comprehensive assessment of the efficacy of experimental treatments

Impact Factor: outdated artefact or stepping-stone to journal certification?

A review of Garfield's journal impact factor and its specific implementation as the Thomson Reuters Impact Factor reveals several weaknesses in this commonly-used indicator of journal standing. Key limitations include the mismatch between citing and cited documents, the deceptive display of three decimals that belies the real precision, and the absence of confidence intervals. These are minor issues that are easily amended and should be corrected, but more substantive improvements are needed. There are indications that the scientific community seeks and needs better certification of journal procedures to improve the quality of published science. Comprehensive certification of editorial and review procedures could help ensure adequate procedures to detect duplicate and fraudulent submissions.Comment: 25 pages, 12 figures, 6 table

Going it alone won’t work! The relational imperative for social innovation in social enterprises

Shifts in the philosophy of the “state” and a growing emphasis on the “Big Society” have placed an increasing onus on a newly emerging organizational form, social enterprises, to deliver innovative solutions to ease societal issues. However, the question of how social enterprises manage the process of social innovation remains largely unexplored. Based on insights from both in-depth interviews and a quantitative empirical study of social enterprises, this research examines the role of stakeholder relationships in supporting the process of social innovation within social enterprises. We find that social enterprises are adept at working with their stakeholders in the ideation stage of social innovation. In contrast, they often fail to harness knowledge and expertise from their partners during the social innovation implementation phase. Consequently, we propose a social innovation–stakeholder relationship matrix that provides social enterprises in particular with insight for developing stakeholder relationships to achieve their social innovation missions