Methodological criteria for the assessment of moderators in systematic reviews of randomised controlled trials : a consensus study

Background: Current methodological guidelines provide advice about the assessment of sub-group analysis within RCTs, but do not specify explicit criteria for assessment. Our objective was to provide researchers with a set of criteria that will facilitate the grading of evidence for moderators, in systematic reviews. Method: We developed a set of criteria from methodological manuscripts (n = 18) using snowballing technique, and electronic database searches. Criteria were reviewed by an international Delphi panel (n = 21), comprising authors who have published methodological papers in this area, and researchers who have been active in the study of sub-group analysis in RCTs. We used the Research ANd Development/University of California Los Angeles appropriateness method to assess consensus on the quantitative data. Free responses were coded for consensus and disagreement. In a subsequent round additional criteria were extracted from the Cochrane Reviewers’ Handbook, and the process was repeated. Results: The recommendations are that meta-analysts report both confirmatory and exploratory findings for subgroups analysis. Confirmatory findings must only come from studies in which a specific theory/evidence based apriori statement is made. Exploratory findings may be used to inform future/subsequent trials. However, for inclusion in the meta-analysis of moderators, the following additional criteria should be applied to each study: Baseline factors should be measured prior to randomisation, measurement of baseline factors should be of adequate reliability and validity, and a specific test of the interaction between baseline factors and interventions must be presented. Conclusions: There is consensus from a group of 21 international experts that methodological criteria to assess moderators within systematic reviews of RCTs is both timely and necessary. The consensus from the experts resulted in five criteria divided into two groups when synthesising evidence: confirmatory findings to support hypotheses about moderators and exploratory findings to inform future research. These recommendations are discussed in reference to previous recommendations for evaluating and reporting moderator studies

SmartEx: a case study on user profiling and adaptation in exhibition booths

An investigation into user profiling and adaptation with exhibition booth as a case study is reported. First a review of the field of exhibitions and trade fairs and a summary introduction to adaptation and profiling are given. We then introduce three criteria for the evaluation of exhibition booth: effectiveness, efficiency and affect. Effectiveness is related the amount of information collected, efficiency is a measurement of the time taken to collect the information, and affect is the perception of the experience and the mood booth visitors have during and after their visit. We have selected these criteria to assess adaptive and profiled exhibition booths, we call smart exhibition (SmartEx). The assessment is performed with an experiment with three test conditions (non-profiled/non adaptive, profiled/non-adaptive and profiled adaptive presentations). Results of the experiment are presented along discussion. While there is significant improvements of effectiveness and efficiency between the two-first test conditions, the improvement is not significant for the last test condition, for reasons explained. As for the affect, the results show that it has an under-estimated importance in people minds and that it should be addressed more carefully

Dealing with heterogeneity of treatment effects: is the literature up to the challenge?

<p>Abstract</p> <p>Background</p> <p>Some patients will experience more or less benefit from treatment than the averages reported from clinical trials; such variation in therapeutic outcome is termed heterogeneity of treatment effects (HTE). Identifying HTE is necessary to individualize treatment. The degree to which heterogeneity is sought and analyzed correctly in the general medical literature is unknown. We undertook this literature sample to track the use of HTE analyses over time, examine the appropriateness of the statistical methods used, and explore the predictors of such analyses.</p> <p>Methods</p> <p>Articles were selected through a probability sample of randomized controlled trials (RCTs) published in <it>Annals of Internal Medicine</it>, <it>BMJ</it>, <it>JAMA</it>, <it>The Lancet</it>, and <it>NEJM </it>during odd numbered months of 1994, 1999, and 2004. RCTs were independently reviewed and coded by two abstractors, with adjudication by a third. Studies were classified as reporting: (1) HTE analysis, utilizing a formal test for heterogeneity or treatment-by-covariate interaction, (2) subgroup analysis only, involving no formal test for heterogeneity or interaction; or (3) neither. Chi-square tests and multiple logistic regression were used to identify variables associated with HTE reporting.</p> <p>Results</p> <p>319 studies were included. Ninety-two (29%) reported HTE analysis; another 88 (28%) reported subgroup analysis only, without examining HTE formally. Major covariates examined included individual risk factors associated with prognosis, responsiveness to treatment, or vulnerability to adverse effects of treatment (56%); gender (30%); age (29%); study site or center (29%); and race/ethnicity (7%). Journal of publication and sample size were significant independent predictors of HTE analysis (p < 0.05 and p < 0.001, respectively).</p> <p>Conclusion</p> <p>HTE is frequently ignored or incorrectly analyzed. An iterative process of exploratory analysis followed by confirmatory HTE analysis will generate the data needed to facilitate an individualized approach to evidence-based medicine.</p

Adatom Fe(III) on the hematite surface: Observation of a key reactive surface species

The reactivity of a mineral surface is determined by the variety and population of different types of surface sites (e.g., step, kink, adatom, and defect sites). The concept of "adsorbed nutrient" has been built into crystal growth theories, and many other studies of mineral surface reactivity appeal to ill-defined "active sites." Despite their theoretical importance, there has been little direct experimental or analytical investigation of the structure and properties of such species. Here, we use ex-situ and in-situ scanning tunneling microcopy (STM) combined with calculated images based on a resonant tunneling model to show that observed nonperiodic protrusions and depressions on the hematite (001) surface can be explained as Fe in an adsorbed or adatom state occupying sites different from those that result from simple termination of the bulk mineral. The number of such sites varies with sample preparation history, consistent with their removal from the surface in low pH solutions

Methods for specifying the target difference in a randomised controlled trial : the Difference ELicitation in TriAls (DELTA) systematic review

Peer reviewedPublisher PD

Reliability and Validity of the KIPPPI: An Early Detection Tool for Psychosocial Problems in Toddlers

Background: The KIPPPI (Brief Instrument Psychological and Pedagogical Problem Inventory) is a Dutch questionnaire that measures psychosocial and pedagogical problems in 2-year olds and consists of a KIPPPI Total score, Wellbeing scale, Competence scale, and Autonomy scale. This study examined the reliability, validity, screening accuracy and clinical application of the KIPPPI. Methods: Parents of 5959 2-year-old children in the Rotterdam area, the Netherlands, were invited to participate in the study. Parents of 3164 children (53.1% of all invited parents) completed the questionnaire. The internal consistency was evaluated and in subsamples the test-retest reliability and concurrent validity with regard to the Child Behavioral Checklist (CBCL). Discriminative validity was evaluated by comparing scores of parents who worried about their child's upbringing and parent's that did not. Screening accuracy of the KIPPPI was evaluated against the CBCL by calculating the Receiver Operating Characteristic (ROC) curves. The clinical application was evaluated by the relation between KIPPPI scores and the clinical decision made by the child health professionals. Results: Psychometric properties of the KIPPPI Total score, Wellbeing scale, Competence scale and Autonomy scale were respectively: Cronbach's alphas: 0.88, 0.86, 0.83, 0.58. Test-rete

A Systematic Review of the Effect of Cognitive Strategies on Strength Performance

Background Researchers have tested the beliefs of sportspeople and sports medicine specialists that cognitive strategies influence strength performance. Few investigators have synthesised the literature. Objectives The specific objectives were to review evidence regarding (a) the cognitive strategy–strength performance relationship; (b) participant skill level as a moderator; and (c) cognitive, motivational, biomechanical/physiological, and emotional mediators. Method Studies were sourced via electronic databases, reference lists of retrieved articles, and manual searches of relevant journals. Studies had to be randomised or counterbalanced experiments with a control group or condition, repeated measures, and a quality control score above 0.5 (out of 1). Cognitive strategies included goal setting, imagery, self-talk, preparatory arousal, and free choice. Dependent variables included maximal strength, local muscular endurance, or muscular power. Results Globally, cognitive strategies were reliability associated with increased strength performance (results ranged from 61 to 65 %). Results were mixed when examining the effects of specific strategies on particular dependent variables, although no intervention had an overall negative influence. Indeterminate relationships emerged regarding hypothesised mediators (except cognitive variables) and participant skill level as a moderator. Conclusions Although cognitive strategies influence strength performance, there are knowledge gaps regarding specific types of strength, especially muscular power. Cognitive variables, such as concentration, show promise as possible mediators

Prescribing patterns in premenstrual syndrome

BACKGROUND: Over 300 therapies have been proposed for premenstrual syndrome. To date there has been only one survey conducted in the UK of PMS treatments prescribed by GPs, a questionnaire-based study by the National Association of Premenstrual Syndrome in 1989. Since then, selective serotonin re-uptake inhibitors have been licensed for severe PMS/PMDD, and governmental recommendations to reduce the dosage of vitamin B6 (the first choice over-the-counter treatment for many women with PMS) have been made. This study investigates the annual rates of diagnoses and prescribing patterns for premenstrual syndrome (1993–1998) within a computerised general practitioner database. METHODS: Retrospective survey of prescribing data for premenstrual syndrome between 1993–1998 using the General Practice Research Database for the West Midlands Region which contains information on 282,600 female patients RESULTS: Overall the proportion of women with a prescription-linked diagnosis of premenstrual syndrome has halved over the five years. Progestogens including progesterone were the most commonly recorded treatment for premenstrual syndrome during the whole study period accounting for over 40% of all prescriptions. Selective serotonin-reuptake inhibitors accounted for only 2% of the prescriptions in 1993 but rose to over 16% by 1998, becoming the second most commonly recorded treatment. Vitamin B6 accounted for 22% of the prescriptions in 1993 but dropped markedly between 1997 and 1998 to 11%. CONCLUSIONS: This study shows a yearly decrease in the number of prescriptions linked to diagnoses for premenstrual syndrome. Progestogens including progesterone, is the most widely prescribed treatment for premenstrual syndrome despite the lack of evidence demonstrating their efficacy

The Relationship Between Homework Compliance and Therapy Outcomes: An Updated Meta-Analysis

The current study was an updated meta-analysis of manuscripts since the year 2000 examining the effects of homework compliance on treatment outcome. A total of 23 studies encompassing 2,183 subjects were included. Results indicated a significant relationship between homework compliance and treatment outcome suggesting a small to medium effect (r = .26; 95% CI = .19–.33). Moderator analyses were conducted to determine the differential effect size of homework on treatment outcome by target symptoms (e.g., depression; anxiety), source of homework rating (e.g., client; therapist), timing of homework rating (e.g., retroactive vs. contemporaneous), and type of homework rating (e.g., Likert; total homeworks completed). Results indicated that effect sizes were robust across target symptoms, but differed by source of homework rating, timing of homework rating, and type of homework rating. Specifically, studies utilizing combined client and therapist ratings of compliance had significantly higher mean effect size relative to those using therapist only assessments and those using objective assessments. Further, studies that rated the percentage of homeworks completed had a significantly lower mean effect size compared to studies using Likert ratings, and retroactive assessments had higher effect size than contemporaneous assessments

Acute effects of remote ischemic preconditioning on cutaneous microcirculation - a controlled prospective cohort study

<p>Abstract</p> <p>Background</p> <p>Therapeutic strategies aiming to reduce ischemia/reperfusion injury by conditioning tissue tolerance against ischemia appear attractive not only from a scientific perspective, but also in clinics. Although previous studies indicate that remote ischemic intermittent preconditioning (RIPC) is a systemic phenomenon, only a few studies have focused on the elucidation of its mechanisms of action especially in the clinical setting. Therefore, the aim of this study is to evaluate the acute microcirculatory effects of remote ischemic preconditioning on a distinct cutaneous location at the lower extremity which is typically used as a harvesting site for free flap reconstructive surgery in a human in-vivo setting.</p> <p>Methods</p> <p>Microcirculatory data of 27 healthy subjects (25 males, age 24 ± 4 years, BMI 23.3) were evaluated continuously at the anterolateral aspect of the left thigh during RIPC using combined Laser-Doppler and photospectrometry (Oxygen-to-see, Lea Medizintechnik, Germany). After baseline microcirculatory measurement, remote ischemia was induced using a tourniquet on the contralateral upper arm for three cycles of 5 min.</p> <p>Results</p> <p>After RIPC, tissue oxygen saturation and capillary blood flow increased up to 29% and 35% during the third reperfusion phase versus baseline measurement, respectively (both p = 0.001). Postcapillary venous filling pressure decreased statistically significant by 16% during second reperfusion phase (p = 0.028).</p> <p>Conclusion</p> <p>Remote intermittent ischemic preconditioning affects cutaneous tissue oxygen saturation, arterial capillary blood flow and postcapillary venous filling pressure at a remote cutaneous location of the lower extremity. To what extent remote preconditioning might ameliorate reperfusion injury in soft tissue trauma or free flap transplantation further clinical trials have to evaluate.</p> <p>Trial registration</p> <p>ClinicalTrials.gov: <a href="http://www.clinicaltrials.gov/ct2/show/NCT01235286">NCT01235286</a></p