Applying the ROBINS-I tool to natural experiments: an example from public health

Background: A new tool to assess Risk of Bias In Non-randomised Studies of Interventions (ROBINS-I) was published in Autumn 2016. ROBINS-I uses the Cochrane-approved risk of bias (RoB) approach and focusses on internal validity. As such, ROBINS-I represents an important development for those conducting systematic reviews which include non-randomised studies (NRS), including public health researchers. We aimed to establish the applicability of ROBINS-I using a group of NRS which have evaluated non-clinical public health natural experiments. Methods: Five researchers, all experienced in critical appraisal of non-randomised studies, used ROBINS-I to independently assess risk of bias in five studies which had assessed the health impacts of a domestic energy efficiency intervention. ROBINS-I assessments for each study were entered into a database and checked for consensus across the group. Group discussions were used to identify reasons underpinning lack of consensus for specific questions and bias domains. Results: ROBINS-I helped to systematically articulate sources of bias in NRS. However, the lack of consensus in assessments for all seven bias domains raised questions about ROBINS-I’s reliability and applicability for natural experiment studies. The two RoB domains with least consensus were selection (Domain 2) and performance (Domain 4). Underlying the lack of consensus were difficulties in applying an intention to treat or per protocol effect of interest to the studies. This was linked to difficulties in determining whether the intervention status was classified retrospectively at follow-up, i.e. post hoc. The overall risk of bias ranged from moderate to critical; this was most closely linked to the assessment of confounders. Conclusion: The ROBINS-I tool is a conceptually rigorous tool which focusses on risk of bias due to the counterfactual. Difficulties in applying ROBINS-I may be due to poor design and reporting of evaluations of natural experiments. While the quality of reporting may improve in the future, improved guidance on applying ROBINS-I is needed to enable existing evidence from natural experiments to be assessed appropriately and consistently. We hope future refinements to ROBINS-I will address some of the issues raised here to allow wider use of the tool

Morphometrical malignancy grading is a valuable prognostic factor in invasive ductal breast cancer

The aim of the present study is to augment the prognostic power of breast cancer grading by elaboration of quantitative histopathological methods. We focus on the recently introduced morphometrical grading system in which the three grading sub-features of the WHO grading system are evaluated with the help of computerised nuclear morphometry, and quantitative methods for assessing mitotic activity and tubular differentiation. The prognostic value of the morphometrical grading system is now confirmed in a material of 159 cases of invasive ductal breast cancer. In the current material the morphometrical grading system very efficiently predicted the prognosis of breast cancer by dividing the patients into favourable (grade I), intermediate (grade II), and unfavourable (grade III) outcome (P<0.0001). The morphometrical grading system was especially efficient in identifying patients with the most unfavourable outcome. In our material the morphometrical grade III was associated with a 5.4-fold risk of breast cancer death. In light of the present results, the morphometrical grading can be applied to clinical use as an aid in treatment decisions of patients with invasive ductal breast cancer

Neurologic Phenotypes Associated With Mutations in RTN4IP1 (OPA10) in Children and Young Adults

Importance: Neurologic disorders with isolated symptoms or complex syndromes are relatively frequent among mitochondrial inherited diseases. Recessive RTN4IP1 gene mutations have been shown to cause isolated and syndromic optic neuropathies. Objective: To define the spectrum of clinical phenotypes associated with mutations in RTN4IP1 encoding a mitochondrial quinone oxidoreductase. Design, Setting, and Participants: This study involved 12 individuals from 11 families with severe central nervous system diseases and optic atrophy. Targeted and whole-exome sequencing were performed-at Hospital Angers (France), Institute of Neurology Milan (Italy), Imagine Institute Paris (France), Helmoltz Zentrum of Munich (Germany), and Beijing Genomics Institute (China)-to clarify the molecular diagnosis of patients. Each patient\u27s neurologic, ophthalmologic, magnetic resonance imaging, and biochemical features were investigated. This study was conducted from May 1, 2014, to June 30, 2016. Main Outcomes and Measures: Recessive mutations in RTN4IP1 were identified. Clinical presentations ranged from isolated optic atrophy to severe encephalopathies. Results: Of the 12 individuals in the study, 6 (50%) were male and 6 (50%) were female. They ranged in age from 5 months to 32 years. Of the 11 families, 6 (5 of whom were consanguineous) had a member or members who presented isolated optic atrophy with the already reported p.Arg103His or the novel p.Ile362Phe, p.Met43Ile, and p.Tyr51Cys amino acid changes. The 5 other families had a member or members who presented severe neurologic syndromes with a common core of symptoms, including optic atrophy, seizure, intellectual disability, growth retardation, and elevated lactate levels. Additional clinical features of those affected were deafness, abnormalities on magnetic resonance images of the brain, stridor, and abnormal electroencephalographic patterns, all of which eventually led to death before age 3 years. In these patients, novel and very rare homozygous and compound heterozygous mutations were identified that led to the absence of the protein and complex I disassembly as well as mild mitochondrial network fragmentation. Conclusions and Relevance: A broad clinical spectrum of neurologic features, ranging from isolated optic atrophy to severe early-onset encephalopathies, is associated with RTN4IP1 biallelic mutations and should prompt RTN4IP1 screening in both syndromic neurologic presentations and nonsyndromic recessive optic neuropathies

Can the feedback of patient assessments, brief training, or their combination, improve the interpersonal skills of primary care physicians? A systematic review

<p>Abstract</p> <p>Background</p> <p>Improving quality of primary care is a key focus of international health policy. Current quality improvement efforts place a large focus on technical, clinical aspects of quality, but a comprehensive approach to quality improvement should also include interpersonal care. Two methods of improving the quality of interpersonal care in primary care have been proposed. One involves the feedback of patient assessments of interpersonal care to physicians, and the other involves brief training and education programmes. This study therefore reviewed the efficacy of (i) feedback of real patient assessments of interpersonal care skills, (ii) brief training focused on the improvement of interpersonal care (iii) interventions combining both (i) and (ii)</p> <p>Methods</p> <p>Systematic review of randomised controlled trials. Three electronic databases were searched (CENTRAL, Medline and Embase) and augmented by searches of the bibliographies of retrieved articles. The quality of studies was appraised and results summarised in narrative form.</p> <p>Results</p> <p>Nine studies were included (two patient based feedback studies and seven brief training studies). Of the two feedback studies, one reported a significant positive effect. Only one training study reported a significant positive effect.</p> <p>Conclusion</p> <p>There is limited evidence concerning the effects of patient based feedback. There is reasonable evidence that brief training as currently delivered is not effective, although the evidence is not definitive, due to the small number of trials and the variation in the training methods and goals. The lack of effectiveness of these methods may reflect a number of issues, such as differences in the effectiveness of the interventions in experienced practitioners and those in training, the lack of theory linking feedback to behaviour change, failure to provide sufficient training or to use a comprehensive range of behaviour change techniques. Further research into both feedback and brief training interventions is required before these interventions are routinely introduced to improve patient satisfaction with interpersonal care in primary care. The interventions to be tested in future research should consider using insights from the wider literature on communication outside primary care, might benefit from a clearer theoretical basis, and should examine the use of combined brief training and feedback.</p

An economic evaluation of Alexander Technique lessons or acupuncture sessions for patients with chronic neck pain : A randomized trial (ATLAS)

OBJECTIVES: To assess the cost-effectiveness of acupuncture and usual care, and Alexander Technique lessons and usual care, compared with usual GP care alone for chronic neck pain patients. METHODS: An economic evaluation was undertaken alongside the ATLAS trial, taking both NHS and wider societal viewpoints. Participants were offered up to twelve acupuncture sessions or twenty Alexander lessons (equivalent overall contact time). Costs were in pounds sterling. Effectiveness was measured using the generic EQ-5D to calculate quality adjusted life years (QALYs), as well as using a specific neck pain measure-the Northwick Park Neck Pain Questionnaire (NPQ). RESULTS: In the base case analysis, incremental QALY gains were 0.032 and 0.025 in the acupuncture and Alexander groups, respectively, in comparison to usual GP care, indicating moderate health benefits for both interventions. Incremental costs were £451 for acupuncture and £667 for Alexander, mainly driven by intervention costs. Acupuncture was likely to be cost-effective (ICER = £18,767/QALY bootstrapped 95% CI £4,426 to £74,562) and was robust to most sensitivity analyses. Alexander lessons were not cost-effective at the lower NICE threshold of £20,000/QALY (£25,101/QALY bootstrapped 95% CI -£150,208 to £248,697) but may be at £30,000/QALY, however, there was considerable statistical uncertainty in all tested scenarios. CONCLUSIONS: In comparison with usual care, acupuncture is likely to be cost-effective for chronic neck pain, whereas, largely due to higher intervention costs, Alexander lessons are unlikely to be cost-effective. However, there were high levels of missing data and further research is needed to assess the long-term cost-effectiveness of these interventions

A population-based study of tumor gene expression and risk of breast cancer death among lymph node-negative patients

INTRODUCTION: The Oncotype DX assay was recently reported to predict risk for distant recurrence among a clinical trial population of tamoxifen-treated patients with lymph node-negative, estrogen receptor (ER)-positive breast cancer. To confirm and extend these findings, we evaluated the performance of this 21-gene assay among node-negative patients from a community hospital setting. METHODS: A case-control study was conducted among 4,964 Kaiser Permanente patients diagnosed with node-negative invasive breast cancer from 1985 to 1994 and not treated with adjuvant chemotherapy. Cases (n = 220) were patients who died from breast cancer. Controls (n = 570) were breast cancer patients who were individually matched to cases with respect to age, race, adjuvant tamoxifen, medical facility and diagnosis year, and were alive at the date of death of their matched case. Using an RT-PCR assay, archived tumor tissues were analyzed for expression levels of 16 cancer-related and five reference genes, and a summary risk score (the Recurrence Score) was calculated for each patient. Conditional logistic regression methods were used to estimate the association between risk of breast cancer death and Recurrence Score. RESULTS: After adjusting for tumor size and grade, the Recurrence Score was associated with risk of breast cancer death in ER-positive, tamoxifen-treated and -untreated patients (P = 0.003 and P = 0.03, respectively). At 10 years, the risks for breast cancer death in ER-positive, tamoxifen-treated patients were 2.8% (95% confidence interval [CI] 1.7–3.9%), 10.7% (95% CI 6.3–14.9%), and 15.5% (95% CI 7.6–22.8%) for those in the low, intermediate and high risk Recurrence Score groups, respectively. They were 6.2% (95% CI 4.5–7.9%), 17.8% (95% CI 11.8–23.3%), and 19.9% (95% CI 14.2–25.2%) for ER-positive patients not treated with tamoxifen. In both the tamoxifen-treated and -untreated groups, approximately 50% of patients had low risk Recurrence Score values. CONCLUSION: In this large, population-based study of lymph node-negative patients not treated with chemotherapy, the Recurrence Score was strongly associated with risk of breast cancer death among ER-positive, tamoxifen-treated and -untreated patients

Breast cancer prognostic classification in the molecular era: the role of histological grade

Breast cancer is a heterogeneous disease with varied morphological appearances, molecular features, behavior, and response to therapy. Current routine clinical management of breast cancer relies on the availability of robust clinical and pathological prognostic and predictive factors to support clinical and patient decision making in which potentially suitable treatment options are increasingly available. One of the best-established prognostic factors in breast cancer is histological grade, which represents the morphological assessment of tumor biological characteristics and has been shown to be able to generate important information related to the clinical behavior of breast cancers. Genome-wide microarray-based expression profiling studies have unraveled several characteristics of breast cancer biology and have provided further evidence that the biological features captured by histological grade are important in determining tumor behavior. Also, expression profiling studies have generated clinically useful data that have significantly improved our understanding of the biology of breast cancer, and these studies are undergoing evaluation as improved prognostic and predictive tools in clinical practice. Clinical acceptance of these molecular assays will require them to be more than expensive surrogates of established traditional factors such as histological grade. It is essential that they provide additional prognostic or predictive information above and beyond that offered by current parameters. Here, we present an analysis of the validity of histological grade as a prognostic factor and a consensus view on the significance of histological grade and its role in breast cancer classification and staging systems in this era of emerging clinical use of molecular classifiers. © 2010 BioMed Central Lt

How do we improve men’s mental health via primary care? An evaluation of the Atlas Men’s Well-being Pilot Programme for stressed/distressed men

Background Over three-quarters of all suicides are men (England and Wales), this is despite higher levels of anxiety and depression being reported by women. This disparity may in part be explained by atypical presentations of distress in men, and gendered issues around help-seeking. Consequently, the Atlas Men’s Well-being Programme was designed to engage stressed/distressed men who were patients at a London-based GP surgery. Atlas encouraged GPs to identify and refer men for counselling and/or acupuncture by raising their awareness of men’s distress. The aim of this pilot study was to evaluate Atlas in terms of patients’ characteristics, service utilisation, patient outcomes and cost implications. Methods All patients using the Programme were asked to complete a questionnaire before and after their Atlas sessions. Outcome measures included the Hospital Anxiety and Depression scale, Perceived Stress Scale, Warwick-Edinburgh Mental Well-being Scale, a 11-point scale measuring physical health, and the Psychological Outcome Profiles (PSYCHLOPS), a patient-generated outcome measure. Additionally, for cost calculations, participants were asked about their employment, number of days off work due to illness, and their health and social care service use. Results 102 participants were recruited, 82 completed pre- and post-treatment questionnaires. Comparisons pre- and post-treatment revealed a statistically significant improvement in anxious mood (p <0.001), perceived stress (p < 0.001), positive well-being (p = <0.001), PSYCHLOPS (p = <0.001) and physical health (p = 0.001), though not depressed mood (p = 0.660). Additionally, reductions in costs related to lost employment and health and social care use, exceeded the cost of Atlas counselling and acupuncture sessions, with an average saving of nearly £700 per patient. Conclusions Atlas attendance was associated with improvements in patients’ mental and physical health, and demonstrated likely cost savings. It is now important to understand patient and stakeholder perspectives. Further research could compare usual care with the Atlas approach, and investigate full cost-effectiveness