Meta-analytical methods to identify who benefits most from treatments: daft, deluded, or deft approach?

Identifying which individuals benefit most from particular treatments or other interventions underpins so-called personalised or stratified medicine. However, single trials are typically underpowered for exploring whether participant characteristics, such as age or disease severity, determine an individual’s response to treatment. A meta-analysis of multiple trials, particularly one where individual participant data (IPD) are available, provides greater power to investigate interactions between participant characteristics (covariates) and treatment effects. We use a published IPD meta-analysis to illustrate three broad approaches used for testing such interactions. Based on another systematic review of recently published IPD meta-analyses, we also show that all three approaches can be applied to aggregate data as well as IPD. We also summarise which methods of analysing and presenting interactions are in current use, and describe their advantages and disadvantages. We recommend that testing for interactions using within-trials information alone (the deft approach) becomes standard practice, alongside graphical presentation that directly visualises this

Duplicated network meta-analysis in advanced prostate cancer: a case study and recommendations for change

Background: Research overlap and duplication is a recognised problem in the context of both pairwise and network systematic reviews and meta-analyses. As a case study, we carried out a scoping review to identify and examine duplicated network meta-analyses (NMAs) in a specific disease setting where several novel therapies have recently emerged: hormone-sensitive metastatic prostate cancer (mHSPC). Methods: MEDLINE and EMBASE were systematically searched, in January 2020, for indirect or mixed treatment comparisons or network meta-analyses of the systemic treatments docetaxel and abiraterone acetate in the mHSPC setting, with a time-to-event outcome reported on the hazard-ratio scale. Eligibility decisions were made, and data extraction performed, by two independent reviewers. Results: A total of 13 eligible reviews were identified, analysing between 3 and 8 randomised comparisons, and comprising between 1773 and 7844 individual patients. Although the included trials and treatments showed a high degree of overlap, we observed considerable variation between identified reviews in terms of review aims, eligibility criteria and included data, statistical methodology, reporting and inference. Furthermore, crucial methodological details and specific source data were often unclear. Conclusions and recommendations: Variation across duplicated NMAs, together with reporting inadequacies, may compromise identification of best-performing treatments. Particularly in fast-moving fields, review authors should be aware of all relevant studies, and of other reviews with potential for overlap or duplication. We recommend that review protocols be published in advance, with greater clarity regarding the specific aims or scope of the project, and that reports include information on how the work builds upon existing knowledge. Source data and results should be clearly and completely presented to allow unbiased interpretation

Positive effects of methylphenidate on hyperactivity are moderated by monoaminergic gene variants in children with autism spectrum disorders.

Methylphenidate (MPH) reduces hyperactive-impulsive symptoms common in children with autism spectrum disorders (ASDs), however, response and tolerability varies widely. We hypothesized monoaminergic gene variants may moderate MPH effects in ASD, as in typically developing children with attention-deficit/hyperactivity disorder. Genotype data were available for 64 children with ASD and hyperactivity who were exposed to MPH during a 1-week safety/tolerability lead-in phase and 58 who went on to be randomized to placebo and three doses of MPH during a 4-week blinded, crossover study. Outcome measures included the Clinical Global Impression-Improvement (CGI-I) scale and the Aberrant Behavior Checklist (ABC-hyperactivity index). A total of 14 subjects discontinued the study because of MPH side effects. Subjects were genotyped for variants in DRD1-DRD5, ADRA2A, SLC6A3, SLC6A4, MAOA and MAOB, and COMT. Forty-nine percent of the sample met positive responder criteria. In this modest but relatively homogeneous sample, significant differences by DRD1 (P=0.006), ADRA2A (P<0.02), COMT (P<0.04), DRD3 (P<0.05), DRD4 (P<0.05), SLC6A3 (P<0.05) and SLC6A4 (P<0.05) genotypes were found for responders versus non-responders. Variants in DRD2 (P<0.001) and DRD3 (P<0.04) were associated with tolerability in the 14 subjects who discontinued the trial. For this first MPH pharmacogenetic study in children with ASD, multiple monoaminergic gene variants may help explain individual differences in MPH's efficacy and tolerability

Moderation of antipsychotic-induced weight gain by energy balance gene variants in the RUPP autism network risperidone studies.

Second-generation antipsychotic exposure, in both children and adults, carries significant risk for excessive weight gain that varies widely across individuals. We queried common variation in key energy balance genes (FTO, MC4R, LEP, CNR1, FAAH) for their association with weight gain during the initial 8 weeks in the two NIMH Research Units on Pediatric Psychopharmacology Autism Network trials (N=225) of risperidone for treatment of irritability in children/adolescents aged 4-17 years with autism spectrum disorders. Variants in the cannabinoid receptor (CNR)-1 promoter (P=1.0 × 10(-6)), CNR1 (P=9.6 × 10(-5)) and the leptin (LEP) promoter (P=1.4 × 10(-4)) conferred robust-independent risks for weight gain. A model combining these three variants was highly significant (P=1.3 × 10(-9)) with a 0.85 effect size between lowest and highest risk groups. All results survived correction for multiple testing and were not dependent on dose, plasma level or ethnicity. We found no evidence for association with a reported functional variant in the endocannabinoid metabolic enzyme, fatty acid amide hydrolase, whereas body mass index-associated single-nucleotide polymorphisms in FTO and MC4R showed only trend associations. These data suggest a substantial genetic contribution of common variants in energy balance regulatory genes to individual antipsychotic-associated weight gain in children and adolescents, which supersedes findings from prior adult studies. The effects are robust enough to be detected after only 8 weeks and are more prominent in this largely treatment naive population. This study highlights compelling directions for further exploration of the pharmacogenetic basis of this concerning multifactorial adverse event

Decision-making in percutaneous coronary intervention: a survey

<p>Abstract</p> <p>Background</p> <p>Few researchers have examined the perceptions of physicians referring cases for angiography regarding the degree to which collaboration occurs during percutaneous coronary intervention (PCI) decision-making. We sought to determine perceptions of physicians concerning their involvement in PCI decisions in cases they had referred to the cardiac catheterization laboratory at a major academic medical center.</p> <p>Methods</p> <p>An anonymous survey was mailed to internal medicine faculty members at a major academic medical center. The survey elicited whether responders perceived that they were included in decision-making regarding PCI, and whether they considered such collaboration to be the best process of decision-making.</p> <p>Results</p> <p>Of the 378 surveys mailed, 35% (133) were returned. Among responding non-cardiologists, 89% indicated that in most cases, PCI decisions were made solely by the interventionalist at the time of the angiogram. Among cardiologists, 92% indicated that they discussed the findings with the interventionalist prior to any PCI decisions. When asked what they considered the best process by which PCI decisions are made, 66% of non-cardiologists answered that they would prefer collaboration between either themselves or a non-interventional cardiologist and the interventionalist. Among cardiologists, 95% agreed that a collaborative approach is best.</p> <p>Conclusion</p> <p>Both non-cardiologists and cardiologists felt that involving another decision-maker, either the referring physician or a non-interventional cardiologist, would be the best way to make PCI decisions. Among cardiologists, there was more concordance between what they believed was the best process for making decisions regarding PCI and what they perceived to be the actual process.</p

Should Tyrosine Kinase Inhibitors Be Considered for Advanced Non-Small-Cell Lung Cancer Patients With Wild Type EGFR? Two Systematic Reviews and Meta-Analyses of Randomized Trials

Guidance concerning tyrosine kinase inhibitors (TKIs) for patients with wild type epidermal growth factor receptor (EGFR) and advanced non-small-cell lung cancer (NSCLC) after first-line treatment is unclear. We assessed the effect of TKIs as second-line therapy and maintenance therapy after first-line chemotherapy in two systematic reviews and meta-analyses, focusing on patients without EGFR mutations. Systematic searches were completed and data extracted from eligible randomized controlled trials. Three analytical approaches were used to maximize available data. Fourteen trials of second-line treatment (4388 patients) were included. Results showed the effect of TKIs on progression-free survival (PFS) depended on EGFR status (interaction hazard ratio [HR], 2.69; P = .004). Chemotherapy benefited patients with wild type EGFR (HR, 1.31; P < .0001), TKIs benefited patients with mutations (HR, 0.34; P = .0002). Based on 12 trials (85% of randomized patients) the benefits of TKIs on PFS decreased with increasing proportions of patients with wild type EGFR (P = .014). Six trials of maintenance therapy (2697 patients) were included. Results showed that although the effect of TKIs on PFS depended on EGFR status (interaction HR, 3.58; P < .0001), all benefited from TKIs (wild type EGFR: HR, 0.82; P = .01; mutated EGFR: HR, 0.24; P < .0001). There was a suggestion that benefits of TKIs on PFS decreased with increasing proportions of patients with wild type EGFR (P = .11). Chemotherapy should be standard second-line treatment for patients with advanced NSCLC and wild type EGFR. TKIs might be unsuitable for unselected patients. TKIs appear to benefit all patients compared with no active treatment as maintenance treatment, however, direct comparisons with chemotherapy are needed

Editorial Peer Reviewers' Recommendations at a General Medical Journal: Are They Reliable and Do Editors Care?

BACKGROUND: Editorial peer review is universally used but little studied. We examined the relationship between external reviewers' recommendations and the editorial outcome of manuscripts undergoing external peer-review at the Journal of General Internal Medicine (JGIM). METHODOLOGY/PRINCIPAL FINDINGS: We examined reviewer recommendations and editors' decisions at JGIM between 2004 and 2008. For manuscripts undergoing peer review, we calculated chance-corrected agreement among reviewers on recommendations to reject versus accept or revise. Using mixed effects logistic regression models, we estimated intra-class correlation coefficients (ICC) at the reviewer and manuscript level. Finally, we examined the probability of rejection in relation to reviewer agreement and disagreement. The 2264 manuscripts sent for external review during the study period received 5881 reviews provided by 2916 reviewers; 28% of reviews recommended rejection. Chance corrected agreement (kappa statistic) on rejection among reviewers was 0.11 (p<.01). In mixed effects models adjusting for study year and manuscript type, the reviewer-level ICC was 0.23 (95% confidence interval [CI], 0.19-0.29) and the manuscript-level ICC was 0.17 (95% CI, 0.12-0.22). The editors' overall rejection rate was 48%: 88% when all reviewers for a manuscript agreed on rejection (7% of manuscripts) and 20% when all reviewers agreed that the manuscript should not be rejected (48% of manuscripts) (p<0.01). CONCLUSIONS/SIGNIFICANCE: Reviewers at JGIM agreed on recommendations to reject vs. accept/revise at levels barely beyond chance, yet editors placed considerable weight on reviewers' recommendations. Efforts are needed to improve the reliability of the peer-review process while helping editors understand the limitations of reviewers' recommendations

Conductance Ratios and Cellular Identity

Recent experimental evidence suggests that coordinated expression of ion channels plays a role in constraining neuronal electrical activity. In particular, each neuronal cell type of the crustacean stomatogastric ganglion exhibits a unique set of positive linear correlations between ionic membrane conductances. These data suggest a causal relationship between expressed conductance correlations and features of cellular identity, namely electrical activity type. To test this idea, we used an existing database of conductance-based model neurons. We partitioned this database based on various measures of intrinsic activity, to approximate distinctions between biological cell types. We then tested individual conductance pairs for linear dependence to identify correlations. Contrary to experimental evidence, in which all conductance correlations are positive, 32% of correlations seen in this database were negative relationships. In addition, 80% of correlations seen here involved at least one calcium conductance, which have been difficult to measure experimentally. Similar to experimental results, each activity type investigated had a unique combination of correlated conductances. Finally, we found that populations of models that conform to a specific conductance correlation have a higher likelihood of exhibiting a particular feature of electrical activity. We conclude that regulating conductance ratios can support proper electrical activity of a wide range of cell types, particularly when the identity of the cell is well-defined by one or two features of its activity. Furthermore, we predict that previously unseen negative correlations and correlations involving calcium conductances are biologically plausible

Can computerized clinical decision support systems improve practitioners' diagnostic test ordering behavior? A decision-maker-researcher partnership systematic review

<p>Abstract</p> <p>Background</p> <p>Underuse and overuse of diagnostic tests have important implications for health outcomes and costs. Decision support technology purports to optimize the use of diagnostic tests in clinical practice. The objective of this review was to assess whether computerized clinical decision support systems (CCDSSs) are effective at improving ordering of tests for diagnosis, monitoring of disease, or monitoring of treatment. The outcome of interest was effect on the diagnostic test-ordering behavior of practitioners.</p> <p>Methods</p> <p>We conducted a decision-maker-researcher partnership systematic review. We searched MEDLINE, EMBASE, Ovid's EBM Reviews database, Inspec, and reference lists for eligible articles published up to January 2010. We included randomized controlled trials comparing the use of CCDSSs to usual practice or non-CCDSS controls in clinical care settings. Trials were eligible if at least one component of the CCDSS gave suggestions for ordering or performing a diagnostic procedure. We considered studies 'positive' if they showed a statistically significant improvement in at least 50% of test ordering outcomes.</p> <p>Results</p> <p>Thirty-five studies were identified, with significantly higher methodological quality in those published after the year 2000 (<it>p </it>= 0.002). Thirty-three trials reported evaluable data on diagnostic test ordering, and 55% (18/33) of CCDSSs improved testing behavior overall, including 83% (5/6) for diagnosis, 63% (5/8) for treatment monitoring, 35% (6/17) for disease monitoring, and 100% (3/3) for other purposes. Four of the systems explicitly attempted to reduce test ordering rates and all succeeded. Factors of particular interest to decision makers include costs, user satisfaction, and impact on workflow but were rarely investigated or reported.</p> <p>Conclusions</p> <p>Some CCDSSs can modify practitioner test-ordering behavior. To better inform development and implementation efforts, studies should describe in more detail potentially important factors such as system design, user interface, local context, implementation strategy, and evaluate impact on user satisfaction and workflow, costs, and unintended consequences.</p