Many Labs 5:Testing pre-data collection peer review as an intervention to increase replicability

Replication studies in psychological science sometimes fail to reproduce prior findings. If these studies use methods that are unfaithful to the original study or ineffective in eliciting the phenomenon of interest, then a failure to replicate may be a failure of the protocol rather than a challenge to the original finding. Formal pre-data-collection peer review by experts may address shortcomings and increase replicability rates. We selected 10 replication studies from the Reproducibility Project: Psychology (RP:P; Open Science Collaboration, 2015) for which the original authors had expressed concerns about the replication designs before data collection; only one of these studies had yielded a statistically significant effect (p < .05). Commenters suggested that lack of adherence to expert review and low-powered tests were the reasons that most of these RP:P studies failed to replicate the original effects. We revised the replication protocols and received formal peer review prior to conducting new replication studies. We administered the RP:P and revised protocols in multiple laboratories (median number of laboratories per original study = 6.5, range = 3?9; median total sample = 1,279.5, range = 276?3,512) for high-powered tests of each original finding with both protocols. Overall, following the preregistered analysis plan, we found that the revised protocols produced effect sizes similar to those of the RP:P protocols (?r = .002 or .014, depending on analytic approach). The median effect size for the revised protocols (r = .05) was similar to that of the RP:P protocols (r = .04) and the original RP:P replications (r = .11), and smaller than that of the original studies (r = .37). Analysis of the cumulative evidence across the original studies and the corresponding three replication attempts provided very precise estimates of the 10 tested effects and indicated that their effect sizes (median r = .07, range = .00?.15) were 78% smaller, on average, than the original effect sizes (median r = .37, range = .19?.50)

12th International CHARGE syndrome conference proceedings

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/134130/1/ajmga37544.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/134130/2/ajmga37544_am.pd

Shear wave elastography imaging of carotid plaques: feasible, reproducible and of clinical potential

Background: Shear Wave Elastography (SWE) imaging is a novel ultrasound technique for quantifying tissue elasticity. Studies have demonstrated that SWE is able to differentiate between diseased and normal tissue in a wide range clinical applications. However its applicability to atherosclerotic carotid disease has not been established. The aim of this study was to assess the feasibility and potential clinical benefit of using SWE imaging for the assessment of carotid plaques. Methods: Eighty-one patients (mean age 76 years, 51 male) underwent greyscale and SWE imaging. Elasticity was quantified by measuring mean Young’s Modulus (YM) within the plaque and within the vessel wall. Echogenicity was assessed using the Gray-Weale classification scale and the greyscale median (GSM). Results: Fifty four plaques with stenosis greater than 30% were assessed. Reproducibility of YM measurements, quantified by the inter-frame coefficient of variation, was 22% within the vessel wall and 19% within the carotid plaque. Correlation with percentage stenosis was significant for plaque YM (p = 0.003), but insignificant for plaque GSM (p = 0.46). Plaques associated with focal neurological symptoms had significantly lower mean YM than plaques in asymptomatic patients (62 kPa vs 88 kPa; p = 0.01). Logistic regression and Receiver Operating Characteristic (ROC) analysis showed improvements in sensitivity and specificity when percentage stenosis was combined with the YM (area under ROC = 0.78). Conclusions: Our study showed SWE is able to quantify carotid plaque elasticity and provide additional information that may be of clinical benefit to help identify the unstable carotid plaque

Dynamic variations in the ultrasound greyscale median of carotid artery plaques

BACKGROUND: Several studies have found that the ultrasound greyscale median (GSM) of carotid artery plaques may be useful for predicting the risk of cerebrovascular events. However, measurements of GSM are typically performed on still ultrasound images ignoring any variations that may be observed on a frame-by-frame basis. The aim of this study was to establish the existence and investigate the nature and extent of these variations. METHODS: Employing a novel method that enabled plaque boundaries to be tracked semi-automatically, variations in the plaque GSM and observed cross-sectional area were measured for 27 carotid artery plaques (19 consecutive patients, stenosis range 10%-80%) over image sequences of up to 10 seconds in length acquired with a mean frame rate of 32 frames per second. RESULTS: Our results showed a mean inter-frame coefficient of variation (CV) of 5.2% (s.d. 2.5%) for GSM and 4.2% (s.d. 2.9%) for the plaque area. Thirteen of the 27 plaques (48%) exhibited CV in GSM greater than 5% whereas only six plaques (22%) had CV in plaque area of greater than 5%. There was no significant correlation between the CV of GSM and plaque area. CONCLUSIONS: Inter-frame variations in the plaque GSM such as those found in this study have implications on the reproducibility of GSM measurements and their clinical utility. Studies assessing the GSM of carotid artery plaques should consider these variations

Wall motion in the stenotic carotid artery: association with greyscale plaque characteristics, the degree of stenosis and cerebrovascular symptoms

Background: Systolic dilation of the atherosclerotic carotid artery depends on several factors including arterial compliance and the haemodynamic environment. The purpose of this study was to quantify wall motion in stenotic carotid arteries and investigate any associations with the ultrasound greyscale plaque characteristics, the degree of stenosis, and the presence of cerebrovascular symptoms. Methods: Variations in the lumen diameters of 61 stenotic carotid arteries (stenosis range 10%-95%) from 47 patients were measured before the proximal shoulder of the atherosclerotic plaque using ultrasound image sequences over several cardiac cycles. Absolute and percentage diameter changes from diastole to systole were calculated and their relationship to the degree of stenosis, greyscale plaque characteristics, and the presence of ipsilateral hemispheric symptoms were studied. Results: The mean absolute diameter change from diastole to systole was 0.45 mm (s.d. 0.17), and the mean percentage diameter change was 6.9% (s.d. 3.1%). Absolute and percentage diameter changes did not have a statistically significant relationship to the degree of stenosis, greyscale plaque characteristics, or the presence of ipsilateral hemispheric symptoms (p > 0.05). Parameters significantly correlated with the presence of symptoms were the degree of stenosis (p = 0.01), plaque greyscale median (p = 0.02) and the plaque surface irregularity index (p = 0.02). Conclusions: Our study confirmed the degree of stenosis, plaque greyscale median and our surface irregularity index were significant predictors of symptoms, but found no significant correlation between diameter changes of stenosed carotid arteries and the presence of ipsilateral hemispheric symptoms

Quantitative assessment of carotid plaque surface irregularities and correlation to cerebrovascular symptoms

Background: The purpose of this study was to determine whether surface irregularities measured from ultrasound images of carotid artery plaques and quantified using a novel method, correlate with the presence of ipsilateral hemispheric cerebrovascular symptoms. Methods: A plaque surface irregularity index (SII) was measured in 47 carotid artery plaques (32 subjects, stenosis range 10% -95%, 49% symptomatic) using ultrasound image sequences spanning several cardiac cycles. The differences in the distribution of SII in plaques with ipsilateral hemispheric symptoms versus those without symptoms and the correlation between the SII of plaques and the degrees of stenosis of the corresponding arteries were assessed. Diagnostic performance of plaque SII was evaluated on its own and in combination with the degree of stenosis. Results: The mean SII was significantly greater for plaques with ipsilateral hemispheric symptoms (1.89 radians/mm) than for asymptomatic plaques (1.67 radians/mm, p = 0.03). There was no statistically significant association between the SII and the degree of stenosis (p = 0.30). SII predicted the presence of cerebrovascular symptoms with an accuracy of 66% (sensitivity 65%, specificity 67%) on its own and with an accuracy of 83% (sensitivity 96%, specificity 71%) in combination with the degree of stenosis. Conclusions: Quantitative assessment of carotid plaque surface irregularities using a novel SII parameter correlates with the presence ipsilateral hemispheric cerebrovascular symptoms and may increase diagnostic performance beyond that provided by the degree of stenosis

Conventional oxygen therapy versus CPAP as a ceiling of care in ward-based patients with COVID-19: a multi-centre cohort evaluation

BACKGROUND: Continuous positive airway pressure (CPAP) therapy is commonly used for respiratory failure due to severe COVID-19 pneumonitis, including in patients deemed not likely to benefit from invasive mechanical ventilation (nIMV). Little evidence exists demonstrating superiority over conventional oxygen therapy, whilst ward-level delivery of CPAP presents practical challenges. We sought to compare clinical outcomes of oxygen therapy versus CPAP therapy in patients with COVID-19 who were nIMV. METHODS: This retrospective multi-centre cohort evaluation included patients diagnosed with COVID-19 who were nIMV, had a treatment escalation plan of ward-level care and clinical frailty scale ≤ 6. Recruitment occurred during the first two waves of the UK COVID-19 pandemic in 2020; from 1(st) March to May 31(st), and from 1(st) September to 31(st) December. Patients given CPAP were compared to patients receiving oxygen therapy that required FiO(2) ≥0(.)4 for more than 12 hours at hospitals not providing ward-level CPAP. Logistic regression modelling was performed to compare 30-day mortality between treatment groups, accounting for important confounders and within-hospital clustering. FINDINGS: Seven hospitals provided data for 479 patients during the UK COVID-19 pandemic in 2020. Overall 30-day mortality was 75.6% in the oxygen group (186/246 patients) and 77.7% in the CPAP group (181/233 patients). A lack of evidence for a treatment effect persisted in the adjusted model (adjusted odds ratio 0.84 95% CI 0.57-1.23, p=0.37). 49.8% of patients receiving CPAP-therapy (118/237) chose to discontinue it. INTERPRETATION: No survival difference was found between using oxygen alone or CPAP to treat patients with severe COVID-19 who were nIMV. A high patient-initiated discontinuation rate for CPAP suggests a significant treatment burden. Further reflection is warranted on the current treatment guidance and widespread application of CPAP in this setting