Quality science from quality measurement: The role of measurement type with respect to replication and effect size magnitude in psychological research

Copyright: © 2018 Kornbrot et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.The quality of psychological studies is currently a major concern. The Many Labs Project (MLP) and the Open-Science-Collaboration (OSC) have collected key data on replicability and statistical effect sizes. We build on this work by investigating the role played by three measurement types: ratings, proportions and unbounded (measures without conceptual upper limits, e.g. time). Both replicability and effect sizes are dependent on the amount of variability due to extraneous factors. We predicted that the role of such extraneous factors might depend on measurement type, and would be greatest for ratings, intermediate for proportions and least for unbounded. Our results support this conjecture. OSC replication rates for unbounded, 43% and proportion 40% combined are reliably higher than those for ratings at 20% (effect size, w = .20). MLP replication rates for the original studies are: pro- portion = .74, ratings = .40 (effect size w = .33). Original effect sizes (Cohen’s d) are highest for: unbounded OSC cognitive = 1.45, OSC social = .90); next for proportions (OSC cogni- tive = 1.01, OSC social = .84, MLP = .82); and lowest for ratings (OSC social = .64, MLP = .31). These findings are of key importance to scientific methodology and design, even if the reasons for their occurrence are still at the level of conjecture.Peer reviewe

Cross-sectional associations between sleep duration, sedentary time, physical activity, and adiposity indicators among Canadian preschool-aged children using compositional analyses

Abstract Background Sleep duration, sedentary behaviour, and physical activity are three co-dependent behaviours that fall on the movement/non-movement intensity continuum. Compositional data analyses provide an appropriate method for analyzing the association between co-dependent movement behaviour data and health indicators. The objectives of this study were to examine: (1) the combined associations of the composition of time spent in sleep, sedentary behaviour, light-intensity physical activity (LPA), and moderate- to vigorous-intensity physical activity (MVPA) with adiposity indicators; and (2) the association of the time spent in sleep, sedentary behaviour, LPA, or MVPA with adiposity indicators relative to the time spent in the other behaviours in a representative sample of Canadian preschool-aged children. Methods Participants were 552 children aged 3 to 4 years from cycles 2 and 3 of the Canadian Health Measures Survey. Sedentary time, LPA, and MVPA were measured with Actical accelerometers (Philips Respironics, Bend, OR USA), and sleep duration was parental reported. Adiposity indicators included waist circumference (WC) and body mass index (BMI) z-scores based on World Health Organization growth standards. Compositional data analyses were used to examine the cross-sectional associations. Results The composition of movement behaviours was significantly associated with BMI z-scores (p = 0.006) but not with WC (p = 0.718). Further, the time spent in sleep (BMI z-score: γ sleep  = −0.72; p = 0.138; WC: γ sleep  = −1.95; p = 0.285), sedentary behaviour (BMI z-score: γ SB  = 0.19; p = 0.624; WC: γ SB  = 0.87; p = 0.614), LPA (BMI z-score: γ LPA  = 0.62; p = 0.213, WC: γ LPA  = 0.23; p = 0.902), or MVPA (BMI z-score: γ MVPA  = −0.09; p = 0.733, WC: γ MVPA  = 0.08; p = 0.288) relative to the other behaviours was not significantly associated with the adiposity indicators. Conclusions This study is the first to use compositional analyses when examining associations of co-dependent sleep duration, sedentary time, and physical activity behaviours with adiposity indicators in preschool-aged children. The overall composition of movement behaviours appears important for healthy BMI z-scores in preschool-aged children. Future research is needed to determine the optimal movement behaviour composition that should be promoted in this age group

A Measurement of Rb using a Double Tagging Method

The fraction of Z to bbbar events in hadronic Z decays has been measured by the OPAL experiment using the data collected at LEP between 1992 and 1995. The Z to bbbar decays were tagged using displaced secondary vertices, and high momentum electrons and muons. Systematic uncertainties were reduced by measuring the b-tagging efficiency using a double tagging technique. Efficiency correlations between opposite hemispheres of an event are small, and are well understood through comparisons between real and simulated data samples. A value of Rb = 0.2178 +- 0.0011 +- 0.0013 was obtained, where the first error is statistical and the second systematic. The uncertainty on Rc, the fraction of Z to ccbar events in hadronic Z decays, is not included in the errors. The dependence on Rc is Delta(Rb)/Rb = -0.056*Delta(Rc)/Rc where Delta(Rc) is the deviation of Rc from the value 0.172 predicted by the Standard Model. The result for Rb agrees with the value of 0.2155 +- 0.0003 predicted by the Standard Model.Comment: 42 pages, LaTeX, 14 eps figures included, submitted to European Physical Journal

Measurement of the B+ and B-0 lifetimes and search for CP(T) violation using reconstructed secondary vertices

The lifetimes of the B+ and B-0 mesons, and their ratio, have been measured in the OPAL experiment using 2.4 million hadronic Z(0) decays recorded at LEP. Z(0) --> b (b) over bar decays were tagged using displaced secondary vertices and high momentum electrons and muons. The lifetimes were then measured using well-reconstructed charged and neutral secondary vertices selected in this tagged data sample. The results aretau(B+) = 1.643 +/- 0.037 +/- 0.025 pstau(Bo) = 1.523 +/- 0.057 +/- 0.053 pstau(B+)/tau(Bo) = 1.079 +/- 0.064 +/- 0.041,where in each case the first error is statistical and the second systematic.A larger data sample of 3.1 million hadronic Z(o) decays has been used to search for CP and CPT violating effects by comparison of inclusive b and (b) over bar hadron decays, No evidence fur such effects is seen. The CP violation parameter Re(epsilon(B)) is measured to be Re(epsilon(B)) = 0.001 +/- 0.014 +/- 0.003and the fractional difference between b and (b) over bar hadron lifetimes is measured to(Delta tau/tau)(b) = tau(b hadron) - tau((b) over bar hadron)/tau(average) = -0.001 +/- 0.012 +/- 0.008

Measurement of the inclusive and dijet cross-sections of b-jets in pp collisions at sqrt(s) = 7 TeV with the ATLAS detector

The inclusive and dijet production cross-sections have been measured for jets containing b-hadrons (b-jets) in proton-proton collisions at a centre-of-mass energy of sqrt(s) = 7 TeV, using the ATLAS detector at the LHC. The measurements use data corresponding to an integrated luminosity of 34 pb^-1. The b-jets are identified using either a lifetime-based method, where secondary decay vertices of b-hadrons in jets are reconstructed using information from the tracking detectors, or a muon-based method where the presence of a muon is used to identify semileptonic decays of b-hadrons inside jets. The inclusive b-jet cross-section is measured as a function of transverse momentum in the range 20 < pT < 400 GeV and rapidity in the range |y| < 2.1. The bbbar-dijet cross-section is measured as a function of the dijet invariant mass in the range 110 < m_jj < 760 GeV, the azimuthal angle difference between the two jets and the angular variable chi in two dijet mass regions. The results are compared with next-to-leading-order QCD predictions. Good agreement is observed between the measured cross-sections and the predictions obtained using POWHEG + Pythia. MC@NLO + Herwig shows good agreement with the measured bbbar-dijet cross-section. However, it does not reproduce the measured inclusive cross-section well, particularly for central b-jets with large transverse momenta.Comment: 10 pages plus author list (21 pages total), 8 figures, 1 table, final version published in European Physical Journal

Sediment geochemistry of streams draining abandoned lead / zinc mines in central Wales: the Afon Twymyn

Purpose Despite the decline of metal mining in the UK during the early 20th century, a substantial legacy of heavy metal contamination persists in river channel and floodplain sediments. Poor sediment quality is likely to impede the achievement of ’good’ chemical and ecological status for surface waters under the European Union Water Framework Directive. This paper examines the environmental legacy of the Dylife lead/zinc mine in the central Wales mining district. Leachable heavy metal concentrations in the bed sediments of the Afon Twymyn are established and the geochemical partitioning, potential mobility and bioavailability of sediment-associated heavy metals are established. Materials and methods Sediment samples were collected from the river bed and dry-sieved into two size fractions (<63 μm and 64–2,000 μm). The fractionated samples were then subjected to a sequential extraction procedure to isolate heavy metals (Pb, Zn, Cu, Cd, Fe, Mn) in three different geochemical phases. Sediment samples were then analysed for heavy metals using ICP-AES. Results and discussion The bed sediment of the Afon Twymyn is grossly polluted with heavy metals. Within the vicinity of the former mine, Pb concentrations are up to 100 times greater than levels reported to have deleterious impacts on aquatic ecology. Most heavy metals exist in the most mobile easily exchangeable and carbonate-bound geochemical phases, potentially posing serious threats to ecological integrity and constituting a significant, secondary, diffuse source of pollution. Metal concentrations decrease sharply downstream of the former mine, although there is a gradual increase in the proportion of readily extractable Zn and Cd. Conclusions Implementation of sediment quality guidelines is important in order to achieve the aims of the Water Framework Directive. Assessments of sediment quality should include measurements of background metal concentrations, river water physico-chemistry and, most importantly, metal mobility and potential bioavailability. Uniformity of sediment guidelines throughout Europe and flexibility of targets with regard to the most heavily contaminated mine sites are recommended

The changing global distribution and prevalence of canine transmissible venereal tumour.

BACKGROUND: The canine transmissible venereal tumour (CTVT) is a contagious cancer that is naturally transmitted between dogs by the allogeneic transfer of living cancer cells during coitus. CTVT first arose several thousand years ago and has been reported in dog populations worldwide; however, its precise distribution patterns and prevalence remain unclear. RESULTS: We analysed historical literature and obtained CTVT prevalence information from 645 veterinarians and animal health workers in 109 countries in order to estimate CTVT's former and current global distribution and prevalence. This analysis confirmed that CTVT is endemic in at least 90 countries worldwide across all inhabited continents. CTVT is estimated to be present at a prevalence of one percent or more in dogs in at least 13 countries in South and Central America as well as in at least 11 countries in Africa and 8 countries in Asia. In the United States and Australia, CTVT was reported to be endemic only in remote indigenous communities. Comparison of current and historical reports of CTVT indicated that its prevalence has declined in Northern Europe, possibly due to changes in dog control laws during the nineteenth and twentieth centuries. Analysis of factors influencing CTVT prevalence showed that presence of free-roaming dogs was associated with increased CTVT prevalence, while dog spaying and neutering were associated with reduced CTVT prevalence. Our analysis indicated no gender bias for CTVT and we found no evidence that animals with CTVT frequently harbour concurrent infectious diseases. Vincristine was widely reported to be the most effective therapy for CTVT. CONCLUSIONS: Our results provide a survey of the current global distribution of CTVT, confirming that CTVT is endemic in at least 90 countries worldwide. Additionally, our analysis highlights factors that continue to modify CTVT's prevalence around the world and implicates free-roaming dogs as a reservoir for the disease. Our analysis also documents the disappearance of the disease from the United Kingdom during the twentieth century, which appears to have been an unintentional result of the introduction of dog control policies.This is the author's accepted manuscript. The final version of this article has been published by BioMed Central: http://www.biomedcentral.com/1746-6148/10/168

Sources of stakeholder salience in the responsible investment movement: why do investors sign the Principles for Responsible Investment?

Since its inception in 2006, the United Nations-backed Principles for Responsible Investment (PRI) have grown to over 1300 signatories representing over $45 trillion. This growth is not slowing down. In this paper, we argue that there is a set of attributes which make the PRI salient as a stakeholder and its claim to sign the six PRI important to institutional investors. We use Mitchell et al.’s (Acad Manag Rev 22:853–886, 1997) theoretical framework of stakeholder salience, as extended by Gifford (J Bus Eth 92:79–97, 2010). We use as evidence confidential data from the annual survey of signatories carried out by the PRI in a 5-year period between 2007 and 2011. The findings highlight pragmatic and organizational legitimacy, normative and utilitarian power, and management values as the attributes that contribute most to the salience of the PRI as a stakeholder

Lead and Cadmium Levels and Balance and Vestibular Dysfunction among Adult Participants in the National Health and Nutrition Examination Survey (NHANES) 1999–2004

Background: Few studies have been conducted to identify risk factors for balance and vestibular dysfunction in general populations, but previous studies have reported evidence of adverse effects of lead and cadmium on balance control in high-risk groups

Measurement of the W+W−γW^{+}W^{-} \gamma Cross-section and First direct Limits on Anomalous Electroweak Quartic Gauge Couplings

A study of W+W- events accompanied by hard photon radiation produced in e+e- collisions at LEP is presented. Events consistent with two on-shell W-bosons and an isolated photon are selected from 183pb^-1 of data recorded at root{s}=189GeV. From these data, 17 W+W-gamma candidates are selected with photon energy greater than 10GeV, consistent with the Standard Model expectation. These events are used to measure the e+e- to W+W-gamma cross-section within a set of geometric and kinematic cuts; sigma{W+W-gamma} = 136+-37+-8 fb, where the first error is statistical and the second systematic. The photon energy spectrum is used to set the first direct, albeit weak, limits on possible anomalous contributions to the {W+ W- gamma gamma} and {W+ W- gamma Z0} vertices: -0.070GeV^{-2} < a_0/Lambda^2 < 0.070GeV^{-2}, -0.13GeV^{-2} < a_c/Lambda^2 < 0.19GeV^{-2}, -0.61GeV^{-2} < a_n/Lambda^2 < 0.57GeV^{-2}, where Lambda represents the energy scale for new physics.A study of W+W- events accompanied by hard photon radiation produced in e+e- collisions at LEP is presented. Events consistent with two on-shell W-bosons and an isolated photon are selected from 183pb^-1 of data recorded at root{s}=189GeV. From these data, 17 W+W-gamma candidates are selected with photon energy greater than 10GeV, consistent with the Standard Model expectation. These events are used to measure the e+e- to W+W-gamma cross-section within a set of geometric and kinematic cuts; sigma{W+W-gamma} = 136+-37+-8 fb, where the first error is statistical and the second systematic. The photon energy spectrum is used to set the first direct, albeit weak, limits on possible anomalous contributions to the {W+ W- gamma gamma} and {W+ W- gamma Z0} vertices: -0.070GeV^{-2} < a_0/Lambda^2 < 0.070GeV^{-2}, -0.13GeV^{-2} < a_c/Lambda^2 < 0.19GeV^{-2}, -0.61GeV^{-2} < a_n/Lambda^2 < 0.57GeV^{-2}, where Lambda represents the energy scale for new physics.A study of W+W- events accompanied by hard photon radiation produced in e+e- collisions at LEP is presented. Events consistent with two on-shell W-bosons and an isolated photon are selected from 183pb^-1 of data recorded at root{s}=189GeV. From these data, 17 W+W-gamma candidates are selected with photon energy greater than 10GeV, consistent with the Standard Model expectation. These events are used to measure the e+e- to W+W-gamma cross-section within a set of geometric and kinematic cuts; sigma{W+W-gamma} = 136+-37+-8 fb, where the first error is statistical and the second systematic. The photon energy spectrum is used to set the first direct, albeit weak, limits on possible anomalous contributions to the {W+ W- gamma gamma} and {W+ W- gamma Z0} vertices: -0.070GeV^{-2} < a_0/Lambda^2 < 0.070GeV^{-2}, -0.13GeV^{-2} < a_c/Lambda^2 < 0.19GeV^{-2}, -0.61GeV^{-2} < a_n/Lambda^2 < 0.57GeV^{-2}, where Lambda represents the energy scale for new physics.A study of W+W- events accompanied by hard photon radiation produced in e+e- collisions at LEP is presented. Events consistent with two on-shell W-bosons and an isolated photon are selected from 183pb^-1 of data recorded at root{s}=189GeV. From these data, 17 W+W-gamma candidates are selected with photon energy greater than 10GeV, consistent with the Standard Model expectation. These events are used to measure the e+e- to W+W-gamma cross-section within a set of geometric and kinematic cuts; sigma{W+W-gamma} = 136+-37+-8 fb, where the first error is statistical and the second systematic. The photon energy spectrum is used to set the first direct, albeit weak, limits on possible anomalous contributions to the {W+ W- gamma gamma} and {W+ W- gamma Z0} vertices: -0.070GeV^{-2} < a_0/Lambda^2 < 0.070GeV^{-2}, -0.13GeV^{-2} < a_c/Lambda^2 < 0.19GeV^{-2}, -0.61GeV^{-2} < a_n/Lambda^2 < 0.57GeV^{-2}, where Lambda represents the energy scale for new physics.A study of W+W- events accompanied by hard photon radiation produced in e+e- collisions at LEP is presented. Events consistent with two on-shell W-bosons and an isolated photon are selected from 183pb^-1 of data recorded at root{s}=189GeV. From these data, 17 W+W-gamma candidates are selected with photon energy greater than 10GeV, consistent with the Standard Model expectation. These events are used to measure the e+e- to W+W-gamma cross-section within a set of geometric and kinematic cuts; sigma{W+W-gamma} = 136+-37+-8 fb, where the first error is statistical and the second systematic. The photon energy spectrum is used to set the first direct, albeit weak, limits on possible anomalous contributions to the {W+ W- gamma gamma} and {W+ W- gamma Z0} vertices: -0.070GeV^{-2} < a_0/Lambda^2 < 0.070GeV^{-2}, -0.13GeV^{-2} < a_c/Lambda^2 < 0.19GeV^{-2}, -0.61GeV^{-2} < a_n/Lambda^2 < 0.57GeV^{-2}, where Lambda represents the energy scale for new physics.A study of W+W- events accompanied by hard photon radiation produced in e+e- collisions at LEP is presented. Events consistent with two on-shell W-bosons and an isolated photon are selected from 183pb^-1 of data recorded at root{s}=189GeV. From these data, 17 W+W-gamma candidates are selected with photon energy greater than 10GeV, consistent with the Standard Model expectation. These events are used to measure the e+e- to W+W-gamma cross-section within a set of geometric and kinematic cuts; sigma{W+W-gamma} = 136+-37+-8 fb, where the first error is statistical and the second systematic. The photon energy spectrum is used to set the first direct, albeit weak, limits on possible anomalous contributions to the {W+ W- gamma gamma} and {W+ W- gamma Z0} vertices: -0.070GeV^{-2} < a_0/Lambda^2 < 0.070GeV^{-2}, -0.13GeV^{-2} < a_c/Lambda^2 < 0.19GeV^{-2}, -0.61GeV^{-2} < a_n/Lambda^2 < 0.57GeV^{-2}, where Lambda represents the energy scale for new physics.A study of W+W- events accompanied by hard photon radiation produced in e+e- collisions at LEP is presented. Events consistent with two on-shell W-bosons and an isolated photon are selected from 183pb^-1 of data recorded at root{s}=189GeV. From these data, 17 W+W-gamma candidates are selected with photon energy greater than 10GeV, consistent with the Standard Model expectation. These events are used to measure the e+e- to W+W-gamma cross-section within a set of geometric and kinematic cuts; sigma{W+W-gamma} = 136+-37+-8 fb, where the first error is statistical and the second systematic. The photon energy spectrum is used to set the first direct, albeit weak, limits on possible anomalous contributions to the {W+ W- gamma gamma} and {W+ W- gamma Z0} vertices: -0.070GeV^{-2} < a_0/Lambda^2 < 0.070GeV^{-2}, -0.13GeV^{-2} < a_c/Lambda^2 < 0.19GeV^{-2}, -0.61GeV^{-2} < a_n/Lambda^2 < 0.57GeV^{-2}, where Lambda represents the energy scale for new physics.A study of W+W- events accompanied by hard photon radiation produced in e+e- collisions at LEP is presented. Events consistent with two on-shell W-bosons and an isolated photon are selected from 183pb^-1 of data recorded at root{s}=189GeV. From these data, 17 W+W-gamma candidates are selected with photon energy greater than 10GeV, consistent with the Standard Model expectation. These events are used to measure the e+e- to W+W-gamma cross-section within a set of geometric and kinematic cuts; sigma{W+W-gamma} = 136+-37+-8 fb, where the first error is statistical and the second systematic. The photon energy spectrum is used to set the first direct, albeit weak, limits on possible anomalous contributions to the {W+ W- gamma gamma} and {W+ W- gamma Z0} vertices: -0.070GeV^{-2} < a_0/Lambda^2 < 0.070GeV^{-2}, -0.13GeV^{-2} < a_c/Lambda^2 < 0.19GeV^{-2}, -0.61GeV^{-2} < a_n/Lambda^2 < 0.57GeV^{-2}, where Lambda represents the energy scale for new physics.A study of W + W − events accompanied by hard photon radiation produced in e + e − collisions at LEP is presented. Events consistent with two on-shell W-bosons and an isolated photon are selected from 183 pb −1 of data recorded at s =189 GeV. From these data, 17 W + W − γ candidates are selected with photon energy greater than 10 GeV, consistent with the Standard Model expectation. These events are used to measure the e + e − →W + W − γ cross-section within a set of geometric and kinematic cuts, σ ̂ WW γ =136±37±8 fb, where the first error is statistical and the second systematic. The photon energy spectrum is used to set the first direct, albeit weak, limits on possible anomalous contributions to the W + W − γγ and W + W − γ Z 0 vertices: −0.070 GeV −