Quality science from quality measurement: The role of measurement type with respect to replication and effect size magnitude in psychological research

Copyright: © 2018 Kornbrot et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.The quality of psychological studies is currently a major concern. The Many Labs Project (MLP) and the Open-Science-Collaboration (OSC) have collected key data on replicability and statistical effect sizes. We build on this work by investigating the role played by three measurement types: ratings, proportions and unbounded (measures without conceptual upper limits, e.g. time). Both replicability and effect sizes are dependent on the amount of variability due to extraneous factors. We predicted that the role of such extraneous factors might depend on measurement type, and would be greatest for ratings, intermediate for proportions and least for unbounded. Our results support this conjecture. OSC replication rates for unbounded, 43% and proportion 40% combined are reliably higher than those for ratings at 20% (effect size, w = .20). MLP replication rates for the original studies are: pro- portion = .74, ratings = .40 (effect size w = .33). Original effect sizes (Cohen’s d) are highest for: unbounded OSC cognitive = 1.45, OSC social = .90); next for proportions (OSC cogni- tive = 1.01, OSC social = .84, MLP = .82); and lowest for ratings (OSC social = .64, MLP = .31). These findings are of key importance to scientific methodology and design, even if the reasons for their occurrence are still at the level of conjecture.Peer reviewe

Acceptability and feasibility of peer assisted supervision and support for intervention practitioners: a Q-methodology evaluation

Evidence-based interventions often include quality improvement methods to support fidelity and improve client outcomes. Clinical supervision is promoted as an effective way of developing practitioner confidence and competence in delivery; however, supervision is often inconsistent and embedded in hierarchical line management structures that may limit the opportunity for reflective learning. The Peer Assisted Supervision and Support (PASS) supervision model uses peer relationships to promote the self-regulatory capacity of practitioners to improve intervention delivery. The aim of the present study was to assess the acceptability and feasibility of PASS amongst parenting intervention practitioners. A Q-methodology approach was used to generate data and 30 practitioners volunteered to participate in the study. Data were analyzed and interpreted using standard Q-methodology procedures and by-person factor analysis yielded three factors. There was consensus that PASS was acceptable. Participants shared the view that PASS facilitated an environment of support where negative aspects of interpersonal relationships that might develop in supervision were not evident. Two factors represented the viewpoint that PASS was also a feasible model of supervision. However, the third factor was comprised of practitioners who reported that PASS could be time consuming and difficult to fit into existing work demands. There were differences across the three factors in the extent to which practitioners considered PASS impacted on their intervention delivery. The findings highlight the importance of organizational mechanisms that support practitioner engagement in supervision

Brane-World Gravity

The observable universe could be a 1+3-surface (the "brane") embedded in a 1+3+\textit{d}-dimensional spacetime (the "bulk"), with Standard Model particles and fields trapped on the brane while gravity is free to access the bulk. At least one of the \textit{d} extra spatial dimensions could be very large relative to the Planck scale, which lowers the fundamental gravity scale, possibly even down to the electroweak ($\sim$ TeV) level. This revolutionary picture arises in the framework of recent developments in M theory. The 1+10-dimensional M theory encompasses the known 1+9-dimensional superstring theories, and is widely considered to be a promising potential route to quantum gravity. At low energies, gravity is localized at the brane and general relativity is recovered, but at high energies gravity "leaks" into the bulk, behaving in a truly higher-dimensional way. This introduces significant changes to gravitational dynamics and perturbations, with interesting and potentially testable implications for high-energy astrophysics, black holes, and cosmology. Brane-world models offer a phenomenological way to test some of the novel predictions and corrections to general relativity that are implied by M theory. This review analyzes the geometry, dynamics and perturbations of simple brane-world models for cosmology and astrophysics, mainly focusing on warped 5-dimensional brane-worlds based on the Randall--Sundrum models. We also cover the simplest brane-world models in which 4-dimensional gravity on the brane is modified at \emph{low} energies -- the 5-dimensional Dvali--Gabadadze--Porrati models. Then we discuss co-dimension two branes in 6-dimensional models.Comment: A major update of Living Reviews in Relativity 7:7 (2004) "Brane-World Gravity", 119 pages, 28 figures, the update contains new material on RS perturbations, including full numerical solutions of gravitational waves and scalar perturbations, on DGP models, and also on 6D models. A published version in Living Reviews in Relativit

Assessing Specific Cognitive Deficits Associated with Dementia in Older Adults with Down Syndrome: Use and Validity of the Arizona Cognitive Test Battery (ACTB)

BACKGROUND: Down syndrome is associated with specific cognitive deficits. Alongside this, older adults with Down syndrome are a high risk group for dementia. The Arizona Cognitive Test Battery (ACTB), a cognitive assessment battery specifically developed for use with individuals with Down syndrome, has been proposed for use as outcome measures for clinical trials in this population. It has not been validated in older adults with Down syndrome. This study aims to assess the use and validity of the ACTB in older adults with Down syndrome. METHODS: Participants with Down syndrome aged 45 and over were assessed using the ACTB, standard tabletop tests and informant ratings. RESULTS: Assessment outcomes of 49 participants were analysed. Of these, 19 (39%) had a diagnosis of dementia or possible dementia. Most participants were able to attempt most of the tasks, although some tasks had high floor effects (including CANTAB Intra-Extra Dimensional shift stages completed and Modified Dots Task). Of the ACTB tasks, statistically significant differences were observed between the dementia and no dementia groups on CANTAB Simple Reaction Time median latency, NEPSY Visuomotor Precision-Car and Motorbike and CANTAB Paired Associates Learning stages completed. No significant differences were observed for CANTAB Intra-Extra Dimensional Shift, Modified Dots Task, Finger Sequencing, NEPSY Visuomotor precision-Train and Car and CANTAB Paired Associates Learning first trial memory score. Several of the tasks in the ACTB can be used in older adults with Down syndrome and have mild to moderate concurrent validity when compared to tabletop tests and informant ratings, although this varies on a test by test basis. CONCLUSIONS: Overall, scores for a number of tests in the ACTB were similar when comparing dementia and no dementia groups of older adults with Down syndrome, suggesting that it would not be an appropriate outcome measure of cognitive function for clinical trials of dementia treatments without further modification and validation

A genetic cause of Alzheimer disease: mechanistic insights from Down syndrome

Down syndrome, caused by an extra copy of chromosome 21, is associated with a greatly increased risk of early onset Alzheimer disease. It is thought that this risk is conferred by the presence of three copies of the gene encoding amyloid precursor protein (APP), an Alzheimer risk factor, although the possession of extra copies of other chromosome 21 genes may also play a role. Further study of the mechanisms underlying the development of Alzheimer disease in Down syndrome could provide insights into the mechanisms that cause dementia in the general population

Search for Standard Model Higgs Boson Production in Association with a W Boson using a Neural Network

We present a search for standard model Higgs boson production in association with a W boson in proton-antiproton collisions at a center of mass energy of 1.96 TeV. The search employs data collected with the CDF II detector that correspond to an integrated luminosity of approximately 1.9 inverse fb. We select events consistent with a signature of a single charged lepton, missing transverse energy, and two jets. Jets corresponding to bottom quarks are identified with a secondary vertex tagging method, a jet probability tagging method, and a neural network filter. We use kinematic information in an artificial neural network to improve discrimination between signal and background compared to previous analyses. The observed number of events and the neural network output distributions are consistent with the standard model background expectations, and we set 95% confidence level upper limits on the production cross section times branching fraction ranging from 1.2 to 1.1 pb or 7.5 to 102 times the standard model expectation for Higgs boson masses from 110 to $150 GeV/c^2, respectively.We present a search for standard model Higgs boson production in association with a W boson in proton-antiproton collisions (pp̅ →W±H→ℓνbb̅ ) at a center of mass energy of 1.96 TeV. The search employs data collected with the CDF II detector that correspond to an integrated luminosity of approximately 1.9  fb-1. We select events consistent with a signature of a single charged lepton (e±/μ±), missing transverse energy, and two jets. Jets corresponding to bottom quarks are identified with a secondary vertex tagging method, a jet probability tagging method, and a neural network filter. We use kinematic information in an artificial neural network to improve discrimination between signal and background compared to previous analyses. The observed number of events and the neural network output distributions are consistent with the standard model background expectations, and we set 95% confidence level upper limits on the production cross section times branching fraction ranging from 1.2 to 1.1 pb or 7.5 to 102 times the standard model expectation for Higgs boson masses from 110 to 150  GeV/c2, respectively.Peer reviewe

Multi-messenger observations of a binary neutron star merger

On 2017 August 17 a binary neutron star coalescence candidate (later designated GW170817) with merger time 12:41:04 UTC was observed through gravitational waves by the Advanced LIGO and Advanced Virgo detectors. The Fermi Gamma-ray Burst Monitor independently detected a gamma-ray burst (GRB 170817A) with a time delay of ~1.7 s with respect to the merger time. From the gravitational-wave signal, the source was initially localized to a sky region of 31 deg2 at a luminosity distance of 40+8-8 Mpc and with component masses consistent with neutron stars. The component masses were later measured to be in the range 0.86 to 2.26 Mo. An extensive observing campaign was launched across the electromagnetic spectrum leading to the discovery of a bright optical transient (SSS17a, now with the IAU identification of AT 2017gfo) in NGC 4993 (at ~40 Mpc) less than 11 hours after the merger by the One- Meter, Two Hemisphere (1M2H) team using the 1 m Swope Telescope. The optical transient was independently detected by multiple teams within an hour. Subsequent observations targeted the object and its environment. Early ultraviolet observations revealed a blue transient that faded within 48 hours. Optical and infrared observations showed a redward evolution over ~10 days. Following early non-detections, X-ray and radio emission were discovered at the transient’s position ~9 and ~16 days, respectively, after the merger. Both the X-ray and radio emission likely arise from a physical process that is distinct from the one that generates the UV/optical/near-infrared emission. No ultra-high-energy gamma-rays and no neutrino candidates consistent with the source were found in follow-up searches. These observations support the hypothesis that GW170817 was produced by the merger of two neutron stars in NGC4993 followed by a short gamma-ray burst (GRB 170817A) and a kilonova/macronova powered by the radioactive decay of r-process nuclei synthesized in the ejecta

Long-term complete responses after 131I-tositumomab therapy for relapsed or refractory indolent non-Hodgkin's lymphoma

We present the long-term results of 18 chemotherapy relapsed indolent (N=12) or transformed (N=6) NHL patients of a phase II anti-CD20 131I-tositumomab (Bexxar®) therapy study. The biphasic therapy included two injections of 450 mg unlabelled antibody combined with 131I-tositumomab once as dosimetric and once as therapeutic activity delivering 75 or 65 cGy whole-body radiation dose to patients with normal or reduced platelet counts, respectively. Two patients were not treated due to disease progression during dosimetry. The overall response rate was 81% in the 16 patients treated, including 50% CR/CRu and 31% PR. Median progression free survival of the 16 patients was 22.5 months. Median overall survival has not been reached after a median observation of 48 months. Median PFS of complete responders (CR/CRu) has not been reached and will be greater than 51 months. Short-term side effects were mainly haematological and transient. Among the relevant long-term side effects, one patient previously treated with CHOP chemotherapy died from secondary myelodysplasia. Four patients developed HAMA. In conclusion, 131I-tositumomab RIT demonstrated durable responses especially in those patients who achieved a complete response. Six of eight CR/CRu are ongoing after 46–70 months

Breast density and polymorphisms in genes coding for CYP1A2 and COMT: the Multiethnic Cohort

BACKGROUND: Mammographic density is a strong predictor of breast cancer risk and is increased by hormone replacement therapy (HRT). Some associations with genetic polymorphisms in enzymes involved in estrogen metabolism have been described. This cross-sectional analysis examined the relation between mammographic density and the CYP1A2*1F and COMT Val(58 )Met polymorphisms among 332 breast cancer cases and 254 controls in the Hawaii component of the Multiethnic Cohort. METHODS: Mammographic density, before diagnosis in cases, was quantified by using a validated computer-assisted method. Blood samples were genotyped by standard PCR/RFLP methods. Adjusted mean percent density was calculated by genotype using mixed models with the unstructured covariance option. RESULTS: A positive association between the C allele in the CYP1A2*1F gene and percent density, but not the dense area, was suggested (p = 0.11). The relation was limited to controls (p = 0.045), postmenopausal women not using HRT (p = 0.08), and normal weight subjects (p = 0.046). We did not observe any relation between the COMT Val(58 )Met polymorphism and breast density. CONCLUSION: The lack of an association between the CYP1A2 genotype and the size of the dense areas suggests an effect on the non-dense, i.e., fatty breast tissue. The discrepancies among studies may be due to differential susceptibility; changes in enzyme activity as a result of the CYP1A2*1F polymorphism may influence breast tissue differently depending on hormonal status. Larger studies with the ability to look at interactions would be useful to elucidate the influence of genetic variation in CYP1A2 and COMT on the risk of developing breast cancer

Tamoxifen induces oxidative stress and apoptosis in oestrogen receptor-negative human cancer cell lines

Recent data have demonstrated that the anti-oestrogen tamoxifen (TAM) is able to facilitate apoptosis in cancer cells not expressing oestrogen receptor (ER). In an attempt to identify the biochemical pathway for this phenomenon, we investigated the role of TAM as an oxidative stress agent. In two ER-negative human cancer cell lines, namely T-leukaemic Jurkat and ovarian A2780 cancer cells, we have demonstrated that TAM is able to generate oxidative stress, thereby causing thiol depletion and activation of the transcriptional factor NF-κB. As described for other oxidative agents, TAM was able to induce either cell proliferation or apoptosis depending on the dose. When used at the lowest dose tested (0.1 μM), a slight proliferative effect of TAM was noticed in terms of cell counts and DNA synthesis rate, whereas at higher doses (10 μM) a consistent occurrence of apoptosis was detected. Importantly, the induction of apoptosis by TAM is not linked to down-regulation or functional inactivation by phosphorylation of the antiapoptotic bcl-2 protein. © 1999 Cancer Research Campaig