Multidimensional Signals and Analytic Flexibility: Estimating Degrees of Freedom in Human-Speech Analyses

Recent empirical studies have highlighted the large degree of analytic flexibility in data analysis that can lead to substantially different conclusions based on the same data set. Thus, researchers have expressed their concerns that these researcher degrees of freedom might facilitate bias and can lead to claims that do not stand the test of time. Even greater flexibility is to be expected in fields in which the primary data lend themselves to a variety of possible operationalizations. The multidimensional, temporally extended nature of speech constitutes an ideal testing ground for assessing the variability in analytic approaches, which derives not only from aspects of statistical modeling but also from decisions regarding the quantification of the measured behavior. In this study, we gave the same speech-production data set to 46 teams of researchers and asked them to answer the same research question, resulting in substantial variability in reported effect sizes and their interpretation. Using Bayesian meta-analytic tools, we further found little to no evidence that the observed variability can be explained by analysts’ prior beliefs, expertise, or the perceived quality of their analyses. In light of this idiosyncratic variability, we recommend that researchers more transparently share details of their analysis, strengthen the link between theoretical construct and quantitative system, and calibrate their (un)certainty in their conclusions

SPARC 2018 Internationalisation and collaboration : Salford postgraduate annual research conference book of abstracts

Welcome to the Book of Abstracts for the 2018 SPARC conference. This year we not only celebrate the work of our PGRs but also the launch of our Doctoral School, which makes this year’s conference extra special. Once again we have received a tremendous contribution from our postgraduate research community; with over 100 presenters, the conference truly showcases a vibrant PGR community at Salford. These abstracts provide a taster of the research strengths of their works, and provide delegates with a reference point for networking and initiating critical debate. With such wide-ranging topics being showcased, we encourage you to take up this great opportunity to engage with researchers working in different subject areas from your own. To meet global challenges, high impact research inevitably requires interdisciplinary collaboration. This is recognised by all major research funders. Therefore engaging with the work of others and forging collaborations across subject areas is an essential skill for the next generation of researchers

Multidimensional Signals and Analytic Flexibility: Estimating Degrees of Freedom in Human-Speech Analyses

Recent empirical studies have highlighted the large degree of analytic flexibility in data analysis that can lead to substantially different conclusions based on the same data set. Thus, researchers have expressed their concerns that these researcher degrees of freedom might facilitate bias and can lead to claims that do not stand the test of time. Even greater flexibility is to be expected in fields in which the primary data lend themselves to a variety of possible operationalizations. The multidimensional, temporally extended nature of speech constitutes an ideal testing ground for assessing the variability in analytic approaches, which derives not only from aspects of statistical modeling but also from decisions regarding the quantification of the measured behavior. In this study, we gave the same speech-production data set to 46 teams of researchers and asked them to answer the same research question, resulting in substantial variability in reported effect sizes and their interpretation. Using Bayesian meta-analytic tools, we further found little to no evidence that the observed variability can be explained by analysts’ prior beliefs, expertise, or the perceived quality of their analyses. In light of this idiosyncratic variability, we recommend that researchers more transparently share details of their analysis, strengthen the link between theoretical construct and quantitative system, and calibrate their (un)certainty in their conclusions. © The Author(s) 2023.Open access articleThis item from the UA Faculty Publications collection is made available by the University of Arizona with support from the University of Arizona Libraries. If you have questions, please contact us at [email protected]

Preoperative nasopharyngeal swab testing and postoperative pulmonary complications in patients undergoing elective surgery during the SARS-CoV-2 pandemic.

BACKGROUND: Surgical services are preparing to scale up in areas affected by COVID-19. This study aimed to evaluate the association between preoperative SARS-CoV-2 testing and postoperative pulmonary complications in patients undergoing elective cancer surgery. METHODS: This international cohort study included adult patients undergoing elective surgery for cancer in areas affected by SARS-CoV-2 up to 19 April 2020. Patients suspected of SARS-CoV-2 infection before operation were excluded. The primary outcome measure was postoperative pulmonary complications at 30 days after surgery. Preoperative testing strategies were adjusted for confounding using mixed-effects models. RESULTS: Of 8784 patients (432 hospitals, 53 countries), 2303 patients (26.2 per cent) underwent preoperative testing: 1458 (16.6 per cent) had a swab test, 521 (5.9 per cent) CT only, and 324 (3.7 per cent) swab and CT. Pulmonary complications occurred in 3.9 per cent, whereas SARS-CoV-2 infection was confirmed in 2.6 per cent. After risk adjustment, having at least one negative preoperative nasopharyngeal swab test (adjusted odds ratio 0.68, 95 per cent confidence interval 0.68 to 0.98; P = 0.040) was associated with a lower rate of pulmonary complications. Swab testing was beneficial before major surgery and in areas with a high 14-day SARS-CoV-2 case notification rate, but not before minor surgery or in low-risk areas. To prevent one pulmonary complication, the number needed to swab test before major or minor surgery was 18 and 48 respectively in high-risk areas, and 73 and 387 in low-risk areas. CONCLUSION: Preoperative nasopharyngeal swab testing was beneficial before major surgery and in high SARS-CoV-2 risk areas. There was no proven benefit of swab testing before minor surgery in low-risk areas