Multidimensional Signals and Analytic Flexibility: Estimating Degrees of Freedom in Human-Speech Analyses

Recent empirical studies have highlighted the large degree of analytic flexibility in data analysis that can lead to substantially different conclusions based on the same data set. Thus, researchers have expressed their concerns that these researcher degrees of freedom might facilitate bias and can lead to claims that do not stand the test of time. Even greater flexibility is to be expected in fields in which the primary data lend themselves to a variety of possible operationalizations. The multidimensional, temporally extended nature of speech constitutes an ideal testing ground for assessing the variability in analytic approaches, which derives not only from aspects of statistical modeling but also from decisions regarding the quantification of the measured behavior. In this study, we gave the same speech-production data set to 46 teams of researchers and asked them to answer the same research question, resulting in substantial variability in reported effect sizes and their interpretation. Using Bayesian meta-analytic tools, we further found little to no evidence that the observed variability can be explained by analysts’ prior beliefs, expertise, or the perceived quality of their analyses. In light of this idiosyncratic variability, we recommend that researchers more transparently share details of their analysis, strengthen the link between theoretical construct and quantitative system, and calibrate their (un)certainty in their conclusions

Data from an International Multi-Centre Study of Statistics and Mathematics Anxieties and Related Variables in University Students (the SMARVUS Dataset)

This large, international dataset contains survey responses from N = 12,570 students from 100 universities in 35 countries, collected in 21 languages. We measured anxieties (statistics, mathematics, test, trait, social interaction, performance, creativity, intolerance of uncertainty, and fear of negative evaluation), self-efficacy, persistence, and the cognitive reflection test, and collected demographics, previous mathematics grades, self-reported and official statistics grades, and statistics module details. Data reuse potential is broad, including testing links between anxieties and statistics/mathematics education factors, and examining instruments’ psychometric properties across different languages and contexts

A community-sourced glossary of open scholarship terms

Supplementary Information: This list of terms represents the ‘Open Scholarship Glossary 1.0’ (available at: https://forrt.org/glossary/. Glossary available under a CC BY NC SA 4.0 license at: https://static-content.springer.com/esm/art%3A10.1038%2Fs41562-021-01269-4/MediaObjects/41562_2021_1269_MOESM1_ESM.pdf).https://static-content.springer.com/esm/art%3A10.1038%2Fs41562-021-01269-4/MediaObjects/41562_2021_1269_MOESM1_ESM.pd

Researching L2 motivation : past, present and future

This concluding chapter examines the ‘how’ of language learning motivation research–that is, the methodological approaches, research designs, and tools of inquiry used to investigate motivation for language learning. The purpose of the chapter is to survey the diverse range of approaches to researching L2 (second language) motivation, with reference to particular types of study and particular research traditions. The chapter does not provide a practical “how to” guide for specific methods of inquiry, but aims instead to offer a critical analysis of strengths, limitations and challenges associated with different approaches to investigating language learning motivation. As reflected in its title, the chapter takes a broadly historical perspective and reviews how research designs have evolved and diversified over the decades in line with theoretical developments, broader research trends, and advances in technology. It discusses recent methodological innovations in the field, identifies current research challenges and issues, and outlines considerations for researching language learning motivation in the future