Multidimensional Signals and Analytic Flexibility: Estimating Degrees of Freedom in Human-Speech Analyses

Recent empirical studies have highlighted the large degree of analytic flexibility in data analysis that can lead to substantially different conclusions based on the same data set. Thus, researchers have expressed their concerns that these researcher degrees of freedom might facilitate bias and can lead to claims that do not stand the test of time. Even greater flexibility is to be expected in fields in which the primary data lend themselves to a variety of possible operationalizations. The multidimensional, temporally extended nature of speech constitutes an ideal testing ground for assessing the variability in analytic approaches, which derives not only from aspects of statistical modeling but also from decisions regarding the quantification of the measured behavior. In this study, we gave the same speech-production data set to 46 teams of researchers and asked them to answer the same research question, resulting in substantial variability in reported effect sizes and their interpretation. Using Bayesian meta-analytic tools, we further found little to no evidence that the observed variability can be explained by analysts’ prior beliefs, expertise, or the perceived quality of their analyses. In light of this idiosyncratic variability, we recommend that researchers more transparently share details of their analysis, strengthen the link between theoretical construct and quantitative system, and calibrate their (un)certainty in their conclusions

Predicting response to physiotherapy treatment for musculoskeletal shoulder pain : Protocol for a longitudinal cohort study

© 2013 Chester et al.; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly citedShoulder pain affects all ages, with a lifetime prevalence of one in three. The most effective treatment is not known. Physiotherapy is often recommended as the first choice of treatment. At present, it is not possible to identify, from the initial physiotherapy assessment, which factors predict the outcome of physiotherapy for patients with shoulder pain. The primary objective of this study is to identify which patient characteristics and baseline measures, typically assessed at the first physiotherapy appointment, are related to the functional outcome of shoulder pain 6 weeks and 6 months after starting physiotherapy treatment.Peer reviewedFinal Published versio

Characterizing Storm Response and Recovery using the Beach Change Envelope: Fire Island, New York

Hurricane Sandy at Fire Island, New York presented unique challenges in the quantification of storm impacts using traditional metrics of coastal change, wherein measured changes (shoreline, dune crest, and volume change) did not fully reflect the substantial changes in sediment redistribution following the storm. We used a time series of beach profile data at Fire Island, New York to define a new contour-based morphologic change metric, the Beach Change Envelope (BCE). The BCE quantifies changes to the upper portion of the beach likely to sustain measurable impacts from storm waves and capture a variety of storm and post-storm beach states. We evaluated the ability of the BCE to characterize cycles of beach change by relating it to a conceptual beach recovery regime, and demonstrated that BCE width and BCE height from the profile time series correlate well with established stages of recovery. We also investigated additional applications of this metric to capture impacts from storms and human modification by applying it to several post-storm historical datasets in which impacts varied considerably; Nor\u27Ida (2009), Hurricane Irene (2011), Hurricane Sandy (2012), and a 2009 community replenishment. In each case, the BCE captured distinctive upper beach morphologic change characteristic of these different beach building and erosional events. Analysis of the beach state at multiple profile locations showed spatial trends in recovery consistent with recent morphologic island evolution, which other studies have linked with sediment availability and the geologic framework. Ultimately we demonstrate a new way of more effectively characterizing beach response and recovery cycles to evaluate change along sandy coasts