7 research outputs found
âstatcheckâ:Automatically detect statistical reporting inconsistencies to increase reproducibility of meta-analyses.
We present the R package and web app statcheck to automatically detect statistical reporting inconsistencies in primary studies and metaâanalyses. Previous research has shown a high prevalence of reported pâvalues that are inconsistent â meaning a reâcalculated pâvalue, based on the reported test statistic and degrees of freedom, does not match the authorâreported pâvalue. Such inconsistencies affect the reproducibility and evidential value of published findings. The tool statcheck can help researchers to identify statistical inconsistencies so that they may correct them. In this paper, we provide an overview of the prevalence and consequences of statistical reporting inconsistencies. We also discuss the tool statcheck in more detail and give an example of how it can be used in a metaâanalysis. We end with some recommendations concerning the use of statcheck in metaâanalyses and make a case for better reporting standards of statistical results