Systematic reviews and meta-analyses of test accuracy: developing methods that meet practitioners’ needs

Abstract

Testing can be a substantial driver of health care costs. Increase in test use over recent decades has occurred despite disappointing results from test accuracy evaluations. Poor quality and reporting of primary test accuracy studies and difficulties with understanding and application of test accuracy information are purported to be important contributors to this observed evidence ‘gap’. The objectives of this thesis were to: * Systematically review evidence concerning the understanding and application of test accuracy metrics. * Undertake primary research building on the review of understanding and application. * Assess whether the contribution of test accuracy reviews to the test accuracy evidence base is compromised by deficiencies in their contextual fit, or of included primary studies. Existing research concerned with understanding and application of test accuracy information is not driven by the needs of decision makers. Contrary to the prevailing view in the literature, findings of original research from this thesis demonstrate that probability revision is not a feature of diagnostic decision making. Choice of test accuracy metric however was shown to have a profound influence on diagnostic decision making. Deficiencies in question formulation and contextualisation of test accuracy reviews are undermining their contribution to the test accuracy evidence base