The Australian Research Quality Framework: A live experiment in capturing the social, economic, environmental, and cultural returns of publicly funded research

Copyright @ 2008 Wiley Periodicals Inc. This is the accepted version of the following article: Donovan, C. (2008), The Australian Research Quality Framework: A live experiment in capturing the social, economic, environmental, and cultural returns of publicly funded research. New Directions for Evaluation, 2008: 47–60, which has been published in final form at http://onlinelibrary.wiley.com/doi/10.1002/ev.260/abstract.The author regards development of Australia's ill-fated Research Quality Framework (RQF) as a “live experiment” in determining the most appropriate approach to evaluating the extra-academic returns, or “impact,” of a nation's publicly funded research. The RQF was at the forefront of an international movement toward richer qualitative, contextual approaches that aimed to gauge the wider economic, social, environmental, and cultural benefits of research. Its construction and implementation sent mixed messages and created confusion about what impact is, and how it is best measured, to the extent that this bold live experiment did not come to fruition

A systematic review and economic evaluation of newgeneration computed tomography scanners for imaging in coronary artery disease and congenital heart disease: Somatom definition flash, Aquilion ONE, Brilliance ICT and Discovery CT750 HD

Background: Computed tomography (CT) is important in diagnosing and managing many conditions, including coronary artery disease (CAD) and congenital heart disease. Current CT scanners can very accurately diagnose CAD requiring revascularisation in most patients. However, imaging technologies have developed rapidly and new-generation computed tomography (NGCCT) scanners may benefit patients who are difficult to image (e.g. obese patients, patients with high or irregular heart beats and patients who have high levels of coronary calcium or a previous stent or bypass graft). Objective: To assess the clinical effectiveness and cost-effectiveness of NGCCT for diagnosing clinically significant CAD in patients who are difficult to image using 64-slice computed tomography and treatment planning in complex congenital heart disease. Data sources: Bibliographic databases were searched from 2000 to February/March 2011, including MEDLINE, MEDLINE In-Process and Other Non-Indexed Citations, EMBASE, Cochrane Database of Systematic Reviews (CDSR), Cochrane Central Register of Controlled Trials (CENTRAL), Database of Abstracts of Reviews of Effects (DARE), NHS Economic Evaluation Database (NHS EED), Health Technology Assessment (HTA) database and Science Citation Index (SCI). Trial registers and conference proceedings were searched. Review methods: Systematic review methods followed published guidance. Risk of bias was assessed using QUADAS-2. Results were stratified by patient group. Summary sensitivity and specificity were calculated using a bivariate summary receiver operating characteristic, or random effects model. Heterogeneity was assessed using the chisquared statistic and I2-statistic. Cost-effectiveness of NGCCT was modelled separately for suspected and known CAD, evaluating invasive coronary angiography (ICA) only, ICA after positive NGCCT (NGCCT-ICA), and NGCCT only. The cost-effectiveness of NGCCT, compared with 64-slice CT, in reducing imaging-associated radiation in congenital heart disease was assessed. Results: Twenty-four studies reported accuracy of NGCCT for diagnosing CAD in difficult-to-image patients. No clinical effectiveness studies of NGCCT in congenital heart disease were identified. The pooled per-patient estimates of sensitivity were 97.7% [95% confidence interval (CI) 88.0% to 99.9%], 97.7% (95% CI 93.2% to 99.3%) and 96.0% (95% CI 88.8% to 99.2%) for patients with arrhythmias, high heart rates and previous stent, respectively. The corresponding estimates of specificity were 81.7% (95% CI 71.6% to 89.4%), 86.3% (95% CI 80.2% to 90.7%) and 81.6% (95% CI 74.7% to 87.3%), respectively. In patients with high coronary calcium scores, previous bypass grafts or obesity, only per-segment or per-artery data were available. Sensitivity estimates remained high (> 90% in all but one study). In patients with suspected CAD, the NGCCTonly strategy appeared most cost-effective; the incremental cost-effectiveness ratio (ICER) of NGCCT-ICA compared with NGCCT only was £71,000. In patients with known CAD, the most cost-effective strategy was NGCCT-ICA (highest cost saving, dominates ICA only). The ICER of NGCCT only compared with NGCCT-ICA was £726,230. For radiation exposure only, the ICER for NGCCT compared with 64-slice C