5 research outputs found
Assessing the performance of methodological search filters to improve the efficiency of evidence information retrieval: five literature reviews and a qualitative study
Evaluation of a mobile screening service for abdominal aortic aneurysm in Broken Hill, a remote regional centre in far western NSW
Optimising the expansion of the National Bowel Cancer Screening Program
Objectives: To estimate the impact of various expansion scenarios of the National Bowel Cancer Screening Program (NBCSP) on the number of bowel cancer deaths prevented; and to investigate the impact of the expansion scenarios on colonoscopy demand. Design: MISCAN-Colon, a well established, validated computer simulation model for bowel cancer screening, was adjusted to reflect the Australian situation. In July 2013, we simulated the effects of screening over a 50-year period, starting in 2006. The model parameters included rates of participation in screening and follow-up, rates of identification of cancerous and precancerous lesions, bowel cancer incidence, mortality and the outcomes of the NBCSP. Five implementation scenarios, based on biennial screening using an immunochemical faecal occult blood test, were developed and modelled. A sensitivity analysis that increased screening participation to 60% was also conducted. Participants: Australian residents aged 50 to 74 years. Main outcome measures: Comparison of the impact of five implementation scenarios on the number of bowel cancer deaths prevented and demand for colonoscopy. Results: MISCAN-Colon calculated that in its current state, the NBCSP should prevent 35 169 bowel cancer deaths in the coming 40 years. Accelerating the expansion of the program to achieve biennial screening by 2020 would prevent more than 70 000 deaths. If complete implementation of biennial screening results in a corresponding increase in participation to 60%, the number of deaths prevented will increase across all scenarios. Conclusions: The findings strongly support the need for rapid implementation of the NBCSP. Compared with the current situation, achieving biennial screening by 2020 could result in 100% more bowel cancer deaths (about 35 000) being prevented in the coming 40 years
Assessing the performance of methodological search filters to improve the efficiency of evidence information retrieval: five literature reviews and a qualitative study
Background: Effective study identification is essential for conducting health research, developing clinical guidance and health policy and supporting health-care decision-making. Methodological search filters (combinations of search terms to capture a specific study design) can assist in searching to achieve this. Objectives: This project investigated the methods used to assess the performance of methodological search filters, the information that searchers require when choosing search filters and how that information could be better provided. Methods: Five literature reviews were undertaken in 2010/11: search filter development and testing; comparison of search filters; decision-making in choosing search filters; diagnostic test accuracy (DTA) study methods; and decision-making in choosing diagnostic tests. We conducted interviews and a questionnaire with experienced searchers to learn what information assists in the choice of search filters and how filters are used. These investigations informed the development of various approaches to gathering and reporting search filter performance data. We acknowledge that there has been a regrettable delay between carrying out the project, including the searches, and the publication of this report, because of serious illness of the principal investigator. Results: The development of filters most frequently involved using a reference standard derived from hand-searching journals. Most filters were validated internally only. Reporting of methods was generally poor. Sensitivity, precision and specificity were the most commonly reported performance measures and were presented in tables. Aspects of DTA study methods are applicable to search filters, particularly in the development of the reference standard. There is limited evidence on how clinicians choose between diagnostic tests. No published literature was found on how searchers select filters. Interviewing and questioning searchers via a questionnaire found that filters were not appropriate for all tasks but were predominantly used to reduce large numbers of retrieved records and to introduce focus. The Inter Technology Appraisal Support Collaboration (InterTASC) Information Specialists’ Sub-Group (ISSG) Search Filters Resource was most frequently mentioned by both groups as the resource consulted to select a filter. Randomised controlled trial (RCT) and systematic review filters, in particular the Cochrane RCT and the McMaster Hedges filters, were most frequently mentioned. The majority indicated that they used different filters depending on the requirement for sensitivity or precision. Over half of the respondents used the filters available in databases. Interviewees used various approaches when using and adapting search filters. Respondents suggested that the main factors that would make choosing a filter easier were the availability of critical appraisals and more detailed performance information. Provenance and having the filter available in a central storage location were also important. Limitations: The questionnaire could have been shorter and could have included more multiple choice questions, and the reviews of filter performance focused on only four study designs. Conclusions: Search filter studies should use a representative reference standard and explicitly report methods and results. Performance measures should be presented systematically and clearly. Searchers find filters useful in certain circumstances but expressed a need for more user-friendly performance information to aid filter choice. We suggest approaches to use, adapt and report search filter performance. Future work could include research around search filters and performance measures for study designs not addressed here, exploration of alternative methods of displaying performance results and numerical synthesis of performance comparison results. Funding: The National Institute for Health Research (NIHR) Health Technology Assessment programme and Medical Research Council–NIHR Methodology Research Programme (grant number G0901496)