Twelve years of clinical practice guideline development, dissemination and evaluation in Canada (1994 to 2005)

Background - Despite the growing availability of clinical practice guidelines since the early 1990's, little is known about how guideline development and dissemination may have changed over time in Canada. This study compares Canadian guideline development, dissemination, and evaluation in two six year periods from 1994–1999 and 2000–2005. // Methods - Survey of guideline developers who submitted their clinical practice guidelines to the Canadian Medical Association Infobase (a Canadian guideline repository) between 1994 and 2005. Survey items included information about the developers, aspects of guideline development, and dissemination and evaluation activities. // Results - Surveys were sent to the developers of 2341 guidelines in the CMA Infobase over the 12 year period, 1664 surveys were returned (response rate 71%). Of these, 730 unique guidelines were released from 1994–1999, and 630 were released from 2000–2005. Compared to the earlier period, more recent guidelines were being produced in English only. There has been little change in the type of organizations developing guidelines with most developed by provincial and national organizations. In the recent period, developers were more likely to report using computerized search strategies (94% versus 88%), publishing the search strategy (42% versus 34%), reaching consensus using open discussion (95% versus 78%), and evaluating effectiveness of the dissemination strategies (12% versus 6%) and the impact of the CPGs on health outcomes (24% versus 5%). Recent guidelines were less likely to be based on literature reviews (94% versus 99.6%) and were disseminated using fewer strategies (mean 4.78 versus 4.12). // Conclusion - Given that guideline development processes have improved in some areas over the past 12 years yet not in others, ongoing monitoring of guideline quality is required. Guidelines produced more recently in Canada are less likely to be based on a review of the evidence and only about half discuss levels of evidence underlying recommendations. Guideline dissemination and implementation activities have actually decreased. Unfortunately, the potential positive impact on patient health outcomes will not be realized until the recommendations are adopted and acted upon

Riding the knowledge translation roundabout: lessons learned from the Canadian Institutes of Health Research Summer Institute in knowledge translation

<p>Abstract</p> <p>Background</p> <p>Funding the education and training of the next generation of health researchers is a key mandate of the Canadian Institutes of Health Research (CIHR) knowledge translation (KT) portfolio. The field of KT is growing daily; thus, the training and development of a new generation of KT researchers is essential.</p> <p>Methods</p> <p>Using curriculum documents, participant evaluations, and self-reflection, this paper describes a unique Summer Institute hosted by the CIHR in Cornwall, Ontario, Canada. We outline the key aspects of a successful training initiative that could inform organizations and agencies worldwide with an interest in or who have a mandate for KT.</p> <p>Results</p> <p>This work provides potential funders, faculty, and students with an inside look into the purpose, process, and outcomes of such training initiatives.</p> <p>Conclusion</p> <p>National and international KT organizations, research institutions, and funding agencies are encouraged to consider replicating the training model employed here, as investment into KT personnel will foster the advancement of the field within and beyond local borders.</p> <p>'To the individual who devotes his/her life to science, nothing can give more happiness than when the results immediately find practical application. There are not two sciences. There is science and the application of science, and these two are linked as the fruit is to the tree.' – Louis Pasteur, 1871 (from presentation by Ian Graham, 2008 CIHR Knowledge Translation Summer Institute)</p

Systematic assessment of the quality of osteoporosis guidelines

BACKGROUND: Numerous agencies have developed clinical practice guidelines for the management of postmenopausal osteoporosis. The study objective was to conduct a systematic assessment of the quality of osteoporosis guidelines produced since 1998. METHODS: Guidelines were identified by searching MEDLINE (1998+), the world wide web, known guideline developer websites, bibliographies of retrieved guidelines, and through consultation with content experts. Each guideline was then assessed by three independent appraisers using the 'Appraisal Instrument for Clinical Guidelines' (version 1) by Cluzeau. RESULTS: We identified 26 unique guidelines from 1998–2001 and 21 met our inclusion criteria. Of the 21 guidelines reviewed, 8 were developed by medical societies, 6 by national groups, 6 by government agencies, and 1 by an international group. Twelve of the guidelines were published, 7 were organizational reports, and 2 were accessible only from the web. Half or more of the 20 items assessing the rigor of guideline development were met by 15% (median quality score 23%, range 5–80%, (95% CI 16.5, 34.7)), 81% met at least half of the 12 items assessing guideline content and context (median score 58%, range 17–83%, (95% CI 50.8, 65.5)), and none met half or more of the items assessing guideline application (median score 0%, range 0–47%, (95% CI -0.5 to 12.6)). Eight guidelines described the method used to assess the strength of evidence, and in 6 there was an explicit link between recommendations and the supporting evidence. Ten guidelines were judged not suitable for use in practice, 10 were acceptable with modification, and one was acceptable for use without modification. CONCLUSION: The methodological quality of current osteoporosis guidelines is low, although their scores for clinical content were higher. Virtually no guidelines covered dissemination issues. Few guidelines were judged as acceptable for use in their current format

A new species of Dermopristis Kearn, Whittington & Evans-Gowing, 2010 (Monogenea: Microbothriidae), with observations on associations between the gut diverticula and reproductive system and on the presence of denticles in the nasal fossae of the host Glaucostegus typus (Bennett) (Elasmobranchii: Rhinobatidae)

Dermopristis cairae n. sp. (Microbothriidae) is described from the skin and possibly from the nasal fossae of the giant shovelnosed ray Glaucostegus typus (Bennett). The new species is distinguished from D. paradoxus Kearn, Whittington & Evans-Gowing, 2010 by its larger size, body shape, lack of transverse ridges on the ventral surface and absence of a seminal receptacle. Extensive short gut branches lie dorsal to the testes and adjacent to the coiled region of the vas deferens and the oo¨type, possibly reflecting high metabolic demand in these areas. Denticles are present in the lining of the nasal fossae of G. typus, providing a firm substrate for the cement-based attachment of a microbothriid. However, confirmation that D. cairae inhabits the nasal fossae of G. typus is required

Increasing value and reducing waste in biomedical research: who's listening?

The biomedical research complex has been estimated to consume almost a quarter of a trillion US dollars every year. Unfortunately, evidence suggests that a high proportion of this sum is avoidably wasted. In 2014, The Lancet published a series of five reviews showing how dividends from the investment in research might be increased from the relevance and priorities of the questions being asked, to how the research is designed, conducted, and reported. 17 recommendations were addressed to five main stakeholders-funders, regulators, journals, academic institutions, and researchers. This Review provides some initial observations on the possible effects of the Series, which seems to have provoked several important discussions and is on the agendas of several key players. Some examples of individual initiatives show ways to reduce waste and increase value in biomedical research. This momentum will probably move strongly across stakeholder groups, if collaborative relationships evolve between key players; further important work is needed to increase research value. A forthcoming meeting in Edinburgh, UK, will provide an initial forum within which to foster the collaboration neede

Improving the use of research evidence in guideline development: 14. Reporting guidelines

BACKGROUND: The World Health Organization (WHO), like many other organisations around the world, has recognised the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the 14(th )of a series of 16 reviews that have been prepared as background for advice from the WHO Advisory Committee on Health Research to WHO on how to achieve this. OBJECTIVES: We reviewed the literature on reporting guidelines and recommendations. METHODS: We searched PubMed and three databases of methodological studies for existing systematic reviews and relevant methodological research. We did not conduct systematic reviews ourselves. Our conclusions are based on the available evidence, consideration of what WHO and other organisations are doing and logical arguments. KEY QUESTIONS AND ANSWERS: There is little empirical evidence that addresses these questions. Our answers are based on logical arguments and standards put forward by other groups. What standard types of recommendations or reports should WHO use? • WHO should develop standard formats for reporting recommendations to facilitate recognition and use by decision makers for whom the recommendations are intended, and to ensure that all the information needed to judge the quality of a guideline, determine its applicability and, if needed, adapt it, is reported. • WHO should develop standard formats for full systematically developed guidelines that are sponsored by WHO, rapid assessments, and guidelines that are endorsed by WHO. • All three formats should include the same information as full guidelines, indicating explicitly what the group preparing the guideline did not do, as well as the methods that were used. • These formats should be used across clinical, public health and health systems recommendations. How should recommendations be formulated and reported? • Reports should be structured, using headings that correspond to those suggested by the Conference on Guideline Standardization or similar headings. • The quality of evidence and strength of recommendations should be reported explicitly using a standard approach. • The way in which recommendations are formulated should be adapted to the specific characteristics of a specific guideline. • Urgent attention should be given to developing a template that provides decision makers with the relevant global evidence that is needed to inform a decision and offers practical methods for incorporating the context specific evidence and judgements that are needed

Improving the use of research evidence in guideline development: 13. Applicability, transferability and adaptation

BACKGROUND: The World Health Organization (WHO), like many other organisations around the world, has recognised the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the thirteenth of a series of 16 reviews that have been prepared as background for advice from the WHO Advisory Committee on Health Research to WHO on how to achieve this. OBJECTIVES: We reviewed the literature on applicability, transferability, and adaptation of guidelines. METHODS: We searched five databases for existing systematic reviews and relevant primary methodological research. We reviewed the titles of all citations and retrieved abstracts and full text articles if the citations appeared relevant to the topic. We checked the reference lists of articles relevant to the questions and used snowballing as a technique to obtain additional information. We used the definition "coming from, concerning or belonging to at least two or all nations" for the term international. Our conclusions are based on the available evidence, consideration of what WHO and other organisations are doing and logical arguments. KEY QUESTIONS AND ANSWERS: We did not identify systematic reviews addressing the key questions. We found individual studies and projects published in the peer reviewed literature and on the Internet. Should WHO develop international recommendations? • Resources for developing high quality recommendations are limited. Internationally developed recommendations can facilitate access to and pooling of resources, reduce unnecessary duplication, and involve international scientists. • Priority should be given to international health problems and problems that are important in low and middle-income countries, where these advantages are likely to be greatest. • Factors that influence the transferability of recommendations across different settings should be considered systematically and flagged, including modifying factors, important variation in needs, values, costs and the availability of resources. What should be done centrally and locally? • The preparation of systematic reviews and evidence profiles should be coordinated centrally, in collaboration with organizations that produce systematic reviews. Centrally developed evidence profiles should be adaptable to specific local circumstances. • Consideration should be given to models that involve central coordination with work being undertaken by centres located throughout the world. • While needs, availability of resources, costs, the presence of modifying factors and values need to be assessed locally, support for undertaking these assessments may be needed to make guidelines applicable. • WHO should provide local support for adapting and implementing recommendations by developing tools, building capacity, learning from international experience, and through international networks that support evidence-informed health policies, such as the Evidence-informed Policy Network (EVIPNet). How should recommendations be adapted? • WHO should provide detailed guidance for adaptation of international recommendations. • Local adaptation processes should be systematic and transparent, they should involve stakeholders, and they should report the key factors that influence decisions, including those flagged in international guidelines, and the reasons for any modifications that are made

When piloting health services interventions, what predicts real world behaviours? A systematic concept mapping review

Modeling studies to inform the design of complex health services interventions often involves elements that differ from the intervention's ultimate real-world use. These "hypothetical" elements include pilot participants, materials, and settings. Understanding the conditions under which studies with "hypothetical" elements can yield valid results would greatly help advance health services research. Our objectives are: 1) to conduct a systematic review of the literature to identify factors affecting the relationship between hypothetical decisions and real-world behaviours, and 2) to summarise and organize these factors into a preliminary framework. Methods: We conducted an electronic database search using PsycINFO and Medline on November 30th, 2015, updated March 7th, 2019. We also conducted a supplemental snowball search on December 9th 2015 and a reverse citation search using Scopus and Web of Science. Studies were eligible to be included in this review if they clearly addressed the consistency between some type of hypothetical decision and a corresponding real decision or behaviour. Two reviewers extracted data using a standardized data collection form developed through an iterative consensus-based process. We extracted basic study information and data about each study's research area, design, and research question. Quotations from the articles were extracted and summarized into standardized factor statements. Results: Of the 2444 articles that were screened, 68 articles were included in the review. The articles identified 27 factors that we grouped into 4 categories: decision maker factors, cognitive factors, task factors, and matching factors. Conclusions: We have summarized a large number of factors that may be relevant when considering whether hypothetical health services pilot work can be expected to yield results that are consistent with real-world behaviours. Our descriptive framework can serve as the basis for organizing future work exploring which factors are most relevant when seeking to develop complex health services interventions

Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines

BACKGROUND: The AGREE instrument has been validated for evaluating Clinical Practice Guidelines (CPG) pertaining to medical care. This study evaluated the reliability and validity of physical therapists using the AGREE to assess quality of CPGs relevant to physical therapy practice. METHODS: A total of 69 physical therapists participated and were classified as generalists, specialist or researchers. Pairs of appraisers within each category evaluated independently, a set of 6 CPG selected at random from a pool of 55 CPGs. RESULTS: Reliability between pairs of appraisers indicated low to high reliability depending on the domain and number of appraisers (0.17–0.81 for single appraiser; 0.30–0.96 when score averaged across a pair of appraisers). The highest reliability was achieved for Rigour of Development, which exceeded ICC> 0.79, if scores from pairs of appraisers were pooled. Adding more than 3 appraisers did not consistently improve reliability. Appraiser type did not determine reliability scores. End-users, including study participants and a separate sample of 102 physical therapy students, found the AGREE useful to guide critical appraisal. The construct validity of the AGREE was supported in that expected differences on Rigour of Development domains were observed between expert panels versus those with no/uncertain expertise (differences of 10–21% p = 0.09–0.001). Factor analysis with varimax rotation, produced a 4-factor solution that was similar, although not in exact agreement with the AGREE Domains. Validity was also supported by the correlation observed (Kendall-tao = 0.69) between Overall Assessment and the Rigour of Development domain. CONCLUSION: These findings suggest that the AGREE instrument is reliable and valid when used by physiotherapists to assess the quality of CPG pertaining to physical therapy health services