Using systematic review methods within a Ph.D. dissertation in political science : challenges and lessons learned from practice

Systematic review and synthesis methods have gained wide acceptance within the social sciences and, as a result, many postgraduate students now consider using them for their thesis or dissertation research. However, students are rarely aware of all the concrete implications that their decision entails. This reflective narrative reports the experience of a political science student who began to conduct a systematic review as part of his PhD dissertation but who did not complete it. The aim of this article is to identify challenges and lessons learned from this experience and to formulate recommendations for postgraduate students who wish to make an informed choice with respect to the use of these methods

Barriers, facilitators and views about next steps to implementing supports for evidence-informed decision-making in health systems: a qualitative study

Background: Mobilizing research evidence for daily decision-making is challenging for health system decision-makers. In a previous qualitative paper, we showed the current mix of supports that Canadian health-care organizations have in place and the ones that are perceived to be helpful to facilitate the use of research evidence in health system decision-making. Factors influencing the implementation of such supports remain poorly described in the literature. Identifying the barriers to and facilitators of different interventions is essential for implementation of effective, context-specific, supports for evidence-informed decision-making (EIDM) in health systems. The purpose of this study was to identify (a) barriers and facilitators to implementing supports for EIDM in Canadian health-care organizations, (b) views about emerging development of supports for EIDM, and (c) views about the priorities to bridge the gaps in the current mix of supports that these organizations have in place. Methods: This qualitative study was conducted in three types of health-care organizations (regional health authorities, hospitals, and primary care practices) in two Canadian provinces (Ontario and Quebec). Fifty-seven in-depth semi-structured telephone interviews were conducted with senior managers, library managers, and knowledge brokers from health-care organizations that have already undertaken strategic initiatives in knowledge translation. The interviews were taped, transcribed, and then analyzed thematically using NVivo 9 qualitative data analysis software. Results: Limited resources (i.e., money or staff), time constraints, and negative attitudes (or resistance) toward change were the most frequently identified barriers to implementing supports for EIDM. Genuine interest from health system decision-makers, notably their willingness to invest money and resources and to create a knowledge translation culture over time in health-care organizations, was the most frequently identified facilitator to implementing supports for EIDM. The most frequently cited views about emerging development of supports for EIDM were implementing accessible and efficient systems to support the use of research in decision-making (e.g., documentation and reporting tools, communication tools, and decision support tools) and developing and implementing an infrastructure or position where the accountability for encouraging knowledge use lies. The most frequently stated priorities for bridging the gaps in the current mix of supports that these organizations have in place were implementing technical infrastructures to support research use and to ensure access to research evidence and establishing formal or informal ties to researchers and knowledge brokers outside the organization who can assist in EIDM. Conclusions: These results provide insights on the type of practical implementation imperatives involved in supporting EIDM

What supports do health system organizations have in place to facilitate evidence-informed decision-making? a qualitative study

Background: Decisions regarding health systems are sometimes made without the input of timely and reliable evidence, leading to less than optimal health outcomes. Healthcare organizations can implement tools and infrastructures to support the use of research evidence to inform decision-making. Objectives: The purpose of this study was to profile the supports and instruments (i.e., programs, interventions, instruments or tools) that healthcare organizations currently have in place and which ones were perceived to facilitate evidence-informed decision-making. Methods: In-depth semi-structured telephone interviews were conducted with individuals in three different types of positions (i.e., a senior management team member, a library manager, and a ‘knowledge broker’) in three types of healthcare organizations (i.e., regional health authorities, hospitals and primary care practices) in two Canadian provinces (i.e., Ontario and Quebec). The interviews were taped, transcribed, and then analyzed thematically using NVivo 9 qualitative data analysis software. Results: A total of 57 interviews were conducted in 25 organizations in Ontario and Quebec. The main findings suggest that, for the healthcare organizations that participated in this study, the following supports facilitate evidence-informed decision-making: facilitating roles that actively promote research use within the organization; establishing ties to researchers and opinion leaders outside the organization; a technical infrastructure that provides access to research evidence, such as databases; and provision and participation in training programs to enhance staff’s capacity building. Conclusions: This study identified the need for having a receptive climate, which laid the foundation for the implementation of other tangible initiatives and supported the use of research in decision-making. This study adds to the literature on organizational efforts that can increase the use of research evidence in decision-making. Some of the identified supports may increase the use of research evidence by decision-makers, which may then lead to more informed decisions, and hopefully to a strengthened health system and improved health

A cross-sectional survey of supports for evidence-informed decision-making in healthcare organisations: a research protocol

Background: This protocol builds on the development of a) a framework that identified the various supports (i.e. positions, activities, interventions) that a healthcare organisation or health system can implement for evidence-informed decision-making (EIDM) and b) a qualitative study that showed the current mix of supports that some Canadian healthcare organisations have in place and the ones that are perceived to facilitate the use of research evidence in decision-making. Based on these findings, we developed a web survey to collect cross-sectional data about the specific supports that regional health authorities and hospitals in two Canadian provinces (Ontario and Quebec) have in place to facilitate EIDM. Methods/design This paper describes the methods for a cross-sectional web survey among 32 regional health authorities and 253 hospitals in the provinces of Quebec and Ontario (Canada) to collect data on the current mix of organisational supports that these organisations have in place to facilitate evidence-informed decision-making. The data will be obtained through a two-step survey design: a 10-min survey among CEOs to identify key units and individuals in regard to our objectives (step 1) and a 20-min survey among managers of the key units identified in step 1 to collect information about the activities performed by their unit regarding the acquisition, assessment, adaptation and/or dissemination of research evidence in decision-making (step 2). The study will target three types of informants: CEOs, library/documentation centre managers and all other key managers whose unit is involved in the acquisition, assessment, adaptation/packaging and/or dissemination of research evidence in decision-making. We developed an innovative data collection system to increase the likelihood that only the best-informed respondent available answers each survey question. The reporting of the results will be done using descriptive statistics of supports by organisation type and by province. Discussion This study will be the first to collect and report large-scale cross-sectional data on the current mix of supports health system organisations in the two most populous Canadian provinces have in place for evidence-informed decision-making. The study will also provide useful information to researchers on how to collect organisation-level data with reduced risk of self-reporting bias

Measuring organizational readiness for knowledge translation in chronic care

<p>Abstract</p> <p>Background</p> <p>Knowledge translation (KT) is an imperative in order to implement research-based and contextualized practices that can answer the numerous challenges of complex health problems. The Chronic Care Model (CCM) provides a conceptual framework to guide the implementation process in chronic care. Yet, organizations aiming to improve chronic care require an adequate level of organizational readiness (OR) for KT. Available instruments on organizational readiness for change (ORC) have shown limited validity, and are not tailored or adapted to specific phases of the knowledge-to-action (KTA) process. We aim to develop an evidence-based, comprehensive, and valid instrument to measure OR for KT in healthcare. The OR for KT instrument will be based on core concepts retrieved from existing literature and validated by a Delphi study. We will specifically test the instrument in chronic care that is of an increasing importance for the health system.</p> <p>Methods</p> <p>Phase one: We will conduct a systematic review of the theories and instruments assessing ORC in healthcare. The retained theoretical information will be synthesized in a conceptual map. A bibliography and database of ORC instruments will be prepared after appraisal of their psychometric properties according to the standards for educational and psychological testing. An online Delphi study will be carried out among decision makers and knowledge users across Canada to assess the importance of these concepts and measures at different steps in the KTA process in chronic care.</p> <p>Phase two: A final OR for KT instrument will be developed and validated both in French and in English and tested in chronic disease management to measure OR for KT regarding the adoption of comprehensive, patient-centered, and system-based CCMs.</p> <p>Discussion</p> <p>This study provides a comprehensive synthesis of current knowledge on explanatory models and instruments assessing OR for KT. Moreover, this project aims to create more consensus on the theoretical underpinnings and the instrumentation of OR for KT in chronic care. The final product--a comprehensive and valid OR for KT instrument--will provide the chronic care settings with an instrument to assess their readiness to implement evidence-based chronic care.</p

Inter-individual relationships within a Canadian SPOR research network: a social network study

Efforts have been made by health research granting agencies to bring research closer to patients’ concerns. In Canada, such efforts were formalized in 2011 with the funding of the Strategy for Patient-Oriented Research (SPOR)’s research networks to address research priorities identified by patients and accelerate the translation of research findings into patient care and health care policy. Among these networks, SPOR Diabetes Action Canada (DAC) has created patient-partner circles to facilitate their integration within the network. The nature of the relationships within this atypical patient-oriented research network is systematically explored in this paper

Use of relevailles : relevailles and intersectoral collaborations : brief report.

In the interest of population-based responsibility, health and social services establishments (HSSEs) are expected to establish more working partnerships with organismes communautaires Famille (OCF – community-based family organizations). Some OCFs offer a service called ‘relevailles,’ which consists of providing a home-visiting postnatal support program that adapts to the needs of each family, in order to listen, encourage, inform, and support day-to-day organization. The use and impacts of this service, as well as the collaborations surrounding its implementation in local networks of services provided by health and social services establishments, remain largely unknown

The impact of information presentation and cognitive dissonance on processing systematic review summaries: a randomized controlled trial on bicycle helmet legislation

Background: Summaries of systematic reviews are a reference method for the dissemination of research evidence on the effectiveness of public health interventions beyond the scientific community. Motivated reasoning and cognitive dissonance may interfere with readers’ ability to process the information included in such summaries. Methods: We conducted a web experiment on a panel of university-educated North Americans (N = 259) using a systematic review of the effectiveness of bicycle helmet legislation as a test case. The outcome variables were the perceived tentativeness of review findings and attitude toward bicycle helmet legislation. We manipulated two types of uncertainty: (i) deficient uncertainty (inclusion vs. non-inclusion of information on limitations of the studies included in the review) and (ii) consensus uncertainty (consensual findings showing legislation effectiveness vs. no evidence of effectiveness). We also examined whether reported expertise in helmet legislation and the frequency of wearing a helmet while cycling interact with the experimental factors. Results: None of the experimental manipulations had a main effect on the perceived tentativeness. The presentation of consensual efficacy findings had a positive main effect on the attitude toward the legislation. Self-reported expertise had a significant main effect on the perceived tentativeness, and exposing participants with reported expertise to results showing a lack of evidence of efficacy increased their favorable attitude toward the legislation. Participants’ helmet use was positively associated with their attitude toward the legislation (but not with perceived tentativeness). Helmet use did not interact with the experimental manipulations. Conclusions: Motivated reasoning and cognitive dissonance influence a reader’s ability to process information contained in a systematic review summary

Evaluation of intersectoral collaborations : "Relevailles" and intersectoral collaborations. Brief Report.

HIGHLIGHTS • In 3 of the 4 cases, the key actor in the collaborative network was the OCF coordinator/liaison officer. • All the networks were vulnerable to the departure of a key actor. • Collaborative networks did not include any perinatal assistants. • 35 of the 37 HSSE actors involved in collaborative networks belonged to a local community services centre (CLSC), even when there was a birthing hospital or birthing centre in the HSSE. • Five determinants contributed to or constrained intersectoral collaborations between OCFs and HSSEs. • Sufficiency of resources, knowledge of the partner organization, and complementarity/flexibility in the delivery of services were determinants of collaborations. • Six modes of OCF/HSSE collaboration were identified. • There are few formal mechanisms for collaboration between organizations. • Disagreements/misunderstandings on the mechanisms for sharing information about families occurred between organizations and even within organizations. • Some parents perceived links between OCFs and CLSCs as falling into two modes of collaboration, namely 1) activating the request/recourse to partner organization services and 2) coordinating the services provided to families

Development and Content Validation of a Transcultural Instrument to Assess Organizational Readiness for Knowledge Translation in Healthcare Organizations: The OR4KT

Background Implementing effective interventions in healthcare requires organizations to be ready to support change. This study aimed to develop, adapt transculturally, and assess the content and face validity of the Organizational Readiness for Knowledge Translation (OR4KT) tool. The OR4KT was designed to measure the readiness of healthcare organizations to implement evidence-informed change across a variety of services. Methods Based on systematic reviews of the literature, a Delphi exercise, and expert consultation, we first generated an initial pool of items. Second, we developed and assessed content validity of the pilot OR4KT questionnaire in English. Third, we created French and Spanish versions using a sequential forward and backward translation approach, and transcultural adaptation by a consensus process. Finally, we conducted pilot studies in three contexts – the Basque country region (Spain), and the provinces of Québec and Ontario (Canada) – where 30 experts assessed the face validity of the three versions of OR4KT. Results We selected 59 items, grouped in 6 dimensions (organizational climate, context, change content, leadership, organizational support, and motivation) for the final English version of OR4KT. Translation and transcultural adaptation did not identify any content or language problems. Our findings indicate that the English, French and Spanish versions of OR4KT are linguistically equivalents and have high face validity. Only minor revisions to the wording of some items were recommended. Conclusion The OR4KT holds promise as a measure of readiness for knowledge translation (KT) in healthcare organizations. The validity and reliability of the three versions of the OR4KT will be assessed in real-life contexts of implementation of evidence-based changes in healthcare