A mixed methods inquiry into the validity of data

This is an Open Access article distributed under the terms of the Creative Commons Attribution Licens

Knowledge translation research in population health: establishing a collaborative research agenda

<p>Abstract</p> <p>Background</p> <p>Despite the increasing mobilization of researchers and funding organizations around knowledge translation (KT) in Canada and elsewhere, many questions have been only partially answered, particularly in the field of population health. This article presents the results of a systematic process to draw out possible avenues of collaboration for researchers, practitioners and decision-makers who work in the area of KT. The main objective was to establish a research agenda on knowledge translation in population health.</p> <p>Methods</p> <p>Using the Concept Mapping approach, the research team wanted to identify priority themes for the development of research on KT in population health. Mapping is based on multivariate statistical analyses (multidimensional scaling and hierarchical cluster analysis) in which statements produced during a brainstorming session are grouped in weighted clusters. The final maps are a visual representation of the priority themes of research on KT. Especially designed for facilitating consensus in the understanding and organization of various concepts, the Concept Mapping method proved suitable for achieving this objective.</p> <p>Results</p> <p>The maps were produced by 19 participants from university settings, and from institutions within the health and social services network. Three main perspectives emerge from this operation: (1) The evaluation of the effectiveness of KT efforts is one of the main research priorities; (2) The importance of taking into consideration user contexts in any KT effort; (3) The challenges related to sharing power for decision-making and action-taking among various stakeholder groups. These perspectives open up avenues of collaboration for stakeholders who are involved in research on KT. Besides these three main perspectives, the concept maps reveal three other trends which should be emphasized.</p> <p>Conclusion</p> <p>The Concept Mapping process reported in this article aimed to provoke collective reflection on the research questions that should be studied, in order to foster coherence in research activities in the field of population health. Based on this, it is appropriate to continue to support the development of research projects in KT and the formation of research teams in this field. Research on KT must lead to concrete outcomes within communities that are interested in the question.</p

Policymakers\u27 experience of a capacity-building intervention designed to increase their use of research: A realist process evaluation

Background: An intervention’s success depends on how participants interact with it in local settings. Process evaluation examines these interactions, indicating why an intervention was or was not effective, and how it (and similar interventions) can be improved for better contextual fit. This is particularly important for innovative trials like Supporting Policy In health with Research: an Intervention Trial (SPIRIT), where causal mechanisms are poorly understood. SPIRIT was testing a multi-component intervention designed to increase the capacity of health policymakers to use research. Methods: Our mixed-methods process evaluation sought to explain variation in observed process effects across the six agencies that participated in SPIRIT. Data collection included observations of intervention workshops (n = 59), purposively sampled interviews (n = 76) and participant feedback forms (n = 553). Using a realist approach, data was coded for context-mechanism-process effect configurations (retroductive analysis) by two authors. Results: Intervention workshops were very well received. There was greater variation of views regarding other aspects of SPIRIT such as data collection, communication and the intervention’s overall value. We identified nine inter-related mechanisms that were crucial for engaging participants in these policy settings: (1) Accepting the premise (agreeing with the study’s assumptions); (2) Self-determination (participative choice); (3) The Value Proposition (seeing potential gain); (4) ‘Getting good stuff’ (identifying useful ideas, resources or connections); (5) Self-efficacy (believing ‘we can do this!’); (6) Respect (feeling that SPIRIT understands and values one’s work); (7) Confidence (believing in the study’s integrity and validity); (8) Persuasive leadership (authentic and compelling advocacy from leaders); and (9) Strategic insider facilitation (local translation and mediation). These findings were used to develop tentative explanatory propositions and to revise the programme theory. Conclusion: This paper describes how SPIRIT functioned in six policy agencies, including why strategies that worked well in one site were less effective in others. Findings indicate a complex interaction between participants’ perception of the intervention, shifting contextual factors, and the form that the intervention took in each site. Our propositions provide transferable lessons about contextualised areas of strength and weakness that may be useful in the development and implementation of similar studies

The use of mixed methods in research

Mixed methods research is becoming increasingly popular and is widely acknowledged as a means of achieving a more complex understanding of research problems. Combining both the in-depth, contextual views of qualitative research with the broader generalizations of larger population quantitative approaches, mixed methods research can be used to produce a rigorous and credible source of data. Using this methodology, the same core issue is investigated through the collection, analysis, and interpretation of both types of data within one study or a series of studies. Multiple designs are possible and can be guided by philosophical assumptions. Both qualitative and quantitative data can be collected simultaneously or sequentially (in any order) through a multiphase project. Integration of the two data sources then occurs with consideration is given to the weighting of both sources; these can either be equal or one can be prioritized over the other. Designed as a guide for novice mixed methods researchers, this chapter gives an overview of the historical and philosophical roots of mixed methods research. We also provide a practical overview of its application in health research as well as pragmatic considerations for those wishing to undertake mixed methods research