On the co-production of research: why we should say what we mean, mean what we say, and learn as we go

Researchers are increasingly encouraged to “co-produce” or “co-create” their research, particularly if it is to have that much-prized impact. But what exactly does this really mean? Bev J. Holmes defines co-production as the collaboration between researchers and others with a stake in a project in its governance, priority-setting, conducting of research, and knowledge translation. Once what is meant by co-production is clearly outlined, it is equally important to address the many challenges of optimising participants’ contributions, and also to commit to learning throughout the process of co-producing research

Time to shift from systems thinking-talking to systems thinking-action Comment on “Constraints to applying systems thinking concepts in health systems: A regional perspective from surveying stakeholders in Eastern Mediterranean countries”

A recent International Journal of Health Policy and Management (IJHPM) article by Fadi El-Jardali and colleagues makes an important contribution to the literature on health system strengthening by reporting on a survey of healthcare stakeholders in Low- and Middle-Income Countries (LMICs) about Systems Thinking (ST). The study’s main contributions are its confirmation that healthcare stakeholders understand the importance of ST but do not know how to act on that understanding, and the call for collective action by the global community of systems thinkers committed to healthcare improvement. We offer three basic considerations for next steps by this community, derived from our recent work in ST and the related field of Knowledge Translation (KT): resist the temptation to adopt a reductionist approach; recognize not everyone needs to understand ST; and do not wait for everything to be in place before getting started

Re-imagining Research: A Bold Call, but Bold Enough?; Comment on “Experience of Health Leadership in Partnering with University-Based Researchers in Canada: A Call to ‘Re-Imagine’ Research”

Many articles over the last two decades have enumerated barriers to and facilitators for evidence use in health systems. Bowen et al’s article “Response to Experience of Health Leadership in Partnering with University-Based Researchers: A Call to ‘Re-imagine Research’” furthers the debate by focusing on an under-explored research area (health system design and health service organization) with an under-studied stakeholder group (health system leaders), by undertaking a broad program of research on partnerships, and, based on participant responses, by calling for re-imagining of research itself. In response to the claim that the research community is not providing expertise to this pressing issue in the health system, I provide four high level reasons: partnerships mean different things to different people, our language does not reflect the reality we want, our health systems have yet to fully embrace evidence use, and complexity is easier to talk about than act within. Bowen et al’s study, and their broader program of research, is well-placed to explore these issues further, helping identify appropriate researcher-health system leader partnership models for various health system change projects. Given the positive shifts identified in this study, and the knowledge that participants demonstrate about what needs to change, the time is right for bold action, re-imagining not only research, but healthcare, such that the production and use of evidence for better health is embraced and supported

What the Public Was Saying about the H1N1 Vaccine: Perceptions and Issues Discussed in On-Line Comments during the 2009 H1N1 Pandemic

During the 2009 H1N1 pandemic, a vaccine was made available to all Canadians. Despite efforts to promote vaccination, the public's intent to vaccinate remained low. In order to better understand the public's resistance to getting vaccinated, this study addressed factors that influenced the public's decision making about uptake. To do this, we used a relatively novel source of qualitative data – comments posted on-line in response to news articles on a particular topic. This study analysed 1,796 comments posted in response to 12 articles dealing with H1N1 vaccine on websites of three major Canadian news sources. Articles were selected based on topic and number of comments. A second objective was to assess the extent to which on-line comments can be used as a reliable data source to capture public attitudes during a health crisis. The following seven themes were mentioned in at least 5% of the comments (% indicates the percentage of comments that included the theme): fear of H1N1 (18.8%); responsibility of media (17.8%); government competency (17.7%); government trustworthiness (10.7%); fear of H1N1 vaccine (8.1%); pharmaceutical companies (7.6%); and personal protective measures (5.8%). It is assumed that the more frequently a theme was mentioned, the more that theme influenced decision making about vaccination. These key themes for the public were often not aligned with the issues and information officials perceived, and conveyed, as relevant in the decision making process. The main themes from the comments were consistent with results from surveys and focus groups addressing similar issues, which suggest that on-line comments do provide a reliable source of qualitative data on attitudes and perceptions of issues that emerge in a health crisis. The insights derived from the comments can contribute to improved communication and policy decisions about vaccination in health crises that incorporate the public's views

Effects of antiplatelet therapy on stroke risk by brain imaging features of intracerebral haemorrhage and cerebral small vessel diseases: subgroup analyses of the RESTART randomised, open-label trial

Background Findings from the RESTART trial suggest that starting antiplatelet therapy might reduce the risk of recurrent symptomatic intracerebral haemorrhage compared with avoiding antiplatelet therapy. Brain imaging features of intracerebral haemorrhage and cerebral small vessel diseases (such as cerebral microbleeds) are associated with greater risks of recurrent intracerebral haemorrhage. We did subgroup analyses of the RESTART trial to explore whether these brain imaging features modify the effects of antiplatelet therapy

Effects of antiplatelet therapy after stroke due to intracerebral haemorrhage (RESTART): a randomised, open-label trial

Background: Antiplatelet therapy reduces the risk of major vascular events for people with occlusive vascular disease, although it might increase the risk of intracranial haemorrhage. Patients surviving the commonest subtype of intracranial haemorrhage, intracerebral haemorrhage, are at risk of both haemorrhagic and occlusive vascular events, but whether antiplatelet therapy can be used safely is unclear. We aimed to estimate the relative and absolute effects of antiplatelet therapy on recurrent intracerebral haemorrhage and whether this risk might exceed any reduction of occlusive vascular events. Methods: The REstart or STop Antithrombotics Randomised Trial (RESTART) was a prospective, randomised, open-label, blinded endpoint, parallel-group trial at 122 hospitals in the UK. We recruited adults (≥18 years) who were taking antithrombotic (antiplatelet or anticoagulant) therapy for the prevention of occlusive vascular disease when they developed intracerebral haemorrhage, discontinued antithrombotic therapy, and survived for 24 h. Computerised randomisation incorporating minimisation allocated participants (1:1) to start or avoid antiplatelet therapy. We followed participants for the primary outcome (recurrent symptomatic intracerebral haemorrhage) for up to 5 years. We analysed data from all randomised participants using Cox proportional hazards regression, adjusted for minimisation covariates. This trial is registered with ISRCTN (number ISRCTN71907627). Findings: Between May 22, 2013, and May 31, 2018, 537 participants were recruited a median of 76 days (IQR 29–146) after intracerebral haemorrhage onset: 268 were assigned to start and 269 (one withdrew) to avoid antiplatelet therapy. Participants were followed for a median of 2·0 years (IQR [1·0– 3·0]; completeness 99·3%). 12 (4%) of 268 participants allocated to antiplatelet therapy had recurrence of intracerebral haemorrhage compared with 23 (9%) of 268 participants allocated to avoid antiplatelet therapy (adjusted hazard ratio 0·51 [95% CI 0·25–1·03]; p=0·060). 18 (7%) participants allocated to antiplatelet therapy experienced major haemorrhagic events compared with 25 (9%) participants allocated to avoid antiplatelet therapy (0·71 [0·39–1·30]; p=0·27), and 39 [15%] participants allocated to antiplatelet therapy had major occlusive vascular events compared with 38 [14%] allocated to avoid antiplatelet therapy (1·02 [0·65–1·60]; p=0·92). Interpretation: These results exclude all but a very modest increase in the risk of recurrent intracerebral haemorrhage with antiplatelet therapy for patients on antithrombotic therapy for the prevention of occlusive vascular disease when they developed intracerebral haemorrhage. The risk of recurrent intracerebral haemorrhage is probably too small to exceed the established benefits of antiplatelet therapy for secondary prevention

Effects of antiplatelet therapy after stroke due to intracerebral haemorrhage (RESTART): a randomised, open-label trial

Background: Antiplatelet therapy reduces the risk of major vascular events for people with occlusive vascular disease, although it might increase the risk of intracranial haemorrhage. Patients surviving the commonest subtype of intracranial haemorrhage, intracerebral haemorrhage, are at risk of both haemorrhagic and occlusive vascular events, but whether antiplatelet therapy can be used safely is unclear. We aimed to estimate the relative and absolute effects of antiplatelet therapy on recurrent intracerebral haemorrhage and whether this risk might exceed any reduction of occlusive vascular events. Methods: The REstart or STop Antithrombotics Randomised Trial (RESTART) was a prospective, randomised, open-label, blinded endpoint, parallel-group trial at 122 hospitals in the UK. We recruited adults (≥18 years) who were taking antithrombotic (antiplatelet or anticoagulant) therapy for the prevention of occlusive vascular disease when they developed intracerebral haemorrhage, discontinued antithrombotic therapy, and survived for 24 h. Computerised randomisation incorporating minimisation allocated participants (1:1) to start or avoid antiplatelet therapy. We followed participants for the primary outcome (recurrent symptomatic intracerebral haemorrhage) for up to 5 years. We analysed data from all randomised participants using Cox proportional hazards regression, adjusted for minimisation covariates. This trial is registered with ISRCTN (number ISRCTN71907627). Findings: Between May 22, 2013, and May 31, 2018, 537 participants were recruited a median of 76 days (IQR 29–146) after intracerebral haemorrhage onset: 268 were assigned to start and 269 (one withdrew) to avoid antiplatelet therapy. Participants were followed for a median of 2·0 years (IQR [1·0– 3·0]; completeness 99·3%). 12 (4%) of 268 participants allocated to antiplatelet therapy had recurrence of intracerebral haemorrhage compared with 23 (9%) of 268 participants allocated to avoid antiplatelet therapy (adjusted hazard ratio 0·51 [95% CI 0·25–1·03]; p=0·060). 18 (7%) participants allocated to antiplatelet therapy experienced major haemorrhagic events compared with 25 (9%) participants allocated to avoid antiplatelet therapy (0·71 [0·39–1·30]; p=0·27), and 39 [15%] participants allocated to antiplatelet therapy had major occlusive vascular events compared with 38 [14%] allocated to avoid antiplatelet therapy (1·02 [0·65–1·60]; p=0·92). Interpretation: These results exclude all but a very modest increase in the risk of recurrent intracerebral haemorrhage with antiplatelet therapy for patients on antithrombotic therapy for the prevention of occlusive vascular disease when they developed intracerebral haemorrhage. The risk of recurrent intracerebral haemorrhage is probably too small to exceed the established benefits of antiplatelet therapy for secondary prevention

Effects of antiplatelet therapy after stroke due to intracerebral haemorrhage (RESTART): a randomised, open-label trial

BACKGROUND: Antiplatelet therapy reduces the risk of major vascular events for people with occlusive vascular disease, although it might increase the risk of intracranial haemorrhage. Patients surviving the commonest subtype of intracranial haemorrhage, intracerebral haemorrhage, are at risk of both haemorrhagic and occlusive vascular events, but whether antiplatelet therapy can be used safely is unclear. We aimed to estimate the relative and absolute effects of antiplatelet therapy on recurrent intracerebral haemorrhage and whether this risk might exceed any reduction of occlusive vascular events. METHODS: The REstart or STop Antithrombotics Randomised Trial (RESTART) was a prospective, randomised, open-label, blinded endpoint, parallel-group trial at 122 hospitals in the UK. We recruited adults (≥18 years) who were taking antithrombotic (antiplatelet or anticoagulant) therapy for the prevention of occlusive vascular disease when they developed intracerebral haemorrhage, discontinued antithrombotic therapy, and survived for 24 h. Computerised randomisation incorporating minimisation allocated participants (1:1) to start or avoid antiplatelet therapy. We followed participants for the primary outcome (recurrent symptomatic intracerebral haemorrhage) for up to 5 years. We analysed data from all randomised participants using Cox proportional hazards regression, adjusted for minimisation covariates. This trial is registered with ISRCTN (number ISRCTN71907627). FINDINGS: Between May 22, 2013, and May 31, 2018, 537 participants were recruited a median of 76 days (IQR 29-146) after intracerebral haemorrhage onset: 268 were assigned to start and 269 (one withdrew) to avoid antiplatelet therapy. Participants were followed for a median of 2·0 years (IQR [1·0- 3·0]; completeness 99·3%). 12 (4%) of 268 participants allocated to antiplatelet therapy had recurrence of intracerebral haemorrhage compared with 23 (9%) of 268 participants allocated to avoid antiplatelet therapy (adjusted hazard ratio 0·51 [95% CI 0·25-1·03]; p=0·060). 18 (7%) participants allocated to antiplatelet therapy experienced major haemorrhagic events compared with 25 (9%) participants allocated to avoid antiplatelet therapy (0·71 [0·39-1·30]; p=0·27), and 39 [15%] participants allocated to antiplatelet therapy had major occlusive vascular events compared with 38 [14%] allocated to avoid antiplatelet therapy (1·02 [0·65-1·60]; p=0·92). INTERPRETATION: These results exclude all but a very modest increase in the risk of recurrent intracerebral haemorrhage with antiplatelet therapy for patients on antithrombotic therapy for the prevention of occlusive vascular disease when they developed intracerebral haemorrhage. The risk of recurrent intracerebral haemorrhage is probably too small to exceed the established benefits of antiplatelet therapy for secondary prevention. FUNDING: British Heart Foundation

Time to Shift from Systems Thinking-Talking to Systems Thinking-Action; Comment on “Constraints to Applying Systems Thinking Concepts in Health Systems: A Regional Perspective from Surveying Stakeholders in Eastern Mediterranean Countries”

A recent International Journal of Health Policy and Management (IJHPM) article by Fadi El-Jardali and colleagues makes an important contribution to the literature on health system strengthening by reporting on a survey of healthcare stakeholders in Low- and Middle-Income Countries (LMICs) about Systems Thinking (ST). The study’s main contributions are its confirmation that healthcare stakeholders understand the importance of ST but do not know how to act on that understanding, and the call for collective action by the global community of systems thinkers committed to healthcare improvement. We offer three basic considerations for next steps by this community, derived from our recent work in ST and the related field of Knowledge Translation (KT): resist the temptation to adopt a reductionist approach; recognize not everyone needs to understand ST; and do not wait for everything to be in place before getting started

Reviewer training to assess knowledge translation in funding applications is long overdue

Abstract Background Health research funding agencies are placing a growing focus on knowledge translation (KT) plans, also known as dissemination and implementation (D&I) plans, in grant applications to decrease the gap between what we know from research and what we do in practice, policy, and further research. Historically, review panels have focused on the scientific excellence of applications to determine which should be funded; however, relevance to societal health priorities, the facilitation of evidence-informed practice and policy, or realizing commercialization opportunities all require a different lens. Discussion While experts in their respective fields, grant reviewers may lack the competencies to rigorously assess the KT components of applications. Funders of health research—including health charities, non-profit agencies, governments, and foundations—have an obligation to ensure that these components of funding applications are as rigorously evaluated as the scientific components. In this paper, we discuss the need for a more rigorous evaluation of knowledge translation potential by review panels and propose how this may be addressed. Conclusion We propose that reviewer training supported in various ways including guidelines and KT expertise on review panels and modalities such as online and face-to-face training will result in the rigorous assessment of all components of funding applications, thus increasing the relevance and use of funded research evidence. An unintended but highly welcome consequence of such training could be higher quality D&I or KT plans in subsequent funding applications from trained reviewers