Knowledge user survey and Delphi process to inform development of a new risk of bias tool to assess systematic reviews with network meta-analysis (RoB NMA tool)

Background: Network meta-analysis (NMA) is increasingly used in guideline development and other aspects of evidence-based decision-making. We aimed to develop a risk of bias (RoB) tool to assess NMAs (RoB NMA tool). An international steering committee recommended that the RoB NMA tool to be used in combination with the Risk of Bias in Systematic reviews (ROBIS) tool (i.e. because it was designed to assess biases only) or other similar quality appraisal tools (eg, A MeaSurement Tool to Assess systematic Reviews 2 [AMSTAR 2]) to assess quality of systematic reviews. The RoB NMA tool will assess NMA biases and limitations regarding how the analysis was planned, data were analysed and results were presented, including the way in which the evidence was assembled and interpreted. Objectives: Conduct (a) a Delphi process to determine expert opinion on an item's inclusion and (b) a knowledge user survey to widen its impact. Design: Cross-sectional survey and Delphi process. Methods: Delphi panellists were asked to rate whether items should be included. All agreed-upon item were included in a second round of the survey (defined as 70% agreement). We surveyed knowledge users' views and preferences about the importance, utility and willingness to use the RoB NMA tool to evaluate evidence in practice and in policymaking. We included 12 closed and 10 open-ended questions, and we followed a knowledge translation plan to disseminate the survey through social media and professional networks. Results: 22 items were entered into a Delphi survey of which 28 respondents completed round 1, and 22 completed round 2. Seven items did not reach consensus in round 2. A total of 298 knowledge users participated in the survey (14% respondent rate). 75% indicated that their organisation produced NMAs, and 78% showed high interest in the tool, especially if they had received adequate training (84%). Most knowledge users and Delphi panellists preferred a tool to assess both bias in individual NMA results and authors' conclusions. Response bias in our sample is a major limitation as knowledge users working in high-income countries were more represented. One of the limitations of the Delphi process is that it depends on the purposive selection of experts and their availability, thus limiting the variability in perspectives and scientific disciplines. Conclusions: This Delphi process and knowledge user survey informs the development of the RoB NMA tool

Make or break: Succeeding in transition from incarceration.

Several factors impact successful reintegration after incarceration. We sought to better understand these factors such as pre-release preparedness or access to financial resources in provincial correctional facilities in Ontario, Canada with an underlying focus on the role of personal identification (PID) among people at risk of homelessness. We conducted a qualitative study with one-on-one telephone interviews. Eligibility criteria included having been released from a provincial correctional facility in the preceding 2 years, being over the age of 18, speaking English and having telephone access. Participants were recruited between February 2021 and July 2021. All interviews were audio recorded and transcribed. Data was analyzed using a thematic analysis framework along with strategies from grounded theory research. We interviewed 12 individuals and identified six key themes including 1) Degree of Preparedness Pre-Release 2) Managing Priorities Post-Release 3) Impact of Support Post-Release 4) Obstacles with Accessing Services 5) Influence of Personal Identification 6) Emotions and Uncertainty. We found that people with mental health and addiction challenges are uniquely at risk post-release. Solutions must include comprehensive and proactive case management that bridges the pre-release and post-release periods, simplified processes for obtaining PID, better connections to health and social services, and improved pre-release planning for community support

Interview guide.

Several factors impact successful reintegration after incarceration. We sought to better understand these factors such as pre-release preparedness or access to financial resources in provincial correctional facilities in Ontario, Canada with an underlying focus on the role of personal identification (PID) among people at risk of homelessness. We conducted a qualitative study with one-on-one telephone interviews. Eligibility criteria included having been released from a provincial correctional facility in the preceding 2 years, being over the age of 18, speaking English and having telephone access. Participants were recruited between February 2021 and July 2021. All interviews were audio recorded and transcribed. Data was analyzed using a thematic analysis framework along with strategies from grounded theory research. We interviewed 12 individuals and identified six key themes including 1) Degree of Preparedness Pre-Release 2) Managing Priorities Post-Release 3) Impact of Support Post-Release 4) Obstacles with Accessing Services 5) Influence of Personal Identification 6) Emotions and Uncertainty. We found that people with mental health and addiction challenges are uniquely at risk post-release. Solutions must include comprehensive and proactive case management that bridges the pre-release and post-release periods, simplified processes for obtaining PID, better connections to health and social services, and improved pre-release planning for community support.</div

COREQ (COnsolidated criteria for REporting Qualitative research) checklist.

COREQ (COnsolidated criteria for REporting Qualitative research) checklist.</p

Participant characteristics.

Several factors impact successful reintegration after incarceration. We sought to better understand these factors such as pre-release preparedness or access to financial resources in provincial correctional facilities in Ontario, Canada with an underlying focus on the role of personal identification (PID) among people at risk of homelessness. We conducted a qualitative study with one-on-one telephone interviews. Eligibility criteria included having been released from a provincial correctional facility in the preceding 2 years, being over the age of 18, speaking English and having telephone access. Participants were recruited between February 2021 and July 2021. All interviews were audio recorded and transcribed. Data was analyzed using a thematic analysis framework along with strategies from grounded theory research. We interviewed 12 individuals and identified six key themes including 1) Degree of Preparedness Pre-Release 2) Managing Priorities Post-Release 3) Impact of Support Post-Release 4) Obstacles with Accessing Services 5) Influence of Personal Identification 6) Emotions and Uncertainty. We found that people with mental health and addiction challenges are uniquely at risk post-release. Solutions must include comprehensive and proactive case management that bridges the pre-release and post-release periods, simplified processes for obtaining PID, better connections to health and social services, and improved pre-release planning for community support.</div

WISEST Website Demonstation Nov 2023

WISEST Website Demonstation Nov 202

Introduction to WISEST - Video

An automated quality appraisal tool for systematic reviews using AMSTAR 2 and ROBI

WISEST Project: An AI tool to help assess the strengths and limitations of systematic reviews, especially when multiple exist on the same topic

Our aim is t