Characteristics and knowledge synthesis approach for 456 network meta-analyses: a scoping review.

BACKGROUND Network meta-analysis (NMA) has become a popular method to compare more than two treatments. This scoping review aimed to explore the characteristics and methodological quality of knowledge synthesis approaches underlying the NMA process. We also aimed to assess the statistical methods applied using the Analysis subdomain of the ISPOR checklist. METHODS Comprehensive literature searches were conducted in MEDLINE, PubMed, EMBASE, and Cochrane Database of Systematic Reviews from inception until April 14, 2015. References of relevant reviews were scanned. Eligible studies compared at least four different interventions from randomised controlled trials with an appropriate NMA approach. Two reviewers independently performed study selection and data abstraction of included articles. All discrepancies between reviewers were resolved by a third reviewer. Data analysis involved quantitative (frequencies) and qualitative (content analysis) methods. Quality was evaluated using the AMSTAR tool for the conduct of knowledge synthesis and the ISPOR tool for statistical analysis. RESULTS After screening 3538 citations and 877 full-text papers, 456 NMAs were included. These were published between 1997 and 2015, with 95% published after 2006. Most were conducted in Europe (51%) or North America (31%), and approximately one-third reported public sources of funding. Overall, 84% searched two or more electronic databases, 62% searched for grey literature, 58% performed duplicate study selection and data abstraction (independently), and 62% assessed risk of bias. Seventy-eight (17%) NMAs relied on previously conducted systematic reviews to obtain studies for inclusion in their NMA. Based on the AMSTAR tool, almost half of the NMAs incorporated quality appraisal results to formulate conclusions, 36% assessed publication bias, and 16% reported the source of funding. Based on the ISPOR tool, half of the NMAs did not report if an assessment for consistency was conducted or whether they accounted for inconsistency when present. Only 13% reported heterogeneity assumptions for the random-effects model. CONCLUSIONS The knowledge synthesis methods and analytical process for NMAs are poorly reported and need improvement

A knowledge translation tool improved osteoporosis disease management in primary care: an interrupted time series analysis

BACKGROUND: Osteoporosis affects over 200 million people worldwide at a high cost to healthcare systems, yet gaps in management still exist. In response, we developed a multi-component osteoporosis knowledge translation (Op-KT) tool involving a patient-initiated risk assessment questionnaire (RAQ), which generates individualized best practice recommendations for physicians and customized education for patients at the point of care. The objective of this study was to evaluate the effectiveness of the Op-KT tool for appropriate disease management by physicians. METHODS: The Op-KT tool was evaluated using an interrupted time series design. This involved multiple assessments of the outcomes 12 months before (baseline) and 12 months after tool implementation (52 data points in total). Inclusion criteria were family physicians and their patients at risk for osteoporosis (women aged ≥50 years, men aged ≥65 years). Primary outcomes were the initiation of appropriate osteoporosis screening and treatment. Analyses included segmented linear regression modeling and analysis of variance. RESULTS: The Op-KT tool was implemented in three family practices in Ontario, Canada representing 5 family physicians with 2840 age eligible patients (mean age 67 years; 76% women). Time series regression models showed an overall increase from baseline in the initiation of screening (3.4%; P < 0.001), any osteoporosis medications (0.5%; P = 0.006), and calcium or vitamin D (1.2%; P = 0.001). Improvements were also observed at site level for all the three sites considered, but these results varied across the sites. Of 351 patients who completed the RAQ unprompted (mean age 64 years, 77% women), the mean time for completing the RAQ was 3.43 minutes, and 56% had any disease management addressed by their physician. Study limitations included the inherent susceptibility of our design compared with a randomized trial. CONCLUSIONS: The multicomponent Op-KT tool significantly increased osteoporosis investigations in three family practices, and highlights its potential to facilitate patient self-management. Next steps include wider implementation and evaluation of the tool in primary care. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s13012-014-0109-9) contains supplementary material, which is available to authorized users

A knowledge translation tool improved osteoporosis disease management in primary care: an interrupted time series analysis

Abstract Background Osteoporosis affects over 200 million people worldwide at a high cost to healthcare systems, yet gaps in management still exist. In response, we developed a multi-component osteoporosis knowledge translation (Op-KT) tool involving a patient-initiated risk assessment questionnaire (RAQ), which generates individualized best practice recommendations for physicians and customized education for patients at the point of care. The objective of this study was to evaluate the effectiveness of the Op-KT tool for appropriate disease management by physicians. Methods The Op-KT tool was evaluated using an interrupted time series design. This involved multiple assessments of the outcomes 12 months before (baseline) and 12 months after tool implementation (52 data points in total). Inclusion criteria were family physicians and their patients at risk for osteoporosis (women aged ≥50 years, men aged ≥65 years). Primary outcomes were the initiation of appropriate osteoporosis screening and treatment. Analyses included segmented linear regression modeling and analysis of variance. Results The Op-KT tool was implemented in three family practices in Ontario, Canada representing 5 family physicians with 2840 age eligible patients (mean age 67 years; 76% women). Time series regression models showed an overall increase from baseline in the initiation of screening (3.4%; P < 0.001), any osteoporosis medications (0.5%; P = 0.006), and calcium or vitamin D (1.2%; P = 0.001). Improvements were also observed at site level for all the three sites considered, but these results varied across the sites. Of 351 patients who completed the RAQ unprompted (mean age 64 years, 77% women), the mean time for completing the RAQ was 3.43 minutes, and 56% had any disease management addressed by their physician. Study limitations included the inherent susceptibility of our design compared with a randomized trial. Conclusions The multicomponent Op-KT tool significantly increased osteoporosis investigations in three family practices, and highlights its potential to facilitate patient self-management. Next steps include wider implementation and evaluation of the tool in primary care

Changes in mammography screening in Ontario and Alberta following national guideline dissemination: an interrupted time series analysis

Background: In November 2011, the Canadian Task Force on Preventive Health Care released guidelines for screening women at average breast cancer risk. Weak recommendations (framed using GRADE methodology) were made for screening women aged 50 to 74 years every two to three years, and for not screening women aged 40 to 49 years. Methods: We conducted an interrupted time series analysis using administrative data to examine bilateral mammography use before and after a release of a national breast screening guideline. Women aged 40 to 74 years living in Ontario or Alberta from 30th November 2008 to 30th November 2014 were included. Strata included age, region of residence, neighbourhood income quintile, immigration status, and education level. Results: In both provinces, mammography use rates were lower in the post-intervention period (527 vs. 556 and 428 vs. 465/1000 women in Ontario and Alberta, respectively). In Ontario, mammography trends decreased following guideline release to align with recommendations for women aged 40 to 74 (decrease of 2.21/1000 women, SE 0.26/1000, p<0.0001). In Alberta, mammography trends decreased for women aged 40 to 49 years (3/1000 women, SE 0.32, p<0.001) and 50 to 69 (2.9/1000 women, SE 0.79, p<0.001), but did not change for women aged 70 to 74 (0.7/1000 women, SE 1.23, p=0.553). In both provinces, trends in mammography use rates were sustained for up to three years after guideline release. Conclusions: We observed a decrease in screening for women aged 40-49. Additional research to explore whether shared decision making was used to optimize guideline-concordant screening for women aged 50-74 is needed

Changes in mammography screening in Ontario and Alberta following national guideline dissemination: an interrupted time series analysis [version 2; peer review: 2 approved]

Background: In November 2011, the Canadian Task Force on Preventive Health Care released guidelines for screening women at average breast cancer risk. Weak recommendations (framed using GRADE methodology) were made for screening women aged 50 to 74 years every two to three years, and for not screening women aged 40 to 49 years. Methods: We conducted an interrupted time series analysis using administrative data to examine bilateral mammography use before and after a release of a national breast screening guideline. Women aged 40 to 74 years living in Ontario or Alberta from 30th November 2008 to 30th November 2014 were included. Strata included age, region of residence, neighbourhood income quintile, immigration status, and education level. Results: In both provinces, mammography use rates were lower in the post-intervention period (527 vs. 556 and 428 vs. 465/1000 women in Ontario and Alberta, respectively). In Ontario, mammography trends decreased following guideline release to align with recommendations for women aged 40 to 74 (decrease of 2.21/1000 women, SE 0.26/1000, p<0.0001). In Alberta, mammography trends decreased for women aged 40 to 49 years (3/1000 women, SE 0.32, p<0.001) and 50 to 69 (2.9/1000 women, SE 0.79, p<0.001), but did not change for women aged 70 to 74 (0.7/1000 women, SE 1.23, p=0.553). In both provinces, trends in mammography use rates were sustained for up to three years after guideline release. Conclusions: We observed a decrease in screening for women aged 40-49. Additional research to explore whether shared decision making was used to optimize guideline-concordant screening for women aged 50-74 is needed

Can the effects of the mobilization of vulnerable elders in Ontario (MOVE ON) implementation be replicated in new settings: an interrupted time series design

Abstract Background Bed rest for older hospitalized patients places them at risk for hospital-acquired morbidity. We previously evaluated an early mobilization intervention and found it to be effective at improving mobilization rates and decreasing length of stay on internal medicine units. The aim of this study was to conduct a replication study evaluating the impact of the evidence-informed mobilization intervention on surgery, psychiatry, medicine, and cardiology inpatient units. Methods A multi-component early mobilization intervention was tailored to the local context at seven hospitals in Ontario, Canada. The primary outcome was patient mobilization measured by conducting visual audits twice a week, three times a day. Secondary outcomes were hospital length of stay and discharge destination, which were obtained from hospital decision support data. The study population was patients aged 65 years and older who were admitted to surgery, psychiatry, medicine, and cardiology inpatient units between March and August 2014. Using an interrupted time series design, the intervention was evaluated over three time periods–pre-intervention, during, and post-intervention. Results A total of 3098 patients [mean age 78.46 years (SD 8.38)] were included in the overall analysis. There was a significant increase in mobility immediately after the intervention period compared to pre-intervention with a slope change of 1.91 (95% confidence interval [CI] 0.74–3.08, P-value = 0.0014). A decreasing trend in median length of stay was observed in the majority of the participating sites. Overall, a median length of stay of 26.24 days (95% CI 23.67–28.80) was observed pre-intervention compared to 23.81 days (95% CI 20.13–27.49) during the intervention and 24.69 days (95% CI 22.43–26.95) post-intervention. The overall decrease in median length of stay was associated with the increase in mobility across the sites. Conclusions MOVE increased mobilization and these results were replicated across surgery, psychiatry, medicine, and cardiology inpatient units

Scaling-up implementation in community hospitals: a multisite interrupted time series design of the Mobilization of Vulnerable Elders (MOVE) program in Alberta

Abstract Background As the population ages, older hospitalized patients are at increased risk for hospital-acquired morbidity. The Mobilization of Vulnerable Elders (MOVE) program is an evidence-informed early mobilization intervention that was previously evaluated in Ontario, Canada. The program was effective at improving mobilization rates and decreasing length of stay in academic hospitals. The aim of this study was to scale-up the program and conduct a replication study evaluating the impact of the evidence-informed mobilization intervention on various units in community hospitals within a different Canadian province. Methods The MOVE program was tailored to the local context at four community hospitals in Alberta, Canada. The study population was patients aged 65 years and older who were admitted to medicine, surgery, rehabilitation and intensive care units between July 2015 and July 2016. The primary outcome was patient mobilization measured by conducting visual audits twice a week, three times a day. The secondary outcomes included hospital length of stay obtained from hospital administrative data, and perceptions of the intervention assessed through a qualitative assessment. Using an interrupted time series design, the intervention was evaluated over three time periods (pre-intervention, during, and post-intervention). Results A total of 3601 patients [mean age 80.1 years (SD = 8.4 years)] were included in the overall analysis. There was a significant increase in mobilization at the end of the intervention period compared to pre-intervention, with 6% more patients out of bed (95% confidence interval (CI) 1, 11; p-value = 0.0173). A decreasing trend in median length of stay was observed, where patients on average stayed an estimated 3.59 fewer days (95%CI -15.06, 7.88) during the intervention compared to pre-intervention period. Conclusions MOVE is a low-cost, effective and adaptable intervention that improves mobilization in older hospitalized patients. This intervention has been replicated and scaled up across various units and hospital settings

An evaluation of the comparative effectiveness of geriatrician-led comprehensive geriatric assessment for improving patient and healthcare system outcomes for older adults: a protocol for a systematic review and network meta-analysis

Abstract Background Comprehensive geriatric assessment (CGA) is an integrated model of care involving a geriatrician and an interdisciplinary team and can prioritize and manage complex health needs of older adults with multimorbidity. CGAs differ across healthcare settings, ranging from shared care conducted in primary care settings to specialized inpatient units in acute care. Models of care involving geriatricians vary across healthcare settings, and it is unclear which CGA model is most effective. Our objective is to conduct a systematic review and network meta-analysis (NMA) to examine the comparative effectiveness of various geriatrician-led CGAs and to identify which models improve patient and healthcare system level outcomes. Methods An integrated knowledge translation approach will be used and knowledge users (KUs) including patients, caregivers, geriatricians, and healthcare policymakers will be involved throughout the review. Electronic databases including MEDLINE, EMBASE, Cochrane library, and Ageline will be searched from inception to November 2016 to identify relevant studies. Randomized controlled trials of older adults (≥65 years of age) that examine geriatrician-led CGAs compared to any intervention will be included. Primary and secondary outcomes will be selected by KUs to ensure the results are relevant to their decision-making. Two reviewers will independently screen the search results, extract data, and assess risk of bias. Data will be synthesized using an NMA to allow for multiple comparisons using direct (head-to-head) as well as indirect evidence. Interventions will be ranked according to their effectiveness using surface under the cumulative ranking curve (SUCRA). Discussion As the proportion of older adults grows worldwide, the demand for specialized geriatric services that help manage complex health needs of older adults with multimorbidity will increase in many countries. Results from this systematic review and NMA will enhance decision-making and the efficient allocation of scarce geriatric resources. Moreover, active involvement of KUs throughout the review process will ensure the results are relevant to different levels of decision-making. Systematic review registration PROSPERO CRD4201401400