Sustainability of the whole-community project '10,000 Steps': a longitudinal study

<p>Abstract</p> <p>Background</p> <p>In the dissemination and implementation literature, there is a dearth of information on the sustainability of community-wide physical activity (PA) programs in general and of the '10,000 Steps' project in particular. This paper reports a longitudinal evaluation of organizational and individual sustainability indicators of '10,000 Steps'.</p> <p>Methods</p> <p>Among project adopters, department heads of 24 public services were surveyed 1.5 years after initially reported project implementation to assess continuation, institutionalization, sustained implementation of intervention components, and adaptations. Barriers and facilitators of project sustainability were explored. Citizens (<it>n </it>= 483) living near the adopting organizations were interviewed to measure maintenance of PA differences between citizens aware and unaware of '10,000 Steps'. Independent-samples <it>t</it>, Mann-Whitney <it>U</it>, and chi-square tests were used to compare organizations for representativeness and individual PA differences.</p> <p>Results</p> <p>Of all organizations, 50% continued '10,000 Steps' (mostly in cycles) and continuation was independent of organizational characteristics. Level of intervention institutionalization was low to moderate on evaluations of routinization and moderate for project saturation. The global implementation score (58%) remained stable and three of nine project components were continued by less than half of organizations (posters, street signs and variants, personalized contact). Considerable independent adaptations of the project were reported (e.g. campaign image). Citizens aware of '10,000 Steps' remained more active during leisure time than those unaware (227 ± 235 and 176 ± 198 min/week, respectively; <it>t </it>= -2.6; p < .05), and reported more household-related (464 ± 397 and 389 ± 346 min/week, respectively; <it>t </it>= -2.2; p < .05) and moderate-intensity-PA (664 ± 424 and 586 ± 408 min/week, respectively; <it>t </it>= -2.0; p < .05). Facilitators of project sustainability included an organizational leader supporting the project, availability of funding or external support, and ready-for-use materials with ample room for adaptation. Barriers included insufficient synchronization between regional and community policy levels and preference for other PA projects.</p> <p>Conclusions</p> <p>'10,000 Steps' could remain sustainable but design, organizational, and contextual barriers need consideration. Sustainability of '10,000 Steps' in organizations can occur in cycles rather than in ongoing projects. Future research should compare sustainability other whole-community PA projects with '10,000 Steps' to contrast sustainability of alternative models of whole-community PA projects. This would allow optimization of project elements and methods to support decisions of choice for practitioners.</p

The revised Approved Instructional Resources score:An improved quality evaluation tool for online educational resources

BACKGROUND: Free Open-Access Medical education (FOAM) use among residents continues to rise. However, it often lacks quality assurance processes and residents receive little guidance on quality assessment. The Academic Life in Emergency Medicine Approved Instructional Resources tool (AAT) was created for FOAM appraisal by and for expert educators and has demonstrated validity in this context. It has yet to be evaluated in other populations.OBJECTIVES: We assessed the AAT's usability in a diverse population of practicing emergency medicine (EM) physicians, residents, and medical students; solicited feedback; and developed a revised tool.METHODS: As part of the Medical Education Translational Resources: Impact and Quality (METRIQ) study, we recruited medical students, EM residents, and EM attendings to evaluate five FOAM posts with the AAT and provide quantitative and qualitative feedback via an online survey. Two independent analysts performed a qualitative thematic analysis with discrepancies resolved through discussion and negotiated consensus. This analysis informed development of an initial revised AAT, which was then further refined after pilot testing among the author group. The final tool was reassessed for reliability.RESULTS: Of 330 recruited international participants, 309 completed all ratings. The Best Evidence in Emergency Medicine (BEEM) score was the component most frequently reported as difficult to use. Several themes emerged from the qualitative analysis: for ease of use-understandable, logically structured, concise, and aligned with educational value. Limitations include deviation from questionnaire best practices, validity concerns, and challenges assessing evidence-based medicine. Themes supporting its use include evaluative utility and usability. The author group pilot tested the initial revised AAT, revealing a total score average measure intraclass correlation coefficient (ICC) of moderate reliability (ICC = 0.68, 95% confidence interval [CI] = 0 to 0.962). The final AAT's average measure ICC was 0.88 (95% CI = 0.77 to 0.95).CONCLUSIONS: We developed the final revised AAT from usability feedback. The new score has significantly increased usability, but will need to be reassessed for reliability in a broad population.</p

The Social Media Index as an Indicator of Quality for Emergency Medicine Blogs: A METRIQ Study

Study objective: Online educational resources such as blogs are increasingly used for education by emergency medicine clinicians. The Social Media Index was developed to quantify their relative impact. The Medical Education Translational Resources: Indicators of Quality (METRIQ) study was conducted in part to determine the association between the Social Media Index score and quality as measured by gestalt and previously derived quality instruments. Methods: Ten blogs were randomly selected from a list of emergency medicine and critical care Web sites. The 2 most recent clinically oriented blog posts published on these blogs were evaluated with gestalt, the Academic Life in Emergency Medicine Approved Instructional Resources (ALiEM AIR) score, and the METRIQ-8 score. Volunteer raters (including medical students, emergency medicine residents, and emergency medicine attending physicians) were identified with a multimodal recruitment methodology. The Social Media Index was calculated in February 2016, November 2016, April 2017, and December 2017. Pearson's correlations were calculated between the Social Media Index and the average rater gestalt, ALiEM AIR score, and METRIQ-8 score. Results: A total of 309 of 330 raters completed all ratings (93.6%). The Social Media Index correlated moderately to strongly with the mean rater gestalt ratings (range 0.69 to 0.76) and moderately with the mean rater ALiEM AIR score (range 0.55 to 0.61) and METRIQ-8 score (range 0.53 to 0.57) during the month of the blog post's selection and for 2 years after. Conclusion: The Social Media Index's correlation with multiple quality evaluation instruments over time supports the hypothesis that it is associated with overall Web site quality. It can play a role in guiding individuals to high-quality resources that can be reviewed with critical appraisal techniques