Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS)

BACKGROUND: Although the importance of the organizational environment for implementing evidence-based practices (EBP) has been widely recognized, there are limited options for measuring implementation climate in public sector health settings. The goal of this research was to develop and test a measure of EBP implementation climate that would both capture a broad range of issues important for effective EBP implementation and be of practical use to researchers and managers seeking to understand and improve the implementation of EBPs. METHODS: Participants were 630 clinicians working in 128 work groups in 32 US-based mental health agencies. Items to measure climate for EBP implementation were developed based on past literature on implementation climate and other strategic climates and in consultation with experts on the implementation of EBPs in mental health settings. The sample was randomly split at the work group level of analysis; half of the sample was used for exploratory factor analysis (EFA), and the other half was used for confirmatory factor analysis (CFA). The entire sample was utilized for additional analyses assessing the reliability, support for level of aggregation, and construct-based evidence of validity. RESULTS: The EFA resulted in a final factor structure of six dimensions for the Implementation Climate Scale (ICS): 1) focus on EBP, 2) educational support for EBP, 3) recognition for EBP, 4) rewards for EBP, 5) selection for EBP, and 6) selection for openness. This structure was supported in the other half of the sample using CFA. Additional analyses supported the reliability and construct-based evidence of validity for the ICS, as well as the aggregation of the measure to the work group level. CONCLUSIONS: The ICS is a very brief (18 item) and pragmatic measure of a strategic climate for EBP implementation. It captures six dimensions of the organizational context that indicate to employees the extent to which their organization prioritizes and values the successful implementation of EBPs. The ICS can be used by researchers to better understand the role of the organizational context on implementation outcomes and by organizations to evaluate their current climate as they consider how to improve the likelihood of implementation success. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s13012-014-0157-1) contains supplementary material, which is available to authorized users

Qualitative study on the implementation of professional pharmacy services in Australian community pharmacies using framework analysis

Abbreviations: BCT, Behavioural change techniques taxonomy; BCW, Behavioural change wheel; CFIR, Consolidated framework for implementation research; EPOC, Cochrane effective practice and organisation of care; FISpH, Framework for the implementation of services in pharmacy; GIF, Generic implementation framework; KPI, Key performance indicator; TDF, Theoretical domains frameworkBackground: Multiple studies have explored the implementation process and influences, however it appears there is no study investigating these influences across the stages of implementation. Community pharmacy is attempting to implement professional services (pharmaceutical care and other health services). The use of implementation theory may assist the achievement of widespread provision, support and integration. The objective was to investigate professional service implementation in community pharmacy to contextualise and advance the concepts of a generic implementation framework previously published. Methods: Purposeful sampling was used to investigate implementation across a range of levels of implementation in community pharmacies in Australia. Twenty-five semi-structured interviews were conducted and analysed using a framework methodology. Data was charted using implementation stages as overarching themes and each stage was thematically analysed, to investigate the implementation process, the influences and their relationships. Secondary analyses were performed of the factors (barriers and facilitators) using an adapted version of the Consolidated Framework for Implementation Research (CFIR), and implementation strategies and interventions, using the Expert Recommendations for Implementing Change (ERIC) discrete implementation strategy compilation. Results: Six stages emerged, labelled as development or discovery, exploration, preparation, testing, operation and sustainability. Within the stages, a range of implementation activities/steps and five overarching influences (pharmacys' direction and impetus, internal communication, staffing, community fit and support) were identified. The stages and activities were not applied strictly in a linear fashion. There was a trend towards the greater the number of activities considered, the greater the apparent integration into the pharmacy organization. Implementation factors varied over the implementation stages, and additional factors were added to the CFIR list and definitions modified/contextualised for pharmacy. Implementation strategies employed by pharmacies varied widely. Evaluations were lacking. Conclusions: The process of implementation and five overarching influences of professional services implementation in community pharmacy have been outlined. Framework analysis revealed, outside of the five overarching influences, factors influencing implementation varied across the implementation stages. It is proposed at each stage, for each domain, the factors, strategies and evaluations should be considered. The Framework for the Implementation of Services in Pharmacy incorporates the contextualisation of implementation science for pharmacy.The study was funded as part of a University of Technology Sydney (UTS) Research Excellence Scholarship (RES), comprising of an Australian Postgraduate Award (APA) Scholarship funded by the Australian Government, plus a Top-up funded by the University of Technology Sydney, received from the primary author (JCM)

The Embodiment of Success and Failure as Forward versus Backward Movements

People often speak of success (e.g., “advance”) and failure (e.g., “setback”) as if they were forward versus backward movements through space. Two experiments sought to examine whether grounded associations of this type influence motor behavior. In Experiment 1, participants categorized success versus failure words by moving a joystick forward or backward. Failure categorizations were faster when moving backward, whereas success categorizations were faster when moving forward. Experiment 2 removed the requirement to categorize stimuli and used a word rehearsal task instead. Even without Experiment 1’s response procedures, a similar cross-over interaction was obtained (e.g., failure memorizations sped backward movements relative to forward ones). The findings are novel yet consistent with theories of embodied cognition and self-regulation

Imageability ratings across languages

Imageability is a psycholinguistic variable that indicates how well a word gives rise to a mental image or sensory experience. Imageability ratings are used extensively in psycholinguistic, neuropsychological, and aphasiological studies. However, little formal knowledge exists about whether and how these ratings are associated between and within languages. Fifteen imageability databases were cross-correlated using nonparametric statistics. Some of these corresponded to unpublished data collected within a European research network-the Collaboration of Aphasia Trialists (COST IS1208). All but four of the correlations were significant. The average strength of the correlations (rho = .68) and the variance explained (R (2) = 46%) were moderate. This implies that factors other than imageability may explain 54% of the results. Imageability ratings often correlate across languages. Different possibly interacting factors may explain the moderate strength and variance explained in the correlations: (1) linguistic and cultural factors; (2) intrinsic differences between the databases; (3) range effects; (4) small numbers of words in each database, equivalent words, and participants; and (5) mean age of the participants. The results suggest that imageability ratings may be used cross-linguistically. However, further understanding of the factors explaining the variance in the correlations will be needed before research and practical recommendations can be made

Participatory instructional redesign by students and teachers in secondary education: effects on perceptions of instruction

Könings, K. D., Brand-Gruwel, S., & Van Merriënboer, J. J. G. (2011). Participatory instructional redesign by students and teachers in secondary education: effects on perceptions of instruction. Instructional Science, 39(5), 737–762.Students’ perceptions of instruction are important because they direct the learning of students. The fact that teachers have only limited knowledge of these perceptions is likely to threaten the effectiveness of learning, because congruence between interpretations of an instructional intervention is necesarry for its optimal use. This study examines participatory design as a strategy for taking student perceptions into account in instructional re/design. Participatory design meetings of groups of teachers and seven co-designing students in a secondary education setting identified changes to improve the regular education process. The results on changes in student perceptions, perceived-desired discrepancy, and teacher-student disagreement showed some improvement for the co-designers but, unexpectedly, limited or even negative effects for the non-co-designing students. Possible causes are discussed. Participatory design seems to have potential for improving education, but further research is needed

Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors

Implementation science is a quickly growing discipline. Lessons learned from business and medical settings are being applied but it is unclear how well they translate to settings with different historical origins and customs (e.g., public mental health, social service, alcohol/drug sectors). The purpose of this paper is to propose a multi-level, four phase model of the implementation process (i.e., Exploration, Adoption/Preparation, Implementation, Sustainment), derived from extant literature, and apply it to public sector services. We highlight features of the model likely to be particularly important in each phase, while considering the outer and inner contexts (i.e., levels) of public sector service systems

Phenotypic and Genome-Wide Analysis of an Antibiotic-Resistant Small Colony Variant (SCV) of Pseudomonas aeruginosa

Small colony variants (SCVs) are slow-growing bacteria, which often show increased resistance to antibiotics and cause latent or recurrent infections. It is therefore important to understand the mechanisms at the basis of this phenotypic switch.One SCV (termed PAO-SCV) was isolated, showing high resistance to gentamicin and to the cephalosporine cefotaxime. PAO-SCV was prone to reversion as evidenced by emergence of large colonies with a frequency of 10(-5) on media without antibiotics while it was stably maintained in presence of gentamicin. PAO-SCV showed a delayed growth, defective motility, and strongly reduced levels of the quorum sensing Pseudomonas quinolone signal (PQS). Whole genome expression analysis further suggested a multi-layered antibiotic resistance mechanism, including simultaneous over-expression of two drug efflux pumps (MexAB-OprM, MexXY-OprM), the LPS modification operon arnBCADTEF, and the PhoP-PhoQ two-component system. Conversely, the genes for the synthesis of PQS were strongly down-regulated in PAO-SCV. Finally, genomic analysis revealed the presence of mutations in phoP and phoQ genes as well as in the mexZ gene encoding a repressor of the mexXY and mexAB-oprM genes. Only one mutation occurred only in REV, at nucleotide 1020 of the tufA gene, a paralog of tufB, both encoding the elongation factor Tu, causing a change of the rarely used aspartic acid codon GAU to the more common GAC, possibly causing an increase of tufA mRNA translation. High expression of phoP and phoQ was confirmed for the SCV variant while the revertant showed expression levels reduced to wild-type levels.By combining data coming from phenotypic, gene expression and proteome analysis, we could demonstrate that resistance to aminoglycosides in one SCV mutant is multifactorial including overexpression of efflux mechanisms, LPS modification and is accompanied by a drastic down-regulation of the Pseudomonas quinolone signal quorum sensing system