Undertaking sociotechnical evaluations of health information technologies

There is an increasing international recognition that the evaluation of health information technologies should involve assessments of both the technology and the social/organisational contexts into which it is deployed. There is, however, a lack of agreement on definitions, published guidance on how such ‘sociotechnical evaluations’ should be undertaken, and how they distinguish themselves from other approaches. We explain what sociotechnical evaluations are, consider the contexts in which these are most usefully undertaken, explain what they entail, reflect on the potential pitfalls associated with such research, and suggest possible ways to avoid these

Concerted adoption as an emerging strategy for digital transformation of healthcare - lessons from Australia, Canada, and England

Objectives: With an increasing focus on the digitalization of health and care settings, there is significant scope to learn from international approaches to promote concerted adoption of electronic health records. Materials and methods: We review three large-scale initiatives from Australia, Canada, and England, and extract common lessons for future health and social care transformation strategy. Results: In doing so, we discuss how, despite differences in contexts, concerted adoption enables sharing of experience and learning to streamline the digital transformation of health and care. Discussion and conclusion: Concerted adoption can be accelerated through building communities of expertise and partnerships promoting knowledge transfer and circulation of expertise, commonalities in geographical and cultural contexts, and commonalities in technological systems

Establishing data-intensive learning health systems: an interdisciplinary exploration of the planned introduction of hospital electronic prescribing and medicines administration systems in Scotland

Background Creating learning health systems, characterised by the use and repeated reuse of demographic, process and clinical data to improve the safety, quality and efficiency of care, is a key aim in realising the potential benefits and efficiency savings associated with the implementation of health information technology.Objectives We sought to investigate stakeholder perspectives on and experiences of the implementation of hospital electronic prescribing and medicines administration (HEPMA) systems in Scotland and use these to inform political decisions on approaches to promoting the use and reuse of digitised prescribing and medication administration data in order to improve care processes and outcomes.Methods We identified and recruited key national stakeholders involved in implementing and/or using HEPMA data from generic and specialty systems. These included representatives from healthcare settings (i.e. doctors, pharmacists and nurses), managers of existing national databases, policy makers, healthcare analytics companies, system suppliers and patient representatives. We conducted multi-disciplinary focus group discussions, audio-recorded these, transcribed data verbatim and thematically analysed the transcripts with the help of NVivo10. In analysing the data, we drew on theoretical and previous empirical work on information infrastructures.Results We identified the following key themes: 1) micro-factors – usability of systems and motivating users to input data; 2) meso-factors – developing technical and organisational infrastructures to facilitate the aggregation of data; and 3) macro-factors – facilitating interoperability and data reuse at larger scales to ensure that data are effectively generated and used.Conclusions This work is relevant not only to countries in the early stages of data strategy development but also to countries aiming to aggregate data at national levels. An overall shared vision of a learning health system at individual, organisational and national levels can help to catalyse such data-intensive transformational efforts

Investigating and learning lessons from early experiences of implementing ePrescribing systems into NHS hospitals:a questionnaire study

Background: ePrescribing systems have significant potential to improve the safety and efficiency of healthcare, but they need to be carefully selected and implemented to maximise benefits. Implementations in English hospitals are in the early stages and there is a lack of standards guiding the procurement, functional specifications, and expected benefits. We sought to provide an updated overview of the current picture in relation to implementation of ePrescribing systems, explore existing strategies, and identify early lessons learned.Methods: a descriptive questionnaire-based study, which included closed and free text questions and involved both quantitative and qualitative analysis of the data generated.Results: we obtained responses from 85 of 108 NHS staff (78.7% response rate). At least 6% (n = 10) of the 168 English NHS Trusts have already implemented ePrescribing systems, 2% (n = 4) have no plans of implementing, and 34% (n = 55) are planning to implement with intended rapid implementation timelines driven by high expectations surrounding improved safety and efficiency of care. The majority are unclear as to which system to choose, but integration with existing systems and sophisticated decision support functionality are important decisive factors. Participants highlighted the need for increased guidance in relation to implementation strategy, system choice and standards, as well as the need for top-level management support to adequately resource the project. Although some early benefits were reported by hospitals that had already implemented, the hoped for benefits relating to improved efficiency and cost-savings remain elusive due to a lack of system maturity.Conclusions: whilst few have begun implementation, there is considerable interest in ePrescribing systems with ambitious timelines amongst those hospitals that are planning implementations. In order to ensure maximum chances of realising benefits, there is a need for increased guidance in relation to implementation strategy, system choice and standards, as well as increased financial resources to fund local activitie

Using Blueprints to promote interorganizational knowledge transfer in digital health initiatives—a qualitative exploration of a national change program in English hospitals

OBJECTIVE: The Global Digital Exemplar (GDE) Program is a national attempt to accelerate digital maturity in healthcare providers through promoting knowledge transfer across the English National Health Service (NHS). “Blueprints”—documents capturing implementation experience—were intended to facilitate this knowledge transfer. Here we explore how Blueprints have been conceptualized, produced, and used to promote interorganizational knowledge transfer across the NHS. MATERIALS AND METHODS: We undertook an independent national qualitative evaluation of the GDE Program. This involved collecting data using semistructured interviews with implementation staff and clinical leaders in provider organizations, nonparticipant observation of meetings, and key documents. We also attended a range of national meetings and conferences, interviewed national program managers, and analyzed a range of policy documents. Our analysis drew on sociotechnical principles, combining deductive and inductive methods. RESULTS: Data comprised 508 interviews, 163 observed meetings, and analysis of 325 documents. We found little evidence of Blueprints being adopted in the manner originally conceived by national program managers. However, they proved effective in different ways to those planned. As well as providing a helpful initial guide to a topic, we found that Blueprints served as a method of identifying relevant expertise that paved the way for subsequent discussions and richer knowledge transfers amongst provider organizations. The primary value of Blueprinting, therefore, seemed to be its role as a networking tool. Members of different organizations came together in developing, applying, and sustaining Blueprints through bilateral conversations—in some circumstances also fostering informal communities of practice. CONCLUSIONS: Blueprints may be effective in facilitating knowledge transfer among healthcare organizations, but need to be accompanied by other evolving methods, such as site visits and other networking activities, to iteratively transfer knowledge and experience