Are We Putting the Cart Before the Horse? A Microcosm of Intended and Unintended Outcomes of Electronic Medical Record Implementation

Leaders in health care are calling for the implementation of electronic medical records (EMR) systems to help alleviate high costs of care delivery, high error rates, and uneven access to care. However, many of these leaders seem to be overlooking unintended outcomes of EMR implementation. Specifically, they may be overlooking the critical role physician beliefs and relationships play in the use of EMRs and in generating both intended and unintended outcomes. We studied a microcosm of the health care system through a qualitative field study examining EMR use in four clinics operating within a multi-specialty medical organization. We found that beliefs held by physicians about medical practice and the patterns of relationships in clinics influence EMR use behaviors in both expected and unexpected ways. Our contribution is to call attention to unintended outcomes of EMR implementation and to suggest that EMRs can be used as artifacts for learning

Local interaction Strategies and Capacity for Better Care in Nursing Homes: A Multiple Case Study

To describe relationship patterns and management practices in nursing homes (NHs) that facilitate or pose barriers to better outcomes for residents and staff. Methods: We conducted comparative, multiple-case studies in selected NHs (N = 4). Data were collected over six months from managers and staff (N = 406), using direct observations, interviews, and document reviews. Manifest content analysis was used to identify and explore patterns within and between cases. Results: Participants described interaction strategies that they explained could either degrade or enhance their capacity to achieve better outcomes for residents; people in all job categories used these 'local interaction strategies'. We categorized these two sets of local interaction strategies as the 'common pattern' and the 'positive pattern' and summarize the results in two models of local interaction. Conclusions: The findings suggest the hypothesis that when staff members in NHs use the set of positive local interaction strategies, they promote inter-connections, information exchange, and diversity of cognitive schema in problem solving that, in turn, create the capacity for delivering better resident care. We propose that these positive local interaction strategies are a critical driver of care quality in NHs. Our hypothesis implies that, while staffing levels and skill mix are important factors for care quality, improvement would be difficult to achieve if staff members are not engaged with each other in these ways.National Institutes of Health 2 R01NR003178-04A2Claude A. Pepper Older American's Independence Center AG-11268Paul A. Beeson Award NIA AG024787VA Health Services Research and Development EDU 08-417John A. Hartford Building Academic Geriatric Nursing Claire M. Fagin FellowshipBusiness Administratio

Participation in Decision Making as a Property of Complex Adaptive Systems: Developing and Testing a Measure

Objectives. To (1) describe participation in decision-making as a systems-level property of complex adaptive systems and (2) present empirical evidence of reliability and validity of a corresponding measure. Method. Study 1 was a mail survey of a single respondent (administrators or directors of nursing) in each of 197 nursing homes. Study 2 was a field study using random, proportionally stratified sampling procedure that included 195 organizations with 3,968 respondents. Analysis. In Study 1, we analyzed the data to reduce the number of scale items and establish initial reliability and validity. In Study 2, we strengthened the psychometric test using a large sample. Results. Results demonstrated validity and reliability of the participation in decision-making instrument (PDMI) while measuring participation of workers in two distinct job categories (RNs and CNAs). We established reliability at the organizational level aggregated items scores.We established validity of the multidimensional properties using convergent and discriminant validity and confirmatory factor analysis. Conclusions. Participation in decision making, when modeled as a systems level property of organization, has multiple dimensions and is more complex than is being traditionally measured. Managers can use this model to form decision teams that maximize the depth and breadth of expertise needed and to foster connection among them

Implementation research design: integrating participatory action research into randomized controlled trials

Luci K. Leykum and Jacqueline A. Pugh are with VERDICT, a VA HSRD REAP at the South Texas Veterans Health Care System, San Antonio, Texas, USA and the Department of Medicine, School of Medicine, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA -- Joel Harmon is with the School of Business, Fairleigh Dickinson University, Madison, New Jersey, USA -- Holly J. Lanham and Reuben R. McDaniel Jr. are with the Department of Information, Risk and Operations Management, McCombs School of Business, The University of Texas at Austin, Austin, Texas, USABackground: A gap continues to exist between what is known to be effective and what is actually delivered in the usual course of medical care. The goal of implementation research is to reduce this gap. However, a tension exists between the need to obtain generalizeable knowledge through implementation trials, and the inherent differences between healthcare organizations that make standard interventional approaches less likely to succeed. The purpose of this paper is to explore the integration of participatory action research and randomized controlled trial (RCT) study designs to suggest a new approach for studying interventions in healthcare settings. Discussion: We summarize key elements of participatory action research, with particular attention to its collaborative, reflective approach. Elements of participatory action research and RCT study designs are discussed and contrasted, with a complex adaptive systems approach used to frame their integration. Summary: The integration of participatory action research and RCT design results in a new approach that reflects not only the complex nature of healthcare organizations, but also the need to obtain generalizeable knowledge regarding the implementation process.Information, Risk, and Operations Management (IROM)[email protected]

The role of conversation in health care interventions: enabling sensemaking and learning

<p>Abstract</p> <p>Background</p> <p>Those attempting to implement changes in health care settings often find that intervention efforts do not progress as expected. Unexpected outcomes are often attributed to variation and/or error in implementation processes. We argue that some unanticipated variation in intervention outcomes arises because unexpected conversations emerge during intervention attempts. The purpose of this paper is to discuss the role of conversation in shaping interventions and to explain why conversation is important in intervention efforts in health care organizations. We draw on literature from sociolinguistics and complex adaptive systems theory to create an interpretive framework and develop our theory. We use insights from a fourteen-year program of research, including both descriptive and intervention studies undertaken to understand and assist primary care practices in making sustainable changes. We enfold these literatures and these insights to articulate a common failure of overlooking the role of conversation in intervention success, and to develop a theoretical argument for the importance of paying attention to the role of conversation in health care interventions.</p> <p>Discussion</p> <p>Conversation between organizational members plays an important role in the success of interventions aimed at improving health care delivery. Conversation can facilitate intervention success because interventions often rely on new sensemaking and learning, and these are accomplished through conversation. Conversely, conversation can block the success of an intervention by inhibiting sensemaking and learning. Furthermore, the existing relationship contexts of an organization can influence these conversational possibilities. We argue that the likelihood of intervention success will increase if the role of conversation is considered in the intervention process.</p> <p>Summary</p> <p>The generation of productive conversation should be considered as one of the foundations of intervention efforts. We suggest that intervention facilitators consider the following actions as strategies for reducing the barriers that conversation can present and for using conversation to leverage improvement change: evaluate existing conversation and relationship systems, look for and leverage unexpected conversation, create time and space where conversation can unfold, use conversation to help people manage uncertainty, use conversation to help reorganize relationships, and build social interaction competence.</p

Making sense of health information technology implementation: A qualitative study protocol

BACKGROUND: Implementing new practices, such as health information technology (HIT), is often difficult due to the disruption of the highly coordinated, interdependent processes (e.g., information exchange, communication, relationships) of providing care in hospitals. Thus, HIT implementation may occur slowly as staff members observe and make sense of unexpected disruptions in care. As a critical organizational function, sensemaking, defined as the social process of searching for answers and meaning which drive action, leads to unified understanding, learning, and effective problem solving -- strategies that studies have linked to successful change. Project teamwork is a change strategy increasingly used by hospitals that facilitates sensemaking by providing a formal mechanism for team members to share ideas, construct the meaning of events, and take next actions. METHODS: In this longitudinal case study, we aim to examine project teams' sensemaking and action as the team prepares to implement new information technology in a tiertiary care hospital. Based on management and healthcare literature on HIT implementation and project teamwork, we chose sensemaking as an alternative to traditional models for understanding organizational change and teamwork. Our methods choices are derived from this conceptual framework. Data on project team interactions will be prospectively collected through direct observation and organizational document review. Through qualitative methods, we will identify sensemaking patterns and explore variation in sensemaking across teams. Participant demographics will be used to explore variation in sensemaking patterns. DISCUSSION: Outcomes of this research will be new knowledge about sensemaking patterns of project teams, such as: the antecedents and consequences of the ongoing, evolutionary, social process of implementing HIT; the internal and external factors that influence the project team, including team composition, team member interaction, and interaction between the project team and the larger organization; the ways in which internal and external factors influence project team processes; and the ways in which project team processes facilitate team task accomplishment. These findings will lead to new methods of implementing HIT in hospitals

Organizational interventions employing principles of complexity science have improved outcomes for patients with Type II diabetes

<p>Abstract</p> <p>Background</p> <p>Despite the development of several models of care delivery for patients with chronic illness, consistent improvements in outcomes have not been achieved. These inconsistent results may be less related to the content of the models themselves, but to their underlying conceptualization of clinical settings as linear, predictable systems. The science of complex adaptive systems (CAS), suggests that clinical settings are non-linear, and increasingly has been used as a framework for describing and understanding clinical systems. The purpose of this study is to broaden the conceptualization by examining the relationship between interventions that leverage CAS characteristics in intervention design and implementation, and effectiveness of reported outcomes for patients with Type II diabetes.</p> <p>Methods</p> <p>We conducted a systematic review of the literature on organizational interventions to improve care of Type II diabetes. For each study we recorded measured process and clinical outcomes of diabetic patients. Two independent reviewers gave each study a score that reflected whether organizational interventions reflected one or more characteristics of a complex adaptive system. The effectiveness of the intervention was assessed by standardizing the scoring of the results of each study as 0 (no effect), 0.5 (mixed effect), or 1.0 (effective).</p> <p>Results</p> <p>Out of 157 potentially eligible studies, 32 met our eligibility criteria. Most studies were felt to utilize at least one CAS characteristic in their intervention designs, and ninety-one percent were scored as either "mixed effect" or "effective." The number of CAS characteristics present in each intervention was associated with effectiveness (p = 0.002). Two individual CAS characteristics were associated with effectiveness: interconnections between participants and co-evolution.</p> <p>Conclusion</p> <p>The significant association between CAS characteristics and effectiveness of reported outcomes for patients with Type II diabetes suggests that complexity science may provide an effective framework for designing and implementing interventions that lead to improved patient outcomes.</p

CONNECT for quality: protocol of a cluster randomized controlled trial to improve fall prevention in nursing homes

<p>Abstract</p> <p>Background</p> <p>Quality improvement (QI) programs focused on mastery of content by individual staff members are the current standard to improve resident outcomes in nursing homes. However, complexity science suggests that learning is a social process that occurs within the context of relationships and interactions among individuals. Thus, QI programs will not result in optimal changes in staff behavior unless the context for social learning is present. Accordingly, we developed CONNECT, an intervention to foster systematic use of management practices, which we propose will enhance effectiveness of a nursing home Falls QI program by strengthening the staff-to-staff interactions necessary for clinical problem-solving about complex problems such as falls. The study aims are to compare the impact of the CONNECT intervention, plus a falls reduction QI intervention (CONNECT + FALLS), to the falls reduction QI intervention alone (FALLS), on fall-related process measures, fall rates, and staff interaction measures.</p> <p>Methods/design</p> <p>Sixteen nursing homes will be randomized to one of two study arms, CONNECT + FALLS or FALLS alone. Subjects (staff and residents) are clustered within nursing homes because the intervention addresses social processes and thus must be delivered within the social context, rather than to individuals. Nursing homes randomized to CONNECT + FALLS will receive three months of CONNECT first, followed by three months of FALLS. Nursing homes randomized to FALLS alone receive three months of FALLs QI and are offered CONNECT after data collection is completed. Complexity science measures, which reflect staff perceptions of communication, safety climate, and care quality, will be collected from staff at baseline, three months after, and six months after baseline to evaluate immediate and sustained impacts. FALLS measures including quality indicators (process measures) and fall rates will be collected for the six months prior to baseline and the six months after the end of the intervention. Analysis will use a three-level mixed model.</p> <p>Discussion</p> <p>By focusing on improving local interactions, CONNECT is expected to maximize staff's ability to implement content learned in a falls QI program and integrate it into knowledge and action. Our previous pilot work shows that CONNECT is feasible, acceptable and appropriate.</p> <p>Trial Registration</p> <p>ClinicalTrials.gov: <a href="http://www.clinicaltrials.gov/ct2/show/NCT00636675">NCT00636675</a></p