Opening the black box of quality improvement collaboratives: an Actor-Network theory approach

<p>Abstract</p> <p>Background</p> <p>Quality improvement collaboratives are often labeled as black boxes because effect studies usually do not describe exactly how the results were obtained. In this article we propose a way of opening such a black box, by taking up a dynamic perspective based on Actor-Network Theory. We thereby analyze how the problematisation process and the measurement practices are constructed. Findings from this analysis may have consequences for future evaluation studies of collaboratives.</p> <p>Methods</p> <p>In an ethnographic design we probed two projects within a larger quality improvement collaborative on long term mental health care and care for the intellectually disabled. Ethnographic observations were made at nine national conferences. Furthermore we conducted six case studies involving participating teams. Additionally, we interviewed the two program leaders of the overall projects.</p> <p>Results</p> <p>In one project the problematisation seemed to undergo a shift of focus away from the one suggested by the project leaders. In the other we observed multiple roles of the measurement instrument used. The instrument did not only measure effects of the improvement actions but also changed these actions and affected the actors involved.</p> <p>Conclusions</p> <p>Effectiveness statistics ideally should be complemented with an analysis of the construction of the collaborative and the improvement practices. Effect studies of collaboratives could benefit from a mixed methods research design that combines quantitative and qualitative methods.</p

Are health care professionals able to judge cancer patients' health care preferences correctly? A cross-sectional study

Background: Health care for cancer patients is primarily shaped by health care professionals. This raises the question to what extent health care professionals are aware of patients' preferences, needs and values. The aim of this study was to explore to what extent there is concordance between patients' preferences in cancer care and patients' preferences as estimated by health care professionals. We also examined whether there were gender differences between health care professionals with regard to the degree in which they can estimate patients' preferences correctly. Methods: To obtain unbiased insight into the specific preferences of cancer patients, we developed the 'Cancer patients' health care preferences' questionnaire'. With this questionnaire we assessed a large sample of cancer patients (n = 386). Next, we asked health care professionals (medical oncologists, nurses and policymakers, n = 60) to fill out this questionnaire and to indicate preferences they thought cancer patients would have. Mean scores between groups were compared using Mann-Whitney tests. Effect sizes (ESs) were calculated for statistically significant differences. Results: We found significant differences (ESs 0.31 to 0.90) between patients and professionals for eight out of twenty-one scales and two out of eight single items. Patients valued care aspects related to expertise and attitude of health care providers and accessibility of services as more important than the professionals thought they would do. Health care professionals overestimated the value that patients set on particularly organisational and environmental aspects. We found significant gender-related differences between the professionals (ESs 0.69 to 1.39) for eight out of twenty-one scales and two out of eight single items. When there were significant differences between male and female healthcare professionals in their estimation of patients health care preferences, female health care professionals invariably had higher scores. Generally, female health care professionals did not estimate patients' preferences and needs better than their male colleagues. Conclusions: Health care professionals are reasonably well able to make a correct estimation of patients preferences, but they should be aware of their own bias and use additional resources to gain a better understanding of patients' specific preferences for each patient is different and ultimately the care needs and preferences will also be unique to the person

Feedback reporting of survey data to healthcare aides

BackgroundThis project occurred during the course of the Translating Research in Elder Care (TREC) program of research. TREC is a multilevel and longitudinal research program being conducted in the three Canadian Prairie Provinces of Alberta, Saskatchewan, and Manitoba. The main purpose of TREC is to increase understanding about the role of organizational context in influencing knowledge use in residential long-term care settings. The purpose of this study was to evaluate healthcare aides&rsquo; (HCAs) perceptions of a one-page poster designed to feed back aggregated data (including demographic information and perceptions about influences on best practice) from the TREC survey they had recently completed. MethodsA convenience sample of 7 of the 15 nursing homes participating in the TREC research program in Alberta were invited to participate. Specific facility-level summary data were provided to each facility in the form of a one-page poster report. Two weeks following delivery of the report, a convenience sample of HCAs was surveyed using one-to-one structured interviews. ResultsOne hundred twenty-three HCAs responded to the evaluation survey. Overall, HCAs&rsquo; opinions about presentation of the feedback report and the understandability, usability, and usefulness of the content were positive. For each report, analysis of data and production and inspection of the report took up to one hour. Information sessions to introduce and explain the reports averaged 18 minutes. Two feedback reports (minimum) were supplied to each facility at a cost of CAN$2.39 per report, for printing and laminating. ConclusionsThis study highlights not only the feasibility of producing understandable, usable, and useful feedback reports of survey data but also the value and importance of providing feedback to survey respondents. More broadly, the findings suggest that modest strategies may have a positive and desirable effect in participating sites. <br /