Patient safety in developing countries: retrospective estimation of scale and nature of harm to patients in hospital

OBJECTIVE: To assess the frequency and nature of adverse events to patients in selected hospitals in developing or transitional economies. DESIGN: Retrospective medical record review of hospital admissions during 2005 in eight countries. SETTING: Ministries of Health of Egypt, Jordan, Kenya, Morocco, Tunisia, Sudan, South Africa and Yemen; the World Health Organisation (WHO) Eastern Mediterranean and African Regions (EMRO and AFRO), and WHO Patient Safety. PARTICIPANTS: Convenience sample of 26 hospitals from which 15,548 patient records were randomly sampled. MAIN OUTCOME MEASURES: Two stage screening. Initial screening based on 18 explicit criteria. Records that screened positive were then reviewed by a senior physician for determination of adverse event, its preventability, and the resulting disability. RESULTS: Of the 15,548 records reviewed, 8.2% showed at least one adverse event, with a range of 2.5% to 18.4% per country. Of these events, 83% were judged to be preventable, while about 30% were associated with death of the patient. About 34% adverse events were from therapeutic errors in relatively non-complex clinical situations. Inadequate training and supervision of clinical staff or the failure to follow policies or protocols contributed to most events. CONCLUSIONS: Unsafe patient care represents a serious and considerable danger to patients in the hospitals that were studied, and hence should be a high priority public health problem. Many other developing and transitional economies will probably share similar rates of harm and similar contributory factors. The convenience sampling of hospitals might limit the interpretation of results, but the identified adverse event rates show an estimate that should stimulate and facilitate the urgent institution of appropriate remedial action and also to trigger more research. Prevention of these adverse events will be complex and involves improving basic clinical processes and does not simply depend on the provision of more resources

Cross sectional study of performance indicators for English Primary Care Trusts: testing construct validity and identifying explanatory variables

BACKGROUND: The performance of Primary Care Trusts in England is assessed and published using a number of different performance indicators. Our study has two broad purposes. Firstly, to find out whether pairs of indicators that purport to measure similar aspects of quality are correlated (as would be expected if they are both valid measures of the same construct). Secondly, we wanted to find out whether broad (global) indicators correlated with any particular features of Primary Care Trusts, such as expenditure per capita. METHODS: Cross sectional quantitative analysis using data from six 2004/05 PCT performance indicators for 303 English Primary Care Trusts from four sources in the public domain: Star Rating, aggregated Quality and Outcomes Framework scores, Dr Foster mortality index, Dr Foster equity index (heart by-pass and hip replacements), NHS Litigation Authority Risk Management standards and Patient Satisfaction scores from the Star Ratings. Forward stepwise multiple regression analysis to determine the effect of Primary Care Trust characteristics on performance. RESULTS: Star Rating and Quality and Outcomes Framework total, both summary measures of global quality, were not correlated with each other (F = 0.66, p = 0.57). There were however positive correlations between Quality and Outcomes Framework total and patient satisfaction (r = 0.61, p < 0.001) and between screening/'additional services' indicators on the Star Ratings and Quality and Outcomes Framework (F = 24, p < 0.001). There was no correlation between different measures of access to services. Likewise we found no relationship between either Star Rating or Litigation Authority Standards and hospital mortality (F = 0.61, p = 0.61; F = 0.31, p = 0.73). CONCLUSION: Performance assessment in healthcare remains on the Government's agenda, with new core and developmental standards set to replace the Star Ratings in 2006. Yet the results of this analysis provide little evidence that the current indicators have sufficient construct validity to measure the underlying concept of quality, except when the specific area of screening is considered

A population-based study from New South Wales, Australia 1996-2001: area variation in survival from colorectal cancer

In this study, we have investigated the impact of area of residence on survival from colon and rectal cancer. Relative survival and relative excess risk of death from cancer were calculated for each of 17 health areas in New South Wales, Australia. There were statistically significant differences in survival across areas for both cancers after adjusting for demographic factors. The variation remained for colon cancer but was reduced for rectal cancer after adjustment for spread of disease at diagnosis. This persistent variation in colon cancer survival suggests that variation in treatment contributes to it, and there is separate evidence for such variation. Of the 7186 patients whose deaths within five years were attributable to colorectal cancer, 784 could have had their survival increased to more than five years if the excess risk of death in all areas was reduced to the 20th centile of its distribution. Estimates such as this can assist in prioritizing improvements in cancer service

Assessing the impact of socio-economic status on cancer survival in New South Wales, Australia 1996-2001

OBJECTIVE: To assess the impact of socio-economic status (SES) on cancer survival in the state of New South Wales (NSW), Australia. METHODS: Patients diagnosed with one of 13 major cancers during 1992-2000 in NSW were followed-up to the end of 2001. The effect of SES on survival was estimated for each individual cancer and all 13 cancers combined using multivariable modeling. The numbers of lives that could be extended if all people had the same level of excess risk of death due to cancer as patients in the highest SES areas were also estimated. RESULTS: There were highly statistically significant variations in survival across SES groups for four cancers: stomach, liver, lung, and breast and all 13 cancers combined. Variation remained highly significant after adjusting for disease stage. Patients in lower SES areas had 10-20% higher excess risk than those in the highest SES areas. In total, there were 3,346 lives potentially extendable beyond 5 years; the highest number was for lung cancer (756). CONCLUSION: The significantly worse survival in lower SES areas from cancers of the stomach, liver, lung, and breast may be due to poorer access to high-quality cancer care. Estimates of the number of lives potentially extendable by improving cancer survival in lower SES areas suggest that priority should be given to improving lung cancer care in lower SES areas in NSW, Australi

Clinical indicators in surgery: A critical review of the Australian experience

Background: A set of clinical measures (indicators), developed by an Australian Council on Healthcare Standards (ACHS) and Royal Australasian College of Surgeons (RACS) working party, was introduced into the accreditation programme in 1997. Although early qualitative and quantitative reporting by health-care organizations (HCOs) reflected their value in stimulating change, the number of HCOs reporting data on this set of clinical indicators (CIs) has declined, despite an increase in the number of HCOs reporting data on the CIs programme overall. Possible reasons for this decline were sought. Methods: A retrospective review of prospectively collected surgical CI data was performed, a national survey of stakeholders in the ACHS programme was conducted and a comparison was made with published international data. Results: From a maximum of 247 HCOs reporting data in 2002, the number fell to 168 by 2011. While favourable trends were evident with some CIs, for example, a decline in the rate of negative histology in childhood appendicectomy and in the rate of in-hospital infection in total hip joint replacement, there was minimal change with many of the CIs, suggesting limited responsiveness as measures of care. In the national survey, stakeholder's response was positive overall, but there was a requirement for regular review of CIs. Although some colleges viewed the CIs as simplistic and not reliable, comparisons with similar measures available in the international literature were favourable. Conclusions: Possible reasons for the declining number of HCOs reporting surgical CI data are a lack of a recent revision of the CIs and a lack of engagement of clinicians from the RACS. Revision of the surgical CI set is required. © 2012 Royal Australasian College of Surgeons

Trends in survival and excess risk of death after diagnosis of cancer in 1980-1996 in New South Wales, Australia

Survival from almost all cancers has improved during the last 30 years. There is debate over the reasons for the improvement. We examined trends in survival for 28 cancers from 1980 to 1996 in New South Wales (NSW), Australia, with adjustment for disease spread at diagnosis. NSW Central Cancer Registry data were used to estimate 5-year relative survival and relative excess risk of death for patients diagnosed in 1980-84, 1985-88, 1989-92 and 1993-96. Statistical significance of variation in excess deaths between periods of diagnosis was assessed using Poisson regression, with adjustment for age, sex, duration of follow-up, histology and spread of disease at diagnosis. There were statistically significant falls in excess deaths for 20 of the cancers with a 25% fall for all cancers combined. Cancers of the prostate, liver, thyroid, breast, gallbladder, body of uterus, rectum, cervix and ovary had falls of >30%. The falls varied by spread of disease; the largest being in localised and regionally spread tumours. Overall survival, when unadjusted for spread of cancer, generally fell in parallel with that in the specific categories of spread, which implies that stage migration did not contribute importantly to survival trends. While acknowledging the limitations of incomplete data on stage of cancer at diagnosis, we conclude that falls in excess deaths in NSW from 1980 to 1996 are unlikely, for many cancers, to be attributed to earlier diagnosis or stage migration; thus advances in cancer treatment have almost certainly contributed to the

Misclassification of colorectal cancer stage and area variation in survival

We previously investigated the impact of health area of residence on colon and rectal cancer survival by estimating area-specific relative excess risk of death (RER), stratified by stage at diagnosis. The aims of this study were to quantify errors in colorectal cancer stage obtained from an Australian population-based cancer registry and assess the potential impact of errors in stage on these estimates. For a subset of cases, we compared the cancer registry stage with that from a survey of treating surgeons. We then randomly reallocated all cases to a simulated 'corrected' stage according to the estimated misclassification probabilities and repeated the analysis of area variation stratified by simulated stage 1,000 times. We found 70% agreement between the Registry and Survey stage. This reallocation of the Registry cases by stage resulted in substantial variation in area-specific RERs across the simulated samples. Area variation in survival for localized colon and localized rectal cancer, which were previously statistically significant when classified using Registry stage, appeared no longer to be so. Misclassification of cancer registry stage can have an important impact on estimates of spatial variation in stage-specific colon and rectal cancer survival. If population-based cancer registry data are to be effectively used in evaluating and improving cancer care, the quality of the stage data may need to be improve