Risk classification in an emergency room: agreement level between a Brazilian institutional and the Manchester Protocol

The aim of this study was to assess the level of agreement between an institutional protocol and the Manchester protocol for the risk assessment of patients attended in an emergency room of a public hospital in Belo Horizonte - MG - Brazil. This is a descriptive and comparative study, in which 382 patients' reports were evaluated and the risk was classified, using the institutional protocol and the Manchester protocol. Rates were calculated through weighted and unweighted kappa, in order to determine the level of agreement between the protocols. The results showed that the correlation between the protocols is average when considering that classification errors occurred between neighboring colors (kappa=0.48), and good when considering that classification errors occurred between extreme colors (kappa=0.61). The Manchester protocol increased the patients' level of priority of patients and has been considered more inclusive.Este estudio tuvo por objetivo verificar el grado de concordancia entre un protocolo institucional y el protocolo de Manchester para la clasificación de riesgo de pacientes atendidos en primeros auxilios de un hospital público de Belo Horizonte - MG - Brasil. Se trata de estudio descriptivo comparativo en el cual 382 fichas fueron evaluadas y, realizada la clasificación de riesgo utilizando los protocolos mencionados encima, a partir del registro realizado por los enfermeros. Índices kappa ponderado y no ponderado fueron calculados para determinar el grado de concordancia entre los protocolos. Los resultados mostraron que la concordancia entre los protocolos es media, cuando considerados los errores de clasificación ocurridos entre colores vecinos (kappa=0,48) y buena, cuando considerados los errores de clasificación ocurridos entre colores extremos (kappa=0,61). Se concluye que el protocolo de Manchester aumentó el nivel de prioridad de los pacientes, demostrando ser un protocolo que incluye más.Este estudo teve por objetivo verificar o grau de concordância entre um protocolo institucional e o protocolo de Manchester, para a classificação de risco de pacientes atendidos no pronto-socorro de um hospital público de Belo Horizonte, MG, Brasil. Trata-se de estudo descritivo comparativo, no qual 382 prontuários foram avaliados e realizada a classificação de risco, utilizando os protocolos mencionados acima, a partir do registro realizado pelos enfermeiros. Índices Kappa ponderado e não ponderado foram calculados para determinar o grau de concordância entre os protocolos. Os resultados mostraram que a concordância entre os protocolos é média, quando considerados os erros de classificação, ocorridos entre cores vizinhas (Kappa=0,48) e boa, quando considerados os erros de classificação, ocorridos entre cores extremas (Kappa=0,61). Conclui-se que o protocolo de Manchester aumentou o nível de prioridade dos pacientes, demonstrando ser protocolo mais inclusivo

Development and testing of a composite index to monitor the continuum of maternal health service delivery at provincial and district level in South Africa

The continuum of care is a recommended framework for comprehensive health service delivery for maternal health, and it integrates health system and social determinants of health. There is a current lack of knowledge on a measurement approach to monitor performance on the framework. In this study we aim to develop and test a composite index for assessing the maternal health continuum in a province in South Africa with the possibility of nationwide use

Development of a supported self-management intervention for adults with type 2 diabetes and a learning disability

Background: Although supported self-management is a well-recognised part of chronic disease management, it has not been routinely used as part of healthcare for adults with a learning disability. We developed an intervention for adults with a mild or moderate learning disability and type 2 diabetes, building on the principles of supported self-management with reasonable adjustments made for the target population. Methods: In five steps, we: 1. Clarified the principles of supported self-management as reported in the published literature 2. Identified the barriers to effective self-management of type 2 diabetes in adults with a learning disability 3. Reviewed existing materials that aim to support self-management of diabetes for people with a learning disability 4. Synthesised the outputs from the first three phases and identified elements of supported self-management that were (a) most relevant to the needs of our target population and (b) most likely to be acceptable and useful to them 5. Implemented and field tested the intervention Results: The final intervention had four standardised components: (1) establishing the participant’s daily routines and lifestyle, (2) identifying supporters and their roles, (3) using this information to inform setting realistic goals and providing materials to the patient and supporter to help them be achieved and (4) monitoring progress against goals. Of 41 people randomised in a feasibility RCT, thirty five (85%) completed the intervention sessions, with over three quarters of all participants (78%) attending at least three sessions. Twenty-three out of 40 (58%) participants were deemed to be very engaged with the sessions and 12/40 (30%) with the materials; 30 (73%) participants had another person present with them during at least one of their sessions; 15/41 (37%) were reported to have a very engaged main supporter, and 18/41 (44%) had a different person who was not their main supporter but who was engaged in the intervention implementation. Conclusions: The intervention was feasible to deliver and, as judged by participation and engagement, acceptable to participants and those who supported them. Trial registration: Current Controlled Trials ISRCTN41897033 (registered 21/01/2013)

Reliability and validity of emergency department triage systems

Reliability and validity of triage systems is important because this can affect patient safety. In this thesis, these aspects of two emergency department (ED) triage systems were studied as well as methodological aspects in these types of studies. The consistency, reproducibility, and criterion validity of the Manchester Triage System (MTS) were studied in chapter 2. The consistency and reproducibility appeared to be ‘substantial’ and ‘high’. However, substantial percentages mistriage occurred. This was further studied in chapter 3 by reviewing weighting schemes for calculating a weighted kappa. It was found that the existing weighting schemes rewarded mistriage too extensively. Therefore, triage weighted kappa was developed and applied. Triage weighted kappa decreased the reliability of triage systems substantially. Besides these shortcomings, the value of kappa depends on the distribution of the data. Therefore, in chapter 4 an approach was developed on how to interprete and compare the reliability of triage systems. The reliability should be interpreted by plotting the kappa against the minimum, normal, and maximum kappa, to obtain information about the skewness of the data. Comparisons between systems can be made by calculating a normal kappa a so that equal chance corrections are obtained. Because this approach affects sample size calculations, in chapter 5 sample size calculation methods for reliability studies were reviewed. Currently no sample size calculation methods exist for reliability studies conducted to ordinal measurement scales such as triage systems. When calculating sample sizes it is important to take into account the dependence of kappa on the distribution of data by setting the null- and alternative hypothesis to the maximum kappa or by setting the confidence interval width to a maximum of 0.10. In chapter 6 the construct validity of the MTS and Emergency Severity Index (ESI) were studied. The ESI was more strongly associated with hospital admission than the MTS. Concerning ED mortality, patients in the more urgent categories of both systems were at increased risk of dying. A small number of patients did not require ESI resources but were admitted to the hospital or sent to the outpatient department. In chapter 7 it appeared that these patients were most likely elderly, referred, or presenting with ‘post operative complications, wound care problems and plaster problems’. Because of this small but structural flaw the ESI guidelines needs revisions concerning these patient groups. Chapter 8 focussed on pain assessments at triage with the MTS. Pain was assessed in nearly one third of the patients who required an assessment according to the guidelines. Nurses mentioned several reasons for not assessing pain at triage including overtriage, time constraints and difficulties with interpreting pain. The reported reasons indicated that the MTS guidelines should describe more precisely how to assess pain. Although both systems’ guidelines need revisions, the studies described in this thesis indicate that the ESI is more reliable and valid than the MTS. Methodologically, one should critically review existing weighting schemes before applying one, and account for the distribution of data when interpreting reliability. These suggestions will reflect the reliability more in accordance with clinical practice