Evaluating inter-rater reliability of indicators to assess performance of medicines management in health facilities in Uganda

Background: To build capacity in medicines management, the Uganda Ministry of Health introduced a nationwide supervision, performance assessment and recognition strategy (SPARS) in 2012. Medicines management supervisors (MMS) assess performance using 25 indicators to identify problems, focus supervision, and monitor improvement in medicines stock and storage management, ordering and reporting, and prescribing and dispensing. Although the indicators are well-recognized and used internationally, little was known about the reliability of these indicators. An initial assessment of inter-rater reliability (IRR), which measures agreement among raters (i.e., MMS), showed poor IRR; subsequently, we implemented efforts to improve IRR. The aim of this study was to assess IRR for SPARS indicators at two subsequent time points to determine whether IRR increased following efforts to improve reproducibility. Methods: IRR was assessed in 2011 and again after efforts to improve IRR in 2012 and 2013. Efforts included targeted training, providing detailed guidelines and job aids, and refining indicator definitions and response categories. In the assessments, teams of three MMS measured 24 SPARS indicators in 26 facilities. We calculated IRR as a team agreement score (i.e., percent of the MMS teams in which all three MMS had the same score). Two sample tests for proportions were used to compare IRR scores for each indicator, domain, and overall for the initial assessment and the following two assessments. We also compared the IRR scores for indicators classified as simple (binary) versus complex (multi-component). Logistic regression was used to identify supervisor group characteristics associated with domain-specific and overall IRR scores. Results: Initially only five (21%) indicators had acceptable reproducibility, defined as an IRR score ≥ 75%. At the initial assessment, prescribing quality indicators had the lowest and stock management indicators had the highest IRR. By the third IRR assessment, 12 (50%) indicators had acceptable reproducibility, and the overall IRR score improved from 57% to 72%. The IRR of simple indicators was consistently higher than that of complex indicators in the three assessment periods. We found no correlation between IRR scores and MMS experience or professional background. Conclusions: Assessments of indicator reproducibility are needed to improve IRR. Using simple indicators is recommended. Electronic supplementary material The online version of this article (10.1186/s40545-018-0137-y) contains supplementary material, which is available to authorized users

Uganda's experience in Ebola virus disease outbreak preparedness, 2018-2019.

BACKGROUND: Since the declaration of the 10th Ebola Virus Disease (EVD) outbreak in DRC on 1st Aug 2018, several neighboring countries have been developing and implementing preparedness efforts to prevent EVD cross-border transmission to enable timely detection, investigation, and response in the event of a confirmed EVD outbreak in the country. We describe Uganda's experience in EVD preparedness. RESULTS: On 4 August 2018, the Uganda Ministry of Health (MoH) activated the Public Health Emergency Operations Centre (PHEOC) and the National Task Force (NTF) for public health emergencies to plan, guide, and coordinate EVD preparedness in the country. The NTF selected an Incident Management Team (IMT), constituting a National Rapid Response Team (NRRT) that supported activation of the District Task Forces (DTFs) and District Rapid Response Teams (DRRTs) that jointly assessed levels of preparedness in 30 designated high-risk districts representing category 1 (20 districts) and category 2 (10 districts). The MoH, with technical guidance from the World Health Organisation (WHO), led EVD preparedness activities and worked together with other ministries and partner organisations to enhance community-based surveillance systems, develop and disseminate risk communication messages, engage communities, reinforce EVD screening and infection prevention measures at Points of Entry (PoEs) and in high-risk health facilities, construct and equip EVD isolation and treatment units, and establish coordination and procurement mechanisms. CONCLUSION: As of 31 May 2019, there was no confirmed case of EVD as Uganda has continued to make significant and verifiable progress in EVD preparedness. There is a need to sustain these efforts, not only in EVD preparedness but also across the entire spectrum of a multi-hazard framework. These efforts strengthen country capacity and compel the country to avail resources for preparedness and management of incidents at the source while effectively cutting costs of using a "fire-fighting" approach during public health emergencies

Survey on retail prices of prescription drugs in Uganda : an inter-regional comparison

Bibliography: leaves 65-69.The main concern of this study was to detemine factors that are responsible for disparities in retail prices of prescription drugs in Uganda. The study also came out with methods that can be used to minimise these disparities and to control retail prices of prescription drugs in Uganda

Inter-rater reliability and validity of good pharmacy practices measures in inspection of public sector health facility pharmacies in Uganda

Abstract Background The National Drug Authority (NDA) inspects and certifies private and public sector pharmacies in Uganda using an indicator-based inspection tool that measures adherence to good pharmacy practices (GPP). 67 measures identify the situation in the domains of premises, dispensing quality, stores management, and operating requirements. Although the GPP measures are well-recognized and used internationally, little is known about their validity and reliability. The study aimed to assess validity, which measures agreement of GPP measures between a gold standard inspector and NDA inspector and inter-rater reliability (IRR), which measures agreement among NDA inspectors, of GPP measures. Methods We assessed validity and IRR by four teams of inspectors in eight government health facilities that represent three levels of care. Each team inspected two facilities, resulting in 24 total inspections. Each team comprised one central-level inspector, one district-level inspector, and one gold-standard inspector (i.e., a very experienced central-level inspector). We calculated median validity and IRR for each GPP measure, overall, indicator categorized as either critical, major, or minor, by domains, by the inspection decision (i.e., certified or not certified) and by adequatevalidity and IRR score (i.e., score ≥ 75%). Results The median validity for all GPP measures was 69%, with 29 (43%) measures having an adequate validity of ≥75%. The median IRR for all GPP measures was 71%, with 31 (46%) having an adequate IRR measure of ≥75%. Validity did not differ significantly by indicator category, domain or level of care. Adequate IRR and validity score (≥75%) was lowest for critical measures, which are key determinants of the certification decision, scoring 20 and 40% respectively. District inspectors had lower median validity for critical indicators and premises and higher validity for store management. Compared to central inspectors, the validity of district inspectors’certification decisions was lower; in the eight facilities, three district inspectors agreed with gold standard inspector vs. all eight central inspectors. Conclusions Our findings question the validity and reliability of many GPP inspection measures, particularly critical measures that greatly impact certification decision. This study demonstrates the need for assessments of, and interventions to improve, validity and reproducibility of GPP measures and inspections

Pharmaceutical system strengthening in Uganda: implementing a holistic, evidence-informed, long-term strategy

Abstract A strong pharmaceutical sector is a precondition for effective and efficient health care and financing systems, and thus for achieving the best possible health of a population. Supported by visionary, long-term donor funds, in conjunction with mutual trust, the USAID-funded Securing Ugandans Rights to Essential Medicines (SURE) and Uganda Health Supply Chain (UHSC) program engaged in a close, more than 10 year-long (in 2018) collaboration with the Ministry of Health of Uganda. Over time, the partnership implemented numerous multi-pronged comprehensive changes in the pharmaceutical sector and conducted research to document successes and failures. We describe the evolution and key characteristics of the SURE/UHSC interventions

Additional file 3: of Evaluating inter-rater reliability of indicators to assess performance of medicines management in health facilities in Uganda

Illustrative example of IRR score calculation for SPARS indicators, sub-indicators, and domains across the rater teams. (PDF 99 kb

Additional file 4: of Evaluating inter-rater reliability of indicators to assess performance of medicines management in health facilities in Uganda

IRR score for the rational drug use sub indicators assessments 1–3. (PDF 502 kb

Development and evaluation of a continuous quality improvement programme for antimicrobial stewardship in six hospitals in Uganda

Background Appropriate antimicrobial use is essential for antimicrobial stewardship (AMS). Ugandan hospitals are making efforts to improve antibiotic use, but improvements have not been sufficiently documented and evaluated.Methods Six Ugandan hospitals implemented AMS interventions between June 2019 and July 2022. We used the WHO AMS toolkit to set-up hospital AMS programmes and implemented interventions using continuous quality improvement (CQI) techniques and targeting conditions commonly associated with antibiotic misuse, that is, urinary tract infections (UTIs), upper respiratory tract infections (URTIs) and surgical antibiotic prophylaxis (SAP). The interventions included training, mentorship and provision of clinical guidelines to support clinical decision-making. Quarterly antibiotic use surveys were conducted.Results Data were collected for 7037 patients diagnosed with UTIs. There was an increase in the proportion of patients receiving one antibiotic for the treatment of UTI from 48% during the pre-intervention to 73.2%, p<0.01. There was a 19.2% reduction in the number of antimicrobials per patient treated for UTI p<0.01. There was an increase in use of nitrofurantoin, the first-line drug for the management of UTI. There was an increase in the use of Access antibiotics for managing UTIs from 50.4% to 53.8%. The proportion of patients receiving no antimicrobials for URTI increased from 26.3% at pre-intervention compared with 53.4% at intervention phase, p<0.01. There was a 20.7% reduction in the mean number of antimicrobials per patient for URTI from the pre-intervention to the intervention phase, from 0.8 to 0.6, respectively, p<0.001 and reduction in the number of treatment days, p=0.0163. Among patients undergoing surgery, 49.5% (2212) received SAP during the pre-intervention versus 50.5% (2169) during the intervention.Conclusions Using CQI approaches to focus on specific causes of inappropriate antibiotic use led to desirable overall reductions in antibiotic use for URTI and UTI

Point Prevalence Survey of Antibiotic Use across 13 Hospitals in Uganda

Standardized monitoring of antibiotic use underpins the effective implementation of antimicrobial stewardship interventions in combatting antimicrobial resistance (AMR). To date, few studies have assessed antibiotic use in hospitals in Uganda to identify gaps that require intervention. This study applied the World Health Organization’s standardized point prevalence survey methodology to assess antibiotic use in 13 public and private not-for-profit hospitals across the country. Data for 1077 patients and 1387 prescriptions were collected between December 2020 and April 2021 and analyzed to understand the characteristics of antibiotic use and the prevalence of the types of antibiotics to assess compliance with Uganda Clinical Guidelines; and classify antibiotics according to the WHO Access, Watch, and Reserve classification. This study found that 74% of patients were on one or more antibiotics. Compliance with Uganda Clinical Guidelines was low (30%); Watch-classified antibiotics were used to a high degree (44% of prescriptions), mainly driven by the wide use of ceftriaxone, which was the most frequently used antibiotic (37% of prescriptions). The results of this study identify key areas for the improvement of antimicrobial stewardship in Uganda and are important benchmarks for future evaluations

Trends in access to anti‐malarial treatment in the formal private sector in Uganda: an assessment of availability and affordability of first‐line anti‐malarials and diagnostics between 2007 and 2018

Background: Malaria is the single largest cause of illness in Uganda. Since the year 2008, the Global Fund has rolled out several funding streams for malaria control in Uganda. Among these are mechanisms aimed at increasing the availability and affordability of artemisinin-based combination therapy (ACT). This paper examines the availability and affordability of first-line malaria treatment and diagnostics in the private sector, which is the preferred first point of contact for 61% of households in Uganda between 2007 and 2018. Methods: Cross-sectional surveys were conducted between 2007 and 2018, based on a standardized World Health Organization/Health Action International (WHO/HAI) methodology adapted to assess availability, patient prices, and affordability of ACT medicines in private retail outlets. A minimum of 30 outlets were surveyed per year as prescribed by the standardized methodology co-developed by the WHO and Health Action International. Availability, patient prices, and affordability of malaria rapid diagnostic tests (RDTs) was also tracked from 2012 following the rollout of the test and treat policy in 2010. The median patient prices for the artemisinin-based combinations and RDTs was calculated in US dollars (USD). Affordability was assessed by computing the number of days’ wages the lowest-paid government worker (LPGW) had to pay to purchase a treatment course for acute malaria. Results: Availability of artemether/lumefantrine (A/L), the first-line ACT medicine, increased from 85 to100% in the private sector facilities during the study period. However, there was low availability of diagnostic tests in private sector facilities ranging between 13% (2012) and 37% (2018). There was a large reduction in patient prices for an adult treatment course of A/L from USD 8.8 in 2007 to USD 1.1 in 2018, while the price of diagnostics remained mostly stagnant at USD 0.5. The affordability of ACT medicines and RDTs was below one day’s wages for LPGW. Conclusions: Availability of ACT medicines in the private sector medicines retail outlets increased to 100% while the availability of diagnostics remained low. Although malaria treatment was affordable, the price of diagnostics remained stagnant and increased the cumulative cost of malaria management. Malaria stakeholders should consolidate the gains made and consider the inclusion of diagnostic kits in the subsidy programme