Strengthening capacity for community and public engagement (CPE): a mixed-methods evaluation of the ‘DELTAS Africa CPE seed fund’ pilot

Background: The ‘DELTAS Africa CPE seed fund’ was a pilot scheme designed to strengthen capacity in community and public engagement (CPE) via a ‘learn by doing’ approach. The scheme supported a total of 25 early career researchers and research support staff belonging to the DELTAS Africa network to design and implement a variety of CPE projects between August 2019 and February 2021. We examine recipient experiences of the DELTAS Africa CPE seed fund initiative, changes in their CPE attitudes, knowledge and proficiency and their CPE practice and/or practice intentions post-award. Methods: A mixed-methods process and performance evaluation drawing on three data sources: An anonymous, online knowledge, attitude and practice survey completed by CPE seed fund awardees pre- and post-project implementation (N=23); semi-structured interviews completed with a sub-sample of awardees and programme implementors (N=9); and ‘end-of-project’ reports completed by all seed fund awardees (N=25). Results: All awardees described their seed fund experience in positive terms, despite invariably finding it more challenging than originally anticipated. The combined survey, interview and end of project report data all uniformly revealed improvement in awardees’ self-reported CPE knowledge, attitudes and proficiency by completion of their respective projects. Commitment to continued CPE activity post award was evident in the survey data and all interviewees were adamant that they would integrate CPE within their respective research work going forward. Conclusion: The DELTAS Africa CPE seed fund appeared to work successfully as a CPE capacity strengthening platform and as a vehicle for fostering longer-term interest in CPE activities

Facility-level intervention to improve attendance and adherence among patients on anti-retroviral treatment in Kenya—a quasi-experimental study using time series analysis

Background: Achieving high rates of adherence to antiretroviral therapy (ART) in resource-poor settings comprises serious, but different, challenges in both the first months of treatment and during the life-long maintenance phase. We measured the impact of a health system-oriented, facility-based intervention to improve clinic attendance and patient adherence. Methods: This was a quasi-experimental, longitudinal, controlled intervention study using interrupted time series analysis. The intervention consisted of (1) using a clinic appointment diary to track patient attendance and monitor monthly performance; (2) changing the mode of asking for self-reported adherence; (3) training staff on adherence concepts, intervention methods, and use of monitoring data; (4) conducting visits to support facility teams with the implementation. We conducted the study in 12 rural district hospitals (6 intervention, 6 control) in Kenya and randomly selected 1894 adult patients over 18 years of age in two cohorts: experienced patients on treatment for at least one year, and newly treated patients initiating ART during the study. Outcome measures were: attending the clinic on or before the date of a scheduled appointment, attending within 3 days of a scheduled appointment, reporting perfect adherence, and experiencing a gap in medication supply of more than 14 days. Results: Among experienced patients, the percentage attending the clinic on or before a scheduled appointment increased in both level (average total increase immediately after intervention) (+5.7%; 95% CI = 2.1, 9.3) and trend (increase per month) (+1.0% per month; 95% CI = 0.6, 1.5) following the intervention, as did the level and trend of those keeping appointments within three days (+4.2%; 95% CI = 1.6, 6.7; and +0.8% per month; 95% CI = 0.6, 1.1, respectively). The relative difference between the intervention and control groups based on the monthly difference in visit rates increased significantly in both level (+6.5; 95% CI = 1.4, 11.6) and trend (1.0% per month; 95% CI = 0.2, 1.8) following the intervention for experienced patients attending the clinic within 3 days of their scheduled appointments. The decrease in the percentage of experienced patients with a medication gap greater than 14 days approached statistical significance (-11.3%; 95% CI = -22.7, 0.1), and the change seemed to persist over 11 months after the intervention. All facility staff used appointment-keeping data to calculate adherence and discussed outcomes regularly. Conclusion: The appointment-tracking system and monthly performance monitoring was strengthened, and patient attendance was improved. Scale-up to national level may be considered

Measuring adherence to antiretroviral treatment in resource-poor settings: The clinical validity of key indicators

<p>Abstract</p> <p>Background</p> <p>Access to antiretroviral therapy has dramatically expanded in Africa in recent years, but there are no validated approaches to measure treatment adherence in these settings.</p> <p>Methods</p> <p>In 16 health facilities, we observed a retrospective cohort of patients initiating antiretroviral therapy. We constructed eight indicators of adherence and visit attendance during the first 18 months of treatment from data in clinic and pharmacy records and attendance logs. We measured the correlation among these measures and assessed how well each predicted changes in weight and CD4 count.</p> <p>Results</p> <p>We followed 488 patients; 63.5% had 100% coverage of medicines during follow-up; 2.7% experienced a 30-day gap in treatment; 72.6% self-reported perfect adherence in all clinic visits; and 19.9% missed multiple clinic visits. After six months of treatment, mean weight gain was 3.9 kg and mean increase in CD4 count was 138.1 cells/mm3.</p> <p>Dispensing-based adherence, self-reported adherence, and consistent visit attendance were highly correlated. The first two types of adherence measure predicted gains in weight and CD4 count; consistent visit attendance was associated only with weight gain.</p> <p>Conclusions</p> <p>This study demonstrates that routine data in African health facilities can be used to monitor antiretroviral adherence at the patient and system level.</p

Measuring adherence to antiretroviral treatment in resource-poor settings: The feasibility of collecting routine data for key indicators

<p>Abstract</p> <p>Background</p> <p>An East African survey showed that among the few health facilities that measured adherence to antiretroviral therapy, practices and definitions varied widely. We evaluated the feasibility of collecting routine data to standardize adherence measurement using a draft set of indicators.</p> <p>Methods</p> <p>Targeting 20 facilities each in Ethiopia, Kenya, Rwanda, and Uganda, in each facility we interviewed up to 30 patients, examined 100 patient records, and interviewed staff.</p> <p>Results</p> <p>In 78 facilities, we interviewed a total of 1,631 patients and reviewed 8,282 records. Difficulties in retrieving records prevented data collection in two facilities. Overall, 94.2% of patients reported perfect adherence; dispensed medicine covered 91.1% of days in a six month retrospective period; 13.7% of patients had a gap of more than 30 days in their dispensed medication; 75.8% of patients attended clinic on or before the date of their next appointment; and 87.1% of patients attended within 3 days.</p> <p>In each of the four countries, the facility-specific median indicators ranged from: 97%-100% for perfect self-reported adherence, 90%-95% of days covered by dispensed medicines, 2%-19% of patients with treatment gaps of 30 days or more, and 72%-91% of appointments attended on time. Individual facilities varied considerably.</p> <p>The percentages of days covered by dispensed medicine, patients with more than 95% of days covered, and patients with a gap of 30 days or more were all significantly correlated with the percentages of patients who attended their appointments on time, within 3 days, or within 30 days of their appointment. Self reported recent adherence in exit interviews was significantly correlated only with the percentage of patients who attended within 3 days of their appointment.</p> <p>Conclusions</p> <p>Field tests showed that data to measure adherence can be collected systematically from health facilities in resource-poor settings. The clinical validity of these indicators is assessed in a companion article. Most patients and facilities showed high levels of adherence; however, poor levels of performance in some facilities provide a target for quality improvement efforts.</p