African primary care research : performing a programme evaluation

CITATION: Dudley, L. 2014. African primary care research: Performing a programme evaluation. African Journal of Primary Health Care & Family Medicine, 6(1): 1-6, doi: 10.4102/phcfm.v6i1.634.The original publication is available at http://www.phcfm.orgThis article is part of a series on Primary Care Research in the African context and focuses on programme evaluation. Different types of programme evaluation are outlined: developmental, process, outcome and impact. Eight steps to follow in designing your programme evaluation are then described in some detail: engage stakeholders; establish what is known; describe the programme; define the evaluation and select a study design; define the indicators; plan and manage data collection and analysis; make judgements and recommendations; and disseminate the findings. Other articles in the series cover related topics such as writing your research proposal, performing a literature review, conducting surveys with questionnaires, qualitative interviewing and approaches to quantitative and qualitative data analysis.http://www.phcfm.org/index.php/phcfm/article/view/634Publisher's versio

The challenges of reshaping disease specific and care oriented community based services towards comprehensive goals: a situation appraisal in the Western Cape Province, South Africa

Similar to other countries in the region, South Africa is currently reorienting a loosely structured and highly diverse community care system that evolved around HIV and TB, into a formalized, comprehensive and integrated primary health care outreach programme, based on community health workers (CHWs). While the difficulties of establishing national CHW programmes are well described, the reshaping of disease specific and care oriented community services, based outside the formal health system, poses particular challenges. This paper is an in-depth case study of the challenges of implementing reforms to community based services (CBS) in one province of South Africa. A multi-method situation appraisal of CBS in the Western Cape Province was conducted over eight months in close collaboration with provincial stakeholders. The appraisal mapped the roles and service delivery, human resource, financing and governance arrangements of an extensive non-governmental organisation (NGO) contracted and CHW based service delivery infrastructure that emerged over 15–20 years in this province. It also gathered the perspectives of a wide range of actors – including communities, users, NGOs, PHC providers and managers - on the current state and future visions of CBS. While there was wide support for new approaches to CBS, there are a number of challenges to achieving this. Although largely government funded, the community based delivery platform remains marginal to the formal public primary health care (PHC) and district health systems. CHW roles evolved from a system of home based care and are limited in scope. There is a high turnover of cadres, and support systems (supervision, monitoring, financing, training), coordination between CHWs, NGOs and PHC facilities, and sub-district capacity for planning and management of CBS are all poorly developed. Reorienting community based services that have their origins in care responses to HIV and TB presents an inter-related set of resource mobilisation, system design and governance challenges. These include not only formalising community based teams themselves, but also the forging of new roles, relationships and mind-sets within the primary health care system, and creating greater capacity for contracting and engaging a plural set of actors - government, NGO and community - at district and sub-district level.Web of Scienc

User assessments and the use of information from MomConnect, a mobile phone text-based information service, by pregnant women and new mothers in South Africa

MomConnect was designed to provide crucial health information to mothers during pregnancy and in the early years of child rearing in South Africa. The design drew on the success of the Mobile Alliance for Maternal Action’s programme in South Africa, as well as a growing list of mobile health (mHealth) interventions implemented internationally. Services such as MomConnect are dependent on user acceptability as all engagements are voluntary, meaning that tools have to be easy to use and useful to be successful. This paper describes the evaluation of the tool by pregnant women and new mothers using the tool. A purposive sample of 32 individual semistructured interviews and 7 focus groups were conducted, across five provinces in South Africa. All the sessions were transcribed and then analysed using a contextualised interpretative approach, with the assistance of Atlas. ti. The women were consistently positive about MomConnect, attaching high value to the content of the messages and the medium in which they were delivered. The system was found to work well, with minor problems in some language translations. Respondents were enthusiastic about the messages, stating that the information was of great use and made them feel empowered in their role as a mother, with some saving the messages to use as a resource or to share with others. The most significant problems related to network coverage. There was strong support for this intervention to continue. Given the user acceptability of mHealth interventions, MomConnect appeared to meet the target of identifying and responding to the recipient’s needs

The acceptability of three vaccine injections given to infants during a single clinic visit in South Africa

BACKGROUND: The Expanded Programme on Immunisation (EPI) has increased the number of antigens and injections administered at one visit. There are concerns that more injections at a single immunisation visit could decrease vaccination coverage. We assessed the acceptability and acceptance of three vaccine injections at a single immunisation visit by caregivers and vaccinators in South Africa. METHODS: A mixed methods exploratory study of caregivers and vaccinators at clinics in two provinces of South Africa was conducted. Quantitative and qualitative data were collected using questionnaires as well as observations of the administration of three-injection vaccination sessions. RESULTS: The sample comprised 229 caregivers and 98 vaccinators. Caregivers were satisfied with the vaccinators’ care (97 %) and their infants receiving immunisation injections (93 %). However, many caregivers, (86 %) also felt that three or more injections were excessive at one visit. Caregivers had limited knowledge of actual vaccines provided, and reasons for three injections. Although vaccinators recognised the importance of informing caregivers about vaccination, they only did this sometimes. Overall, acceptance of three injections was high, with 97 % of caregivers expressing willingness to bring their infant for three injections again in future visits despite concerns about the pain and discomfort that the infant experienced. Many (55 %) vaccinators expressed concern about giving three injections in one immunisation visit. However, in 122 (95 %) observed three-injection vaccination sessions, the vaccinators administered all required vaccinations for that visit. The remaining seven vaccinations were not completed because of vaccine stock-outs. CONCLUSIONS: We found high acceptance by caregivers and vaccinators of three injections. Caregivers’ poor understanding of reasons for three injections resulted from limited information sharing by vaccinators for caregivers. Acceptability of three injections may be improved through enhanced vaccinator-caregiver communication, and improved management of infants’ pain. Vaccinator training should include evidence-informed ways of communicating with caregivers and reducing injection pain. Strategies to improve acceptance and acceptability of three injections should be rigorously evaluated as part of EPI’s expansion in resource-limited countries.IS

Perceptions about data-informed decisions: an assessment of information-use in high HIV-prevalence settings in South Africa

BACKGROUND: Information-use is an integral component of a routine health information system and essential to influence policy-making, program actions and research. Despite an increased amount of routine data collected, planning and resource-allocation decisions made by health managers for managing HIV programs are often not based on data. This study investigated the use of information, and barriers to using routine data for monitoring the prevention of mother-to-child transmission of HIV (PMTCT) programs in two high HIV-prevalence districts in South Africa. METHODS: We undertook an observational study using a multi-method approach, including an inventory of facility records and reports. The performance of routine information systems management (PRISM) diagnostic ‘Use of Information’ tool was used to assess the PMTCT information system for evidence of data use in 57 health facilities in two districts. Twenty-two in-depth interviews were conducted with key informants to investigate barriers to information use in decision-making. Participants were purposively selected based on their positions and experience with either producing PMTCT data and/or using data for management purposes. We computed descriptive statistics and used a general inductive approach to analyze the qualitative data. RESULTS: Despite the availability of mechanisms and processes to facilitate information-use in about two-thirds of the facilities, evidence of information-use (i.e., indication of some form of information-use in available RHIS reports) was demonstrated in 53% of the facilities. Information was inadequately used at district and facility levels to inform decisions and planning, but was selectively used for reporting and monitoring program outputs at the provincial level. The inadequate use of information stemmed from organizational issues such as the lack of a culture of information-use, lack of trust in the data, and the inability of program and facility managers to analyze, interpret and use information. CONCLCUSIONS: Managers’ inability to use information implied that decisions for program implementation and improving service delivery were not always based on data. This lack of data use could influence the delivery of health care services negatively. Facility and program managers should be provided with opportunities for capacity development as well as practice-based, in-service training, and be supported to use information for planning, management and decision-making

Risk factors for Coronavirus disease 2019 (Covid-19) death in a population cohort study from the Western Cape province, South Africa

Risk factors for coronavirus disease 2019 (COVID-19) death in sub-Saharan Africa and the effects of human immunodeficiency virus (HIV) and tuberculosis on COVID-19 outcomes are unknown. We conducted a population cohort study using linked data from adults attending public-sector health facilities in the Western Cape, South Africa. We used Cox proportional hazards models, adjusted for age, sex, location, and comorbidities, to examine the associations between HIV, tuberculosis, and COVID-19 death from 1 March to 9 June 2020 among (1) public-sector “active patients” (≥1 visit in the 3 years before March 2020); (2) laboratory-diagnosed COVID-19 cases; and (3) hospitalized COVID-19 cases. We calculated the standardized mortality ratio (SMR) for COVID-19, comparing adults living with and without HIV using modeled population estimates.Among 3 460 932 patients (16% living with HIV), 22 308 were diagnosed with COVID-19, of whom 625 died. COVID19 death was associated with male sex, increasing age, diabetes, hypertension, and chronic kidney disease. HIV was associated with COVID-19 mortality (adjusted hazard ratio [aHR], 2.14; 95% confidence interval [CI], 1.70–2.70), with similar risks across strata of viral loads and immunosuppression. Current and previous diagnoses of tuberculosis were associated with COVID-19 death (aHR, 2.70 [95% CI, 1.81–4.04] and 1.51 [95% CI, 1.18–1.93], respectively). The SMR for COVID-19 death associated with HIV was 2.39 (95% CI, 1.96–2.86); population attributable fraction 8.5% (95% CI, 6.1–11.1)

Strategies for integrating primary health services in low- and middle-income countries at the point of delivery (Review)

Background In some low- and middle-income countries, separate vertical programmes deliver specific life-saving interventions but can fragment services. Strategies to integrate services aim to bring together inputs, organisation, and delivery of particular functions to increase efficiency and people’s access.We examined the evidence on the effectiveness of integration strategies at the point of delivery (sometimes termed ’linkages’), including integrated delivery of tuberculosis (TB), HIV/AIDS and reproductive health programmes. Objectives To assess the effects of strategies to integrate primary health care services on healthcare delivery and health status in low- and middleincome countries. Search strategy We searched The Cochrane Central Register of Controlled Trials (CENTRAL) 2010, Issue 3, part of the The Cochrane Library. www.thecochranelibrary.com, including the Cochrane Effective Practice andOrganisation of Care Group Specialised Register (searched 15 September 2010); MEDLINE, Ovid (1950 to August Week 5 2010) (searched 10 September 2010); EMBASE, Ovid (1980 to 2010 Week 35) (searched 10 September 2010); CINAHL, EBSCO (1980 to present) (searched 20 September 2010); Sociological Abstracts, CSA Illumina (1952 to current) (searched 10 September 2010); Social Services Abstracts, CSA Illumina (1979 to current) (searched 10 September 2010); POPLINE (1970 to current) (searched 10 September 2010); International Bibliography of the Social Sciences,Webspirs (1951 to current) (searched 01 July 2008); HealthStar (1975 to September 2005), Cab Health (1972 to 1999), and reference lists of articles.We also searched the World Health Organization (WHOLIS) library database, handsearched relevant WHO publications, and contacted experts in the field. Selection criteria Randomised controlled trials, non-randomised controlled trials, controlled before and after studies, and interrupted time series analyses of integration strategies, including strengthening linkages, in primary health care services. Health services in high-income countries, private public partnerships, and hospital inpatient care were excluded as were programmes promoting the integrated management of childhood illnesses. The main outcomes were indicators of healthcare delivery, user views, and health status. Data collection and analysis Two authors independently extracted data and assessed the risk of bias. The statistical results of individual studies are reported and summarised. Main results Five randomised trials and four controlled before and after studies were included. The interventions were complex. Five studies added an additional component, or linked a new component, to an existing service, for example, adding family planning or HIV counselling and testing to routine services. The evidence from these studies indicated that adding on services probably increases service utilisation but probably does not improve health status outcomes, such as incident pregnancies. Four studies compared integrated services to single, special services. Based on the included studies, fully integrating sexually transmitted infection (STI) and family planning, and maternal and child health services into routine care as opposed to delivering them as special ’vertical’ services may decrease utilisation, client knowledge of and satisfaction with the services and may not result in any difference in health outcomes, such as child survival. Integrating HIV prevention and control at facility and community level improved the effectiveness of certain services (STI treatment in males) but resulted in no difference in health seeking behaviour, STI incidence, or HIV incidence in the population. Authors’ conclusions There is some evidence that ’adding on’ services (or linkages) may improve the utilisation and outputs of healthcare delivery. However, there is no evidence to date that a fuller form of integration improves healthcare delivery or health status. Available evidence suggests that full integration probably decreases the knowledge and utilisation of specific services and may not result in any improvements in health status. More rigorous studies of different strategies to promote integration over a wider range of services and settings are needed. These studies should include economic evaluation and the views of clients as clients’ views will influence the uptake of integration strategies at the point of delivery and the effectiveness on community health of these strategies

Continuity of care for tuberculosis patients between hospital and primary health care services in South Africa

Thesis (PhD)--Stellenbosch University, 2020.ENGLISH ABSTRACT : Many tuberculosis (TB) patients in South Africa are admitted to acute care hospitals, but large numbers are lost to care after discharge, and few complete their TB treatment. This contributes to ongoing transmission of TB in communities, frequent hospital readmissions, a high mortality rate and avoidable costs to the health system and society. This thesis studied continuity of care for TB patients discharged from hospital in South Africa. It aimed to describe the problem, identify risk factors for poor continuity of care, synthesise evidence to inform, implement and evaluate an intervention, and produce a policy brief to translate the evidence into policy and practice. The research methods included an observational study, research synthesis, qualitative research, participatory action research, a quasi-experimental study as well as knowledge translation methods to address the various research questions. The study found that a third of TB patients discharged from hospital did not continue TB treatment, and that inadequate clinical management of TB patients in hospital showed a significant correlation with poorer continuity of care and an increased mortality rate. Evidence of strategies to improve continuity of care for chronically ill patients was identified in high-income countries, but no such evidence could be found for TB patients in low and middle-income countries. Using the available evidence and participatory action research, a multicomponent discharge planning and support intervention was designed and implemented in collaboration with a referral hospital in the Western Cape. A before-and-after evaluation found that continuity of care for TB patients improved significantly after implementing the intervention. A process assessment revealed that the characteristics of the intervention, the external context, the persons involved and the methods of implementation had a favourable impact on implementation. Yet the internal context of the hospital was unfavourable for implementation, and in-hospital intervention activities were not sustained. In contrast, information linkages and community-based follow-up and support of TB patients continued. More rigorous studies of interventions to improve continuity of care for TB patients discharged from hospital in similar settings are required. This should be complemented by implementation research to understand and address health systems challenges. Both types of research are needed to effectively translate evidence into practice in the health systems of low and middle-income countries.AFRIKAANSE OPSOMMING : Vele tuberkulose- (TB-) pasiënte in Suid-Afrika word in die akute sorg hospitaal opgeneem, maar baie verdwyn uit die sorgstelsel ná ontslag, en weinig voltooi hulle TB-behandeling. Dít dra by tot aanhoudende TB-oordrag in gemeenskappe, gereelde hospitaalhertoelating, ’n hoë sterftesyfer en vermybare koste vir die gesondheidstelsel en samelewing. Hierdie studie het ondersoek ingestel na die kontinuïteit van sorg vir TB-pasiënte wat uit hospitale in Suid-Afrika ontslaan word. Die doel was om die probleem te beskryf, risikofaktore vir swak kontinuïteit van sorg te identifiseer, bewyse saam te voeg en op grond daarvan ’n intervensie te ontwerp, te implementeer en te evalueer, en ’n beleidsriglyn op te stel om die bewyse in beleid en praktyk om te skakel. Die navorsingsmetodes het ingesluit ’n waarnemingstudie, navorsingsintese, kwalitatiewe navorsing, deelnemende aksienavorsing, ’n kwasi-eksperimentele studie en kennisoordragmetodes om die verskillende navorsingsvraagstukke te ondersoek. Die resultate dui daarop dat ’n derde van TB-pasiënte wat uit die hospitaal ontslaan word, nie met TB-behandeling voortgaan nie, en dat onvoldoende kliniese bestuur van TB-pasiënte in die hospitaal ’n beduidende verband toon met swakker sorgkontinuïteit en ’n hoër sterftesyfer. Bewyse van strategieë om sorgkontinuïteit vir chroniese siek pasiënte te verbeter is in hoë-inkomstelande geïdentifiseer; tog is daar geen bewyse van soortgelyke strategieë vir TB-pasiënte in lae- en middelinkomstelande nie. Met behulp van die beskikbare bewyse en deelnemende aksienavorsing is ’n ontslagbeplanning- en ondersteuningsintervensie met verskeie komponente derhalwe in samewerking met ’n verwysingshospitaal in die Wes-Kaap ontwerp en geïmplementeer. ’n Evaluering voor en ná die tyd bevind dat sorgkontinuïteit vir TB-pasiënte aansienlik verbeter het nadat die intervensie geïmplementeer is. Volgens ’n prosesbeoordeling het die kenmerke van die intervensie, die eksterne konteks, die betrokke persone en die implementeringsmetodes ’n gunstige uitwerking op implementering gehad. Die interne konteks van die hospitaal was egter ongunstig vir implementering, en die hospitaal het nie met intervensieaktiwiteite volgehou nie. Daarteenoor is inligtingsteun en gemeenskapsgebaseerde nasorg en ondersteuning van TB-pasiënte wél voortgesit. Verdere wetenskaplike studies van intervensies ter verbetering van sorgkontinuïteit vir TB-pasiënte wat in soortgelyke omgewings uit die hospitaal ontslaan word, word vereis. Dít behoort aangevul te word met implementeringsnavorsing om die uitdagings van gesondheidstelsels te verstaan en die hoof te bied. Albei tipes navorsing is nodig om bewyse in die gesondheidstelsels van lae- en middelinkomstelande in praktyk om te skakel.Doctora