Monitoring patient care through health facility exit interviews: an assessment of the Hawthorne effect in a trial of adherence to malaria treatment guidelines in Tanzania.

BACKGROUND: Survey of patients exiting health facilities is a common way to assess consultation practices. It is, however, unclear to what extent health professionals may change their practices when they are aware of such interviews taking place, possibly paying more attention to following recommended practices. This so-called Hawthorne effect could have important consequences for interpreting research and programme monitoring, but has rarely been assessed. METHODS: A three-arm cluster-randomised trial of interventions to improve adherence to guidelines for the use of anti-malarial drugs was conducted in Tanzania. Patient interviews were conducted outside health facilities on two randomly-selected days per week. Health workers also routinely documented consultations in their ledgers. The Hawthorne effect was investigated by comparing routine data according to whether exit interviews had been conducted on three key indicators of malaria care. Adjusted logistic mixed-effects models were used, taking into account the dependencies within health facilities and calendar days. RESULTS: Routine data were collected on 19,579 consultations in 18 facilities. The odds of having a malaria rapid diagnostic test (RDT) result reported were 11 % higher on days when exit surveys were conducted (adjusted odds ratio 95 % CI: 0.98-1.26, p = 0.097), 17 % lower for prescribing an anti-malarial drug to patients with a negative RDT result (0.56-1.23, p = 0.343), and 27 % lower for prescribing an anti-malarial when no RDT result was reported (0.53-1.00, p = 0.052). The effect varied with time, with a U-shaped association over the study period (p < 0.001). We also observed a higher number of consultations recorded on days when exit-interviews were conducted (adjusted mean difference = 2.03, p < 0.001). CONCLUSIONS: Although modest, there was some suggestion of better practice by health professionals on days when exit interviews were conducted. Researchers should be aware of the potential Hawthorne effect, and take into account assessment methods when generalising findings to the 'real word' setting. This effect is, however, likely to be context dependent, and further controlled evaluation across different settings should be conducted. TRIAL REGISTRATION: ClinicalTrials.gov: NCT01292707 . Registered on 29th January 2011

"It is good to take her early to the doctor" - mothers' understanding of childhood pneumonia symptoms and health care seeking in Kilimanjaro region, Tanzania.

BACKGROUND: Pneumonia is among the leading causes of avoidable deaths for young children globally. The main burden of mortality falls on children from poor and rural families who are less likely to obtain the treatment they need, highlighting inequities in access to effective care and treatment. Caretakers' illness perceptions and care-seeking practices are of major importance for children with pneumonia to receive adequate care. This study qualitatively explores the caretaker concepts of childhood pneumonia in relation to treatment seeking behaviour and health worker management in Moshi urban district, Tanzania. METHODS: In May - July 2013 data was gathered through different qualitative data collection techniques including five focus group discussions (FGDs) with mothers of children under-five years of age. The FGDs involved free listing of pneumonia symptoms and video presentations of children with respiratory symptoms done, these were triangulated with ten case narratives with mothers of children admitted with pneumonia and eleven in-depth interviews with hospital health workers. Transcripts were coded and analysed using qualitative content analysis. RESULTS: Mothers demonstrated good awareness of common childhood illnesses including pneumonia, which was often associated with symptoms such as cough, flu, chest tightness, fever, and difficulty in breathing. Mothers had mixed views on causative factors and treatments options but generally preferred modern medicine for persisting and severe symptoms. However, all respondent reported access to health facilities as a barrier to care, associated with transport, personal safety and economic constraints. CONCLUSION: Local illness concepts and traditional treatment options did not constitute barriers to care for pneumonia symptoms. Poor access to health facilities was the main barrier. Decentralisation of care through community health workers may improve access to care but needs to be combined with strengthened referral systems and accessible hospital care for those in need

The development of effective behaviour change interventions to support the use of malaria rapid diagnostic tests by Tanzanian clinicians.

BACKGROUND: Parasitological confirmation is now recommended for all cases of suspected malaria. The roll-out of rapid diagnostic tests (RDTs) is hoped to enable this goal in low resource settings through point of care testing. However, simply making RDTs available has not led to high uptake of the tests or adherence to results by clinicians, with malaria continuing to be overdiagnosed in many settings. We undertook to design an evidence-based intervention package that would be sufficient to support the introduction of RDTs at dispensaries in Tanzania, to be evaluated through the Targeting Artemisinin Combination Therapy (TACT) cluster randomised controlled trial. METHODS: We describe five steps in our intervention design: formative research, review of existing evidence and theory, a workshop to define the intervention approach and content and results of formative research, engagement with behaviour change theory and literature, detailed design of intervention materials and piloting and pretesting of intervention materials. This involved fieldwork with a total of 19 health workers and 212 community members in northeast Tanzania. RESULTS: The formative research suggested that RDTs were a potential source of conflict in the health worker-patient interaction, but that health workers used various techniques to resolve this, including provision of antimalarial drugs for RDT-negative patients. Our reviews showed that evidence was mixed regarding the effectiveness of different methods and theories to support change in prescribing practice. Our design process is presented, drawing from this collective evidence. We describe the final TACT intervention package (including interactive small group workshops, feedback text messages, motivational text messages and patient information leaflets and posters) in terms of its programme theory and implementation theory. CONCLUSIONS: Our study suggests that evidence-based design of complex interventions is possible. The use of formative research to understand malaria overdiagnosis in context was central to the design of the intervention as well as empirical research to test materials and methods prior to implementation. The TACT interventions may be appropriate for other settings where clinicians face similar challenges with malaria diagnostics. TRIAL REGISTRATION: NCT01292707

Bringing the state into the clinic? Incorporating the rapid diagnostic test for malaria into routine practice in Tanzanian primary healthcare facilities.

The roles that rapid, point-of-care tests will play in healthcare in low-income settings are likely to expand over the coming years. Yet, very little is known about how they are incorporated into practice, and what it means to use and rely upon them. This paper focuses on the rapid diagnostic test for malaria (mRDT), examining its introduction into low-level public health facilities in Tanzania within an intervention to improve the targeting of costly malaria medication. We interviewed 26 health workers to explore how a participatory training programme, mobile phone messages, posters and leaflets shaped the use and interpretation of the test. Drawing on notions of biopolitics, this paper examines how technologies of the self and mechanisms of surveillance bolstered the role mRDT in clinical decision-making. It shows how the significance of the test interacted with local knowledge, the availability of other medication, and local understandings of good clinical practice. Our findings suggest that in a context in which care is reduced to the provision of medicines, strict adherence to mRDT results may be underpinned by increasing the use of other pharmaceuticals or may leave health workers with patients for whom they are unable to provide care

The practice of 'doing' evaluation: Lessons learned from nine complex intervention trials in action

Background: There is increasing recognition among trialists of the challenges in understanding how particular 'real-life' contexts influence the delivery and receipt of complex health interventions. Evaluations of interventions to change health worker and/or patient behaviours in health service settings exemplify these challenges. When interpreting evaluation data, deviation from intended intervention implementation is accounted for through process evaluations of fidelity, reach, and intensity. However, no such systematic approach has been proposed to account for the way evaluation activities may deviate in practice from assumptions made when data are interpreted.Methods: A collective case study was conducted to explore experiences of undertaking evaluation activities in the real-life contexts of nine complex intervention trials seeking to improve appropriate diagnosis and treatment of malaria in varied health service settings. Multiple sources of data were used, including in-depth interviews with investigators, participant-observation of studies, and rounds of discussion and reflection.Results and discussion: From our experiences of the realities of conducting these evaluations, we identified six key 'lessons learned' about ways to become aware of and manage aspects of the fabric of trials involving the interface of researchers, fieldworkers, participants and data collection tools that may affect the intended production of data and interpretation of findings. These lessons included: foster a shared understanding across the study team of how individual practices contribute to the study goals; promote and facilitate within-team communications for ongoing reflection on the progress of the evaluation; establish processes for ongoing collaboration and dialogue between sub-study teams; the importance of a field research coordinator bridging everyday project management with scientific oversight; collect and review reflective field notes on the progress of the evaluation to aid interpretation of outcomes; and these approaches should help the identification of and reflection on possible overlaps between the evaluation and intervention.Conclusion: The lessons we have drawn point to the principle of reflexivity that, we argue, needs to become part of standard practice in the conduct of evaluations of complex interventions to promote more meaningful interpretations of the effects of an intervention and to better inform future implementation and decision-making. © 2014 Reynolds et al.; licensee BioMed Central Ltd

Bringing the state into the clinic? Incorporating the rapid diagnostic test for malaria into routine practice in Tanzanian primary healthcare facilities

The roles that rapid, point-of-care tests will play in healthcare in low-income settings are likely to expand over the coming years. Yet, very little is known about how they are incorporated into practice, and what it means to use and rely upon them. This paper focuses on the rapid diagnostic test for malaria (mRDT), examining its introduction into low-level public health facilities in Tanzania within an intervention to improve the targeting of costly malaria medication. We interviewed 26 health workers to explore how a participatory training programme, mobile phone messages, posters and leaflets shaped the use and interpretation of the test. Drawing on notions of biopolitics, this paper examines how technologies of the self and mechanisms of surveillance bolstered the role mRDT in clinical decision-making. It shows how the significance of the test interacted with local knowledge, the availability of other medication, and local understandings of good clinical practice. Our findings suggest that in a context in which care is reduced to the provision of medicines, strict adherence to mRDT results may be underpinned by increasing the use of other pharmaceuticals or may leave health workers with patients for whom they are unable to provide care

Malaria overdiagnosis: is patient pressure the problem?

OBJECTIVE: In Africa antimalarials are often prescribed when malaria is unlikely, a problem that is becoming critical as more expensive antimalarials replace established drugs. However, little is known about what drives the overuse of antimalarials. We conducted this study to explore to what extent current prescribing behaviour in hospitals is driven by patient demand. METHODS: Consultations were observed followed by exit interviews with patients or caretakers. Five district hospitals where microscopy was routinely available were selected in areas of low (n = 3) and high (n = 2) malaria transmission in north-eastern Tanzania. All outpatient consultations during the study period were observed (n = 669). Those sent for a malaria blood slide or treated with antimalarials presumptively were interviewed (n = 326). At the end of the study, clinicians were interviewed for their opinions on the use of antimalarials. FINDINGS: Patients were not observed to demand antimalarials from clinicians, but occasionally asked for a malaria slide. Patient satisfaction on exit was similar between those prescribed antimalarials and those not prescribed antimalarials, but more patients or carers expressed satisfaction when the patient had been tested than when not. Clinicians rarely reported perceiving patient demand for antimalarials and asserted that such demand for medication would not affect their prescribing behaviour. CONCLUSIONS: Patient demand was not found to be driving the over-prescription of antimalarials found in the hospitals in our setting. To the contrary, the involvement of patients may provide an opportunity to improve prescribing practice if their expectations for testing and treatment in line with test results can be effectively communicated to clinicians

Perceptions of mothers and hospital staff of paediatric care in 13 public hospitals in northern Tanzania.

User and provider perceptions of quality of care are likely to affect both use and provision of services. However, little is known about how health workers and mothers perceive the delivery of care in hospital paediatric wards in Africa. Paediatric staff and mothers of paediatric inpatients were interviewed to explore their opinions and experience of the admission process and conditions on the ward. Overcrowding, unsanitary conditions and lack of food were major concerns for mothers on the ward, who were deterred from seeking treatment earlier due to fears that hospital admission posed a significant risk of exposure to infection. While most staff were seen as being sympathetic and supportive to mothers, a minority were reported to be judgemental and authoritarian. Health workers identified lack of trained staff, overwork and low pay as major concerns. Staff shortages, lack of effective training and equipment are established problems but our findings also highlight a need for wards to become more parent-friendly, particularly with regard to food, hygiene and space. Training programmes focused on professional conduct and awareness of the problems that mothers face in seeking and receiving care may result in a more supportive and cooperative attitude between staff and mothers