Does a competitive voucher program for adolescents improve the quality of reproductive health care? A simulated patient study in Nicaragua

BACKGROUND: Little is known about how sexual and reproductive (SRH) health can be made accessible and appropriate to adolescents. This study evaluates the impact and sustainability of a competitive voucher program on the quality of SRH care for poor and underserved female adolescents and the usefulness of the simulated patient (SP) method for such evaluation. METHODS: 28,711 vouchers were distributed to adolescents in disadvantaged areas of Managua that gave free-of-charge access to SRH care in 4 public, 10 non-governmental and 5 private clinics. Providers received training and guidelines, treatment protocols, and financial incentives for each adolescent attended. All clinics were visited by female adolescent SPs requesting contraception. SPs were sent one week before, during (with voucher) and one month after the intervention. After each consultation they were interviewed with a standardized questionnaire. Twenty-one criteria were scored and grouped into four categories. Clinics' scores were compared using non-parametric statistical methods (paired design: before-during and before-after). Also the influence of doctors' characteristics was tested using non-parametric statistical methods. RESULTS: Some aspects of service quality improved during the voucher program. Before the program started 8 of the 16 SPs returned 'empty handed', although all were eligible contraceptive users. During the program 16/17 left with a contraceptive method (p = 0.01). Furthermore, more SPs were involved in the contraceptive method choice (13/17 vs.5/16, p = 0.02). Shared decision-making on contraceptive method as well as condom promotion had significantly increased after the program ended. Female doctors had best scores before- during and after the intervention. The improvements were more pronounced among male doctors and doctors older than 40, though these improvements did not sustain after the program ended. CONCLUSION: This study illustrates provider-related obstacles adolescents often face when requesting contraception. The care provided during the voucher program improved for some important outcomes. The improvements were more pronounced among providers with the weakest initial performance. Shared decision-making and condom promotion were improvements that sustained after the program ended. The SP method is suitable and relatively easy to apply in monitoring clinics' performance, yielding important and relevant information. Objective assessment of change through the SP method is much more complex and expensive

Are there valid proxy measures of clinical behaviour?

Background: Accurate measures of health professionals' clinical practice are critically important to guide health policy decisions, as well as for professional self-evaluation and for research-based investigation of clinical practice and process of care. It is often not feasible or ethical to measure behaviour through direct observation, and rigorous behavioural measures are difficult and costly to use. The aim of this review was to identify the current evidence relating to the relationships between proxy measures and direct measures of clinical behaviour. In particular, the accuracy of medical record review, clinician self-reported and patient-reported behaviour was assessed relative to directly observed behaviour. Methods: We searched: PsycINFO; MEDLINE; EMBASE; CINAHL; Cochrane Central Register of Controlled Trials; science/social science citation index; Current contents (social & behavioural med/clinical med); ISI conference proceedings; and Index to Theses. Inclusion criteria: empirical, quantitative studies; and examining clinical behaviours. An independent, direct measure of behaviour (by standardised patient, other trained observer or by video/audio recording) was considered the 'gold standard' for comparison. Proxy measures of behaviour included: retrospective self-report; patient-report; or chart-review. All titles, abstracts, and full text articles retrieved by electronic searching were screened for inclusion and abstracted independently by two reviewers. Disagreements were resolved by discussion with a third reviewer where necessary. Results: Fifteen reports originating from 11 studies met the inclusion criteria. The method of direct measurement was by standardised patient in six reports, trained observer in three reports, and audio/video recording in six reports. Multiple proxy measures of behaviour were compared in five of 15 reports. Only four of 15 reports used appropriate statistical methods to compare measures. Some direct measures failed to meet our validity criteria. The accuracy of patient report and chart review as proxy measures varied considerably across a wide range of clinical actions. The evidence for clinician self-report was inconclusive. Conclusion: Valid measures of clinical behaviour are of fundamental importance to accurately identify gaps in care delivery, improve quality of care, and ultimately to improve patient care. However, the evidence base for three commonly used proxy measures of clinicians' behaviour is very limited. Further research is needed to better establish the methods of development, application, and analysis for a range of both direct and proxy measures of behaviour

Evaluation of the Dutch general exemption level for voluntary fortification with folic acid

Introduction: Fortification with folic acid was prohibited in the Netherlands. Since 2007, a general exemption is given to fortify with folic acid up until a maximum level of 100 µg/100 kcal. This maximum level was based on a calculation model and data of adults only. The model requires parameters on intake (diet, supplements, energy) and on the proportion of energy that may be fortified. This study aimed to evaluate the model parameters considering the changing fortification market. In addition, the risk of young children exceeding the UL for folic acid was studied. Methods: Folic acid fortified foods present on the Dutch market were identified in product databases and by a supermarket inventory. Together with data of the Dutch National Consumption Survey-Young Children (2005/2006) these inventory results were used to re-estimate the model parameters. Habitual folic acid intake of young children was estimated and compared to the UL for several realistic fortification scenarios. Results: Folic acid fortified foods were identified in seven different food groups. In up to 10% of the population, the proportion of energy intake of folic acid fortified foods exceeded 10% – the original model parameter. The folic acid intake from food supplements was about 100 µg/day, which is lower than the intake assumed as the original model parameter (300 µg). In the scenarios representing the current market situation, a small proportion (<5%) of the children exceeded the UL. Conclusion: The maximum fortification level of 100 µg/100 kcal is sufficiently protective for children in the current market situation. In the precautionary model to estimate the maximum fortification levels, subjects with high intakes of folic acid from food and supplements, and high energy intakes are protected from too high folic acid intakes. Combinations of high intakes are low in this population. The maximum levels should be monitored and revised with increasing fortification and supplementation practices

How simulated patients contribute to student learning in an authentic way:An interview study

Introduction: Simulated patients (SPs) play an instrumental role in teaching communication skills and enhancing learning outcomes. Prior research mostly focused on the SP’s contribution to students’ learning outcomes by providing feedback afterwards. A detailed understanding of the contribution of the SP during SP-student encounters is currently lacking although the majority of the interaction between SPs and students occurs during the SP-student encounter. Therefore, this study focuses on how SPs see their contribution to meaningful student learning experiences during SP-student encounters. Methods: We interviewed fifteen simulated patients from one institution. We explored their perspectives on meaningful learning experiences during SP-student encounters through in-depth, semi-structured interviews and analyzed using thematic analysis. Results: SPs view their contribution to meaningful student learning during SP-student encounters from two perspectives. A collective perspective as a member of the community of SPs and an individual perspective. From the collective perspective, SPs believe that the fact that students deal with multiple varied SP-student encounters over time is of value for meaningful learning. From the individual perspective, we noticed that SPs think, act, and react from three different positions. First, as the patient in the role description, second, as a teaching aid and third, as an individual with personal experiences, beliefs, and values. SPs mentioned that the ratio between these different positions can vary within and between encounters. Conclusions: According to SPs, we should value the variation between SPs, thereby creating meaningful variation in authentic interactions in SP-student encounters. SPs should be allowed to act and react from different positions during SP-student encounters, including their role description, as teaching aid, and based on their own experiences. In this way, SP-student encounters are optimized to contribute to meaningful student learning through authenticity.</p

The Quality of Medical Care in Low-Income Countries: From Providers to Markets

Jishnu Das provides a perspective on a research article by Paul Garner and colleagues that reports a systematic review of 80 studies comparing the quality of private versus public ambulatory health care in low and middle income countries

Evaluation of a social franchising and telemedicine programme and the care provided for childhood diarrhoea and pneumonia, Bihar, India

OBJECTIVE: To evaluate the impact on the quality of the care provided for childhood diarrhoea and pneumonia in Bihar, India, of a large-scale, social franchising and telemedicine programme - the World Health Partners' Sky Program. METHODS: We investigated changes associated with the programme in the knowledge and performance of health-care providers by carrying out 810 assessments in a representative sample of providers in areas where the programme was and was not implemented. Providers were assessed using hypothetical patient vignettes and the standardized patient method both before and after programme implementation, in 2011 and 2014, respectively. Differences in providers' performance between implementation and nonimplementation areas were assessed using multivariate difference-in-difference linear regression models. FINDINGS: The programme did not significantly improve health-care providers' knowledge or performance with regard to childhood diarrhoea or pneumonia in Bihar. There was a persistent large gap between knowledge of appropriate care and the care actually delivered. CONCLUSION: Social franchising has received attention globally as a model for delivering high-quality care in rural areas in the developing world but supporting data are scarce. Our findings emphasize the need for sound empirical evidence before social franchising programmes are scaled up

Validity evidence and reliability of a simulated patient feedback instrument

Contains fulltext : 110154.pdf (publisher's version ) (Open Access)BACKGROUND: In the training of healthcare professionals, one of the advantages of communication training with simulated patients (SPs) is the SP's ability to provide direct feedback to students after a simulated clinical encounter. The quality of SP feedback must be monitored, especially because it is well known that feedback can have a profound effect on student performance. Due to the current lack of valid and reliable instruments to assess the quality of SP feedback, our study examined the validity and reliability of one potential instrument, the 'modified Quality of Simulated Patient Feedback Form' (mQSF). METHODS: Content validity of the mQSF was assessed by inviting experts in the area of simulated clinical encounters to rate the importance of the mQSF items. Moreover, generalizability theory was used to examine the reliability of the mQSF. Our data came from videotapes of clinical encounters between six simulated patients and six students and the ensuing feedback from the SPs to the students. Ten faculty members judged the SP feedback according to the items on the mQSF. Three weeks later, this procedure was repeated with the same faculty members and recordings. RESULTS: All but two items of the mQSF received importance ratings of > 2.5 on a four-point rating scale. A generalizability coefficient of 0.77 was established with two judges observing one encounter. CONCLUSIONS: The findings for content validity and reliability with two judges suggest that the mQSF is a valid and reliable instrument to assess the quality of feedback provided by simulated patients