Research in medical education: pratical impact on medical training and future challenges

Medical education research has changed over the years from merely descriptive studies towards justification or curriculum comparison studies and, nowadays, towards a slow introduction of more clarification studies. In clarification studies quantitative and qualitative methods are used to explain why or how educational interventions work or do not work. This shift is described in this paper. In addition, it is explained how research into workplace learning and assessment has impacted developments in educational practice. Finally, it is argued that the participation of teachers within the medical domain in conducting and disseminating research should be cherished, because they play a crucial role in ensuring that medical education research is applied in educational practice

Walking the tightrope with an e-portfolio:imbalance between support and autonomy hampers self-directed learning

Teacher coaching is essential to support self-directed learning, but requires a lot of time and energy. This mixed-methods study investigated the effects of using an e-portfolio with a self-coaching protocol and limited teacher coaching on the development of self-directed learning skills and motivation. With regard to self-directed learning, students' overestimation of performance on learning tasks grew over time, while their ability to formulate points for improvement did not change significantly. With regard to motivation, students' controlled (i.e. largely extrinsic) motivation increased while their autonomous (i.e. largely intrinsic) motivation decreased. Thematic analysis of interviews demonstrated students needed more support and feedback from their teacher. The use of suboptimal cues for performance assessment and an imperfect balance between autonomy and support hampered self-directed learning and motivation. We recommend providing just-in-time feedback about performance on learning tasks and giving students some autonomy over the choice of learning tasks, to enhance reflection and motivation

Exploring the influence of cultural orientations on assessment of communication behaviours during patient-practitioner interactions

Background Research has shown that patients’ and practitioners’ cultural orientations affect communication behaviors and interpretations in cross-cultural patient-practitioner interactions. Little is known about the effect of cultural orientations on assessment of communication behaviors in cross-cultural educational settings. The purpose of this study is to explore cultural orientation as a potential source of assessor idiosyncrasy or between-assessor variability in assessment of communication skills. More specifically, we explored if and how (expert) assessors’ valuing of communication behaviours aligned with their cultural orientations (power-distance, masculinity-femininity, uncertainty avoidance, and individualism-collectivism). Methods Twenty-five pharmacist-assessors watched 3 videotaped scenarios (patient-pharmacist interactions) and ranked each on a 5-point global rating scale. Videotaped scenarios demonstrated combinations of well-portrayed and borderline examples of instrumental and affective communication behaviours. We used stimulated recall and verbal protocol analysis to investigate assessors’ interpretations and evaluations of communication behaviours. Uttered assessments of communication behaviours were coded as instrumental (task-oriented) or affective (socioemotional) and either positive or negative. Cultural orientations were measured using the Individual Cultural Values Scale. Correlations between cultural orientations and global scores, and frequencies of positive, negative, and total utterances of instrumental and affective behaviours were determined. Results Correlations were found to be scenario specific. In videos with poor or good performance, no differences were found across cultural orientations. When borderline performance was demonstrated, high power-distance and masculinity were significantly associated with higher global ratings (r = .445, and .537 respectively, p < 0.05) as well as with fewer negative utterances regarding instrumental (task focused) behaviours (r = −.533 and − .529, respectively). Higher masculinity scores were furthermore associated with positive utterances of affective (socioemotional) behaviours (r = .441). Conclusions Our findings thus confirm cultural orientation as a source of assessor idiosyncrasy and meaningful variations in interpretation of communication behaviours. Interestingly, expert assessors generally agreed on scenarios of good or poor performances but borderline performance was influenced by cultural orientation. Contrary to current practices of assessor and assessment instrument standardization, findings support the use of multiple assessors for patient-practitioner interactions and development of qualitative assessment tools to capture these varying, yet valid, interpretations of performanceScopu

Cognitive apprenticeship in clinical practice: can it stimulate learning in the opinion of students?

Learning in clinical practice can be characterised as situated learning because students learn by performing tasks and solving problems in an environment that reflects the multiple ways in which their knowledge will be put to use in their future professional practice. Collins et al. introduced cognitive apprenticeship as an instructional model for situated learning comprising six teaching methods to support learning: modelling, coaching, scaffolding, articulation, reflection and exploration. Another factor that is looked upon as conducive to learning in clinical practice is a positive learning climate. We explored students’ experiences regarding the learning climate and whether the cognitive apprenticeship model fits students’ experiences during clinical training. In focus group interviews, three groups of 6th-year medical students (N = 21) discussed vignettes representing the six teaching methods and the learning climate to explore the perceived occurrence of the teaching methods, related problems and possibilities for improvement. The students had experienced all six teaching methods during their clerkships. Modelling, coaching, and articulation were predominant, while scaffolding, reflection, and exploration were mainly experienced during longer clerkships and with one clinical teacher. The main problem was variability in usage of the methods, which was attributed to teachers’ lack of time and formal training. The students proposed several ways to improve the application of the teaching methods. The results suggest that the cognitive apprenticeship model is a useful model for teaching strategies in undergraduate clinical training and a valuable basis for evaluation, feedback, self-assessment and faculty development of clinical teachers

“For most of us Africans, we don’t just speak”: a qualitative investigation into collaborative heterogeneous PBL group learning

Collaborative approaches such as Problem Based Learning (PBL) may provide the opportunity to bring together diverse students but their efficacy in practice and the complications that arise due to the mixed ethnicity needs further investigation. This study explores the key advantages and problems of heterogeneous PBL groups from the students’ and teachers’ opinions. Focus groups were conducted with a stratified sample of second year medical students and their PBL teachers. We found that students working in heterogeneous groupings interact with students with whom they don’t normally interact with, learn a lot more from each other because of their differences in language and academic preparedness and become better prepared for their future professions in multicultural societies. On the other hand we found students segregating in the tutorials along racial lines and that status factors disempowered students and subsequently their productivity. Among the challenges was also that academic and language diversity hindered student learning. In light of these the recommendations were that teachers need special diversity training to deal with heterogeneous groups and the tensions that arise. Attention should be given to create ‘the right mix’ for group learning in diverse student populations. The findings demonstrate that collaborative heterogeneous learning has two sides that need to be balanced. On the positive end we have the ‘ideology’ behind mixing diverse students and on the negative the ‘practice’ behind mixing students. More research is needed to explore these variations and their efficacy in more detail

Combined student ratings and self-assessment provide useful feedback for clinical teachers

Many evaluation instruments have been developed to provide feedback to physicians on their clinical teaching but written feedback alone is not always effective. We explored whether feedback effectiveness improved when teachers’ self-assessment was added to written feedback based on student ratings. 37 physicians (10 residents, 27 attending physicians) from different specialties (Internal Medicine, Surgery, Obstetrics/Gynecology, Pediatrics, Neurology, Dermatology, Ophthalmology, ENT, and Psychiatry) were invited to fill out a self-assessment questionnaire on their teaching skills. Students completed an almost identical questionnaire to evaluate the same teachers based on their experiences during clerkships. After receiving written feedback incorporating their self-assessment and the student ratings, the teachers indicated their perceptions of the self-assessment exercise and the written feedback in a questionnaire (five-point Likert scale items) and next, in more detail, in semi-structured interviews with a purposive sample of 12 of the participating teachers. 25 physicians participated (67%). The results showed that self-assessment and student feedback were both perceived as useful (3.7, SD 1.0) but the latter was considered more effective. The physicians we interviewed considered the combination of self-assessment with student ratings more effective than either self-assessment or written feedback alone. Notably, discrepancies between student ratings and self-assessment were deemed a strong incentive for change. We conclude that self-assessment can be a useful tool to stimulate improvement of clinical teaching when it is combined with written feedback based on student ratings. Future research among larger groups is needed to confirm our findings and examine whether these combined tools actually lead to improved teaching

Relevant prior knowledge moderates the effect of elaboration during small group discussion on academic achievement

This study set out to test whether relevant prior knowledge would moderate a positive effect on academic achievement of elaboration during small-group discussion. In a 2 × 2 experimental design, 66 undergraduate students observed a video showing a small-group problem-based discussion about thunder and lightning. In the video, a teacher asked questions to the observing participants. Participants either elaborated by responding to these questions, or did not elaborate, but completed a