GP trainees’ perceptions on learning EBM using conversations in the workplace : a video-stimulated interview study

Background To be able to practice evidence-based medicine (EBM) when making decisions for individual patients, it is important to learn how to combine the best available evidence with the patient's preferences and the physician's clinical expertise. In general practice training, these skills can be learned at the workplace using learning conversations: meetings between the supervising general practitioner (GP) and GP trainee to discuss medical practice, selected topics or professional performance. This study aimed to give insight into the perceptions of GP trainees on their EBM learning processes during learning conversations. Methods We held semi-structured video-stimulated elicitation interviews (n = 22) with GP trainees affiliated to GP training institutes in the Netherlands and Belgium. GP trainees were shown fragments of their learning conversations, enabling reflection during the interview. Taking an inductive approach, interview recordings were transcribed verbatim and analysed with NVivo software. Results GP trainees perceived learning conversations as useful for learning and discussing EBM. Multiple EBM learning activities were identified, such as discussing evidence together, relating evidence to cases in daily practice and discussing the supervisor's experience and the specific local context in the light of what the evidence recommends. However, for learning to occur, trainees need and expect specific behaviour, both from their supervisors and themselves. Supervisors should supply well-substantiated answers that are applicable in practice and give the trainee confirmation. In turn, the trainee needs to prepare well in order to ask focused, in-depth questions. A safe space allowing equal and open discussion between trainee and supervisor is perceived as an essential context for optimal EBM learning. Conclusions Our findings show that trainees find learning conversations useful for EBM learning in general practice. To bring EBM learning to its full potential, attention should be paid to optimising the behavioural and contextual factors found relevant to enhancing EBM learning

Learning conversations with trainees : an undervalued but useful EBM learning opportunity for clinical supervisors

Phenomenon: Supervisors and trainees can learn skills related to evidence-based medicine from each other in the workplace by collaborating and interacting, in this way benefiting from each other's strengths. This study explores supervisors' perceptions of how they currently learn evidence-based medicine by engaging in learning conversations with their trainee. Approach: Semi-structured, video-stimulated elicitation interviews were held with twenty-two Dutch and Belgian supervisors in general practice. Supervisors were shown fragments of their video-recorded learning conversations, allowing them to reflect. Recorded interviews were analyzed using a grounded theory-based approach.Findings: Supervisors did not immediately perceive workplace learning conversations as an opportunity to learn evidence-based medicine from their trainee. They mostly saw these conversations as a learning opportunity for trainees and a chance to maintain the quality of care within their practice. Nevertheless, during the interviews, supervisors did acknowledge that learning conversations help them to gain up-to-date knowledge and search skills or more awareness of their own knowledge or gaps in their knowledge. Not identified as a learning outcome was how to apply evidence-based medicine within a clinical practice by combining evidence with clinical expertise and the patient's preferences. Insights: Supervisors acknowledge that they learn elements of the three aspects of evidence-based medicine by having learning conversations with their trainee, but they currently see this as secondary to the trainee's learning process. Emphasizing opportunities for bidirectional learning could improve learning of evidence-based medicine during workplace learning conversations

When to trust our learners?: Clinical teachers' perceptions of decision variables in the entrustment process

INTRODUCTION: Clinical training programs increasingly use entrustable professional activities (EPAs) as focus of assessment. However, questions remain about which information should ground decisions to trust learners. This qualitative study aimed to identify decision variables in the workplace that clinical teachers find relevant in the elaboration of the entrustment decision processes. The findings can substantiate entrustment decision-making in the clinical workplace. METHODS: Focus groups were conducted with medical and veterinary clinical teachers, using the structured consensus method of the Nominal Group Technique to generate decision variables. A ranking was made based on a relevance score assigned by the clinical teachers to the different decision variables. Field notes, audio recordings and flip chart lists were analyzed and subsequently translated and, as a form of axial coding, merged into one list, combining the decision variables that were similar in their meaning. RESULTS: A list of 11 and 17 decision variables were acknowledged as relevant by the medical and veterinary teacher groups, respectively. The focus groups yielded 21 unique decision variables that were considered relevant to inform readiness to perform a clinical task on a designated level of supervision. The decision variables consisted of skills, generic qualities, characteristics, previous performance or other information. We were able to group the decision variables into five categories: ability, humility, integrity, reliability and adequate exposure. DISCUSSION: To entrust a learner to perform a task at a specific level of supervision, a supervisor needs information to support such a judgement. This trust cannot be credited on a single case at a single moment of assessment, but requires different variables and multiple sources of information. This study provides an overview of decision variables giving evidence to justify the multifactorial process of making an entrustment decision

When to trust our learners? : Clinical teachers' perceptions of decision variables in the entrustment process

INTRODUCTION: Clinical training programs increasingly use entrustable professional activities (EPAs) as focus of assessment. However, questions remain about which information should ground decisions to trust learners. This qualitative study aimed to identify decision variables in the workplace that clinical teachers find relevant in the elaboration of the entrustment decision processes. The findings can substantiate entrustment decision-making in the clinical workplace. METHODS: Focus groups were conducted with medical and veterinary clinical teachers, using the structured consensus method of the Nominal Group Technique to generate decision variables. A ranking was made based on a relevance score assigned by the clinical teachers to the different decision variables. Field notes, audio recordings and flip chart lists were analyzed and subsequently translated and, as a form of axial coding, merged into one list, combining the decision variables that were similar in their meaning. RESULTS: A list of 11 and 17 decision variables were acknowledged as relevant by the medical and veterinary teacher groups, respectively. The focus groups yielded 21 unique decision variables that were considered relevant to inform readiness to perform a clinical task on a designated level of supervision. The decision variables consisted of skills, generic qualities, characteristics, previous performance or other information. We were able to group the decision variables into five categories: ability, humility, integrity, reliability and adequate exposure. DISCUSSION: To entrust a learner to perform a task at a specific level of supervision, a supervisor needs information to support such a judgement. This trust cannot be credited on a single case at a single moment of assessment, but requires different variables and multiple sources of information. This study provides an overview of decision variables giving evidence to justify the multifactorial process of making an entrustment decision

Am I ready for it? Students’ perceptions of meaningful feedback on entrustable professional activities

Background Receiving feedback while in the clinical workplace is probably the most frequently voiced desire of students. In clinical learning environments, providing and seeking performance-relevant information is often difficult for both supervisors and students. The use of entrustable professional activities (EPAs) can help to improve stu-dent assessment within competency-based education. This study aimed to illustrate what students' perceptions are of meaningful feedback viewed as conducive in preparing for performing EPA unsupervised. Methods In a qualitative multicentre study we explored stu-dents' perceptions on meaningful feedback related to EPAs in the clinical workplace. Focus groups were conducted in three different healthcare institutes. Based on concepts from the literature, the transcripts were coded, iteratively reduced and displayed. Results Participants' preferences regarding meaningful feedback on EPAs were quite similar, irrespective of their institution or type of clerkship. Participants explicitly men-tioned that feedback on EPAs could come from a variety of sources. Feedback must come from a credible, trustworthy Electronic supplementary material The online version of this article (doi: 10.1007/s40037-017-0361-1) contains supplementary material, which is available to authorized users. supervisor who knows the student well, be delivered in a safe environment and stress both strengths and points for improvement. The feedback should be provided immedi-ately after the observed activity and include instructions for follow-up. Students would appreciate feedback that refers to their ability to act unsupervised. Conclusion There is abundant literature on how feedback should be provided, and what factors influence how feed-back is sought by students. This study showed that students who are training to perform an EPA unsupervised have clear ideas about how, when and from whom feedback should be delivered. What this paper adds To enhance the educational environment in the workplace, meaningful feedback and valid assessment of students are required. As the literature shows, it is difficult to success-fully apply workplace-based assessments in clinical prac-tice. The use of entrustable professional activities (EPAs) can help to improve student assessment within competency-based education. However, there still is little evidence about what students perceive as useful information to prepare for performing an EPA with less than full supervision. This study aimed to illustrate what students' perceptions are of meaningful feedback viewed as conducive to prepare for the performance of an EPA unsupervised Am I ready for it? Students' perceptions of meaningful feedback on entrustable professional activitie

Bidirectional learning opportunities: how GP-supervisors and trainees exchange knowledge

Introduction: Workplace-based learning conversations can be a good opportunity for supervisors and trainees to learn from each other. When both professionals discuss their specific knowledge openly with each other, learning conversations may be a useful educational tool, for instance for learning how to apply evidence-based medicine (EBM) in the workplace. We do, however, need a better understanding of how the exchange of knowledge provides opportunities for such bidirectional learning. The aim of this study was therefore to analyse how trainees and supervisors currently handle bidirectional learning opportunities by describing in detail how supervisors respond to knowledge expressed by trainees during a learning conversation. Method: We video-recorded learning conversations between supervisors and trainees in general practice (GP). Within these learning conversations, EBM discussions on medical topics were selected and transcribed. We then identified, analysed using Conversation Analysis (CA) and categorised each expression of knowledge by the trainee and the supervisor's subsequent response. Results: We found that when a trainee expresses knowledge during the learning conversation, supervisors either (a) refute the expressed knowledge, (b) immediately suggest an alternative or (c) pose (additional) questions. These responses have consequences for the learning opportunities of both trainee and supervisor: it is only when supervisors pose further questions that trainees are encouraged to elaborate on their knowledge, leading to a bidirectional learning opportunity. Discussion: Improving EBM learning opportunities for both supervisors and trainees requires more than simply instructing trainees to express knowledge-based—for instance—on recent evidence more often. Inflexible institutional roles related to historical claims of supervisors’ epistemic authority hamper bidirectional learning. Posing open questions during learning conversations enhances the flexibility of institutional roles while also creating bidirectional learning opportunities

Bidirectional learning opportunities : how GP‐supervisors and trainees exchange knowledge

Introduction Workplace-based learning conversations can be a good opportunity for supervisors and trainees to learn from each other. When both professionals discuss their specific knowledge openly with each other, learning conversations may be a useful educational tool, for instance for learning how to apply evidence-based medicine (EBM) in the workplace. We do, however, need a better understanding of how the exchange of knowledge provides opportunities for such bidirectional learning. The aim of this study was therefore to analyse how trainees and supervisors currently handle bidirectional learning opportunities by describing in detail how supervisors respond to knowledge expressed by trainees during a learning conversation. Method We video-recorded learning conversations between supervisors and trainees in general practice (GP). Within these learning conversations, EBM discussions on medical topics were selected and transcribed. We then identified, analysed using Conversation Analysis (CA) and categorised each expression of knowledge by the trainee and the supervisor's subsequent response. Results We found that when a trainee expresses knowledge during the learning conversation, supervisors either (a) refute the expressed knowledge, (b) immediately suggest an alternative or (c) pose (additional) questions. These responses have consequences for the learning opportunities of both trainee and supervisor: it is only when supervisors pose further questions that trainees are encouraged to elaborate on their knowledge, leading to a bidirectional learning opportunity. Discussion Improving EBM learning opportunities for both supervisors and trainees requires more than simply instructing trainees to express knowledge-based-for instance-on recent evidence more often. Inflexible institutional roles related to historical claims of supervisors' epistemic authority hamper bidirectional learning. Posing open questions during learning conversations enhances the flexibility of institutional roles while also creating bidirectional learning opportunities