Using conversation analysis to explore feedback on resident performance

Feedback on clinical performance of residents is seen as a fundamental element in postgraduate medical education. Although literature on feedback in medical education is abundant, many supervisors struggle with providing this feedback and residents experience feedback as insufciently constructive. With a detailed analysis of real-world feedback conversations, this study aims to contribute to the current literature by deepening the understanding of how feedback on residents’ performance is provided, and to formulate recommendations for improvement of feedback practice. Eight evaluation meetings between program directors and residents were recorded in 2015–2016. These meetings were analyzed using conversation analysis. This is an ethno-methodological approach that uses a data-driven, iterative procedure to uncover interactional patterns that structure naturally occurring, spoken interaction. Feedback in our data took two forms: feedback as a unidirectional activity and feedback as a dialogic activity. The unidirectional feedback activities prevailed over the dialogic activities. The two diferent formats elicit diferent types of resident responses and have diferent implications for the progress of the interaction. Both feedback format

Judging residents' performance:a qualitative study using grounded theory

BACKGROUND: Although program directors judge residents' performance for summative decisions, little is known about how they do this. This study examined what information program directors use and how they value this information in making a judgment of residents' performance and what residents think of this process. METHODS: Sixteen semi-structured interviews were held with residents and program directors from different hospitals in the Netherlands in 2015-2016. Participants were recruited from internal medicine, surgery and radiology. Transcripts were analysed using grounded theory methodology. Concepts and themes were identified by iterative constant comparison. RESULTS: When approaching semi-annual meetings with residents, program directors report primarily gathering information from the following: assessment tools, faculty members and from their own experience with residents. They put more value on faculty's comments during meetings and in the corridors than on feedback provided in the assessment tools. They are influenced by their own beliefs about learning and education in valuing feedback. Residents are aware that faculty members discuss their performance in meetings, but they believe the assessment tools provide the most important proof to demonstrate their clinical competency. CONCLUSIONS: Residents think that feedback in the assessment tools is the most important proof to demonstrate their performance, whereas program directors scarcely use this feedback to form a judgment about residents' performance. They rely heavily on remarks of faculty in meetings instead. Therefore, residents' performance may be better judged in group meetings that are organised to enhance optimal information sharing and decision making about residents' performance

Design and evaluation of a clinical competency committee

Introduction In postgraduate medical education, group decision-making has emerged as an essential too

Extracellular loops 2 and 3 of the calcitonin receptor selectively modify agonist binding and efficacy.

Class B peptide hormone GPCRs are targets for the treatment of major chronic disease. Peptide ligands of these receptors display biased agonism and this may provide future therapeutic advantage. Recent active structures of the calcitonin (CT) and glucagon-like peptide-1 (GLP-1) receptors reveal distinct engagement of peptides with extracellular loops (ECLs) 2 and 3, and mutagenesis of the GLP-1R has implicated these loops in dynamics of receptor activation. In the current study, we have mutated ECLs 2 and 3 of the human CT receptor (CTR), to interrogate receptor expression, peptide affinity and efficacy. Integration of these data with insights from the CTR and GLP-1R active structures, revealed marked diversity in mechanisms of peptide engagement and receptor activation between the CTR and GLP-1R. While the CTR ECL2 played a key role in conformational propagation linked to Gs/cAMP signalling this was mechanistically distinct from that of GLP-1R ECL2. Moreover, ECL3 was a hotspot for distinct ligand- and pathway- specific effects, and this has implications for the future design of biased agonists of class B GPCRs

Using conversation analysis to explore feedback on resident performance

Contains fulltext : 212380.pdf (publisher's version ) (Open Access)25 januari 201918 p

Group Assessment of Resident Performance: Valuable for Program Director Judgment?

Background: Group discussion of resident performance is an emerging assessment approach in postgraduate medical education. However, groups do not necessarily make better decisions than individuals. Objective: This study examined how group meetings concerning the assessment of residents take place, what information is shared during the meetings, and how this influences program directors' judgment of resident performance. Methods: In 2017, the researchers observed 10 faculty group meetings where resident performance was discussed and interviewed the program directors within a month after the meetings. We used a thematic framework analysis to identify themes from the transcribed meetings and interviews. Results: The information shared by group members during the meetings had 2 aims: (1) forming a judgment about the residents, and (2) faculty development. Most group members shared information without written notes, most discussions were not structured by the program director, the major focus of discussions was on residents with performance concerns, and there was a lack of a shared mental model of resident performance. The program directors who benefited most from the meetings were those who thought group members were engaged and summarized the information after every discussion. Conclusions: Unstructured discussions and a lack of a shared mental model among group members impede effective information sharing about resident performance with a developmental approach. Structured discussions with an equal amount of discussion time for every resident and creating a shared mental model about the purpose of the discussions and the assessment approach could enhance use of a developmental approach to assessing resident performance

Using conversation analysis to explore feedback on resident performance

Feedback on clinical performance of residents is seen as a fundamental element in postgraduate medical education. Although literature on feedback in medical education is abundant, many supervisors struggle with providing this feedback and residents experience feedback as insufficiently constructive. With a detailed analysis of real-world feedback conversations, this study aims to contribute to the current literature by deepening the understanding of how feedback on residents' performance is provided, and to formulate recommendations for improvement of feedback practice. Eight evaluation meetings between program directors and residents were recorded in 2015-2016. These meetings were analyzed using conversation analysis. This is an ethno-methodological approach that uses a data-driven, iterative procedure to uncover interactional patterns that structure naturally occurring, spoken interaction. Feedback in our data took two forms: feedback as a unidirectional activity and feedback as a dialogic activity. The unidirectional feedback activities prevailed over the dialogic activities. The two different formats elicit different types of resident responses and have different implications for the progress of the interaction. Both feedback formats concerned positive as well as negative feedback and both were often mitigated by the participants. Unidirectional feedback and mitigating or downplaying feedback is at odds with the aim of feedback in medical education. Dialogic feedback avoids the pitfall of a program director-dominated conversation and gives residents the opportunity to take ownership of their strengths and weaknesses, which increases chances to change resident behavior. On the basis of linguistic analysis of our real-life data we suggest implications for feedback conversations

Measuring Physical Functioning Using Wearable Sensors in Parkinson Disease and Chronic Obstructive Pulmonary Disease (the Accuracy of Digital Assessment of Performance Trial Study): Protocol for a Prospective Observational Study

BackgroundPhysical capacity and physical activity are important aspects of physical functioning and quality of life in people with a chronic disease such as Parkinson disease (PD) or chronic obstructive pulmonary disease (COPD). Both physical capacity and physical activity are currently measured in the clinic using standardized questionnaires and tests, such as the 6-minute walk test (6MWT) and the Timed Up and Go test (TUG). However, relying only on in-clinic tests is suboptimal since they offer limited information on how a person functions in daily life and how functioning fluctuates throughout the day. Wearable sensor technology may offer a solution that enables us to better understand true physical functioning in daily life. ObjectiveWe aim to study whether device-assisted versions of 6MWT and TUG, such that the tests can be performed independently at home using a smartwatch, is a valid and reliable way to measure the performance compared to a supervised, in-clinic test. MethodsThis is a decentralized, prospective, observational study including 100 people with PD and 100 with COPD. The inclusion criteria are broad: age ≥18 years, able to walk independently, and no co-occurrence of PD and COPD. Participants are followed for 15 weeks with 4 in-clinic visits, once every 5 weeks. Outcomes include several walking tests, cognitive tests, and disease-specific questionnaires accompanied by data collection using wearable devices (the Verily Study Watch and Modus StepWatch). Additionally, during the last 10 weeks of this study, participants will follow an aerobic exercise training program aiming to increase physical capacity, creating the opportunity to study the responsiveness of the remote 6MWT. ResultsIn total, 89 people with PD and 65 people with COPD were included in this study. Data analysis will start in April 2024. ConclusionsThe results of this study will provide information on the measurement properties of the device-assisted 6MWT and TUG in the clinic and at home. When reliable and valid, this can contribute to a better understanding of a person’s physical capacity in real life, which makes it possible to personalize treatment options. Trial RegistrationClinicalTrials.gov NCT05756075; https://clinicaltrials.gov/study/NCT05756075 International Registered Report Identifier (IRRID)DERR1-10.2196/5545