Grading Policies and Practices in Canada: A Landscape Study

Given the longstanding role of grades in education, and their increased use for high-stakes decisions including student mobility, admission, selection, and accountability, this paper paper presents a systematic review of grading policies across all 10 Canadian provinces and 3 territories. In total, 23 policies were inductively analyzed for their articulation of (a) the purposes of grades, (b) the methods used for generating grades, and (c) the relationship between grading and formative assessment. Our analysis revealed significant areas of consistency across Canada while also highlighting important areas of variation. Implications of these findings on the value and use of grades within and across educational systems in Canada are discussed

Making assessment a team sport: a qualitative study of facilitated group feedback in internal medicine residency

Purpose: Competency-based medical education relies on feedback from workplace-based assessment (WBA) to direct learning. Unfortunately, WBAs often lack rich narrative feedback and show bias towards Medical Expert aspects of care. Building on research examining interactive assessment approaches, the Queen’s University Internal Medicine residency program introduced a facilitated, team-based assessment initiative (“Feedback Fridays”) in July 2017, aimed at improving holistic assessment of resident performance on the inpatient medicine teaching units. In this study, we aim to explore how Feedback Fridays contributed to formative assessment of Internal Medicine residents within our current model of competency-based training. Method: A total of 53 residents participated in facilitated, biweekly group assessment sessions during the 2017 and 2018 academic year. Each session was a 30-minute facilitated assessment discussion done with one inpatient team, which included medical students, residents, and their supervising attending. Feedback from the discussion was collected, summarized, and documented in narrative form in electronic WBA forms by the program’s assessment officer for the residents. For research purposes, verbatim transcripts of feedback sessions were analyzed thematically. Results: The researchers identified four major themes for feedback: communication, intra- and inter-personal awareness, leadership and teamwork, and learning opportunities. Although feedback related to a broad range of activities, it showed strong emphasis on competencies within the intrinsic CanMEDS roles. Additionally, a clear formative focus in the feedback was another important finding. Conclusions: The introduction of facilitated team-based assessment in the Queen’s Internal Medicine program filled an important gap in WBA by providing learners with detailed feedback across all CanMEDS roles and by providing constructive recommendations for identified areas for improvement

Rétroaction multisources à la suite d’une simulation en réanimation : une étude qualitative

Background: The direct observation and assessment of learners’ resuscitation skills by an attending physician is challenging due to the unpredictable and time-sensitive nature of these events. Multisource feedback (MSF) may address this challenge and improve the quality of assessments provided to learners. We aimed to describe the similarities and differences in the assessment rationale of attending physicians, registered nurses, and resident peers in the context of a simulation-based resuscitation curriculum. Methods: We conducted a qualitative content analysis of narrative MSF of medical residents in their first postgraduate year of training who were participating in a simulation-based resuscitation course at two Canadian institutions. Assessments included an entrustment score and narrative comments from attending physicians, registered nurses, and resident peers in addition to self-assessment. Narrative comments were transcribed and analyzed thematically using a constant comparative method. Results: All 87 residents (100%) participating in the 2017-2018 course provided consent. A total of 223 assessments were included in our analysis. Four themes emerged from the narrative data: 1) Communication, 2) Leadership, 3) Demeanor, and 4) Medical Expert. Relative to other assessor groups, feedback from nurses focused on patient-centred care and communication while attending physicians focused on the medical expert theme. Peer feedback was the most positive. Self-assessments included comments within each of the four themes. Conclusions: In the context of a simulation-based resuscitation curriculum, MSF provided learners with different perspectives in their narrative assessment rationale and may offer a more holistic assessment of resuscitation skills within a competency-based medical education (CBME) program of assessment.Contexte : Le contexte imprévisible et contraignant au niveau du temps lors de l’observation directe et de la rétroaction associée sur les compétences en réanimation des apprenants constituent un défi pour un médecin superviseur. La rétroaction multisources (RMS) peut être un moyen de relever ce défi et d'améliorer la qualité des rétroactions fournies aux apprenants. Nous visons à décrire les similitudes et les différences quant à la démarche évaluative auprès de médecins traitants, d’infirmières cliniciennes et de pairs résidents dans le cadre d'un cours de réanimation offert par simulation. Méthodes : Nous avons réalisé une analyse de contenu à partir des rétroactions narratives offertes aux résidents en première année de formation postdoctorale dans deux universités canadiennes dans le cadre d’un cours de réanimation offert par simulation. En plus de l’auto-évaluation, la rétroaction comportait un score de confiance et des commentaires narratifs de la part de médecins superviseurs, d’infirmières cliniciennes et des pairs. Les commentaires ont été transcrits et analysés par thèmes en appliquant la méthode générale de comparaison constante. Résultats : Un consentement pour participer à l’étude a été obtenu auprès des 87 résidents (100 %) qui ont suivi le cours en 2017-2018. Nous avons analysé un total de 223 rétroactions. Quatre thèmes ont émergé à partir des données narratives soit : 1) la communication, 2) le leadership, 3) le comportement, et 4) l’expertise médicale. Alors que les infirmières ont ciblé leurs commentaires sur les soins centrés sur le patient et la communication, les médecins superviseurs ont les ont ciblés sur l’expertise médicale. Les commentaires des pairs étaient les plus positifs. Les auto-évaluations comportaient des commentaires sur chacun des quatre thèmes. Conclusions : Dans le contexte d’un cours de réanimation offert par simulation, la RMS a permis aux apprenants d’obtenir des évaluations narratives selon différentes perspectives. Permettant ainsi une approche plus holistique de rétroaction sur les habiletés en réanimation dans le cadre d’un programme d’évaluation axé sur les compétences

Making assessment a team sport: a qualitative study of facilitated group feedback in internal medicine residency

Purpose: Competency-based medical education relies on feedback from workplace-based assessment (WBA) to direct learning. Unfortunately, WBAs often lack rich narrative feedback and show bias towards Medical Expert aspects of care. Building on research examining interactive assessment approaches, the Queen’s University Internal Medicine residency program introduced a facilitated, team-based assessment initiative (“Feedback Fridays”) in July 2017, aimed at improving holistic assessment of resident performance on the inpatient medicine teaching units. In this study, we aim to explore how Feedback Fridays contributed to formative assessment of Internal Medicine residents within our current model of competency-based training. Method: A total of 53 residents participated in facilitated, biweekly group assessment sessions during the 2017 and 2018 academic year. Each session was a 30-minute facilitated assessment discussion done with one inpatient team, which included medical students, residents, and their supervising attending. Feedback from the discussion was collected, summarized, and documented in narrative form in electronic WBA forms by the program’s assessment officer for the residents. For research purposes, verbatim transcripts of feedback sessions were analyzed thematically. Results: The researchers identified four major themes for feedback: communication, intra- and inter-personal awareness, leadership and teamwork, and learning opportunities. Although feedback related to a broad range of activities, it showed strong emphasis on competencies within the intrinsic CanMEDS roles. Additionally, a clear formative focus in the feedback was another important finding. Conclusions: The introduction of facilitated team-based assessment in the Queen’s Internal Medicine program filled an important gap in WBA by providing learners with detailed feedback across all CanMEDS roles and by providing constructive recommendations for identified areas for improvement

L’approche par compétences en formation médicale est-elle mise en œuvre tel que prévu? Premiers enseignements tirés de la médecine physique et réadaptation

Background: As competency-based medical education (CBME) curricula are introduced in residency programs across Canada, systematic evaluation efforts are needed to ensure fidelity of implementation. This study evaluated early outcomes of CBME implementation in one Canadian Physical Medicine and Rehabilitation program that was an early adopter of CBME, with an aim to inform continuous quality improvement initiatives and CBME implementation nationwide. Methods: Using Rapid Evaluation methodology, informed by the CBME Core Components Framework, the intended outcomes of CBME were compared to actual outcomes. Results: Results suggested that a culture of feedback and coaching already existed in this program prior to CBME implementation, yet faculty felt that CBME added a framework to support feedback. The small program size was valuable in fostering strong relationships and individualized learning. However, participants expressed concerns about CBME fostering a reductionist approach to the development of competence. Challenges existed with direct observation, clear expectations for off-service training experiences, and tracking trainee progress. There was trepidation surrounding national curricular change, yet the institution-wide approach to CBME implementation created shared experiences and a community of practice. Conclusions: Program evaluation can help understand gaps between planned versus enacted implementation of CBME, and foster adaptations to improve the fidelity of implementation.Contexte : À mesure que les programmes d’approche par compétences (APC) en formation médicale sont introduits dans les programmes de résidence au Canada, des efforts d'évaluation systématiques sont nécessaires pour assurer la fidélité de la mise en œuvre. Cette étude a évalué les premiers résultats de la mise en œuvre de l’APC en formation médicale dans un programme canadien de médecine physique et réadaptation, qui a été un des premiers à adopter l’APC, dans le but d'orienter les initiatives d'amélioration continue de la qualité et de la mise en œuvre de l’APC à l'échelle nationale. Méthodes : En utilisant une méthodologie d’évaluation rapide, fondée sur le cadre des composantes de base de l’APC en formation médicale, les résultats escomptés de l’APC ont été comparés aux résultats réels. Résultats : Les résultats suggèrent qu'une culture de la rétroaction et de l’encadrement existait déjà dans ce programme avant la mise en œuvre de l’APC, mais le corps professoral a estimé que l’APC en formation médicale a ajouté un cadre pour soutenir cette rétroaction. La petite taille du programme a permis de favoriser des relations solides et un apprentissage individualisé. Cependant, les participants ont exprimé des inquiétudes quant au fait que l’APC favorise une approche réductionniste du développement des compétences. L'observation directe, les attentes claires en matière d'expériences de formation hors de l’environnement clinique et le suivi des progrès des résidents posent problème. Le changement de programme national a suscité des inquiétudes, mais l'approche institutionnelle de la mise en œuvre de l’APC a permis de partager des expériences et de créer une communauté de pratique. Conclusions : L'évaluation des programmes peut aider à comprendre les écarts entre la mise en œuvre planifiée et effective de l’APC en formation médicale, et de favoriser les adaptations pour améliorer le respect des conditions de mise en œuvre

Six ways to get a grip on developing reflexivity statements

Qualitative researchers have underscored the value and importance of being reflexive in the research process, yet existing guidelines or checklists on how to practically address reflexivity are often scant and scattered across studies. In this scholarly perspective, we review, analyse, and present an overview of conceptions of reflexivity. Further, we offer practical guidelines for addressing and developing reflexivity statements in qualitative research. We describe reflexivity as both a concept and a deliberate ongoing process that requires a certain level of researcher consciousness, reflection, introspection, self-awareness, and an analytic attention to the researcher's role in the research process at all stages. We highlight the notion that reflexivity offers researchers an opportunity to examine potential assumptions, through the continuous process of questioning, examining, accepting, and articulating our attitudes, assumptions, perspectives, and roles. We present six recommendations to promote dialogue on the practice of reflexivity among researchers from various ontological and epistemological communities and encourage them to develop their own reflexivity practices

Le curriculum caché dans les disciplines médicales : examen de sa portée, de ses incidences et de son contexte

Background: While research suggests that manifestations of the hidden curriculum (HC) phenomenon have the potential to reinforce or undermine the values of an institution, very few studies have comprehensively measured its scope, impact, and the varied clinical teaching and learning contexts within which they occur. We explored the HC and examined the validity of newly developed constructs and determined the influence of context on the HC. Methods: We surveyed medical students (n =182), residents (n =148), and faculty (n = 140) from all disciplines at our institution between 2019 and 2020. Based on prior research and expertise, we measured participants’ experience with the HC including perceptions of respect and disrespect for different medical disciplines, settings in which the HC is experienced, impact of the HC, personal actions, efficacy, and their institutional perceptions. We examined the factor structure, reliability, and validity of the HC constructs using exploratory factor analysis Cronbach’s alpha, regression analysis and Pearson’s correlations. Results: Expert judges (physician faculty and medical learners) confirmed the content validity of the items used and the analysis revealed new HC constructs reflecting negative expressions, positive impacts and expressions, negative impacts, personal actions, and positive institutional perceptions of the HC. Evidence for criterion validity was found for the negative impacts and the personal actions constructs and were significantly associated with the stage of respondents’ career and gender. Support for convergent validity was obtained for HC constructs that were significantly correlated with certain contexts within which the HC occurs. Conclusion: More unique dimensions and contexts of the HC exist than have been previously documented. The findings demonstrate that specific clinical contexts can be targeted to improve negative expressions and impacts of the HC.Contexte : Bien que la recherche suggère que les expressions du curriculum caché (CC) ont le potentiel de renforcer ou de miner les valeurs d’un établissement, très peu d’études ont mesuré de manière exhaustive sa portée, ses effets et les divers contextes d’enseignement et d’apprentissage cliniques dans lesquels elles se produisent. Nous avons exploré le CC, examiné la validité de nouvelles notions et déterminé l’influence du contexte sur le CC. Méthodes : Entre 2019 et 2020, nous avons interrogé des étudiants (n =182), des résidents (n =148) et des membres du corps professoral (n = 140) de notre établissement, toutes disciplines médicales confondues. Sur la base de recherches et d’expertises antérieures, nous avons mesuré l’expérience des participants par rapport au CC, y compris leurs perceptions du respect ou du non-respect des diverses disciplines médicales, les contextes dans lesquels ils ont été confrontés au CC, les effets et l’efficacité du CC, les perceptions de l’établissement et les actions personnelles des participants. Nous avons examiné la structure factorielle, la fiabilité et la validité des notions du CC à l’aide d’une analyse factorielle exploratoire, du coefficient alpha de Cronbach, d’une analyse de régression et des corrélations de Pearson. Résultats : Des juges experts (médecins enseignants et apprenants) ont confirmé la validité du contenu des éléments utilisés et l’analyse a révélé de nouvelles notions du CC reflétant des expressions et des effets négatifs, des expressions et des effets positifs, des actions personnelles et des perceptions positives du CC au sein des établissements. La validité de critère a été démontrée pour les notions d’impacts négatifs et d’actions personnelles et a été associée de manière significative à l’étape de la carrière des répondants et à leur sexe. La validité convergente a été confirmée pour les notions de CC qui étaient significativement corrélées à certains contextes dans lesquels le CC se manifeste. Conclusion : Il existe plus de dimensions et de contextes uniques du CC que ceux qui avaient été documentés par le passé. Nos résultats montrent que des contextes cliniques spécifiques peuvent être ciblés pour améliorer les expressions et les effets négatifs du CC

Getting Inside the Expert's Head:An Analysis of Physician Cognitive Processes During Trauma Resuscitations

Study objective: Crisis resource management skills are integral to leading the resuscitation of a critically ill patient. Despite their importance, crisis resource management skills (and their associated cognitive processes) have traditionally been difficult to study in the real world. The objective of this study was to derive key cognitive processes underpinning expert performance in resuscitation medicine, using a new eye-tracking-based video capture method during clinical cases. Methods: During an 18-month period, a sample of 10 trauma resuscitations led by 4 expert trauma team leaders was analyzed. The physician team leaders were outfitted with mobile eye-tracking glasses for each case. After each resuscitation, participants were debriefed with a modified cognitive task analysis, based on a cued-recall protocol, augmented by viewing their own first-person perspective eye-tracking video from the clinical encounter. Results: Eye-tracking technology was successfully applied as a tool to aid in the qualitative analysis of expert performance in a clinical setting. All participants stated that using these methods helped uncover previously unconscious aspects of their cognition. Overall, 5 major themes were derived from the interviews: logistic awareness, managing uncertainty, visual fixation behaviors, selective attendance to information, and anticipatory behaviors. Conclusion: The novel approach of cognitive task analysis augmented by eye tracking allowed the derivation of 5 unique cognitive processes underpinning expert performance in leading a resuscitation. An understanding of these cognitive processes has the potential to enhance educational methods and to create new assessment modalities of these previously tacit aspects of expertise in this field

Novel Blood Pressure Locus and Gene Discovery Using Genome-Wide Association Study and Expression Data Sets From Blood and the Kidney.

Elevated blood pressure is a major risk factor for cardiovascular disease and has a substantial genetic contribution. Genetic variation influencing blood pressure has the potential to identify new pharmacological targets for the treatment of hypertension. To discover additional novel blood pressure loci, we used 1000 Genomes Project-based imputation in 150 134 European ancestry individuals and sought significant evidence for independent replication in a further 228 245 individuals. We report 6 new signals of association in or near HSPB7, TNXB, LRP12, LOC283335, SEPT9, and AKT2, and provide new replication evidence for a further 2 signals in EBF2 and NFKBIA Combining large whole-blood gene expression resources totaling 12 607 individuals, we investigated all novel and previously reported signals and identified 48 genes with evidence for involvement in blood pressure regulation that are significant in multiple resources. Three novel kidney-specific signals were also detected. These robustly implicated genes may provide new leads for therapeutic innovation