Intérêt d’un score de la qualité de l'évaluation pour l'apprentissage pour évaluer la rétroaction écrite dans la formation postdoctorale en anesthésiologie : étude de généralisabilité et de décision

Background: Competency based residency programs depend on high quality feedback from the assessment of entrustable professional activities (EPA). The Quality of Assessment for Learning (QuAL) score is a tool developed to rate the quality of narrative comments in workplace-based assessments; it has validity evidence for scoring the quality of narrative feedback provided to emergency medicine residents, but it is unknown whether the QuAL score is reliable in the assessment of narrative feedback in other postgraduate programs. Methods: Fifty sets of EPA narratives from a single academic year at our competency based medical education post-graduate anesthesia program were selected by stratified sampling within defined parameters [e.g. resident gender and stage of training, assessor gender, Competency By Design training level, and word count (≥17 or <17 words)]. Two competency committee members and two medical students rated the quality of narrative feedback using a utility score and QuAL score. We used Kendall’s tau-b co-efficient to compare the perceived utility of the written feedback to the quality assessed with the QuAL score. The authors used generalizability and decision studies to estimate the reliability and generalizability coefficients. Results: Both the faculty’s utility scores and QuAL scores (r = 0.646, p < 0.001) and the trainees’ utility scores and QuAL scores (r = 0.667, p < 0.001) were moderately correlated. Results from the generalizability studies showed that utility scores were reliable with two raters for both faculty (Epsilon=0.87, Phi=0.86) and trainees (Epsilon=0.88, Phi=0.88). Conclusions: The QuAL score is correlated with faculty- and trainee-rated utility of anesthesia EPA feedback. Both faculty and trainees can reliability apply the QuAL score to anesthesia EPA narrative feedback. This tool has the potential to be used for faculty development and program evaluation in Competency Based Medical Education. Other programs could consider replicating our study in their specialty.Contexte : La qualité de la rétroaction à la suite de l’évaluation d’activités professionnelles confiables (APC) est d’une importance capitale dans les programmes de résidence fondés sur les compétences. Le score QuAL (Quality of Assessment for Learning) est un outil développé pour évaluer la qualité de la rétroaction narrative dans les évaluations en milieu de travail. Sa validité a été démontrée dans le cas des commentaires narratifs fournis aux résidents en médecine d'urgence, mais sa fiabilité n’a pas été évaluée dans d'autres programmes de formation postdoctorale. Méthodes : Cinquante ensembles de commentaires portant sur des APC d'une seule année universitaire dans notre programme postdoctoral en anesthésiologie – un programme fondé sur les compétences – ont été sélectionnés par échantillonnage stratifié selon des paramètres préétablis [par exemple, le sexe du résident et son niveau de formation, le sexe de l'évaluateur, le niveau de formation en Compétence par conception, et le nombre de mots (≥17 ou <17 mots)]. Deux membres du comité de compétence et deux étudiants en médecine ont évalué la qualité de la rétroaction narrative à l'aide d'un score d'utilité et d'un score QuAL. Nous avons utilisé le coefficient tau-b de Kendall pour comparer l'utilité perçue de la rétroaction écrite et sa qualité évaluée à l’aide du score QuAL. Les auteurs ont utilisé des études de généralisabilité et de décision pour estimer les coefficients de fiabilité et de généralisabilité. Résultats : Les scores d'utilité et les scores QuAL des enseignants (r = 0,646, p < 0,001) et ceux des étudiants (r = 0,667, p < 0,001) étaient modérément corrélés. Les résultats des études de généralisabilité ont montré qu’avec deux évaluateurs les scores d'utilité étaient fiables tant pour les enseignants (Epsilon=0,87, Phi=0,86) que pour les étudiants (Epsilon=0,88, Phi=0,88). Conclusions : Le score QuAL est en corrélation avec l'utilité de la rétroaction sur les APC en anesthésiologie évaluée par les enseignants et les étudiants. Les uns et les autres peuvent appliquer de manière fiable le score QuAL aux commentaires narratifs sur les APC en anesthésiologie. Cet outil pourrait être utilisé pour le perfectionnement professoral et l'évaluation des programmes dans le cadre d’une formation médicale fondée sur les compétences. D'autres programmes pourraient envisager de reproduire notre étude dans leur spécialité

Preuve de la validité du score de la qualité de l’évaluation pour l’apprentissage : une mesure de qualité pour les commentaires des superviseurs dans la formation médicale fondée sur les compétences

Background: Competency based medical education (CBME) relies on supervisor narrative comments contained within entrustable professional activities (EPA) for programmatic assessment, but the quality of these supervisor comments is unassessed. There is validity evidence supporting the QuAL (Quality of Assessment for Learning) score for rating the usefulness of short narrative comments in direct observation. Objective: We sought to establish validity evidence for the QuAL score to rate the quality of supervisor narrative comments contained within an EPA by surveying the key end-users of EPA narrative comments: residents, academic advisors, and competence committee members. Methods: In 2020, the authors randomly selected 52 de-identified narrative comments from two emergency medicine EPA databases using purposeful sampling. Six collaborators (two residents, two academic advisors, and two competence committee members) were recruited from each of four EM Residency Programs (Saskatchewan, McMaster, Ottawa, and Calgary) to rate these comments with a utility score and the QuAL score.  Correlation between utility and QuAL score were calculated using Pearson’s correlation coefficient. Sources of variance and reliability were calculated using a generalizability study. Results: All collaborators (n = 24) completed the full study.  The QuAL score had a high positive correlation with the utility score amongst the residents (r = 0.80) and academic advisors (r = 0.75) and a moderately high correlation amongst competence committee members (r = 0.68).  The generalizability study found that the major source of variance was the comment indicating the tool performs well across raters. Conclusion: The QuAL score may serve as an outcome measure for program evaluation of supervisors, and as a resource for faculty development.Contexte : Dans la formation médicale fondée sur les compétences (FMFC), l’évaluation programmatique s’appuie sur les commentaires narratifs des superviseurs en lien avec les activités professionnelles confiables (EPA). En revanche, la qualité de ces commentaires n’est pas évaluée. Il existe des preuves de la validité du score QuAL (qualité de l’évaluation pour l’apprentissage, Quality of Assessment for Learning en anglais) pour l’évaluation de l’utilité des commentaires de rétroaction courts lors de la supervision par observation directe. Objectif : Nous avons tenté de démontrer la validité du score QuAL aux fins de l’évaluation de la qualité des commentaires narratifs des superviseurs pour une APC en interrogeant les principaux utilisateurs finaux des rétroactions : les résidents, les conseillers pédagogiques et les membres du comité de compétence. Méthodes : En 2020, les auteurs ont sélectionné au hasard 52 commentaires narratifs anonymisés dans deux bases de données d’APC en médecine d’urgence au moyen d’un échantillonnage intentionnel. Six collaborateurs (deux résidents, deux conseillers pédagogiques et deux membres de comités de compétence) ont été recrutés dans chacun des quatre programmes de résidence en médecine d’urgence (Saskatchewan, McMaster, Ottawa et Calgary) pour évaluer ces commentaires à l’aide d’un score d’utilité et du score QuAL.  La corrélation entre l’utilité et le score QuAL a été calculée à l’aide du coefficient de corrélation de Pearson. Les sources de variance et la fiabilité ont été calculées à l’aide d’une étude de généralisabilité. Résultats : Tous les collaborateurs (n=24) ont réalisé l’étude complète.  Le score QuAL présentait une corrélation positive élevée avec le score d’utilité parmi les résidents (r=0,80) et les conseillers pédagogiques (r=0,75) et une corrélation modérément élevée parmi les membres du comité de compétence (r=0,68).  L’étude de généralisation a révélé que la principale source de variance était le commentaire, ce qui indique que l’outil a fonctionné avec une efficacité égale pour tous les évaluateurs. Conclusion : Le score QuAL peut servir de mesure des résultats pour l’évaluation des superviseurs par les programmes, et de ressource pour le perfectionnement du corps professoral

Results from Ireland\u27s 2014 report card on physical activity in children and youth

Background: Physical activity (PA) levels are a key performance indicator for policy documents in Ireland. The first Ireland Report Card on Physical Activity in Children and Youth aims to set a robust baseline for future surveillance of indicators related to PA in children and youth. Methods: Data collected between 2003-2010 on more than 35,000 7- to 18-year-old children and youth were used and graded using a standardized grading system for 10 indicators. Results: Grades assigned for the indicators were as follows: overall physical activity levels, D-; sedentary behavior (TV viewing), C-; organized sport participation, C-: physical education, D-; active play, inconclusive (INC); active transportation, D; school, C-, community and the built environment, B; family, INC; and government, INC. Conclusions: PA recommendations exist in Ireland but this Report Card has shown that participation is still low. A number of promising policies, programs and services are in place but these require thorough evaluation and adequate resourcing. Agreement and implementation of a common framework for the systematic surveillance of indictors related to PA of children and youth is necessary to monitor change over time and ensure the impact of promising work is captured

Results from Ireland's 2014 Report Card on Physical Activity in Children and Youth

peer-reviewedBackground: Physical activity (PA) levels are a key performance indicator for policy documents in Ireland. The first Ireland Report Card on Physical Activity in Children and Youth aims to set a robust baseline for future surveillance of indicators related to PA in children and youth. Methods: Data collected between 2003-2010 on more than 35,000 7- to 18-year-old children and youth were used and graded using a standardized grading system for 10 indicators. Results: Grades assigned for the indicators were as follows: overall physical activity levels, D-; sedentary behavior (TV viewing), C-; organized sport participation, C-: physical education, D-; active play, inconclusive (INC); active transportation, D; school, C-, community and the built environment, B; family, INC; and government, INC. Conclusions: PA recommendations exist in Ireland but this Report Card has shown that participation is still low. A number of promising policies, programs and services are in place but these require thorough evaluation and adequate resourcing. Agreement and implementation of a common framework for the systematic surveillance of indictors related to PA of children and youth is necessary to monitor change over time and ensure the impact of promising work is captured.peer-reviewe

Results from Ireland north and south\u27s 2016 report card on physical activity for children and youth

Background: Physical activity (PA) is a key performance indicator for policy documents in both the Republic of Ireland and Northern Ireland. Building on baseline grades set in 2014, Ireland\u27s second Report Card on Physical Activity for Children and Youth allows for continued surveillance of indicators related to PA in children and youth. Methods: Data and information were extracted and collated for 10 indicators and graded using an international standardized grading system. Results: Overall, 7 grades stayed the same, 2 increased, and 1 decreased. Grades were assigned as follows: Overall PA, D (an increase); Sedentary Behavior (TV), C-; Physical Education, D-; Active Play, Incomplete/Inconclusive (INC); Active Transportation, D; School, D (a decrease); Home (Family), INC; Community and the Built Environment, B+ (an increase); and Government, INC. Unlike 2014\u27s report card, different grades for the Republic (C-) and Northern Ireland (C+) were assigned for Organized Sport Participation. Conclusions: Although the grade for Overall PA levels increased to a D, this may reflect the increased quality and quantity of data available. The double burden of low PA and high sedentary levels are concerning and underscore the need for advocacy toward, and surveillance of, progress in achieving targets set by the new National Physical Activity Plan in the Republic and obesity and sport plans in the North

Polaron formation for a non-local electron-phonon coupling: A variational wave-function study

We introduce a variational wave-function to study the polaron formation when the electronic transfer integral depends on the relative displacement between nearest-neighbor sites giving rise to a non-local electron-phonon coupling with optical phonon modes. We analyze the ground state properties such as the energy, the electron-lattice correlation function, the phonon number and the spectral weight. Variational results are found in good agreement with analytic weak-coupling perturbative calculations and exact numerical diagonalization of small clusters. We determine the polaronic phase diagram and we find that the tendency towards strong localization is hindered from the pathological sign change of the effective next-nearest-neighbor hopping.Comment: 11 page

The Prostate Specific Membrane Antigen Regulates the Expression of IL-6 and CCL5 in Prostate Tumour Cells by Activating the MAPK Pathways1

The interleukin-6 (IL-6) and the chemokine CCL5 are implicated in the development and progression of several forms of tumours including that of the prostate. The expression of the prostate specific membrane antigen (PSMA) is augmented in high-grade and metastatic tumors. Observations of the clinical behaviour of prostate tumors suggest that the increased secretion of IL-6 and CCL5 and the higher expression of PSMA may be correlated. We hypothesized that PSMA could be endowed with signalling properties and that its stimulation might impact on the regulation of the gene expression of IL-6 and CCL5. We herein demonstrate that the cross-linking of cell surface PSMA with specific antibodies activates the small GTPases RAS and RAC1 and the MAPKs p38 and ERK1/2 in prostate carcinoma LNCaP cells. As downstream effects of the PSMA-fostered RAS-RAC1-MAPK pathway activation we observed a strong induction of NF-κB activation associated with an increased expression of IL-6 and CCL5 genes. Pharmacological blockade with specific inhibitors revealed that both p38 and ERK1/2 participate in the phenomenon, although a major role exerted by p38 was evident. Finally we demonstrate that IL-6 and CCL5 enhanced the proliferative potential of LNCaP cells synergistically and in a dose-dependent manner and that CCL5 functioned by receptor-mediated activation of the STAT5-Cyclin D1 pro-proliferative pathway. The novel functions attributable to PSMA which are described in the present report may have profound influence on the survival and proliferation of prostate tumor cells, accounting for the observation that PSMA overexpression in prostate cancer patients is related to a worse prognosis

Downregulation of RKIP Is Associated with Poor Outcome and Malignant Progression in Gliomas

Malignant gliomas are highly infiltrative and invasive tumors, which precludes the few treatment options available. Therefore, there is an urgent need to elucidate the molecular mechanisms underlying gliomas aggressive phenotype and poor prognosis. The Raf Kinase Inhibitory protein (RKIP), besides regulating important intracellular signaling cascades, was described to be associated with progression, metastasis and prognosis in several human neoplasms. Its role in the prognosis and tumourigenesis of gliomas remains unclear

Booster vaccination against SARS-CoV-2 induces potent immune responses in people with human immunodeficiency virus

Background People with human immunodeficiency virus (HIV) on antiretroviral therapy (ART) with good CD4 T-cell counts make effective immune responses following vaccination against severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). There are few data on longer term responses and the impact of a booster dose. Methods Adults with HIV were enrolled into a single arm open label study. Two doses of ChAdOx1 nCoV-19 were followed 12 months later by a third heterologous vaccine dose. Participants had undetectable viraemia on ART and CD4 counts >350 cells/µL. Immune responses to the ancestral strain and variants of concern were measured by anti-spike immunoglobulin G (IgG) enzyme-linked immunosorbent assay (ELISA), MesoScale Discovery (MSD) anti-spike platform, ACE-2 inhibition, activation induced marker (AIM) assay, and T-cell proliferation. Findings In total, 54 participants received 2 doses of ChAdOx1 nCoV-19. 43 received a third dose (42 with BNT162b2; 1 with mRNA-1273) 1 year after the first dose. After the third dose, total anti-SARS-CoV-2 spike IgG titers (MSD), ACE-2 inhibition, and IgG ELISA results were significantly higher compared to Day 182 titers (P < .0001 for all 3). SARS-CoV-2 specific CD4+ T-cell responses measured by AIM against SARS-CoV-2 S1 and S2 peptide pools were significantly increased after a third vaccine compared to 6 months after a first dose, with significant increases in proliferative CD4+ and CD8+ T-cell responses to SARS-CoV-2 S1 and S2 after boosting. Responses to Alpha, Beta, Gamma, and Delta variants were boosted, although to a lesser extent for Omicron. Conclusions In PWH receiving a third vaccine dose, there were significant increases in B- and T-cell immunity, including to known variants of concern (VOCs)

Endovascular strategy or open repair for ruptured abdominal aortic aneurysm: one-year outcomes from the IMPROVE randomized trial.

AIMS: To report the longer term outcomes following either a strategy of endovascular repair first or open repair of ruptured abdominal aortic aneurysm, which are necessary for both patient and clinical decision-making. METHODS AND RESULTS: This pragmatic multicentre (29 UK and 1 Canada) trial randomized 613 patients with a clinical diagnosis of ruptured aneurysm; 316 to an endovascular first strategy (if aortic morphology is suitable, open repair if not) and 297 to open repair. The principal 1-year outcome was mortality; secondary outcomes were re-interventions, hospital discharge, health-related quality-of-life (QoL) (EQ-5D), costs, Quality-Adjusted-Life-Years (QALYs), and cost-effectiveness [incremental net benefit (INB)]. At 1 year, all-cause mortality was 41.1% for the endovascular strategy group and 45.1% for the open repair group, odds ratio 0.85 [95% confidence interval (CI) 0.62, 1.17], P = 0.325, with similar re-intervention rates in each group. The endovascular strategy group and open repair groups had average total hospital stays of 17 and 26 days, respectively, P < 0.001. Patients surviving rupture had higher average EQ-5D utility scores in the endovascular strategy vs. open repair groups, mean differences 0.087 (95% CI 0.017, 0.158), 0.068 (95% CI -0.004, 0.140) at 3 and 12 months, respectively. There were indications that QALYs were higher and costs lower for the endovascular first strategy, combining to give an INB of £3877 (95% CI £253, £7408) or €4356 (95% CI €284, €8323). CONCLUSION: An endovascular first strategy for management of ruptured aneurysms does not offer a survival benefit over 1 year but offers patients faster discharge with better QoL and is cost-effective. CLINICAL TRIAL REGISTRATION: ISRCTN 48334791