Measuring deliberate reflection in residents: validation and psychometric properties of a measurement tool

PURPOSE: Reflective capacity is the ability to understand critical analysis of knowledge and experience to achieve deeper meaning. In medicine, there is little provision for post-graduate medical education to teach deliberate reflection. The feasibility, scoring characteristics, reliability, validation, and adaptability of a modified previously validated instrument was examined for its usefulness assessing reflective capacity in residents as a step toward developing interventions for improvement. METHODS: Third-year residents and fellows from four anesthesia training programs were administered a slightly modified version of the Reflection Evaluation for Learners\u27 Enhanced Competencies Tool (REFLECT) in a prospective, observational study at the end of the 2019 academic year. Six written vignettes of imperfect anesthesia situations were created. Subjects recorded their perspectives on two randomly assigned vignettes. Responses were scored using a 5-element rubric; average scores were analyzed for psychometric properties. An independent self-report assessment method, the Cognitive Behavior Survey: Residency Level (rCBS) was used to examine construct validity. Internal consistency (ICR, Cronbach\u27s alpha) and interrater reliability (weighted kappa) were examined. Pearson correlations were used between the two measures of reflective capacity. RESULTS: 46/136 invited subjects completed 2/6 randomly assigned vignettes. Interrater agreement was high (k = 0.85). The overall average REFLECT score was 1.8 (1-4 scale) with good distribution across the range of scores. ICR for both the REFLECT score (mean 1.8, sd 0.5; α = 0.92) and the reflection scale of the rCBS (mean 4.5, sd 1.1; α = 0.94) were excellent. There was a significant correlation between REFLECT score and the rCBS reflection scale (r = .44, p \u3c 0.01). CONCLUSIONS: This study demonstrates feasibility, reliability, and sufficiently robust psychometric properties of a modified REFLECT rubric to assess graduate medical trainees\u27 reflective capacity and established construct/convergent validity to an independent measure. The instrument has the potential to assess the effectiveness of interventions intended to improve reflective capacity

Cancer immunoediting by the innate immune system in the absence of adaptive immunity

Cancer immunoediting is the process whereby immune cells protect against cancer formation by sculpting the immunogenicity of developing tumors. Although the full process depends on innate and adaptive immunity, it remains unclear whether innate immunity alone is capable of immunoediting. To determine whether the innate immune system can edit tumor cells in the absence of adaptive immunity, we compared the incidence and immunogenicity of 3'methylcholanthrene-induced sarcomas in syngeneic wild-type, RAG2, and RAG2x γc mice. We found that innate immune cells could manifest cancer immunoediting activity in the absence of adaptive immunity. This activity required natural killer (NK) cells and interferon γ (IFN-γ), which mediated the induction of M1 macrophages. M1 macrophages could be elicited by administration of CD40 agonists, thereby restoring editing activity in RAG2x γc mice. Our results suggest that in the absence of adaptive immunity, NK cell production of IFN-γ induces M1 macrophages, which act as important effectors during cancer immunoediting

Measuring deliberate reflection in residents: validation and psychometric properties of a measurement tool

Abstract Purpose Reflective capacity is “the ability to understand critical analysis of knowledge and experience to achieve deeper meaning.” In medicine, there is little provision for post-graduate medical education to teach deliberate reflection. The feasibility, scoring characteristics, reliability, validation, and adaptability of a modified previously validated instrument was examined for its usefulness assessing reflective capacity in residents as a step toward developing interventions for improvement. Methods Third-year residents and fellows from four anesthesia training programs were administered a slightly modified version of the Reflection Evaluation for Learners’ Enhanced Competencies Tool (REFLECT) in a prospective, observational study at the end of the 2019 academic year. Six written vignettes of imperfect anesthesia situations were created. Subjects recorded their perspectives on two randomly assigned vignettes. Responses were scored using a 5-element rubric; average scores were analyzed for psychometric properties. An independent self-report assessment method, the Cognitive Behavior Survey: Residency Level (rCBS) was used to examine construct validity. Internal consistency (ICR, Cronbach’s alpha) and interrater reliability (weighted kappa) were examined. Pearson correlations were used between the two measures of reflective capacity. Results 46/136 invited subjects completed 2/6 randomly assigned vignettes. Interrater agreement was high (k = 0.85). The overall average REFLECT score was 1.8 (1–4 scale) with good distribution across the range of scores. ICR for both the REFLECT score (mean 1.8, sd 0.5; α = 0.92) and the reflection scale of the rCBS (mean 4.5, sd 1.1; α = 0.94) were excellent. There was a significant correlation between REFLECT score and the rCBS reflection scale (r = .44, p < 0.01). Conclusions This study demonstrates feasibility, reliability, and sufficiently robust psychometric properties of a modified REFLECT rubric to assess graduate medical trainees’ reflective capacity and established construct/convergent validity to an independent measure. The instrument has the potential to assess the effectiveness of interventions intended to improve reflective capacity

Cancer immunoediting by the innate immune system in the absence of adaptive immunity.

Cancer immunoediting is the process whereby immune cells protect against cancer formation by sculpting the immunogenicity of developing tumors. Although the full process depends on innate and adaptive immunity, it remains unclear whether innate immunity alone is capable of immunoediting. To determine whether the innate immune system can edit tumor cells in the absence of adaptive immunity, we compared the incidence and immunogenicity of 3'methylcholanthrene-induced sarcomas in syngeneic wild-type, RAG2(-/-), and RAG2(-/-)x γc(-/-) mice. We found that innate immune cells could manifest cancer immunoediting activity in the absence of adaptive immunity. This activity required natural killer (NK) cells and interferon γ (IFN-γ), which mediated the induction of M1 macrophages. M1 macrophages could be elicited by administration of CD40 agonists, thereby restoring editing activity in RAG2(-/-)x γc(-/-) mice. Our results suggest that in the absence of adaptive immunity, NK cell production of IFN-γ induces M1 macrophages, which act as important effectors during cancer immunoediting

Microneedle-mediated intratumoral delivery of anti-CTLA-4 promotes cDC1-dependent eradication of oral squamous cell carcinoma with limited irAEs

Head and neck squamous cell carcinoma (HNSCC) ranks sixth in cancer incidence worldwide and has a 5-year survival rate of only 63%. Immunotherapies-principally immune checkpoint inhibitors (ICI), such as anti-PD-1 and anti-CTLA-4 antibodies that restore endogenous antitumor T-cell immunity-offer the greatest promise for HNSCC treatment. Anti-PD-1 has been recently approved for first-line treatment of recurrent and metastatic HNSCC; however, less than 20% of patients show clinical benefit and durable responses. In addition, the clinical application of ICI has been limited by immune-related adverse events (irAE) consequent to compromised peripheral immune tolerance. Although irAEs are often reversible, they can become severe, prompting premature therapy termination or becoming life threatening. To address the irAEs inherent to systemic ICI therapy, we developed a novel, local delivery strategy based upon an array of soluble microneedles (MN). Using our recently reported syngeneic, tobacco-signature murine HNSCC model, we found that both systemic and local-MN anti-CTLA-4 therapy lead to &gt;90% tumor response, which is dependent on CD8 T cells and conventional dendritic cell type 1 (cDC1). However, local-MN delivery limited the distribution of anti-CTLA-4 antibody from areas distal to draining lymphatic basins. Employing Foxp3-GFPDTR transgenic mice to interrogate irAEs in vivo, we found that local-MN delivery of anti-CTLA-4 protects animals from irAEs observed with systemic therapy. Taken together, our findings support the exploration of MN-intratumoral ICI delivery as a viable strategy for HNSCC treatment with reduced irAEs, and the opportunity to target cDC1s as part of multimodal treatment options to boost ICI therapy

Impact of personalized feedback:The case of coaching and learning change plans

This chapter describes an empirically derived model for impactful feedback discussions. The R2C2 model has four phases: Educators build the relationship (R) between educator and learner, gain learner reactions (R) to the feedback which can be used to determine the potential for change and development, and explore and ensure a mutual understanding of the content (C) in order to coach for change (C) to co-create achievable learning change plans that can be monitored to ensure learner progress. Two mechanisms in particular, coaching and learning change plans, support learner acceptance and use of the feedback. The chapter concludes with suggestions for future application and research in health professions education and higher education