Disruption and Dissonance: Exploring Constructive Tensions Within Research in Medical Education

The academic medicine community has experienced an unprecedented level of disruption in recent years. In this context, the authors consider how the disruptions have impacted the state of research in medical education (RIME). The articles in this year\u27s RIME supplement reflect several constructive tensions that provide insight on future for the field. In this commentary, the authors discuss themes and propose a framework for the future. Recommendations include: normalizing help seeking during times of disruption and uncertainty, contextualizing the application of complex approaches to assessment, advancing and problematizing innovation, and recognizing the deeply embedded and systemic nature of inequities

A comparison of two scales for assessing health professional students’ attitude toward interprofessional learning

Rationale : The validated 19-item Readiness for Interprofessional Learning Scale (RIPLS) is often used for assessing attitudes toward interprofessional education (IPE). The 12-item Interdisciplinary Education Perception Scale (IEPS), also used for this purpose, has not been validated among the professions of medicine, pharmacy, and physician assistants (PAs). The discriminatory ability of the two scales has not been directly compared. Comparison of the two will aid educators in selecting the optimal scale. Objective : To compare psychometric properties of the RIPLS and IEPS and to examine the ability of each scale to discriminate mean scores among student subgroups (gender, profession, seniority, and prior IPE exposure). Method : We conducted a cross-sectional (Qualtrics©) survey (RIPLS and IEPS) of junior and senior students in medicine (n=360), pharmacy (n=360), and the PA profession (n=106). Descriptive statistics were used to report aggregate mean scores of subgroups. The internal consistency of each scale was assessed using Cronbach's α. Concurrent validity was measured by Pearson's correlation coefficients. Independent-sample t-tests and analysis of variances (ANOVAs) were performed to assess the discriminatory ability of each scale. Cohen's d effect sizes were calculated for all significant pair-wise comparisons. Results : Response rate was 82%. Cronbach's α was 0.85 (RIPLS) and 0.91 (IEPS). The RIPLS discriminated scores by gender among junior students only, and scores by IPE exposure among all students. The IEPS distinguished score differences for the three professions among junior students and by prior IPE exposure for all three professions. Neither scale detected differences in mean scores by profession among all students or by level of training among the three professions. Conclusions : Neither the RIPLS nor the IEPS has greater discriminatory ability for detecting attitude differences among the student subgroups. Reason for differences may be explained by slightly different scale constructs. The RIPLS is designed to assess students’ own attitude toward interprofessional learning, while the IEPS discerns perceived attitudes about team collaboration for students’ own professions and may be more appropriate for more advanced students

Assessing Patient-centered Care: One Approach to Health Disparities Education

Patient-centered care has been described as one approach to cultural competency education that could reduce racial and ethnic health disparities by preparing providers to deliver care that is respectful and responsive to the preferences of each patient. In order to evaluate the effectiveness of a curriculum in teaching patient-centered care (PCC) behaviors to medical students, we drew on the work of Kleinman, Eisenberg, and Good to develop a scale that could be embedded across cases in an objective structured clinical examination (OSCE). To compare the reliability, validity, and feasibility of an embedded patient-centered care scale with the use of a single culturally challenging case in measuring students′ use of PCC behaviors as part of a comprehensive OSCE. A total of 322 students from two California medical schools participated in the OSCE as beginning seniors. Cronbach’s alpha was used to assess the internal consistency of each approach. Construct validity was addressed by establishing convergent and divergent validity using the cultural challenge case total score and OSCE component scores. Feasibility assessment considered cost and training needs for the standardized patients (SPs). Medical students demonstrated a moderate level of patient-centered skill (mean = 63%, SD = 11%). The PCC Scale demonstrated an acceptable level of internal consistency (alpha = 0.68) over the single case scale (alpha = 0.60). Both convergent and divergent validities were established through low to moderate correlation coefficients. The insertion of PCC items across multiple cases in a comprehensive OSCE can provide a reliable estimate of students′ use of PCC behaviors without incurring extra costs associated with implementing a special cross-cultural OSCE. This approach is particularly feasible when an OSCE is already part of the standard assessment of clinical skills. Reliability may be increased with an additional investment in SP training

The Knowledge, Attitudes and Usage of Complementary and Alternative Medicine of Medical Students

The increasing use of CAM by patients has led to an increase in teaching about CAM in medical school in the US. In preparation for initiation of a new curriculum in Integrative Medicine at the David Geffen School of Medicine at UCLA a cross sectional survey was used to assess medical students': (i) familiarity, (ii) opinions, (iii) personal use and (iv) willingness to recommend specific CAM modalities, using a five point Likert scale of an established measure. A total of 263 first, second and third year medical students at UCLA completed surveys. Third year students reported less personal use of CAM and less favorable attitudes towards CAM than first year students. Since this was a cross-sectional rather than longitudinal study this may be a cohort effect. However, it may reflect the increased curricular emphasis on evidenced-based medicine, and subsequent student dependence on randomized clinical trials to influence and guide practice. This will need to be addressed in curricular efforts to incorporate Integrative Medicine

Working with interpreters: how student behavior affects quality of patient interaction when using interpreters

Background: Despite the prevalence of medical interpreting in the clinical environment, few medical professionals receive training in best practices when using an interpreter. We designed and implemented an educational workshop on using interpreters as part of the cultural competency curriculum for second year medical students (MSIIs) at David Geffen School of Medicine at UCLA. The purpose of this study is two-fold: first, to evaluate the effectiveness of the workshop and second, if deficiencies are found, to investigate whether the deficiencies affected the quality of the patient encounter when using an interpreter. Methods: A total of 152 MSIIs completed the 3-hour workshop and a 1-station objective-structured clinical examination, 8 weeks later to assess skills. Descriptive statistics and independent sample t-tests were used to assess workshop effectiveness. Results: Based on a passing score of 70%, 39.4% of the class failed. Two skills seemed particularly problematic: assuring confidentiality (missed by 50%) and positioning the interpreter (missed by 70%). While addressing confidentiality did not have a significant impact on standardized patient satisfaction, interpreter position did. Conclusion: Instructing the interpreter to sit behind the patient helps sustain eye contact between clinician and patient, while assuring confidentiality is a tenet of quality clinical encounters. Teaching students and faculty to emphasize both is warranted to improve cross-language clinical encounters

Assessing Patient-centered Care: One Approach to Health Disparities Education

Patient-centered care has been described as one approach to cultural competency education that could reduce racial and ethnic health disparities by preparing providers to deliver care that is respectful and responsive to the preferences of each patient. In order to evaluate the effectiveness of a curriculum in teaching patient-centered care (PCC) behaviors to medical students, we drew on the work of Kleinman, Eisenberg, and Good to develop a scale that could be embedded across cases in an objective structured clinical examination (OSCE). To compare the reliability, validity, and feasibility of an embedded patient-centered care scale with the use of a single culturally challenging case in measuring students′ use of PCC behaviors as part of a comprehensive OSCE. A total of 322 students from two California medical schools participated in the OSCE as beginning seniors. Cronbach’s alpha was used to assess the internal consistency of each approach. Construct validity was addressed by establishing convergent and divergent validity using the cultural challenge case total score and OSCE component scores. Feasibility assessment considered cost and training needs for the standardized patients (SPs). Medical students demonstrated a moderate level of patient-centered skill (mean = 63%, SD = 11%). The PCC Scale demonstrated an acceptable level of internal consistency (alpha = 0.68) over the single case scale (alpha = 0.60). Both convergent and divergent validities were established through low to moderate correlation coefficients. The insertion of PCC items across multiple cases in a comprehensive OSCE can provide a reliable estimate of students′ use of PCC behaviors without incurring extra costs associated with implementing a special cross-cultural OSCE. This approach is particularly feasible when an OSCE is already part of the standard assessment of clinical skills. Reliability may be increased with an additional investment in SP training

Flipping a Single Lecture in a Survey Course to Active Learning: Do the Benefits Justify the Costs?

Health education has seen a surge of interest in active learning strategies like the flipped classroom. In response to the need for physical distancing in the age of COVID-19, schools are rapidly shifting to web-based and video technology, sometimes without being able to predict the outcomes of this change. The objectives of this pilot experiment were to (1) compare active learning (AL) methods versus traditional lecture for transmitting and retaining knowledge in the introductory pre-clinical medical school curriculum and (2) weigh whether the costs required to flip instruction were justified by learning gains. The authors took a 2 h lecture for first-year medical students and converted half of it into an AL format. In-person lecture and active learning groups were compared in terms of student knowledge at pre-intervention, immediately post-intervention, and 6 months post-intervention. Costs for first-time delivery and anticipated costs for repeat delivery of each format were calculated. Students' gains in knowledge increased in both groups, though more by lecture (control) than via AL. Delivering a single hour of new AL costs 3.4 times that of a new lecture. Repeat offerings of the AL intervention were estimated to cost 5.4 times that of the repeat lecture. The 1 h AL session was less effective than the 1 h lecture for knowledge acquisition and retention at 6-month follow-up. The AL was more expensive to produce and to repeat. Future research needs to evaluate the impact of AL with a larger N, control group, structured faculty/resident procedures, and assessment of gaining and applying attitudes and skills in addition to knowledge

Interprofessional education: What measurable learning outcomes are realistic for the physician assistant profession?

© 2016 Physician Assistant Education Association. Purpose To compare physician assistant (PA) students’ attitudes regarding interprofessional education by students’ seniority, gender, age, and previous experience with interprofessional education. Methods The validated 19-item Readiness for Interprofessional Learning Scale and the 12-item Interdisciplinary Education Perception Scale were administered to matriculating and graduating PA students from 2 US institutions (N = 186). Primary outcomes were score differences by subgroup and institution using independent sample t-tests. We also examined scale validity measured by Cronbach’s alpha (internal consistency) and Pearson correlation coefficients (concurrent validity). Results Student demographics at both institutions were similar. Initial comparisons did not demonstrate significant institutional differences. Consequently, data were combined for subsequent analyses. Matriculating students had significantly higher mean Readiness for Interprofessional Learning Scale scores than did graduating students. No significant differences were found by gender, age, or previous interprofessional education exposure for either scale. Both scales demonstrated high internal consistency (Readiness for Interprofessional Learning Scale α = 0.93; Interdisciplinary Education Perception Scale α = 0.84). Conclusions Physician assistant student attitudes regarding interprofessional education are very positive at matriculation and are less positive at graduation. Physician assistant student attitudes do not vary by gender, age, or previous interprofessional education exposure. Physician assistant educators should ensure that students’ interprofessional education exposure makes full use of the students’ initial positive attitudes and focuses on skill development for interprofessional education competencies