The Positivism Paradigm of Research.

Research paradigms guide scientific discoveries through their assumptions and principles. Understanding paradigm-specific assumptions helps illuminate the quality of findings that support scientific studies and identify gaps in generating sound evidence. This article focuses on the research paradigm of positivism, examining its definition, history, and assumptions (ontology, epistemology, axiology, methodology, and rigor). Positivism is aligned with the hypothetico-deductive model of science that builds on verifying a priori hypotheses and experimentation by operationalizing variables and measures; results from hypothesis testing are used to inform and advance science. Studies aligned with positivism generally focus on identifying explanatory associations or causal relationships through quantitative approaches, where empirically based findings from large sample sizes are favored-in this regard, generalizable inferences, replication of findings, and controlled experimentation have been principles guiding positivist science. Criteria for evaluating the quality of positivist research are discussed. An example from health professions education is provided to guide positivist thinking in study design and implementation

Developing questionnaires for educational research: AMEE Guide No. 87

In this AMEE Guide, we consider the design and development of self-administered surveys, commonly called questionnaires. Questionnaires are widely employed in medical education research. Unfortunately, the processes used to develop such questionnaires vary in quality and lack consistent, rigorous standards. Consequently, the quality of the questionnaires used in medical education research is highly variable. To address this problem, this AMEE Guide presents a systematic, seven-step process for designing high-quality questionnaires, with particular emphasis on developing survey scales. These seven steps do not address all aspects of survey design, nor do they represent the only way to develop a high-quality questionnaire. Instead, these steps synthesize multiple survey design techniques and organize them into a cohesive process for questionnaire developers of all levels. Addressing each of these steps systematically will improve the probabilities that survey designers will accurately measure what they intend to measure

When will I get my paper back? A replication study of publication timelines for health professions education research.

INTRODUCTION: Biomedical researchers have lamented the lengthy timelines from manuscript submission to publication and highlighted potential detrimental effects on scientific progress and scientists\u27 careers. In 2015, Himmelstein identified the mean time from manuscript submission to acceptance in biomedicine as approximately 100 days. The length of publication timelines in health professions education (HPE) is currently unknown. METHODS: This study replicates Himmelstein\u27s work with a sample of 14 HPE journals published between 2008-2018. Using PubMed, 19,182 article citations were retrieved. Open metadata for each were downloaded, including the date the article was received by the journal, date the authors resubmitted revisions, date the journal accepted the article, and date of entry into PubMed. Journals without publication history metadata were excluded. RESULTS: Publication history data were available for 55% (n = 8) of the journals sampled. The publication histories of 4,735 (25%) articles were analyzed. Mean time from: (1) author submission to journal acceptance was 180.93 days (SD = 103.89), (2) author submission to posting on PubMed was 263.55 days (SD = 157.61), and (3) journal acceptance to posting on PubMed was 83.15 days (SD = 135.72). DISCUSSION: This study presents publication metadata for journals that openly provide it-a first step towards understanding publication timelines in HPE. Findings confirm the replicability of the original study, and the limited data suggest that, in comparison to biomedical scientists broadly, medical educators may experience longer wait times for article acceptance and publication. Reasons for these delays are currently unknown and deserve further study; such work would be facilitated by increased public access to journal metadata

Breaking Down Grit: Persistency and Flexibility in the Career Plans of Military Medical Students.

INTRODUCTION: The field of medicine is experiencing a crisis as high levels of physician and trainee burnout threaten the pipeline of future physicians. Grit, or passion and perseverance for long-term goals, has been studied in high-performing and elite military units and found to be predictive of successful completion of training in adverse conditions. The Uniformed Services University of the Health Sciences (USU) graduates military medical leaders who make up a significant portion of the Military Health System physician workforce. Taken together, an improved understanding of the relationships between burnout, well-being, grit, and retention among USU graduates is critical to the success of the Military Health System. MATERIALS AND METHODS: The current study was approved by the Institutional Review Board at USU and explored these relations among 519 medical students across three graduating classes. These students participated in two surveys approximately one year apart from October 2018 until November 2019. Participants completed measures on grit, burnout, and likelihood of leaving the military. These data were then merged with demographic and academic data (e.g., Medical College Admission Test scores) from the USU Long Term Career Outcome Study. These variables were then analyzed simultaneously using structural equation modeling to examine the relationships among variables in a single model. RESULTS: Results reaffirmed the 2-factor model of grit as both passion and perseverance (or interest consistency). No significant relationships emerged between burnout and other study variables. Sustained and focused interest was predictive of less likelihood of staying in the military. CONCLUSION: This study offers important insights into the relationship among well-being factors, grit, and long-term career planning in the military. The limitations of using a single-item measure of burnout and measuring behavioral intentions in a short time frame during undergraduate medical education highlight the importance of future longitudinal studies that can examine actual behaviors across a career lifespan. However, this study offers some key insights into potential impacts on the retention of military physicians. The findings suggest that military physicians who are most likely to stay in the military tend to embrace a more fluid and flexible medical specialty path. This is critical in expectation setting for the military to train and retain military physicians across a wide range of critical wartime specialties

Understanding context specificity:the effect of contextual factors on clinical reasoning

Background: Situated cognition theory argues that thinking is inextricably situated in a context. In clinical reasoning, this can lead to context specificity: a physician arriving at two different diagnoses for two patients with the same symptoms, findings, and diagnosis but different contextual factors (something beyond case content potentially influencing reasoning). This paper experimentally investigates the presence of and mechanisms behind context specificity by measuring differences in clinical reasoning performance in cases with and without contextual factors. Methods: An experimental study was conducted in 2018-2019 with 39 resident and attending physicians in internal medicine. Participants viewed two outpatient clinic video cases (unstable angina and diabetes mellitus), one with distracting contextual factors and one without. After viewing each case, participants responded to six open-ended diagnostic items (e.g. problem list, leading diagnosis) and rated their cognitive load. Results: Multivariate analysis of covariance (MANCOVA) results revealed significant differences in angina case performance with and without contextual factors [Pillai's trace = 0.72, F=12.4, df=(6, 29), p Conclusions: Using typical presentations of common diagnoses, and contextual factors typical for clinical practice, we provide ecologically valid evidence for the theoretically predicted negative effects of context specificity (i.e. for the angina case), with large effect sizes, offering insight into the persistence of diagnostic error

Well-being at a Military Medical School and Implications for Military Retention.

INTRODUCTION: Physical and psychological well-being play a critical role in the academic and professional development of medical students and can alter the trajectory of a student\u27s quality of personal and professional life. Military medical students, given their dual role as officer and student, experience unique stressors and issues that may play a role in their future intentions to continue military service, as well as practice medicine. As such, this study explores well-being across the 4 years of medical school at Uniformed Services University (USU) and how well-being relates to a student\u27s likelihood to continue serving in the military and practicing medicine. METHODS: In September 2019, 678 USU medical students were invited to complete a survey consisting of three sections-the Medical Student Well-being Index (MSWBI), a single-item burnout measure, and six questions regarding their likelihood of staying in the military and medical practice. Survey responses were analyzed using descriptive statistics, analysis of variance (ANOVA), and contingency table analysis. Additionally, thematic analysis was conducted on open-ended responses included as part of the likelihood questions. RESULTS: Our MSWBI and burnout scores suggest that the overall state of well-being among medical students at USU is comparable to other studies of the medical student population. ANOVA revealed class differences among the four cohorts, highlighted by improved well-being scores as students transitioned from clerkships to their fourth-year curriculum. Fewer clinical students (MS3s and MS4s), compared to pre-clerkship students, indicated a desire to stay in the military. In contrast, a higher percentage of clinical students seemed to reconsider their medical career choice compared to their pre-clerkship student counterparts. Medicine-oriented likelihood questions were associated with four unique MSWBI items, whereas military-oriented likelihood questions were associated with one unique MSWBI item. CONCLUSION: The present study found that the overall state of well-being in USU medical students is satisfactory, but opportunities for improvement exist. Medical student well-being seemed to have a stronger association with medicine-oriented likelihood items than with military-oriented likelihood items. To obtain and refine best practices for strengthening engagement and commitment, future research should examine if and how military and medical contexts converge and diverge throughout training. This may enhance the medical school and training experience and, ultimately, reinforce, or strengthen, the desire and commitment to practice and serve in military medicine

Fundamentals of Anorectal Technical Skills: A Concise Surgical Skills Course

Introduction Anorectal diseases, among the most common surgical conditions, are underrepresented in medical training. The Fundamentals of Anorectal Technical Skills course was developed to provide cost-effective formal training in diagnosis of common anorectal conditions and in commonly performed anorectal procedures using the theories of deliberative practice and perceptual and adaptive learning. Materials and Methods First- through third-year general surgery and internal medicine residents and third- and fourth-year medical students participated in a course consisting of didactic instruction and hands on skills stations. The course covered common anorectal conditions, including internal and external hemorrhoids, fissures, condylomata, abscesses, fistula-in-ano, rectal prolapse, pilonidal disease, pruritis ani, and anal and rectal cancer, as well as common procedures such as anoscopy, excision of thrombosed external hemorrhoids, banding of internal hemorrhoids, rigid proctoscopy, incision and drainage of an abscess, administration of local anesthesia, and reduction of rectal prolapse. Before the course, participants completed a questionnaire consisting of demographics; previous anorectal experience, as measured by procedural case volume; confidence diagnosing and treating anorectal conditions; and a clinical knowledge multiple-choice quiz. Immediately following the course, participants took an additional survey reassessing their confidence and testing their clinical knowledge. This study was granted an educational exception by the Institutional Review Board at Walter Reed National Military Medical Center. Results Forty-three learners participated in this course. Forty-six percent of participants had not participated in any anorectal cases, 26% had participated in 1 to 5 cases, 17% had participated in 6 to 10 cases, 6% had been involved with 11 to15 cases, and 6% had been involved with more than 15 cases. For learners who had no prior experience, 1 to 5 prior cases, or 6 to 10 cases, there were statistically and educationally significant increases in confidence for all diagnoses and procedures. Additionally, there were statistically and educationally significant increases between pre-course and post-course quiz scores for learners who had no prior experience (7.8 ± 2.0 vs. 11.8 ± 2.5, P < 0.01, Cohen’s d = 1.8) and for those who had only participated in 1 to 5 cases (11.0 ± 3.7 vs. 14.2 ± 2.0, P = 0.04, Cohen’s d = 1.1). The changes in quiz scores for learners who previously had been involved with six or more cases were not statistically significant. Conclusion This course provides a cost-effective training that significantly boosts learners’ confidence in diagnosis of common anorectal procedures and confidence in performance of common anorectal procedures, in addition to improving objectively measured anorectal clinical knowledge

The effect of assessments on student motivation for learning and its outcomes in health professions education: A review

Purpose: In health professions education (HPE) the effect of assessments on student motivation for learning and its consequences have been largely neglected. This is problematic because assessments can hamper motivation and psychological well-being. The research questions guiding this review were: How do assessments affect student motivation for learning in HPE? What outcomes does this lead to in which contexts? Method: In October 2020, the authors searched PubMed, Embase, APA PsycInfo, ERIC, CINAHL, and Web of Science Core Collection for “assessments” AND “motivation” AND “health professions education/students.” Empirical papers or literature reviews investigating the effect of assessments on student motivation for learning in HPE using quantitative, qualitative, or mixed methods from January 1, 2010–October 29, 2020, were included. The authors chose the realist synthesis method for data analysis to study the intended and unintended consequences of this complex topic. Assessments were identified as stimulating autonomous or controlled motivation using sensitizing concepts from self-determination theory and data on context-mechanism-outcome were extracted. Results: Twenty-four of 15,291 articles were ultimately included. Assessments stimulating controlled motivation seemed to have negative outcomes. An example of an assessment that stimulates controlled motivation is one that focuses on factual knowledge (context), which encourages studying only for the assessment (mechanism) and results in surface learning (outcome). Assessments stimulating autonomous motivation seemed to have positive outcomes. An example of an assessment that stimulates autonomous motivation is one that is fun (context), which through active learning (mechanism) leads to higher effort and better connection with the material (outcome). Conclusions: These findings indicate that students strategically learned what was expected to appear in assessments at the expense of what was needed in practice. Therefore, health professions educators should rethink their assessment philosophy and practices and introduce assessments that are relevant to professional practice and stimulate genuine interest in the content