Evaluating the Effectiveness of Undergraduate Clinical Education Programs

Medical schools should use a variety of measures to evaluate the effectiveness of their clinical curricula. Both outcome measures and process measures should be included, and these can be organized according to the four-level training evaluation model developed by Donald Kirkpatrick. Managing evaluation data requires the institution to employ deliberate strategies to monitor signals in real-time and aggregate data so that informed decisions can be made. Future steps in program evaluation includes increased emphasis on patient outcomes and multi-source feedback, as well as better integration of existing data sources

Fundulus as the premier teleost model in environmental biology : opportunities for new insights using genomics

Author Posting. © Elsevier B.V., 2007. This is the author's version of the work. It is posted here by permission of Elsevier B.V. for personal use, not for redistribution. The definitive version was published in Comparative Biochemistry and Physiology Part D: Genomics and Proteomics 2 (2007): 257-286, doi:10.1016/j.cbd.2007.09.001.A strong foundation of basic and applied research documents that the estuarine fish Fundulus heteroclitus and related species are unique laboratory and field models for understanding how individuals and populations interact with their environment. In this paper we summarize an extensive body of work examining the adaptive responses of Fundulus species to environmental conditions, and describe how this research has contributed importantly to our understanding of physiology, gene regulation, toxicology, and ecological and evolutionary genetics of teleosts and other vertebrates. These explorations have reached a critical juncture at which advancement is hindered by the lack of genomic resources for these species. We suggest that a more complete genomics toolbox for F. heteroclitus and related species will permit researchers to exploit the power of this model organism to rapidly advance our understanding of fundamental biological and pathological mechanisms among vertebrates, as well as ecological strategies and evolutionary processes common to all living organisms.This material is based on work supported by grants from the National Science Foundation DBI-0420504 (LJB), OCE 0308777 (DLC, RNW, BBR), BES-0553523 (AW), IBN 0236494 (BBR), IOB-0519579 (DHE), IOB-0543860 (DWT), FSML-0533189 (SC); National Institute of Health NIEHS P42-ES007381(GVC, MEH), P42-ES10356 (RTD), ES011588 (MFO); and NCRR P20 RR-016463 (DWT); Natural Sciences and Engineering Research Council of Canada Discovery (DLM, TDS, WSM) and Collaborative Research and Development Programs (DLM); NOAA/National Sea Grant NA86RG0052 (LJB), NA16RG2273 (SIK, MEH,GVC, JJS); Environmental Protection Agency U91620701 (WSB), R82902201(SC) and EPA’s Office of Research and Development (DEN)

Finishing the euchromatic sequence of the human genome

The sequence of the human genome encodes the genetic instructions for human physiology, as well as rich information about human evolution. In 2001, the International Human Genome Sequencing Consortium reported a draft sequence of the euchromatic portion of the human genome. Since then, the international collaboration has worked to convert this draft into a genome sequence with high accuracy and nearly complete coverage. Here, we report the result of this finishing process. The current genome sequence (Build 35) contains 2.85 billion nucleotides interrupted by only 341 gaps. It covers ∼99% of the euchromatic genome and is accurate to an error rate of ∼1 event per 100,000 bases. Many of the remaining euchromatic gaps are associated with segmental duplications and will require focused work with new methods. The near-complete sequence, the first for a vertebrate, greatly improves the precision of biological analyses of the human genome including studies of gene number, birth and death. Notably, the human enome seems to encode only 20,000-25,000 protein-coding genes. The genome sequence reported here should serve as a firm foundation for biomedical research in the decades ahead

A comparison of the effectiveness of the team-based learning readiness assessments completed at home to those completed in class

Purpose: The readiness assurance process (RAP) of team-based learning (TBL) is an important element that ensures that students come prepared to learn. However, the RAP can use a significant amount of class time which could otherwise be used for application exercises. The authors administered the TBL-associated RAP in class or individual readiness assurance tests (iRATs) at home to compare medical student performance and learning preference for physiology content. Methods: Using cross-over study design, the first year medical student TBL teams were divided into two groups. One group was administered iRATs and group readiness assurance tests (gRATs) consisting of physiology questions during scheduled class time. The other group was administered the same iRAT questions at home, and did not complete a gRAT. To compare effectiveness of the two administration methods, both groups completed the same 12-question physiology assessment during dedicated class time. Four weeks later, the entire process was repeated, with each group administered the RAP using the opposite method. Results: The performance on the physiology assessment after at-home administration of the iRAT was equivalent to performance after traditional in-class administration of the RAP. In addition, a majority of students preferred the at-home method of administration and reported that the at-home method was more effective in helping them learn course content. Conclusion: The at-home administration of the iRAT proved effective. The at-home administration method is a promising alternative to conventional iRATs and gRATs with the goal of preserving valuable in-class time for TBL application exercises

Is it a match? a novel method of evaluating medical school success

Background: Medical education program evaluation allows for curricular improvements to both Undergraduate (UME) and Graduate Medical Education (GME). UME programs are left with little more than match rates and self-report to evaluate success of graduates in The Match. Objective: This manuscript shares a novel method of program evaluation through a systematic assessment of Match outcomes. Design: Surveys were developed and distributed to Program Training Directors (PTDs) at our institution to classify residency programs into which our UME graduates matched using an ordinal response scale and open-ended responses. Outcomes-based measures for UME graduates were collected and analyzed. The relationship between PTD survey data and UME graduates’ outcomes were explored. Open-ended response data were qualitatively analyzed using iterative cycles of coding and identifying themes. Results: The PTD survey response rate was 100%. 71% of our graduates matched to programs ranked as ‘elite’ (36%) or ‘top’ (35%) tier. The mean total number of ‘Honors’ grades achieved by UME graduates was 2.6. Data showed that graduates entering elite and top GME programs did not consistently earn Honors in their associated clerkships. A positive correlation was identified between USMLE Step 1 score, number of honors, and residency program rankings for a majority of the programs. Qualitative analysis identified research, faculty, and clinical exposure as necessary characteristics of ‘elite’ programs:. Factors considered by PTDs in the rating of programs included reputation, faculty, research, national presence and quality of graduates. Conclusions: This study describes a novel outcomes-based method of evaluating the success of UME programs. Results provided useful feedback about the quality of our UME program and its ability to produce graduates who match in highly-regarded GME programs. The findings from this study can benefit Clerkship Directors, Student Affairs and Curriculam Deans, and residency PTDs as they help students determine their competitiveness forspecialties and specific residency programs

Mystery behind the match: an undergraduate medical education–graduate medical education collaborative approach to understanding match goals and outcomes

Background: There is a paucity of information regarding institutional targets for the number of undergraduate medical education (UME) graduates being matched to graduate medical education (GME) programs at their home institutions. At our institution, the Duke University, the number of UME graduates matched to GME programs declined dramatically in 2011. To better understand why this decline may have happened, we sought to identify perceived quality metrics for UME and GME learners, evaluate trends in match outcomes and educational program characteristics, and explore whether there is an ideal retention rate for UME graduates in their home institutions’ GME programs. Methods: We analyzed the number of Duke University UME graduates remaining at Duke for GME training over the past 5 years. We collected data to assess for changing characteristics of UME and GME, and performed descriptive analysis of trends over time to investigate the potential impact on match outcomes. Results: A one-sample t-test analysis showed no statistically significant difference in the number of Duke UME graduates who stayed for GME training. For both UME and GME, no significant changes in the characteristics of either program were found. Discussion: We created a process for monitoring data related to the characteristics or perceived quality of UME and GME programs and developed a shared understanding of what may impact match lists for both UME graduates and GME programs, leaving the Match somewhat less mysterious. While we understand the trend of graduates remaining at their home institutions for GME training, we are uncertain whether setting a goal for retention is reasonable, and so some mystery remains. We believe there is an invaluable opportunity for collaboration between UME and GME stakeholders to facilitate discussion about setting shared institutional goals