The Second Maiden's Tragedy

OBJECTIVE: To determine the perceived importance of specific competencies in professional veterinary practice and education among veterinarians in several countries. DESIGN: Survey-based prospective study. SAMPLE: 1,137 veterinarians in 10 countries. PROCEDURES: Veterinarians were invited via email to participate in the study. A framework of 18 competencies grouped into 7 domains (veterinary expertise, communication, collaboration, entrepreneurship, health and welfare, scholarship, and personal development) was used. Respondents rated the importance of each competency for veterinary professional practice and for veterinary education by use of a 9-point Likert scale in an online questionnaire. Quantitative statistical analyses were performed to assess the data. RESULTS: All described competencies were perceived as having importance (with overall mean ratings [all countries] >/= 6.45/9) for professional practice and education. Competencies related to veterinary expertise had the highest ratings (overall mean, 8.33/9 for both professional practice and education). For the veterinary expertise, entrepreneurship, and scholarship domains, substantial differences (determined on the basis of statistical significance and effect size) were found in importance ratings among veterinarians in different countries. CONCLUSIONS AND CLINICAL RELEVANCE: Results indicated a general consensus regarding the importance of specific types of competencies in veterinary professional practice and education. Further research into the definition of competencies essential for veterinary professionals is needed to help inform an international dialogue on the subject

Exploring medical residents' perceived need for negotiation skills training

Objectives: This study explores the optimal focus for negotiation skills development training by investigating how often medical residents negotiate in practice, and how they perceive the effectiveness of their negotiation capabilities. Methods: An exploratory study was performed using a questionnaire regarding the medical residents' working environment, negotiation frequency, knowledge and skills using a 5-point Likert scale, multiple choice questions and open questions. Exploratory factor analysis with principal component analysis, varimax rotation, reliability analysis, and content analysis were used to reduce the number of variables. Descriptive and interferential statistics and multiple regression analysis were used to analyze the data. Results: We analyzed the responses of 60 medical residents. The findings showed that the perceived development of their negotiation knowledge (M=3.06, SD=0.83) was less than their negotiation skills (M=3.69, SD=0.47). Their attitude during negotiations, especially females, differed substantially in the interactions with nurses than with their supervisors. Medical residents with more working experience, better negotiation skills or who worked in hierarchical environments negotiated more frequently with their supervisors. Medical residents with better collaboration skills and negotiation knowledge demonstrated better negotiation skills. Conclusions: This study underlines medical residents' need for negotiation training. In addition to the basic negotiation knowledge and skills, training programs in negotiation should focus on the medical residents' awareness of their attitudes during negotiations, combining the assertiveness shown in interactions with supervisors with the empathy and emotional engagement present in interactions with nurses. Furthermore, attention should be paid to the influence of the environmental hierarchy on negotiation skill development

A pilot study of a practice management training module for medical residents

BACKGROUND: In 2005 a competency based curriculum was introduced in the Dutch postgraduate medical training programs. While the manager's role is one of the seven key competencies, there is still no formal management course in most postgraduate curricula. Based on a needs assessment we conducted, several themes were identified as important for a possible management training program. We present the results of the pilot training we performed to investigate two of these themes. METHODS: The topics "knowledge of the healthcare system" and "time management" were developed from the list of suggested management training themes. Fourteen residents participated in the training and twenty-four residents served as control. The training consisted of two sessions of four hours with a homework assignment in between. 50 True/false-questions were given as pre- and post-test to both the test and control groups to assess the level of acquired knowledge among the test group as well as the impact of the intervention. We also performed a qualitative evaluation using evaluation forms and in-depth interviews. RESULTS: All fourteen residents completed the training. Six residents in the control group were lost to follow up. The pre- and post-test showed improvement among the participating residents in comparison to the residents from the control group, but this improvement was not significant. The qualitative assessment showed that all residents evaluated the training positively and experienced it as a useful addition to their training in becoming a medical specialist. CONCLUSION: Our training was evaluated positively and considered to be valuable. This study supports the need for mandatory medical management training as part of the postgraduate medical curriculum. Our training could be an example of how to teach two important themes in the broad area of medical management education

Influence of PBL with open-book tests on knowledge retention measured

The influence of problem-based learning (PBL) and open-book tests on

Benchmarking by cross-institutional comparison of student achievement in a progress test

OBJECTIVE: To determine the effectiveness of single-point benchmarking and longitudinal benchmarking for inter-school educational evaluation. METHODS: We carried out a mixed, longitudinal, cross-sectional study using data from 24 annual measurement moments (4 tests x 6 year groups) over 4 years for 4 annual progress tests assessing the graduation-level knowledge of all students from 3 co-operating medical schools. Participants included undergraduate medical students (about 5000) from 3 medical schools. The main outcome measures involved between-school comparisons of progress test results based on different benchmarking methods. RESULTS: Variations in relative school performance across different tests and year groups indicate instability and low reliability of single-point benchmarking, which is subject to distortions as a result of school-test and year group-test interaction effects. Deviations of school means from the overall mean follow an irregular, noisy pattern obscuring systematic between-school differences. The longitudinal benchmarking method results in suppression of noise and revelation of systematic differences. The pattern of a school's cumulative deviations per year group gives a credible reflection of the relative performance of year groups. CONCLUSIONS: Even with highly comparable curricula, single-point benchmarking can result in distortion of the results of comparisons. If longitudinal data are available, the information contained in a school's cumulative deviations from the overall mean can be used. In such a case, the mean test score across schools is a useful benchmark for cross-institutional comparison

Impact of institute and person variables on teachers' conceptions of learning and teaching.

Background: Teachers' conceptions of learning and teaching are important for faculty development to result in enduring changes in teaching practices. Until now, studies on these conceptions have mostly focused on traditional, lecture-based curricula rather than on small-group student-centred educational formats, which are gaining ground worldwide. Aim: To explore which factors predict teachers' conceptions in student-centred curricula. Methods: In two Dutch medical schools with 10 and 40 years of student-centred education, teachers were asked to fill out the Conceptions of Learning and Teaching (COLT) Questionnaire to assess their teacher-centredness', appreciation of active learning' and orientation to professional practice'. Next, we quantitatively assessed the relations of teachers' conceptions with their personal and occupational characteristics and institute. Results: Overall response was 49.4% (N = 319/646). Institute was the main predictor for variance in all three scales, and discipline, gender and teaching experience significantly explained variance in two of the scales. More than 80% of the variance was not explained by these factors. Conclusion: Longer exposure to a student-centred curriculum was associated with fewer teacher-centred conceptions, greater appreciation of active learning' and stronger orientation towards professional practice'. In line with studies on lecture-based curricula, discipline, gender and teaching experience also appeared important for teachers' conceptions in student-centred curricula. More research is necessary to better understand the influence of institute on the three teachers' conceptions scales

The use of instructional design guidelines to increase effectiveness of postpartum hemorrhage simulation training

OBJECTIVE: To compare learning outcomes of postpartum hemorrhage simulation training based on either instructional design guidelines or best practice. METHODS: A pretest-post-test non-equivalent groups study was conducted among obstetrics and gynecology residents in Recife, Brazil, from June 8 to August 30, 2013. The instructional design group included 13 teams, whereas the best practice group included seven teams. A standardized task checklist was used for scenario analysis and the proportion of correctly executed tasks compared (post-test minus pretest). RESULTS: The instructional design group scored higher than the best practice group for total number of tasks completed (median difference 0.46 vs 0.17; P<0.001; effect size [r]=0.72). Similar results were observed for communication (median difference 0.56 vs 0.22; P=0.004; r=0.58), laboratory evaluation (median difference 0.83 vs 0.00; P<0.001; r=0.76), and mechanical management (median difference 0.25 vs -0.15; P=0.048; r=0.39). Speed of learning was also increased. The median differences were 0.20 for the instructional design group compared with 0.05 for the best practice group at 60 seconds (P=0.015; r=0.49), and 0.49 versus 0.26 (P=0.001; r=0.65) at 360 seconds. CONCLUSION: The use of simulation training for postpartum hemorrhage that was based on instructional design guidelines yielded better learning outcomes than did training based on best practice

Stakeholder perspectives on workplace-based performance assessment: towards a better understanding of assessor behaviour

Workplace-Based Assessment (WBA) plays a pivotal role in present-day competency-based medical curricula. Validity in WBA mainly depends on how stakeholders (e.g. clinical supervisors and learners) use the assessments-rather than on the intrinsic qualities of instruments and methods. Current research on assessment in clinical contexts seems to imply that variable behaviours during performance assessment of both assessors and learners may well reflect their respective beliefs and perspectives towards WBA. We therefore performed a Q methodological study to explore perspectives underlying stakeholders' behaviours in WBA in a postgraduate medical training program. Five different perspectives on performance assessment were extracted: Agency, Mutuality, Objectivity, Adaptivity and Accountability. These perspectives reflect both differences and similarities in stakeholder perceptions and preferences regarding the utility of WBA. In comparing and contrasting the various perspectives, we identified two key areas of disagreement, specifically 'the locus of regulation of learning' (i.e., self-regulated versus externally regulated learning) and 'the extent to which assessment should be standardised' (i.e., tailored versus standardised assessment). Differing perspectives may variously affect stakeholders' acceptance, use-and, consequently, the effectiveness-of assessment programmes. Continuous interaction between all stakeholders is essential to monitor, adapt and improve assessment practices and to stimulate the development of a shared mental model. Better understanding of underlying stakeholder perspectives could be an important step in bridging the gap between psychometric and socio-constructivist approaches in WBA

Flexible electronic feedback using the virtues of progress testing

The potential richness of the feedback for learners and teachers is one of the educational advantages of progress tests (PTs). Every test administration yields information on a student's knowledge level in each sub-domain of the test (cross-sectional information), and it adds a next point to the corresponding knowledge growth curve (longitudinal information). Traditional paper-based feedback has severe limitations and requires considerable effort from the learners to give meaning to the data. We reasoned that the PT data should be flexibly accessible in all pathways and with any available comparison data, according to the personal interest of the learner. For that purpose, a web-based tool (Progress test Feedback, the ProF system) was developed. This article presents the principles and features of the generated feedback and shows how it can be used. In addition to enhancement of the feedback, the ProF database of longitudinal PT-data also provides new opportunities for research on knowledge growth, and these are currently being explored

Electronic assessment of clinical reasoning in clerkships: A mixed-methods comparison of long-menu key-feature problems with context-rich single best answer questions

BACKGROUND: It remains unclear which item format would best suit the assessment of clinical reasoning: context-rich single best answer questions (crSBAs) or key-feature problems (KFPs). This study compared KFPs and crSBAs with respect to students' acceptance, their educational impact, and psychometric characteristics when used in a summative end-of-clinical-clerkship pediatric exam. METHODS: Fifth-year medical students (n = 377) took a computer-based exam that included 6-9 KFPs and 9-20 crSBAs which assessed their clinical reasoning skills, in addition to an objective structured clinical exam (OSCE) that assessed their clinical skills. Each KFP consisted of a case vignette and three key features using a "long-menu" question format. We explored students' perceptions of the KFPs and crSBAs in eight focus groups and analyzed statistical data of 11 exams. RESULTS: Compared to crSBAs, KFPs were perceived as more realistic and difficult, providing a greater stimulus for the intense study of clinical reasoning, and were generally well accepted. The statistical analysis revealed no difference in difficulty, but KFPs resulted more reliable and efficient than crSBAs. The correlation between the two formats was high, while KFPs correlated more closely with the OSCE score. CONCLUSIONS: KFPs with long-menu exams seem to bring about a positive educational effect without psychometric drawbacks