Psychometric properties of an instrument to measure the clinical learning environment

Objectives: The clinical learning environment is an influential factor in work-based learning. Evaluation of this environment gives insight into the educational functioning of clinical departments. The Postgraduate Hospital Educational Environment Measure (PHEEM) is an evaluation tool consisting of a validated questionnaire with 3 subscales. In this paper we further investigate the psychometric properties of the PHEEM. We set out to validate the 3 subscales and test the reliability of the PHEEM for both clerks (clinical medical students) and registrars (specialists in training). Methods: Clerks and registrars from different hospitals and specialties filled out the PHEEM. To investigate the construct validity of the 3 subscales, we used an exploratory factor analysis followed by varimax rotation, and a cluster analysis known as Mokken scale analysis. We estimated the reliability of the questionnaire by means of variance components according to generalisability theory. Results: A total of 256 clerks and 339 registrars filled out the questionnaire. The exploratory factor analysis plus varimax rotation suggested a 1-dimensional scale. The Mokken scale analysis confirmed this result. The reliability analysis showed a reliable outcome for 1 department with 14 clerks or 11 registrars. For multiple departments 3 respondents combined with 10 departments provide a reliable outcome for both groups. Discussion: The PHEEM is a questionnaire measuring 1 dimension instead of the hypothesised 3 dimensions. The sample size required to achieve a reliable outcome is feasible. The instrument can be used to evaluate both single and multiple departments for both clerks and registrars. © 2007 Blackwell Publishing Ltd

The Second Maiden's Tragedy

OBJECTIVE: To determine the perceived importance of specific competencies in professional veterinary practice and education among veterinarians in several countries. DESIGN: Survey-based prospective study. SAMPLE: 1,137 veterinarians in 10 countries. PROCEDURES: Veterinarians were invited via email to participate in the study. A framework of 18 competencies grouped into 7 domains (veterinary expertise, communication, collaboration, entrepreneurship, health and welfare, scholarship, and personal development) was used. Respondents rated the importance of each competency for veterinary professional practice and for veterinary education by use of a 9-point Likert scale in an online questionnaire. Quantitative statistical analyses were performed to assess the data. RESULTS: All described competencies were perceived as having importance (with overall mean ratings [all countries] >/= 6.45/9) for professional practice and education. Competencies related to veterinary expertise had the highest ratings (overall mean, 8.33/9 for both professional practice and education). For the veterinary expertise, entrepreneurship, and scholarship domains, substantial differences (determined on the basis of statistical significance and effect size) were found in importance ratings among veterinarians in different countries. CONCLUSIONS AND CLINICAL RELEVANCE: Results indicated a general consensus regarding the importance of specific types of competencies in veterinary professional practice and education. Further research into the definition of competencies essential for veterinary professionals is needed to help inform an international dialogue on the subject

Competency-based education is beneficial for professional development

Contains fulltext : 152053.pdf (publisher's version ) (Open Access

What would happen to education if we take education evidence seriously?

Contains fulltext : 137206.pdf (publisher's version ) (Open Access)Educational practice and educational research are not aligned with each other. Current educational practice heavily relies on information transmission or content delivery to learners. Yet evidence shows that delivery is only a minor part of learning. To illustrate the directions we might take to find better educational strategies, six areas of educational evidence are briefly reviewed. The flipped classroom idea is proposed to shift our expenditure and focus in education. All information delivery could be web distributed, thus creating more time for other more expensive educational strategies to support the learner. In research our focus should shift from comparing one curriculum to the other, to research that explains why things work in education and under which conditions. This may generate ideas for creative designers to develop new educational strategies. These best practices should be shared and further researched. At the same time attention should be paid to implementation and the realization that teachers learn in a way very similar to the people they teach. If we take the evidence seriously, our educational practice will look quite different to the way it does now

"MÁS ALLÁ DE LA INTUICIÓN"

This paper is the speech that the author gave when he was accepted as a professor of education at the University of Maastricht. The author looks back on the past to analyse his own process of education and reflects on his own experience as a teacher and as an educational developer. He compares traditional, intuitive approaches to teaching to a rational approach and spells out the features it should have.Este artículo recoge una conferencia pronunciada por el autor con motivo de la aceptación del puesto de Catedrático de la Educación en la Universidad de Maastricht. El autor echa la vista atrás y se remonta a su época de estudiante para analizar la formación recibida y su propia experiencia como profesor y promotor de la educación. Compara los enfoques tradicionales, intuitivos de la enseñanza, con un enfoque racional y las características que este debería tener

Secrets of success in medical training

Item does not contain fulltex

[Educational Impact of performance appraisal: the case of the Mini-Clinical Evaluation Exercise (Mini-CEX)],Efecto educativo de la evaluación del desempeño profesional: el caso del mini-CEX

Contains fulltext : 117973.pdf (publisher's version ) (Open Access

A model of the pre-assessment learning effects of assessment is operational in an undergraduate clinical context.

Contains fulltext : 110818.pdf (publisher's version ) (Open Access)BACKGROUND: No validated model exists to explain the learning effects of assessment, a problem when designing and researching assessment for learning. We recently developed a model explaining the pre-assessment learning effects of summative assessment in a theory teaching context. The challenge now is to validate this model. The purpose of this study was to explore whether the model was operational in a clinical context as a first step in this process. METHODS: Given the complexity of the model, we adopted a qualitative approach. Data from in-depth interviews with eighteen medical students were subject to content analysis. We utilised a code book developed previously using grounded theory. During analysis, we remained alert to data that might not conform to the coding framework and open to the possibility of deploying inductive coding. Ethical clearance and informed consent were obtained. RESULTS: The three components of the model i.e., assessment factors, mechanism factors and learning effects were all evident in the clinical context. Associations between these components could all be explained by the model. Interaction with preceptors was identified as a new subcomponent of assessment factors. The model could explain the interrelationships of the three facets of this subcomponent i.e., regular accountability, personal consequences and emotional valence of the learning environment, with previously described components of the model. CONCLUSIONS: The model could be utilized to analyse and explain observations in an assessment context different to that from which it was derived. In the clinical setting, the (negative) influence of preceptors on student learning was particularly prominent. In this setting, learning effects resulted not only from the high-stakes nature of summative assessment but also from personal stakes, e.g. for esteem and agency. The results suggest that to influence student learning, consequences should accrue from assessment that are immediate, concrete and substantial. The model could have utility as a planning or diagnostic tool in practice and research settings