Training simulated patients: evaluation of a training approach using self-assessment and peer/tutor feedback to improve performance

<p>Abstract</p> <p>Background</p> <p>Most medical schools use simulated patients (SPs) for teaching. In this context the authenticity of role play and quality of feedback provided by SPs is of paramount importance. The available literature on SP training mostly addresses instructor led training where the SPs are given direction on their roles. This study focuses on the use of peer and self evaluation as a tool to train SPs.</p> <p>Methods</p> <p>SPs at the medical school participated in a staff development and training programme which included a) self-assessment of their performance while observing video-tapes of their role play using a structured guide and b) peer group assessment of their performance under tutor guidance. The pre and post training performance in relation to authenticity of role play and quality of feedback was blindly assessed by students and tutors using a validated instrument and the scores were compared. A focus group discussion and a questionnaire assessed acceptability of the training programme by the SPs.</p> <p>Results</p> <p>The post-training performance assessment scores were significantly higher (p < 0.05) than the pre-training scores. The degree of improvement in the quality of feedback provided to students was more when compared to the improvement of role play. The acceptability of the training by the SPs was very satisfactory scoring an average of 7.6 out of 10. The majority of the SPs requested the new method of training to be included in their current training programme as a regular feature.</p> <p>Conclusion</p> <p>Use of structured self-reflective and peer-interactive, practice based methods of SP training is recommended to improve SP performance. More studies on these methods of training may further refine SP training and lead to improvement of SP performance which in turn may positively impact medical education.</p

Problem-based learning in dental education: what's the evidence for and against... and is it worth the effort?

The document attached has been archived with permission from the Australian Dental Association. An external link to the publisher’s copy is included.All Australian dental schools have introduced problem-based learning (PBL) approaches to their programmes over the past decade, although the nature of the innovations has varied from school to school. Before one can ask whether PBL is better than the conventional style of education, one needs to consider three key issues. Firstly, we need to agree on what is meant by the term PBL; secondly, we need to decide what “better” means when comparing educational approaches; and thirdly, we must look carefully at how PBL is implemented in given situations. It is argued that PBL fulfils, at least in theory, some important principles relating to the development of new knowledge. It also represents a change in focus from teachers and teaching in conventional programmes to learners and learning. Generally, students enjoy PBL programmes more than conventional programmes and feel they are more nurturing. There is also some evidence of an improvement in clinical and diagnostic reasoning ability associated with PBL curricula. The main negative points raised about PBL are the costs involved and mixed reports of insufficient grounding of students in the basic sciences. Financial restraints will probably preclude the introduction of pure or fully integrated PBL programmes in Australian dental schools. However, our research and experience, as well as other published literature, indicate that well-planned hybrid PBL programmes, with matching methods of assessment, can foster development of the types of knowledge, skills and attributes that oral health professionals will need in the future.T Winning and G Townsen

Integrated problem-based learning in the neuroscience curriculum – the SUNY Downstate experience

BACKGROUND: This paper reports the author's initial experience as Block Director in converting a Conventional Curriculum into a problem-based learning model (PBL) for teaching Psychopathology. As part of a wide initiative in curriculum reform, Psychopathology, which was a six-week course in the second-year medical school curriculum, became integrated into a combined Neuroscience block. The study compares curriculum conversion at State University of New York (SUNY), Downstate, with the experiences at other medical centres that have instituted similar curricula reform. METHODS: Student satisfaction with the Conventional and PBL components of the Neuroscience curriculum was compared using questionnaires and formal discussions between faculty and a body of elected students. The PBL experience in Psychopathology was also compared with that of the rest of the Neuroscience Block, which used large student groups and expert facilitators, while the Psychopathology track was limited to small groups using mentors differing widely in levels of expertise. RESULTS: Students appeared to indicate a preference toward conventional lectures and large PBL groups using expert facilitators in contrast to small group mentors who were not experts. Small PBL groups with expert mentors in the Psychopathology track were also rated favorably. CONCLUSION: The study reviews the advantages and pitfalls of the PBL system when applied to a Neuroscience curriculum on early career development. At SUNY, conversion from a Conventional model to a PBL model diverged from that proposed by Howard S. Barrows where student groups define the learning objectives and problem-solving strategies. In our model, the learning objectives were faculty-driven. The critical issue for the students appeared to be the level of faculty expertise rather than group size. Expert mentors were rated more favorably by students in fulfilling the philosophical objectives of PBL. The author, by citing the experience at other major Medical Faculties, makes a cautious attempt to address the challenges involved in the conversion of a Psychopathology curriculum into a PBL dominated format

The relationships between problem characteristics, achievement-related behaviors, and academic achievement in problem-based learning

This study investigated the influence of five problem characteristics on students' achievement-related classroom behaviors and academic achievement. Data from 5,949 polytechnic students in PBL curricula across 170 courses were analyzed by means of path analysis. The five problem characteristics were: (1) problem clarity, (2) problem familiarity, (3) the extent to which the problem stimulated group discussion, (4) self-study, and (5) identification of learning goals. The results showed that problem clarity led to more group discussion, identification of learning goals, and self-study than problem familiarity. On the other hand, problem familiarity had a stronger and direct impact on academic achievement

Effects of tutor-related behaviours on the process of problem-based learning

Tutors in a Problem-Based Learning (PBL) curriculum are thought to play active roles in guiding students to develop frameworks for use in the construction of knowledge. This implies that both subject-matter expertise and the ability of tutors to facilitate the learning process must be important in helping students learn. This study examines the behavioural effects of tutors in terms of subject-matter expertise, social congruence and cognitive congruence on students’ learning process and on their final achievement. The extent of students’ learning at each PBL phase was estimated by tracking the number of relevant concepts recalled at the end of each learning phase, while student achievement was based on students’ ability to describe and elaborate upon the relationship between relevant concepts learned. By using Analysis of Covariance, social congruence of the tutor was found to have a significant influence on learning in each PBL phase while all of the tutor-related behaviours had a significant impact on student achievement. The results suggest that the ability of tutors to communicate informally with students and hence create a less threatening learning environment that promotes a free flow exchange of ideas, has a greater impact on learning at each of the PBL phases as compared to tutors’ subject-matter expertise and their ability to explain concepts in a way that is easily understood by students. The data presented indicates that these tutor-related behaviours are determinants of learning in a PBL curriculum, with social congruence having a greater influence on learning in the different PBL phases

Tutoring in problem-based learning medical curricula: the influence of tutor background and style on effectiveness

BACKGROUND: Evidence for the superiority of particular characteristics in PBL tutors in medical curricula is generally inconclusive. Most studies have investigated the effectiveness of content experts compared with that of non-experts as measured either by student satisfaction or academic achievement. A few have compared academic staff tutors with student tutors. The purpose of this study was to investigate the relationship between students' perception of overall tutor effectiveness, particular tutor behaviours, clinical qualifications and academic appointment. METHOD: A questionnaire designed to evaluate particular aspects of PBL tutoring technique, related either to subject-matter knowledge or to process-facilitation skill, as well as overall effectiveness, was distributed to students in first year of a PBL medical program at the end of each of three tutor terms. A total of 76 tutor terms were included in the study. Data analysis compared clinical with non-clinical tutors, and staff with non-staff tutors. RESULTS: Clinically qualified tutors used their subject-matter knowledge significantly more than non-clinical tutors and were seen as being more empathic with their students. Staff tutors placed more emphasis on assessment than non-staff tutors and were seen as having greater skill in establishing and maintaining an environment of cooperation within their PBL groups than non-staff tutors. CONCLUSION: These results suggest that both subject-matter knowledge and process-facilitation skills are necessary but not individually sufficient characteristics of effective tutors

To be or not to be: the importance of attendance in integrated physiology teaching using non-traditional approaches

<p>Abstract</p> <p>Background</p> <p>There is increasing use of non-traditional methods like problem-based learning, team-working and several other active-learning techniques in Physiology teaching. While several studies have investigated the impact of class attendance on the academic performance in traditional teaching, there is limited information regarding whether the new modalities are especially sensible to this factor.</p> <p>Methods</p> <p>Here, we performed a comparative study between a control group receiving information through traditional methods and an experimental group submitted to new methodologies in Physiology teaching.</p> <p>Results</p> <p>We found that while mean examination scores were similar in the control and the experimental groups, a different picture emerge when data are organized according to four categorical attendance levels. In the experimental group, scores were not different between the 1st and the 2nd exams (P = 0.429) nor between the 2nd and the 3^rdexams (P = 0.225) for students that never or poorly attend classes, in contrast to the control group (P < 0.001). A score difference between attending students versus the absentees was maximal in the experimental versus the control group all along the different exams and in the final score.</p> <p>Conclusion</p> <p>We suggest that class attendance is critical for learning using non-traditional methods.</p