Interactive seminars or small group tutorials in preclinical medical education: results of a randomized controlled trial

<p>Abstract</p> <p>Background</p> <p>Learning in small group tutorials is appreciated by students and effective in the acquisition of clinical problem-solving skills but poses financial and resource challenges. Interactive seminars, which accommodate large groups, might be an alternative. This study examines the educational effectiveness of small group tutorials and interactive seminars and students' preferences for and satisfaction with these formats.</p> <p>Methods</p> <p>Students in year three of the Leiden undergraduate medical curriculum, who agreed to participate in a randomized controlled trial (RCT, n = 107), were randomly allocated to small group tutorials (n = 53) or interactive seminars (n = 54). Students who did not agree were free to choose either format (n = 105). Educational effectiveness was measured by comparing the participants' results on the end-of-block test. Data on students' reasons and satisfaction were collected by means of questionnaires. Data was analyzed using student unpaired t test or chi-square test where appropriate.</p> <p>Results</p> <p>There were no significant differences between the two educational formats in students' test grades. Retention of knowledge through active participation was the most frequently cited reason for preferring small group tutorials, while a dislike of compulsory course components was mentioned more frequently by students preferring interactive seminars. Small group tutorials led to greater satisfaction.</p> <p>Conclusions</p> <p>We found that small group tutorials leads to greater satisfaction but not to better learning results. Interactive learning in large groups might be might be an effective alternative to small group tutorials in some cases and be offered as an option.</p

Tutoring in problem-based learning medical curricula: the influence of tutor background and style on effectiveness

BACKGROUND: Evidence for the superiority of particular characteristics in PBL tutors in medical curricula is generally inconclusive. Most studies have investigated the effectiveness of content experts compared with that of non-experts as measured either by student satisfaction or academic achievement. A few have compared academic staff tutors with student tutors. The purpose of this study was to investigate the relationship between students' perception of overall tutor effectiveness, particular tutor behaviours, clinical qualifications and academic appointment. METHOD: A questionnaire designed to evaluate particular aspects of PBL tutoring technique, related either to subject-matter knowledge or to process-facilitation skill, as well as overall effectiveness, was distributed to students in first year of a PBL medical program at the end of each of three tutor terms. A total of 76 tutor terms were included in the study. Data analysis compared clinical with non-clinical tutors, and staff with non-staff tutors. RESULTS: Clinically qualified tutors used their subject-matter knowledge significantly more than non-clinical tutors and were seen as being more empathic with their students. Staff tutors placed more emphasis on assessment than non-staff tutors and were seen as having greater skill in establishing and maintaining an environment of cooperation within their PBL groups than non-staff tutors. CONCLUSION: These results suggest that both subject-matter knowledge and process-facilitation skills are necessary but not individually sufficient characteristics of effective tutors

What can we learn from facilitator and student perceptions of facilitation skills and roles in the first year of a problem-based learning curriculum?

BACKGROUND: The small group tutorial is a cornerstone of problem-based learning. By implication, the role of the facilitator is of pivotal importance. The present investigation canvassed perceptions of facilitators with differing levels of experience regarding their roles and duties in the tutorial. METHODS: In January 2002, one year after problem-based learning implementation at the Nelson R. Mandela School of Medicine, facilitators with the following experience were canvassed: trained and about to facilitate, facilitated once only and facilitated more than one six-week theme. Student comments regarding facilitator skills were obtained from a 2001 course survey. RESULTS: While facilitators generally agreed that the three-day training workshop provided sufficient insight into the facilitation process, they become more comfortable with increasing experience. Many facilitators experienced difficulty not providing content expertise. Again, this improved with increasing experience. Most facilitators saw students as colleagues. They agreed that they should be role models, but were less enthusiastic about being mentors. Students were critical of facilitators who were not up to date with curriculum implementation or who appeared disinterested. While facilitator responses suggest that there was considerable intrinsic motivation, this might in fact not be the case. CONCLUSIONS: Even if they had facilitated on all six themes, facilitators could still be considered as novices. Faculty support is therefore critical for the first few years of problem-based learning, particularly for those who had facilitated once only. Since student and facilitator expectations in the small group tutorial may differ, roles and duties of facilitators must be explicit for both parties from the outset

The relationships between problem characteristics, achievement-related behaviors, and academic achievement in problem-based learning

This study investigated the influence of five problem characteristics on students' achievement-related classroom behaviors and academic achievement. Data from 5,949 polytechnic students in PBL curricula across 170 courses were analyzed by means of path analysis. The five problem characteristics were: (1) problem clarity, (2) problem familiarity, (3) the extent to which the problem stimulated group discussion, (4) self-study, and (5) identification of learning goals. The results showed that problem clarity led to more group discussion, identification of learning goals, and self-study than problem familiarity. On the other hand, problem familiarity had a stronger and direct impact on academic achievement

Relevant prior knowledge moderates the effect of elaboration during small group discussion on academic achievement

This study set out to test whether relevant prior knowledge would moderate a positive effect on academic achievement of elaboration during small-group discussion. In a 2 × 2 experimental design, 66 undergraduate students observed a video showing a small-group problem-based discussion about thunder and lightning. In the video, a teacher asked questions to the observing participants. Participants either elaborated by responding to these questions, or did not elaborate, but completed a

Involvement in teaching improves learning in medical students: a randomized cross-over study

<p>Abstract</p> <p>Background</p> <p>Peer-assisted learning has many purported benefits including preparing students as educators, improving communication skills and reducing faculty teaching burden. But comparatively little is known about the effects of teaching on learning outcomes of peer educators in medical education.</p> <p>Methods</p> <p>One hundred and thirty-five first year medical students were randomly allocated to 11 small groups for the Gastroenterology/Hematology Course at the University of Calgary. For each of 22 sessions, two students were randomly selected from each group to be peer educators. Students were surveyed to estimate time spent preparing as peer educator versus group member. Students completed an end-of-course 94 question multiple choice exam. A paired t-test was used to compare performance on clinical presentations for which students were peer educators to those for which they were not.</p> <p>Results</p> <p>Preparation time increased from a mean (SD) of 36 (33) minutes baseline to 99 (60) minutes when peer educators (Cohen's <it>d </it>= 1.3; p < 0.001). The mean score (SD) for clinical presentations in which students were peer educators was 80.7% (11.8) compared to77.6% (6.9) for those which they were not (<it>d </it>= 0.33; <it>p </it>< 0.01).</p> <p>Conclusion</p> <p>Our results suggest that involvement in teaching small group sessions improves medical students' knowledge acquisition and retention.</p

Are tutor behaviors in problem-based learning stable? A generalizability study of social congruence, expertise and cognitive congruence

The purpose of this study was to investigate the stability of three distinct tutor behaviors (1) use of subject-matter expertise, (2) social congruence and (3) cognitive congruence, in a problem-based learning (PBL) environment. The data comprised the input from 16,047 different students to a survey of 762 tutors administered in three consecutive semesters. Over the three semesters each tutor taught two of the same course and one different course. A generalizability study was conducted to determine whether the tutor behaviors were generalizable across the three measurement occasions. The results indicate that three semesters are sufficient to make generalizations about all three tutor behaviors. In addition the results show that individual differences between tutors account for the greatest differences in levels of expertise, social congruence and cognitive congruence. The study concludes that tutor behaviors are fairly consistent in PBL and somewhat impervious to change. Implications of these findings for tutor training are discussed

Effects of tutor-related behaviours on the process of problem-based learning

Tutors in a Problem-Based Learning (PBL) curriculum are thought to play active roles in guiding students to develop frameworks for use in the construction of knowledge. This implies that both subject-matter expertise and the ability of tutors to facilitate the learning process must be important in helping students learn. This study examines the behavioural effects of tutors in terms of subject-matter expertise, social congruence and cognitive congruence on students’ learning process and on their final achievement. The extent of students’ learning at each PBL phase was estimated by tracking the number of relevant concepts recalled at the end of each learning phase, while student achievement was based on students’ ability to describe and elaborate upon the relationship between relevant concepts learned. By using Analysis of Covariance, social congruence of the tutor was found to have a significant influence on learning in each PBL phase while all of the tutor-related behaviours had a significant impact on student achievement. The results suggest that the ability of tutors to communicate informally with students and hence create a less threatening learning environment that promotes a free flow exchange of ideas, has a greater impact on learning at each of the PBL phases as compared to tutors’ subject-matter expertise and their ability to explain concepts in a way that is easily understood by students. The data presented indicates that these tutor-related behaviours are determinants of learning in a PBL curriculum, with social congruence having a greater influence on learning in the different PBL phases

Cognitive engagement in the problem-based learning classroom

The objective of the present study was to examine to what extent autonomy in problem-based learning (PBL) results in cognitive engagement with the topic at hand. To that end, a short self-report instrument was devised and validated. Moreover, it was examined how cognitive engagement develops as a function of the learning process and the extent to which cognitive engagement determines subsequent levels of cognitive engagement during a one-day PBL event. Data were analyzed by means of confirmatory factor analysis, repeated measures ANOVA, and path analysis. The results showed that the new measure of situational cognitive engagement is valid and reliable. Furthermore, the results revealed that students’ cognitive engagement significantly increased as a function of the learning event. Implications of these findings for PBL are discussed

Visualising the invisible: a network approach to reveal the informal social side of student learning

World-wide, universities in health sciences have transformed their curriculum to include collaborative learning and facilitate the students’ learning process. Interaction has been acknowledged to be the synergistic element in this learning context. However, students spend the majority of their time outside their classroom and interaction does not stop outside the classroom. Therefore we studied how informal social interaction influences student learning. Moreover, to explore what really matters in the students learning process, a model was tested how the generally known important constructs—prior performance, motivation and social integration—relate to informal social interaction and student learning. 301 undergraduate medical students participated in this cross-sectional quantitative study. Informal social interaction was assessed using self-reported surveys following the network approach. Students’ individual motivation, social integration and prior performance were assessed by the Academic Motivation Scale, the College Adaption Questionnaire and students’ GPA respectively. A factual knowledge test represented student’ learning. All social networks were positively associated with student learning significantly: friendships (β = 0.11), providing information to other students (β = 0.16), receiving information from other students (β = 0.25). Structural equation modelling revealed a model in which social networks increased student learning (r = 0.43), followed by prior performance (r = 0.31). In contrast to prior literature, students’ academic motivation and social integration were not associated with students’ learning. Students’ informal social interaction is strongly associated with students’ learning. These findings underline the need to change our focus from the formal context (classroom) to the informal context to optimize student learning and deliver modern medics