Self- and peer assessment may not be an accurate measure of PBL tutorial process

<p>Abstract</p> <p>Background</p> <p>Universidade Cidade de São Paulo adopted a problem-based learning (PBL) strategy as the predominant method for teaching and learning medicine. Self-, peer- and tutor marks of the educational process are taken into account as part of the final grade, which also includes assessment of content. This study compared the different perspectives (and grades) of evaluators during tutorials with first year medical students, from 2004 to 2007 (n = 349), from seven semesters.</p> <p>Methods</p> <p>The tutorial evaluation method was comprised of the students' self assessment (SA) (10%), tutor assessment (TA) (80%) and peer assessment (PA) (10%) to calculate a final educational process grade for each tutorial. We compared these three grades from each tutorial for seven semesters using ANOVA and a post hoc test.</p> <p>Results</p> <p>A total of 349 students participated with 199 (57%) women and 150 (42%) men. The SA and PA scores were consistently greater than the TA scores. Moreover, the SA and PA groups did not show statistical difference in any semester evaluated, while both differed from tutor assessment in all semesters (Kruskal-Wallis, Dunn's test). The Spearman rank order showed significant (p < 0.0001) and positive correlation for the SA and PA groups (r = 0.806); this was not observed when we compared TA with PA (r = 0.456) or TA with SA (r = 0.376).</p> <p>Conclusion</p> <p>Peer- and self-assessment marks might be reliable but not valid for PBL tutorial process, especially if these assessments are used for summative assessment, composing the final grade. This article suggests reconsideration of the use of summative assessment for self-evaluation in PBL tutorials.</p

Problem formulation by medical students: an observation study

<p>Abstract</p> <p>Background</p> <p>Medical problems are often complex and ill-structured. In formulating the problem, one has to discriminate pertinent elements from irrelevant information in order to effectively find a solution. In this observation study, we describe how medical students formulate the problem of a complex case.</p> <p>Methods</p> <p>32 third year medical students were presented with a complex case of endocarditis. They were asked to synthesize the case and give the best formulation of the problem. They were then asked to provide a diagnosis. A subsequent group of 25 students were presented with the problem already formulated and were also asked for the diagnosis. We analyzed the student's problem formulations using the presence or absence of essential elements of the case, the use of higher-order concepts and the use of relations between concepts.</p> <p>Results</p> <p>12/32 students presented with the case made the correct diagnosis. Diagnostic accuracy was significantly associated with the use of higher-order concepts and relations between concepts. Establishing explicit relations was particularly important. Almost all students who missed the diagnosis could not elicit any relations between concepts but only reported factual observations. When presented with an already formulated problem, 19/25 students made the correct diagnosis. (p < 0.05)</p> <p>Conclusion</p> <p>When faced with a complex new case, students may not have the structured knowledge to recognize the nature of the problem. They have to build new schema or problem representation. Our observations suggest that this process involves using higher-order concepts and establishing new relations between concepts. The fact that students could recognize the disease when presented with a formulated problem but had more difficulty when presented with the original complex case indicates that knowledge of the clinical features may be necessary but not sufficient for problem formulation. Our hypothesis is that problem formulation represents a distinct ability.</p

Benefits of knowledge-based interprofessional communication skills training in medical undergraduate education

OBJECTIVES: Good interprofessional communication is fundamental to effective teamworking in medicine. Finalmed is a private course that teaches the principles and methods of clinical presenting as an iterative technique of reasoning though clinical data. We have tested the efficacy of this technique using a questionnaire-based study. DESIGN: An anonymized 10-point Likert scale questionnaire was designed. SETTING: Questionnaires were distributed at five UK courses and two UAE courses. PARTICIPANTS: Questionnaires were given to all students attending these courses. MAIN OUTCOME MEASURES: The questionnaire included pre- and post-course questions addressing self-reported confidence in clinical presenting (CCP) and effectiveness in clinical presenting (ECP). We also asked whether attendees felt that clinical presenting should be integrated formally into medical school curricula. RESULTS: A total of 331/395 questionnaires were returned. Median improvement in CCP was 50% (P < 0.0001) and in ECP was 40% (P < 0.0001), irrespective of country of study, graduate entry status and whether the student felt that they had been exposed to these techniques previously. Students recorded a strong opinion in favour of integrating the content and style of the Finalmed course into their medical school curriculum, with 286 students (86%) recording a score of ≥8. CONCLUSION: Our study suggests that after a two- or three-day dedicated course, both self-reported confidence and effectiveness in clinical presenting significantly improve. Furthermore, students in the UK and the UAE returned a desire for integration into medical school curricula of IPC through the teaching of clinical presenting

The use of contextualised standardised client simulation to develop clinical reasoning in final year veterinary students

Clinical reasoning is an important skill for veterinary students to develop before graduation. Simulation has been studied in medical education as a method for developing clinical reasoning in students, but evidence supporting it is limited. This study involved the creation of a contextualized, standardized client simulation session that aimed to improve the clinical reasoning ability and confidence of final-year veterinary students. Sixty-eight participants completed three simulated primary-care consultations, with the client played by an actor and the pet by a healthy animal. Survey data showed that all participants felt that the session improved their clinical decision-making ability. Quantitative clinical reasoning self-assessment, performed using a validated rubric, triangulated this finding, showing an improvement in students’ perception of several components of their clinical reasoning skill level from before the simulation to after it. Blinded researcher analysis of the consultation video recordings found that students showed a significant increase in ability on the history-taking and making-sense-of-data (including formation of a differential diagnosis) components of the assessment rubric. Thirty students took part in focus groups investigating their experience with the simulation. Two themes arose from thematic analysis of these data: variety of reasoning methods and “It’s a different way of thinking.” The latter highlights differences between the decision making students practice during their time in education and the decision making they will use once they are in practice. Our findings suggest that simulation can be used to develop clinical reasoning in veterinary students, and they demonstrate the need for further research in this area

Situational awareness within objective structured clinical examination stations in undergraduate medical training - a literature search

Background: Medical students may not be able to identify the essential elements of situational awareness (SA) necessary for clinical reasoning. Recent studies suggest that students have little insight into cognitive processing and SA in clinical scenarios. Objective Structured Clinical Examinations (OSCEs) could be used to assess certain elements of situational awareness. The purpose of this paper is to review the literature with a view to identifying whether levels of SA based on Endsley's model can be assessed utilising OSCEs during undergraduate medical training. Methods: A systematic search was performed pertaining to SA and OSCEs, to identify studies published between January 1975 (first paper describing an OSCE) and February 2017, in peer reviewed international journals published in English. PUBMED, EMBASE, PsycINFO Ovid and SCOPUS were searched for papers that described the assessment of SA using OSCEs among undergraduate medical students. Key search terms included "objective structured clinical examination", "objective structured clinical assessment" or "OSCE" and "non-technical skills", "sense-making", "clinical reasoning", "perception", "comprehension", "projection", "situation awareness", "situational awareness" and "situation assessment". Boolean operators (AND, OR) were used as conjunctions to narrow the search strategy, resulting in the limitation of papers relevant to the research interest. Areas of interest were elements of SA that can be assessed by these examinations. Results: The initial search of the literature retrieved 1127 publications. Upon removal of duplicates and papers relating to nursing, paramedical disciplines, pharmacy and veterinary education by title, abstract or full text, 11 articles were eligible for inclusion as related to the assessment of elements of SA in undergraduate medical students. Discussion: Review of the literature suggests that whole-task OSCEs enable the evaluation of SA associated with clinical reasoning skills. If they address the levels of SA, these OSCEs can provide supportive feedback and strengthen educational measures associated with higher diagnostic accuracy and reasoning abilities. Conclusion: Based on the findings, the early exposure of medical students to SA is recommended, utilising OSCEs to evaluate and facilitate SA in dynamic environment

Alignment of the ALICE Inner Tracking System with cosmic-ray tracks

37 pages, 15 figures, revised version, accepted by JINSTALICE (A Large Ion Collider Experiment) is the LHC (Large Hadron Collider) experiment devoted to investigating the strongly interacting matter created in nucleus-nucleus collisions at the LHC energies. The ALICE ITS, Inner Tracking System, consists of six cylindrical layers of silicon detectors with three different technologies; in the outward direction: two layers of pixel detectors, two layers each of drift, and strip detectors. The number of parameters to be determined in the spatial alignment of the 2198 sensor modules of the ITS is about 13,000. The target alignment precision is well below 10 micron in some cases (pixels). The sources of alignment information include survey measurements, and the reconstructed tracks from cosmic rays and from proton-proton collisions. The main track-based alignment method uses the Millepede global approach. An iterative local method was developed and used as well. We present the results obtained for the ITS alignment using about 10^5 charged tracks from cosmic rays that have been collected during summer 2008, with the ALICE solenoidal magnet switched off.Peer reviewe

The student is key: a realist review of educational interventions to develop analytical and non-analytical clinical reasoning ability

BACKGROUND:Clinical reasoning refers to the cognitive processes used by individuals as they formulate a diagnosis or treatment plan. Clinical reasoning is dependent on formal and experiential knowledge. Developing the ability to acquire and recall knowledge effectively for both analytical and non-analytical cognitive processing has patient safety implications. This realist review examines the way educational interventions develop analytical and non-analytical reasoning ability in undergraduate education. A realist review is theory-driven, seeking not only to identify if an intervention works, but also understand the reasons why, for whom, and in what circumstances. AIM:To develop understanding about the way educational interventions develop effective analytical and non-analytical clinical reasoning ability, when they do, for whom and in what circumstances. METHODS:Literature from a scoping search, combined with expert opinion and researcher experience was synthesised to generate an initial programme theory (IPT). Four databases were searched and articles relevant to the developing theory were selected as appropriate. Factors affecting educational outcomes at the individual student, teacher and wider organisational levels were investigated in order to further refine the IPT. RESULTS:28 papers contributed to the overall programme theory. The review predominantly identified evidence of mechanisms for interventions at the individual student level. Key student level factors influencing the effectiveness of interventions included an individual's self-confidence, self-efficacy and pre-existing level of knowledge. These contexts influenced a variety of educational interventions, impacting both positively and negatively on educational outcomes. DISCUSSION:Development of analytical and non-analytical clinical reasoning ability requires activities that enhance knowledge acquisition and recall alongside the accumulation of clinical experience and opportunities to practise reasoning in real or simulated clinical environments. However, factors such as pre-existing knowledge and self-confidence influence their effectiveness, especially among individuals with 'low knowledge'. Promoting non-analytical reasoning once novices acquire more clinical knowledge is important for the development of clinical reasoning in undergraduate education