Online clinical reasoning assessment with the Script Concordance test: a feasibility study

BACKGROUND: The script concordance (SC) test is an assessment tool that measures capacity to solve ill-defined problems, that is, reasoning in context of uncertainty. This tool has been used up to now mainly in medicine. The purpose of this pilot study is to assess the feasibility of the test delivered on the Web to French urologists. METHODS: The principle of SC test construction and the development of the Web site are described. A secure Web site was created with two sequential modules: (a) The first one for the reference panel (n = 26) with two sub-tasks: to validate the content of the test and to elaborate the scoring system; (b) The second for candidates with different levels of experience in Urology: Board certified urologists, residents, medical students (5 or 6(th )year). Minimum expected number of participants is 150 for urologists, 100 for residents and 50 for medical students. Each candidate is provided with an individual access code to this Web site. He/she may complete the Script Concordance test several times during his/her curriculum. RESULTS: The Web site has been operational since April 2004. The reference panel validated the test in June of the same year during the annual seminar of the French Society of Urology. The Web site is available for the candidates since September 2004. In six months, 80% of the target figure for the urologists, 68% of the target figure for the residents and 20% of the target figure for the student passed the test online. During these six months, no technical problem was encountered. CONCLUSION: The feasibility of the web-based SC test is successful as two-thirds of the expected number of participants was included within six months. Psychometric properties (validity, reliability) of the test will be evaluated on a large scale (N = 300). If positive, educational impact of this assessment tool will be useful to help urologists during their curriculum for the acquisition of clinical reasoning skills, which is crucial for professional competence

The disappearance of the "revolving door" patient in Scottish general practice: successful policies

<b>Background</b> We describe the health of "revolving door" patients in general practice in Scotland, estimate changes in their number over the timescale of the study, and explore reasons for changes, particularly related to NHS and government policy.<p></p> <b>Methods</b> A mixed methods predominantly qualitative study, using a grounded theory approach, set in Scottish general practice. Semi-structured interviews were conducted with professional key informants, 6 Practitioner Services staff who administer the GP registration system and 6 GPs with managerial or clinical experience of working with "revolving door" patients. Descriptive statistical analysis and qualitative analysis of patient removal episodes linked with routine hospital admissions, outpatient appointments, drug misuse treatment episodes and deaths were carried out with cohorts of "revolving door" patients identified from 1999 to 2005 in Scotland.<p></p> <b>Results</b> A "revolving door" patient is removed 4 or more times from GP lists in 7 years. Patients had complex health issues including substance misuse, psychiatric and physical health problems and were at high risk of dying. There was a dramatic reduction in the number of "revolving door" patients during the course of the study.<p></p> <b>Conclusions</b> "Revolving door" patients in general practice had significant health problems. Their numbers have reduced dramatically since 2004 and this probably resulted from improved drug treatment services, pressure from professional bodies to reduce patient removals and the positive ethical regulatory and financial climate of the 2004 GMS GP contract. This is a positive development for the NHS

On line clinical reasoning assessment with Script Concordance test in urology: results of a French pilot study

BACKGROUND: The Script Concordance test (SC) test is an assessment tool that measures the capacity to solve ill-defined problems, that is, reasoning in a context of uncertainty. This study assesses the feasibility, reliability and validity of the SC test made available on the Web to French urologists. METHODS: A 97 items SC test was developed based on major educational objectives of French urology training programmes. A secure Web site was created with two sequential modules: a) The first one for the reference panel to elaborate the scoring system; b) The second for candidates with different levels of experience in urology: Board certified urologists, chief-residents, residents, medical students. All participants were recruited on a voluntary basis. Statistical analysis included descriptive statistics of the participants' scores and factorial analysis of variance (ANOVA) to study differences between groups' means. Reliability was evaluated with Cronbach's alpha coefficient. RESULTS: The on line SC test has been operational since June 2004. Twenty-six faculty members constituted the reference panel. During the following 10 months, 207 participants took the test online (124 urologists, 29 chief-residents, 38 residents, 16 students). No technical problem was encountered. Forty-five percent of the participants completed the test partially only. Differences between the means scores for the 4 groups were statistically significant (P = 0.0123). The Bonferroni post-hoc correction indicated that significant differences were present between students and chief-residents, between students and urologists. There were no differences between chief-residents and urologists. Reliability coefficient was 0.734 for the total group of participants. CONCLUSION: Feasibility of Web-based SC test was proved successful by the large number of participants who participated in a few months. This Web site has permitted to quickly confirm reliability of the SC test and develop strategy to improve construct validity of the test when applied in the field of urology. Nevertheless, optimisation of the SC test content, with a smaller number of items will be necessary. Virtual medical education initiative such as this SC test delivered on the Internet warrants consideration in the current context of national pre-residency certification examination in France

Getting the basics right-staging in head and neck cancer

The cornerstone of oncology literature and therefore medical practice is the ability to compare outcomes of treatment modalities for different stages of cancer

Fostering clinical reasoning in physiotherapy: Comparing the effects of concept map study and concept map completion after example study in novice and advanced learners

Background: Health profession learners can foster clinical reasoning by studying worked examples presenting fully worked out solutions to a clinical problem. It is possible to improve the learning effect of these worked examples by combining them with other learning activities based on con

Clinical Reasoning by Veterinary Students in the First-Opinion Setting: Is It Encouraged? Is It Practiced?

A mixed-methods study was performed to investigate the perceived importance and efficacy of teaching clinical reasoning (CR) skills among students and faculty in a university first-opinion veterinary practice, as this has not previously been described. Qualitative analysis of interview data, discussing objectives and factors considered important for effective learning and the understanding of CR, was performed alongside quantitative analysis of the Preceptor Thinking-Promotion Scale (PTPS) and the Learner Thinking-Behavior Scale (LTBS) (assessing the level of CR encouraged by clinicians and displayed by students) in peri-consultation discussions. Themes that emerged from analysis of the interviews regarding objectives included the desire to develop data acquisition and the need to improve data manipulation and CR. Themes associated with effective learning were a positive student-centered learning environment and feedback. Type II CR was fairly well described, but recognition of the importance of type I CR was poor among clinicians and students and, in some instances, was deemed to be inappropriate. Although many clinicians and students expressed a desire to develop student CR, there was little evidence of this actually occurring in the interactions analyzed, with low PTPS and LTBS scores achieved. There was also poor understanding of whether effective teaching of CR had occurred, demonstrated by a lack of correlation between LTBS and the interaction score for development of student CR. Further training of clinicians and students of the value of type I CR in first-opinion practice is required, as well as clinician education in how best to support the development of CR in students

Does Medical Students' Preference of Test Format (Computer-based vs. Paper-based) have an Influence on Performance?

<p>Abstract</p> <p>Background</p> <p>Computer-based examinations (CBE) ensure higher efficiency with respect to producibility and assessment compared to paper-based examinations (PBE). However, students often have objections against CBE and are afraid of getting poorer results in a CBE.</p> <p>The aims of this study were (1) to assess the readiness and the objections of students to a CBE vs. PBE (2) to examine the acceptance and satisfaction with the CBE on a voluntary basis, and (3) to compare the results of the examinations, which were conducted in different formats.</p> <p>Methods</p> <p>Fifth year medical students were introduced to an examination-player and were free to choose their format for the test. The reason behind the choice of the format as well as the satisfaction with the choice was evaluated after the test with a questionnaire. Additionally, the expected and achieved examination results were measured.</p> <p>Results</p> <p>Out of 98 students, 36 voluntarily chose a CBE (37%), 62 students chose a PBE (63%). Both groups did not differ concerning sex, computer-experience, their achieved examination results of the test, and their satisfaction with the chosen format. Reasons for the students' objections against CBE include the possibility for outlines or written notices, a better overview, additional noise from the keyboard or missing habits normally present in a paper based exam. The students with the CBE tended to judge their examination to be more clear and understandable. Moreover, they saw their results to be independent of the format.</p> <p>Conclusions</p> <p>Voluntary computer-based examinations lead to equal test scores compared to a paper-based format.</p

Professional approaches in clinical judgements among senior and junior doctors: implications for medical education

<p>Abstract</p> <p>Background</p> <p>Clinical experience has traditionally been highly valued in medical education and clinical healthcare. On account of its multi-faceted nature, clinical experience is mostly difficult to articulate, and is mainly expressed in clinical situations as professional approaches. Due to retirement, hospitals in Scandinavia will soon face a substantial decrease in the number of senior specialist doctors, and it has been discussed whether healthcare will suffer an immense loss of experienced-based knowledge when this senior group leaves the organization. Both senior specialists and junior colleagues are often involved in clinical education, but the way in which these two groups vary in professional approaches and contributions to clinical education has not been so well described. Cognitive psychology has contributed to the understanding of how experience may influence professional approaches, but such studies have not included the effect of differences in position and responsibilities that junior and senior doctors hold in clinical healthcare. In the light of the discussion above, it is essential to describe the professional approaches of senior doctors in relation to those of their junior colleagues. This study therefore aims to describe and compare the professional approaches of junior and senior doctors when making clinical judgements.</p> <p>Methods</p> <p>Critical incident technique was used in interviews with nine senior doctors and nine junior doctors in internal medicine. The interviews were subjected to qualitative content analysis.</p> <p>Result</p> <p>Senior and junior doctors expressed a variety of professional approaches in clinical judgement as follows: use of theoretical knowledge, use of prior experience of cases and courses of events, use of ethical and moral values, meeting and communicating with the patient, focusing on available information, relying on their own ability, getting support and guidance from others and being directed by the organization.</p> <p>Conclusion</p> <p>The most prominent varieties of professional approaches were seen in use of knowledge and work-related experience. Senior doctors know how the organization has worked in the past and have acquired techniques with respect to long-term decisions and their consequences. Junior doctors, on the other hand, have developed techniques and expertise for making decisions based on a restricted amount of information, in relation to patients' wellbeing as well as organizational opportunities and constraints. This study contributes to medical education by elucidating the variation in professional approaches among junior and senior doctors, which can be used as a basis for discussion about clinical judgement, in both pre-clinical and clinical education. Further research is required to explain how these professional approaches are expressed and used in clinical education.</p