Joining the dots: Conditional pass and programmatic assessment enhances recognition of problems with professionalism and factors hampering student progress

<p>Abstract</p> <p>Background</p> <p>Programmatic assessment that looks across a whole year may contribute to better decisions compared with those made from isolated assessments alone. The aim of this study is to describe and evaluate a programmatic system to handle student assessment results that is aligned not only with learning and remediation, but also with defensibility. The key components are standards based assessments, use of "Conditional Pass", and regular progress meetings.</p> <p>Methods</p> <p>The new assessment system is described. The evaluation is based on years 4-6 of a 6-year medical course. The types of concerns staff had about students were clustered into themes alongside any interventions and outcomes for the students concerned. The likelihoods of passing the year according to type of problem were compared before and after phasing in of the new assessment system.</p> <p>Results</p> <p>The new system was phased in over four years. In the fourth year of implementation 701 students had 3539 assessment results, of which 4.1% were Conditional Pass. More in-depth analysis for 1516 results available from 447 students revealed the odds ratio (95% confidence intervals) for failure was highest for students with problems identified in more than one part of the course (18.8 (7.7-46.2) p < 0.0001) or with problems with professionalism (17.2 (9.1-33.3) p < 0.0001). The odds ratio for failure was lowest for problems with assignments (0.7 (0.1-5.2) NS). Compared with the previous system, more students failed the year under the new system on the basis of performance during the year (20 or 4.5% compared with four or 1.1% under the previous system (p < 0.01)).</p> <p>Conclusions</p> <p>The new system detects more students in difficulty and has resulted in less "failure to fail". The requirement to state conditions required to pass has contributed to a paper trail that should improve defensibility. Most importantly it has helped detect and act on some of the more difficult areas to assess such as professionalism.</p

Medical students’ preparedness for professional activities in early clerkships

Background Sufficient preparedness is important for transitions to workplace participation and learning in clinical settings. This study aims to analyse medical students’ preparedness for early clerkships using a three-dimensional, socio-cognitive, theory-based model of preparedness anchored in specific professional activities and their supervision level. Methods Medical students from a competency-based undergraduate curriculum were surveyed about preparedness for 21 professional activities and level of perceived supervision during their early clerkships via an online questionnaire. Preparedness was operationalized by the three dimensions of confidence to carry out clerkship activities, being prepared through university teaching and coping with failure by seeking support. Factors influencing preparedness and perceived stress as outcomes were analysed through step-wise regression. Results Professional activities carried out by the students (n = 147; 19.0%) and their supervision levels varied. While most students reported high confidence to perform the tasks, the activity-specific analysis revealed important gaps in preparation through university teaching. Students regularly searched for support in case of difficulty. One quarter of the variance of each preparedness dimension was explained by self-efficacy, supervision quality, amount of prior clerkship experience and nature of professional activities. Preparedness contributed to predicting perceived stress. Conclusions The applied three-dimensional concept of preparedness and the task-specific approach provided a detailed and meaningful view on medical students’ workplace participation and experiences in early clerkships

The impact of large scale licensing examinations in highly developed countries: a systematic review

BACKGROUND: To investigate the existing evidence base for the validity of large-scale licensing examinations including their impact. METHODS: Systematic review against a validity framework exploring: Embase (Ovid Medline); Medline (EBSCO); PubMed; Wiley Online; ScienceDirect; and PsychINFO from 2005 to April 2015. All papers were included when they discussed national or large regional (State level) examinations for clinical professionals, linked to examinations in early careers or near the point of graduation, and where success was required to subsequently be able to practice. Using a standardized data extraction form, two independent reviewers extracted study characteristics, with the rest of the team resolving any disagreement. A validity framework was used as developed by the American Educational Research Association, American Psychological Association, and National Council on Measurement in Education to evaluate each paper’s evidence to support or refute the validity of national licensing examinations. RESULTS: 24 published articles provided evidence of validity across the five domains of the validity framework. Most papers (n = 22) provided evidence of national licensing examinations relationships to other variables and their consequential validity. Overall there was evidence that those who do well on earlier or on subsequent examinations also do well on national testing. There is a correlation between NLE performance and some patient outcomes and rates of complaints, but no causal evidence has been established. CONCLUSIONS: The debate around licensure examinations is strong on opinion but weak on validity evidence. This is especially true of the wider claims that licensure examinations improve patient safety and practitioner competence

Genetic association study of QT interval highlights role for calcium signaling pathways in myocardial repolarization.

The QT interval, an electrocardiographic measure reflecting myocardial repolarization, is a heritable trait. QT prolongation is a risk factor for ventricular arrhythmias and sudden cardiac death (SCD) and could indicate the presence of the potentially lethal mendelian long-QT syndrome (LQTS). Using a genome-wide association and replication study in up to 100,000 individuals, we identified 35 common variant loci associated with QT interval that collectively explain ∼8-10% of QT-interval variation and highlight the importance of calcium regulation in myocardial repolarization. Rare variant analysis of 6 new QT interval-associated loci in 298 unrelated probands with LQTS identified coding variants not found in controls but of uncertain causality and therefore requiring validation. Several newly identified loci encode proteins that physically interact with other recognized repolarization proteins. Our integration of common variant association, expression and orthogonal protein-protein interaction screens provides new insights into cardiac electrophysiology and identifies new candidate genes for ventricular arrhythmias, LQTS and SCD

Assessing the Quality of Clinical Teachers: A Systematic Review of Content and Quality of Questionnaires for Assessing Clinical Teachers

BACKGROUND: Learning in a clinical environment differs from formal educational settings and provides specific challenges for clinicians who are teachers. Instruments that reflect these challenges are needed to identify the strengths and weaknesses of clinical teachers. OBJECTIVE: To systematically review the content, validity, and aims of questionnaires used to assess clinical teachers. DATA SOURCES: MEDLINE, EMBASE, PsycINFO and ERIC from 1976 up to March 2010. REVIEW METHODS: The searches revealed 54 papers on 32 instruments. Data from these papers were documented by independent researchers, using a structured format that included content of the instrument, validation methods, aims of the instrument, and its setting. Results : Aspects covered by the instruments predominantly concerned the use of teaching strategies (included in 30 instruments), supporter role (29), role modeling (27), and feedback (26). Providing opportunities for clinical learning activities was included in 13 instruments. Most studies referred to literature on good clinical teaching, although they failed to provide a clear description of what constitutes a good clinical teacher. Instrument length varied from 1 to 58 items. Except for two instruments, all had to be completed by clerks/residents. Instruments served to provide formative feedback ( instruments) but were also used for resource allocation, promotion, and annual performance review (14 instruments). All but two studies reported on internal consistency and/or reliability; other aspects of validity were examined less frequently. CONCLUSIONS: No instrument covered all relevant aspects of clinical teaching comprehensively. Validation of the instruments was often limited to assessment of internal consistency and reliability. Available instruments for assessing clinical teachers should be used carefully, especially for consequential decisions. There is a need for more valid comprehensive instruments

Current cardiac imaging techniques for detection of left ventricular mass

Estimation of left ventricular (LV) mass has both prognostic and therapeutic value independent of traditional risk factors. Unfortunately, LV mass evaluation has been underestimated in clinical practice. Assessment of LV mass can be performed by a number of imaging modalities. Despite inherent limitations, conventional echocardiography has fundamentally been established as most widely used diagnostic tool. 3-dimensional echocardiography (3DE) is now feasible, fast and accurate for LV mass evaluation. 3DE is also superior to conventional echocardiography in terms of LV mass assessment, especially in patients with abnormal LV geometry. Cardiovascular magnetic resonance (CMR) and cardiovascular computed tomography (CCT) are currently performed for LV mass assessment and also do not depend on cardiac geometry and display 3-dimensional data, as well. Therefore, CMR is being increasingly employed and is at the present standard of reference in the clinical setting. Although each method demonstrates advantages over another, there are also disadvantages to receive attention. Diagnostic accuracy of methods will also be increased with the introduction of more advanced systems. It is also likely that in the coming years new and more accurate diagnostic tests will become available. In particular, CMR and CCT have been intersecting hot topic between cardiology and radiology clinics. Thus, good communication and collaboration between two specialties is required for selection of an appropriate test