Leniency and halo effects in marking undergraduate short research projects

BACKGROUND: Supervisors are often involved in the assessment of projects they have supervised themselves. Previous research suggests that detailed marking sheets may alleviate leniency and halo effects. We set out to determine if, despite using such a marking schedule, leniency and halo effects were evident in the supervisors' marking of undergraduate short research projects (special study modules (SSM)). METHODS: Review of grades awarded by supervisors, second markers and control markers to the written reports of 4(th )year medical students who had participated in an SSM during two full academic years (n = 399). Paired t-tests were used to compare mean marks, Pearson correlation to look at agreement between marks and multiple linear regression to test the prediction of one mark from several others adjusted for one another. RESULTS: There was a highly significant difference of approximately half a grade between supervisors and second markers with supervisors marking higher. (t = 3.12, p < 0.01, difference in grade score = 0.42, 95% CI for mean difference 0.18–0.80). There was a high correlation between the two marks awarded for performance of the project and the written report by the supervisor (r = 0.75), but a low-modest correlation between supervisor and second marker (r = 0.28). Linear regression analysis of the influence of the supervisors' mark for performance on their mark for the report gave a non-significant result. This suggests a leniency effect but no halo effect. CONCLUSIONS: This study shows that with the use of structured marking sheet for assessment of undergraduate medical students, supervisors marks are not associated with a halo effect, but leniency does occur. As supervisor assessment is becoming more common in both under graduate and postgraduate teaching new ways to improve objectivity in marking and to address the leniency of supervisors should be sought

Audit and feedback and clinical practice guideline adherence: Making feedback actionable

BACKGROUND: As a strategy for improving clinical practice guideline (CPG) adherence, audit and feedback (A&F) has been found to be variably effective, yet A&F research has not investigated the impact of feedback characteristics on its effectiveness. This paper explores how high performing facilities (HPF) and low performing facilities (LPF) differ in the way they use clinical audit data for feedback purposes. METHOD: Descriptive, qualitative, cross-sectional study of a purposeful sample of six Veterans Affairs Medical Centers (VAMCs) with high and low adherence to six CPGs, as measured by external chart review audits. One-hundred and two employees involved with outpatient CPG implementation across the six facilities participated in one-hour semi-structured interviews where they discussed strategies, facilitators and barriers to implementing CPGs. Interviews were analyzed using techniques from the grounded theory method. RESULTS: High performers provided timely, individualized, non-punitive feedback to providers, whereas low performers were more variable in their timeliness and non-punitiveness and relied on more standardized, facility-level reports. The concept of actionable feedback emerged as the core category from the data, around which timeliness, individualization, non-punitiveness, and customizability can be hierarchically ordered. CONCLUSION: Facilities with a successful record of guideline adherence tend to deliver more timely, individualized and non-punitive feedback to providers about their adherence than facilities with a poor record of guideline adherence. Consistent with findings from organizational research, feedback intervention characteristics may influence the feedback's effectiveness at changing desired behaviors

How Do Employees Perceive Corporate Responsibility? Development and Validation of a Multidimensional Corporate Stakeholder Responsibility Scale

Recent research on the microfoundations of corporate social responsibility (CSR) has highlighted the need for improved measures to evaluate how stakeholders perceive and subsequently react to CSR initiatives. Drawing on stakeholder theory and data from five samples of employees (N = 3,772), the authors develop and validate a new measure of corporate stakeholder responsibility (CStR), which refers to an organization’s context-specific actions and policies designed to enhance the welfare of various stakeholder groups by accounting for the triple bottom line of economic, social, and environmental performance; it is conceptualized as a superordinate, multidimensional construct. Results from exploratory factor analyses, first- and second-order confirmatory factor analyses, and structural equation modeling provide strong evidence of the convergent, discriminant, incremental, and criterion-related validities of the proposed CStR scale. Two-wave longitudinal studies further extend prior theory by demonstrating that the higher-order CStR construct relates positively and directly to organizational pride and perceived organizational support, as well as positively and indirectly to organizational identification, job satisfaction, and affective commitment, beyond the contribution of overall organizational justice, ethical climate, and prior measures of perceived CSR

Organizational Behaviour

Organizational Behaviour, Second European Edition' offers a comprehensive introduction to the theories of Organisational Behaviour within a European context. In addition to its clear exposition of fundamental concepts, the text's interactive approach develops students' understanding of how OB applies to real working environments. The new edition features: New European Case Studies - New case material featuring European organisations, illuminating the theories of OB with interesting and relevant insights. New International OB Examples - Up-to-date examples reflecting cultural diversity and the increasing globalisation of business. Interactive pedagogical approach - OB exercises, group exercises, internet exercises, and personal awareness and growth exercises test students' ability to apply concepts, analyse models, and evaluate their own aptitudes as future managers. Coverage of contemporary issues in OB - A strong focus on culture and diversity, a new chapter on Influence, Power and Politics, and a full chapter on Managing Occupational Stress

Teachers as leaders: A moderator variable approach

A review of research on teachers as leaders shows that current approaches have produced unclear and inconsistent results. A new approach--viewing teachers in a situational context--is suggested. 155 students filled out 2 questionnaires; the 1st (administered during the 5th wk of class) contained measures of teacher leadership behavior and student role clarity, and the 2nd (administered during the 10th wk) measured overall student satisfaction with the class. Student performance was also assessed at the 10th wk. It was found that (a) student performance significantly correlated with teacher supportiveness and directiveness under low role clarity but not high role clarity, and (b) the differences in these correlations were statistically significant. (23 ref