Evaluation of physicians' professional performance: An iterative development and validation study of multisource feedback instruments

Contains fulltext : 107798.pdf (publisher's version ) (Open Access)BACKGROUND: There is a global need to assess physicians' professional performance in actual clinical practice. Valid and reliable instruments are necessary to support these efforts. This study focuses on the reliability and validity, the influences of some sociodemographic biasing factors, associations between self and other evaluations, and the number of evaluations needed for reliable assessment of a physician based on the three instruments used for the multisource assessment of physicians' professional performance in the Netherlands. METHODS: This observational validation study of three instruments underlying multisource feedback (MSF) was set in 26 non-academic hospitals in the Netherlands. In total, 146 hospital-based physicians took part in the study. Each physician's professional performance was assessed by peers (physician colleagues), co-workers (including nurses, secretary assistants and other healthcare professionals) and patients. Physicians also completed a self-evaluation. Ratings of 864 peers, 894 co-workers and 1960 patients on MSF were available. We used principal components analysis and methods of classical test theory to evaluate the factor structure, reliability and validity of instruments. We used Pearson's correlation coefficient and linear mixed models to address other objectives. RESULTS: The peer, co-worker and patient instruments respectively had six factors, three factors and one factor with high internal consistencies (Cronbach's alpha 0.95 - 0.96). It appeared that only 2 percent of variance in the mean ratings could be attributed to biasing factors. Self-ratings were not correlated with peer, co-worker or patient ratings. However, ratings of peers, co-workers and patients were correlated. Five peer evaluations, five co-worker evaluations and 11 patient evaluations are required to achieve reliable results (reliability coefficient >/= 0.70). CONCLUSIONS: The study demonstrated that the three MSF instruments produced reliable and valid data for evaluating physicians' professional performance in the Netherlands. Scores from peers, co-workers and patients were not correlated with self-evaluations. Future research should examine improvement of performance when using MSF

Is testosterone linked to human aggression? A meta-analytic examination of the relationship between baseline, dynamic, and manipulated testosterone on human aggression

Testosterone is often considered a critical regulator of aggressive behaviour. There is castration/replacement evidence that testosterone indeed drives aggression in some species, but causal evidence in humans is generally lacking and/or—for the few studies that have pharmacologically manipulated testosterone concentrations—inconsistent. More often researchers have examined differences in baseline testosterone concentrations between groups known to differ in aggressiveness (e.g., violent vs non-violent criminals) or within a given sample using a correlational approach. Nevertheless, testosterone is not static but instead fluctuates in response to cues of challenge in the environment, and these challenge-induced fluctuations may more strongly regulate situation-specific aggressive behaviour. Here, we quantitatively summarize literature from all three approaches (baseline, change, and manipulation), providing the most comprehensive meta-analysis of these testosterone-aggression associations/effects in humans to date. Baseline testosterone shared a weak but significant association with aggression (r = 0.054, 95% CIs [0.028, 0.080]), an effect that was stronger and significant in men (r = 0.071, 95% CIs [0.041, 0.101]), but not women (r = 0.002, 95% CIs [−0.041, 0.044]). Changes in T were positively correlated with aggression (r = 0.108, 95% CIs [0.041, 0.174]), an effect that was also stronger and significant in men (r = 0.162, 95% CIs [0.076, 0.246]), but not women (r = 0.010, 95% CIs [−0.090, 0.109]). The causal effects of testosterone on human aggression were weaker yet, and not statistically significant (r = 0.046, 95% CIs [−0.015, 0.108]). We discuss the multiple moderators identified here (e.g., offender status of samples, sex) and elsewhere that may explain these generally weak effects. We also offer suggestions regarding methodology and sample sizes to best capture these associations in future work

The implementation of medical revalidation: an assessment using normalisation process theory

Abstract Background Medical revalidation is the process by which all licensed doctors are legally required to demonstrate that they are up to date and fit to practise in order to maintain their licence. Revalidation was introduced in the United Kingdom (UK) in 2012, constituting significant change in the regulation of doctors. The governing body, the General Medical Council (GMC), envisages that revalidation will improve patient care and safety. This potential however is, in part, dependent upon how successfully revalidation is embedded into routine practice. The aim of this study was to use Normalisation Process Theory (NPT) to explore issues contributing to or impeding the implementation of revalidation in practice. Methods We conducted seventy-one interviews with sixty UK policymakers and senior leaders at different points during the development and implementation of revalidation: in 2011 (n = 31), 2013 (n = 26) and 2015 (n = 14). We selected interviewees using purposeful sampling. NPT was used as a framework to enable systematic analysis across the interview sets. Results Initial lack of consensus over revalidation’s purpose, and scepticism about its value, decreased over time as participants recognised the benefits it brought to their practice (coherence category of NPT). Though acceptance increased across time, revalidation was not seen as a legitimate part of their role by all doctors. Key individuals, notably the Responsible Officer (RO), were vital for the successful implementation of revalidation in organisations (cognitive participation category). The ease with which revalidation could be integrated into working practices varied greatly depending on the type of role a doctor held and the organisation they work for and the provision of resources was a significant variable in this (collective action category). Formal evaluation of revalidation in organisations was lacking but informal evaluation was taking place. Revalidation had not yet reached the stage where feedback was being used for improvement (reflexive monitoring category). Conclusions Requiring all organisations to use the same revalidation model made revalidation easy to integrate into existing work for some but problematic for others. In order for revalidation to be fully embedded and successful, impeding factors, such as a lack of resources, need to be addressed

Electroweak Constraints on Warped Geometry in Five Dimensions and Beyond

Here we consider the tree level corrections to electroweak (EW) observables from standard model (SM) particles propagating in generic warped extra dimensions. The scale of these corrections is found to be dominated by three parameters, the Kaluza-Klein (KK) mass scale, the relative coupling of the KK gauge fields to the Higgs and the relative coupling of the KK gauge fields to fermion zero modes. It is found that 5D spaces that resolve the hierarchy problem through warping typically have large gauge-Higgs coupling. It is also found in $D>5$ where the additional dimensions are warped the relative gauge-Higgs coupling scales as a function of the warp factor. If the warp factor of the additional spaces is contracting towards the IR brane, both the relative gauge-Higgs coupling and resulting EW corrections will be large. Conversely EW constraints could be reduced by finding a space where the additional dimension's warp factor is increasing towards the IR brane. We demonstrate that the Klebanov Strassler solution belongs to the former of these possibilities.Comment: 18 pages, 3 figures (references added) version to appear in JHE

Long term geological record of a global deep subsurface microbial habitat in sand injection complexes

Peer reviewedPublisher PD

A spatio‑temporal model of homicide in El Salvador

This paper examines the spatio-temporal evolution of homicide across the municipalities of El Salvador. It aims at identifying both temporal trends and spatial clusters that may contribute to the formation of time-stable corridors lying behind a historically (recurrent) high homicide rate. The results from this study reveal the presence of significant clusters of high homicide municipalities in the Western part of the country that have remained stable over time, and a process of formation of high homicide clusters in the Eastern region. The results show an increasing homicide trend from 2002 to 2013 with significant municipality-specific differential trends across the country. The data suggests that links may exist between the dynamics of homicide rates, drug trafficking and organized crime

Including the religious viewpoints and experiences of Muslim students in an environment that is both plural and secular

This paper sets out the context and some main lines of argument about the education of Muslim children in England, including concern over low attainment, over segregation and violent extremism. Three approaches to inclusion of Muslims in mainstream educational settings are identified. The paper describes and assesses the identity-based approach to inclusion common to many English schools using a distinction between permissive and affirmative stances to analyse practice. It proceeds to argue for an epistemology-based approach that makes room for students’ experiential and theological perspectives on the content of their learning

Mitral regurgitation quantification by cardiac magnetic resonance imaging (MRI) remains reproducible between software solutions

Background: The reproducibility of mitral regurgitation (MR) quantification by cardiovascular magnetic resonance (CMR) imaging using different software solutions remains unclear. This research aimed to investigate the reproducibility of MR quantification between two software solutions: MASS (version 2019 EXP, LUMC, Netherlands) and CAAS (version 5.2, Pie Medical Imaging). Methods: CMR data of 35 patients with MR (12 primary MR, 13 mitral valve repair/replacement, and ten secondary MR) was used. Four methods of MR volume quantification were studied, including two 4D-flow CMR methods (MRMVAV and MRJet) and two non-4D-flow techniques (MRStandard and MRLVRV). We conducted within-software and inter-software correlation and agreement analyses. Results: All methods demonstrated significant correlation between the two software solutions: MRStandard (r=0.92, p<0.001), MRLVRV (r=0.95, p<0.001), MRJet (r=0.86, p<0.001), and MRMVAV (r=0.91, p<0.001). Between CAAS and MASS, MRJet and MRMVAV, compared to each of the four methods, were the only methods not to be associated with significant bias. Conclusions: We conclude that 4D-flow CMR methods demonstrate equivalent reproducibility to non-4D-flow methods but greater levels of agreement between software solutions

Mitral regurgitation quantification by cardiac magnetic resonance imaging (MRI) remains reproducible between software solutions [version 2; peer review: 1 approved]

BACKGROUND: The reproducibility of mitral regurgitation (MR) quantification by cardiovascular magnetic resonance (CMR) imaging using different software solutions remains unclear. This research aimed to investigate the reproducibility of MR quantification between two software solutions: MASS (version 2019 EXP, LUMC, Netherlands) and CAAS (version 5.2, Pie Medical Imaging). METHODS: CMR data of 35 patients with MR (12 primary MR, 13 mitral valve repair/replacement, and ten secondary MR) was used. Four methods of MR volume quantification were studied, including two 4D-flow CMR methods (MRMVAV and MRJet) and two non-4D-flow techniques (MRStandard and MRLVRV). We conducted within-software and inter-software correlation and agreement analyses. RESULTS: All methods demonstrated significant correlation between the two software solutions: MR_{Standard} (r=0.92, p<0.001), MR_{LVRV} (r=0.95, p<0.001), MR_{Jet} (r=0.86, p<0.001), and MR_{MVAV} (r=0.91, p<0.001). Between CAAS and MASS, MR_{Jet} and MR_{MVAV}, compared to each of the four methods, were the only methods not to be associated with significant bias. CONCLUSIONS: We conclude that 4D-flow CMR methods demonstrate equivalent reproducibility to non-4D-flow methods but greater levels of agreement between software solutions