Development and validation of the ACE tool: Assessing medical trainees' competency in evidence based medicine

BACKGROUND: While a variety of instruments have been developed to assess knowledge and skills in evidence based medicine (EBM), few assess all aspects of EBM - including knowledge, skills attitudes and behaviour - or have been psychometrically evaluated. The aim of this study was to develop and validate an instrument that evaluates medical trainees’ competency in EBM across knowledge, skills and attitude. METHODS: The ‘Assessing Competency in EBM’ (ACE) tool was developed by the authors, with content and face validity assessed by expert opinion. A cross-sectional sample of 342 medical trainees representing ‘novice’, ‘intermediate’ and ‘advanced’ EBM trainees were recruited to complete the ACE tool. Construct validity, item difficulty, internal reliability and item discrimination were analysed. RESULTS: We recruited 98 EBM-novice, 108 EBM-intermediate and 136 EBM-advanced participants. A statistically significant difference in the total ACE score was observed and corresponded to the level of training: on a 0-15-point test, the mean ACE scores were 8.6 for EBM-novice; 9.5 for EBM-intermediate; and 10.4 for EBM-advanced (p < 0.0001). Individual item discrimination was excellent (Item Discrimination Index ranging from 0.37 to 0.84), with internal reliability consistent across all but three items (Item Total Correlations were all positive ranging from 0.14 to 0.20). CONCLUSION: The 15-item ACE tool is a reliable and valid instrument to assess medical trainees’ competency in EBM. The ACE tool provides a novel assessment that measures user performance across the four main steps of EBM. To provide a complete suite of instruments to assess EBM competency across various patient scenarios, future refinement of the ACE instrument should include further scenarios across harm, diagnosis and prognosis

Working conditions, self-perceived stress, anxiety, depression and quality of life: A structural equation modelling approach

<p>Abstract</p> <p>Background</p> <p>The relationships between working conditions [job demand, job control and social support]; stress, anxiety, and depression; and perceived quality of life factors [physical health, psychological wellbeing, social relationships and environmental conditions] were assessed using a sample of 698 male automotive assembly workers in Malaysia.</p> <p>Methods</p> <p>The validated Malay version of the Job Content Questionnaire (JCQ), Depression Anxiety Stress Scales (DASS) and the World Health Organization Quality of Life-Brief (WHOQOL-BREF) were used. A structural equation modelling (SEM) analysis was applied to test the structural relationships of the model using AMOS version 6.0, with the maximum likelihood ratio as the method of estimation.</p> <p>Results</p> <p>The results of the SEM supported the hypothesized structural model (<it>χ</it>²= 22.801, <it>df </it>= 19, <it>p </it>= 0.246). The final model shows that social support (JCQ) was directly related to all 4 factors of the WHOQOL-BREF and inversely related to depression and stress (DASS). Job demand (JCQ) was directly related to stress (DASS) and inversely related to the environmental conditions (WHOQOL-BREF). Job control (JCQ) was directly related to social relationships (WHOQOL-BREF). Stress (DASS) was directly related to anxiety and depression (DASS) and inversely related to physical health, environment conditions and social relationships (WHOQOL-BREF). Anxiety (DASS) was directly related to depression (DASS) and inversely related to physical health (WHOQOL-BREF). Depression (DASS) was inversely related to the psychological wellbeing (WHOQOL-BREF). Finally, stress, anxiety and depression (DASS) mediate the relationships between job demand and social support (JCQ) to the 4 factors of WHOQOL-BREF.</p> <p>Conclusion</p> <p>These findings suggest that higher social support increases the self-reported quality of life of these workers. Higher job control increases the social relationships, whilst higher job demand increases the self-perceived stress and decreases the self-perceived quality of life related to environmental factors. The mediating role of depression, anxiety and stress on the relationship between working conditions and perceived quality of life in automotive workers should be taken into account in managing stress amongst these workers.</p