Novice Learner Experiences in Software Development: A Study of Freshman Undergraduates

This paper presents a study that is part of a larger research project aimed at addressing the gap in the provision of educational software development processes for freshman, novice undergraduate learners, to improve proficiency levels. With the aim of understanding how such learners problem solve in software development in the absence of a formal process, this case study examines the experiences and depth of learning acquired by a sample set of novice undergraduates. A novel adaption of the Kirkpatrick framework known as AKM-SOLO is used to frame the evaluation. The study finds that without the scaffolding of an appropriate structured development process tailored to novices, students are in danger of failing to engage with the problem solving skills necessary for software development, particularly the skill of designing solutions prior to coding. It also finds that this lack of engagement directly impacts their affective state on the course and continues to negatively impact their proficiency and affective state in the second year of their studies leading to just under half of students surveyed being unsure if they wish to pursue a career in software development when they graduate

Level models of continuing professional development evaluation: a grounded review and critique

Continuing professional development (CPD) evaluation in education has been heavily influenced by ‘level models’, deriving from the work of Kirkpatrick and Guskey in particular, which attempt to trace the processes through which CPD interventions achieve outcomes. This paper considers the strengths and limitations of such models, and in particular the degree to which they are able to do justice to the complexity of CPD and its effects. After placing level models within the broader context of debates about CPD evaluation, the paper reports our experience of developing such models heuristically for our own evaluation practice. It then draws on positivist, realist and constructivist traditions to consider some more fundamental ontological and epistemological questions to which they give rise. The paper concludes that level models can be used in a number of ways and with differing emphases, and that choices made about their use will need to reflect both theoretical choices and practical considerations

Training evaluation: a case study of training Iranian health managers

<p>Abstract</p> <p>Background</p> <p>The Ministry of Health and Medical Education in the Islamic Republic of Iran has undertaken a reform of its health system, in which-lower level managers are given new roles and responsibilities in a decentralized system. To support these efforts, a United Kingdom-based university was contracted by the World Health Organization to design a series of courses for health managers and trainers. This process was also intended to develop the capacity of the National Public Health Management Centre in Tabriz, Iran, to enable it to organize relevant short courses in health management on a continuing basis. A total of seven short training courses were implemented, three in the United Kingdom and four in Tabriz, with 35 participants. A detailed evaluation of the courses was undertaken to guide future development of the training programmes.</p> <p>Methods</p> <p>The Kirkpatrick framework for evaluation of training was used to measure participants' reactions, learning, application to the job, and to a lesser extent, organizational impact. Particular emphasis was put on application of learning to the participants' job. A structured questionnaire was administered to 23 participants, out of 35, between one and 13 months after they had attended the courses. Respondents, like the training course participants, were predominantly from provincial universities, with both health system and academic responsibilities. Interviews with key informants and ex-trainees provided supplemental information, especially on organizational impact.</p> <p>Results</p> <p>Participants' preferred interactive methods for learning about health planning and management. They found the course content to be relevant, but with an overemphasis on theory compared to practical, locally-specific information. In terms of application of learning to their jobs, participants found specific information and skills to be most useful, such as health systems research and group work/problem solving. The least useful areas were those that dealt with training and leadership. Participants reported little difficulty in applying learning deemed "useful", and had applied it often. In general, a learning area was used less when it was found difficult to apply, with a few exceptions, such as problem-solving. Four fifths of respondents claimed they could perform their jobs better because of new skills and more in-depth understanding of health systems, and one third had been asked to train their colleagues, indicating a potential for impact on their organization. Interviews with key informants indicated that job performance of trainees had improved.</p> <p>Conclusion</p> <p>The health management training programmes in Iran, and the external university involved in capacity building, benefited from following basic principles of good training practice, which incorporated needs assessment, selection of participants and definition of appropriate learning outcomes, course content and methods, along with focused evaluation. Contracts for external assistance should include specific mention of capacity building, and allow for the collaborative development of courses and of evaluation plans, in order to build capacity of local partners throughout the training cycle. This would also help to develop training content that uses material from local health management situations to demonstrate key theories and develop locally required skills. Training evaluations should as a minimum assess participants' reactions and learning for every course. Communication of evaluation results should be designed to ensure that data informs training activities, as well as the health and human resources managers who are investing in the development of their staff.</p

Selling lottery products to minors: factors affecting retailer compliance

Illegal gambling by adolescent minors has become a major issue in many societies and lottery gambling is often considered a "gateway" to gambling more generally among this age group. The purpose of this study was to identify the influencing factors that affect retailer compliance concerning the selling of lottery products to minors. The research team received the original data (i) directly from the sales agents of the Austrian Lotteries after their responsible gambling training of the retailer in 2014/2015 (Round 1: n = 5032), (ii) directly from a third-party agency carrying out test purchases (i.e., "mystery shopping") in 2014 (Round 2: n = 1421), and (iii) retailers’ responses to their attitudes to youth protection issues (through direct interface with the research team) in 2015 (Round 3: n = 4516). The data from a total of 1036 participants who had taken part in all three rounds was analyzed in the present study. Results showed that in 13.1% of mystery shopping checks (n = 1421), lottery products were sold to a test purchaser under the age of 16 years. The analysis also showed that the older the test purchaser, the greater the likelihood that a lottery product was sold. Under-age lottery sales to girls were over three times more prevalent than sales to boys. Finally, the analysis showed that the higher the number of responsible gambling training sessions completed in the past and the more positive the attitude towards mystery shopping, the higher the compliance rate not to sell a lottery product to young mystery shoppers. Recommendations to increase compliance and raise the awareness among retailers are presented

A systematic review of tests of empathy in medicine

Abstract Background Empathy is frequently cited as an important attribute in physicians and some groups have expressed a desire to measure empathy either at selection for medical school or during medical (or postgraduate) training. In order to do this, a reliable and valid test of empathy is required. The purpose of this systematic review is to determine the reliability and validity of existing tests for the assessment of medical empathy. Methods A systematic review of research papers relating to the reliability and validity of tests of empathy in medical students and doctors. Journal databases (Medline, EMBASE, and PsycINFO) were searched for English-language articles relating to the assessment of empathy and related constructs in applicants to medical school, medical students, and doctors. Results From 1147 citations, we identified 50 relevant papers describing 36 different instruments of empathy measurement. As some papers assessed more than one instrument, there were 59 instrument assessments. 20 of these involved only medical students, 30 involved only practising clinicians, and three involved only medical school applicants. Four assessments involved both medical students and practising clinicians, and two studies involved both medical school applicants and students. Eight instruments demonstrated evidence of reliability, internal consistency, and validity. Of these, six were self-rated measures, one was a patient-rated measure, and one was an observer-rated measure. Conclusion A number of empathy measures available have been psychometrically assessed for research use among medical students and practising medical doctors. No empathy measures were found with sufficient evidence of predictive validity for use as selection measures for medical school. However, measures with a sufficient evidential base to support their use as tools for investigating the role of empathy in medical training and clinical care are available.</p