Choice of outcomes and measurement instruments in randomised trials on eLearning in medical education: A systematic mapping review protocol

Background: There will be a lack of 18 million healthcare workers by 2030. Multiplying the number of well-trained healthcare workers through innovative ways such as eLearning is highly recommended in solving this shortage. However, high heterogeneity of learning outcomes in eLearning systematic reviews reveals a lack of consistency and agreement on core learning outcomes in eLearning for medical education. In addition, there seems to be a lack of validity evidence for measurement instruments used in these trials. This undermines the credibility of these outcome measures and affects the ability to draw accurate and meaningful conclusions. The aim of this research is to address this issue by determining the choice of outcomes, measurement instruments and the prevalence of measurement instruments with validity evidence in randomised trials on eLearning for pre-registration medical education. Methods: We will conduct a systematic mapping and review to identify the types of outcomes, the kinds of measurement instruments and the prevalence of validity evidence among measurement instruments in eLearning randomised controlled trials (RCTs) in pre-registration medical education. The search period will be from January 1990 until August 2017. We will consider studies on eLearning for health professionals' education. Two reviewers will extract and manage data independently from the included studies. Data will be analysed and synthesised according to the aim of the review. Discussion: Appropriate choice of outcomes and measurement tools is essential for ensuring high-quality research in the field of eLearning and eHealth. The results of this study could have positive implications for other eHealth interventions, including (1) improving quality and credibility of eLearning research, (2) enhancing the quality of digital medical education and (3) informing researchers, academics and curriculum developers about the types of outcomes and validity evidence for measurement instruments used in eLearning studies. The protocol aspires to assist in the advancement of the eLearning research field as well as in the development of high-quality healthcare professionals' digital education. Systematic review registration: PROSPERO CRD4201706842

A 10 year case study on the changing determinants of University student satisfaction in the UK

Higher Education (HE), once the prerogative of a tiny elite, is now accessible to larger numbers of people around the world than ever before yet despite the fact that an understanding of student satisfaction has never been more important for today’s universities, the concept remains poorly understood. Here we use published data from the UK’s National Student Survey (NSS), representing data from 2.3 million full-time students collected from 2007 to 2016, as a case study of the benefits and limitations of measuring student satisfaction that might have applicability for other countries, particularly those that, like the UK, have experienced significant growth in student numbers. The analyses showed that the factor structure of the NSS remained generally stable and that the ability of the NSS to discriminate between different subjects at different universities actually improved over the ten-year sample period. The best predictors of overall satisfaction were 'Teaching Quality' and 'Organisation & Management', with 'Assessment & Feedback' having relatively weak predictive ability, despite the sector's tangible efforts to improve on this metric. The tripling of student fees in 2012 for English students (but not the rest of the UK) was used as a ‘natural experiment’ to investigate the sensitivity of student satisfaction ratings to the real economic costs of HE. The tuition fee increase had no identifiable negative effect, with student satisfaction steadily improving throughout the decade. Although the NSS was never designed to measure perceived value-for money, its insensitivity to major changes in the economic costs of HE to the individual suggest that the conventional concept of student satisfaction is incomplete. As such we propose that the concept of student satisfaction: (i) needs to be widened to take into account the broader economic benefits to the individual student by including measures of perceived value-for-money and (ii) should measure students’ level of satisfaction in the years post-graduation, by which time they may have a greater appreciation of the value of their degree in the workplace

Book Review

Obra ressenyada: Pat DAVIES (ed.), Adults in Higher Education: International Perspectives in Access and Participation. London: Kingsley, 1995