A systematic literature review of methodology used to measure effectiveness in digital game-based learning

In recent years, a growing number of studies is being conducted into the effectiveness of digital game-based learning (DGBL). Despite this growing interest, however, it remains difficult to draw general conclusions due to the disparities in methods and reporting. Guidelines or a standardized procedure for conducting DGBL effectiveness research would allow to compare results across studies and provide well-founded and more generalizable evidence for the impact of DGBL. This study presents a first step in this process by mapping current practices through a systematic literature review. The review included peer-reviewed journal and conference publications between 2000 and 2012. Other inclusion criteria were that (1) the study’s primary aim was effectiveness measurement of cognitive learning outcomes, (2) the focus was on digital games and (3) a pre-post design with a control group was used. Twenty-five publications were found eligible for this study. Important differences were found in the number of control groups used and the type of intervention implemented in the control group (e.g. traditional classroom teaching, use of multimedia, computer-based learning, paper exercises, other games, or no intervention). Regarding the implementation method of the DGBL intervention in the experimental group, two approaches can be distinguished: stand-alone intervention or as part of a larger program. Moreover, a wide variety of effectiveness measures was used: measures for learning outcomes were complemented with time measurements and/or with self-reported measurements for self-efficacy and motivation. Learning effect calculation also varied, introducing pre-test scores in the analysis, conducting a separate analysis on pre- and post-test scores or conducting an analysis on difference scores. Our study thus indicates that a variety of methods is being used in DGBL effectiveness research opening a discussion regarding the potential and requirements for future procedural guidelines

The serious games ecosystem: Interdisciplinary and intercontextual praxis

This chapter will situate academia in relation to serious games commercial production and contextual adoption, and vice-versa. As a researcher it is critical to recognize that academic research of serious games does not occur in a vaccum. Direct partnerships between universities and commercial organizations are increasingly common, as well as between research institutes and the contexts that their serious games are deployed in. Commercial production of serious games and their increased adoption in non-commercial contexts will influence academic research through emerging impact pathways and funding opportunities. Adding further complexity is the emergence of commercial organizations that undertake their own research, and research institutes that have inhouse commercial arms. To conclude, we explore how these issues affect the individual researcher, and offer considerations for future academic and industry serious games projects

Cognitive and affective perspectives on immersive technology in education

This research explains the rationale behind the utilization of mobile learning technologies. It involves a qualitative study among children to better understand their opinions and perceptions toward the use of educational applications (apps) that are available on their mobile devices, including smartphones and tablets. The researchers organized semi-structured, face-to-face interview sessions with primary school students who were using mobile technologies at their primary school. The students reported that their engagement with the educational apps has improved their competencies. They acquired relational and communicative skills as they collaborated in teams. On the other hand, there were a few students who were not perceiving the usefulness and the ease of use of the educational apps on their mobile device. This study indicates that the research participants had different skillsets as they exhibited different learning abilities. In conclusion, this contribution opens-up avenues for future research in this promising field of study.peer-reviewe

Large emergency-response exercises: qualitative characteristics - a survey

Exercises, drills, or simulations are widely used, by governments, agencies and commercial organizations, to simulate serious incidents and train staff how to respond to them. International cooperation has led to increasingly large-scale exercises, often involving hundreds or even thousands of participants in many locations. The difference between ‘large’ and ‘small’ exercises is more than one of size: (a) Large exercises are more ‘experiential’ and more likely to undermine any model of reality that single organizations may create; (b) they create a ‘play space’ in which organizations and individuals act out their own needs and identifications, and a ritual with strong social implications; (c) group-analytic psychotherapy suggests that the emotions aroused in a large group may be stronger and more difficult to control. Feelings are an unacknowledged major factor in the success or failure of exercises; (d) successful large exercises help improve the nature of trust between individuals and the organizations they represent, changing it from a situational trust to a personal trust; (e) it is more difficult to learn from large exercises or to apply the lessons identified; (f) however, large exercises can help develop organizations and individuals. Exercises (and simulation in general) need to be approached from a broader multidisciplinary direction if their full potential is to be realized

E-Learning in Business

e-Learning is replacing face-to-face classroom instruction in a growing number of businesses, but what is the prospect for the continued proliferation of e-learning in business? On one hand, the quality of instruction, the cost effectiveness of new technology, a supportive e-learning educational culture, an expansion of the Internet, an increase in online courses, shorter business cycles, mergers, and increasing competition encourage business use of e-learning. On the other hand, employee reticence in using learning technologies, insufficient corporate investment, lack of business-relevant university courses, narrow bandwidth, and Internet access issues are constricting the business use of these technologies

CAHRS hrSpectrum (March - April 2006)

HRSpec06_04.pdf: 1016 downloads, before Oct. 1, 2020

A Phenomenological Study of Digital Business Simulation Games and Implementation for Corporate Learning

This qualitative phenomenological study investigated the experiences of a purposive sample of eight Learning and Development executives to understand the circumstances leading to, as well as the experiences implementing Digital Business Simulation Games (DBSG) in a corporate learning environment, specifically related to the financial service industry. Their perception of the organizational needs, decision-making process of those involved, as well as the experience in design, development, and implementation may contribute to a better understanding of the circumstances within an organization where a DBSG would be an effective solution to achieve the development goals of learners within that organization. This study will also investigate the impact the implementation of the DBSG had on the organization, as well as provide further insight into best practices and critical success factors for future implementations. The research technique employed was a modified van Kaam method as described by Moustakas (1994) based upon transcribed interviews using semi-structured questions to capture the organizational needs, decision-making, and implementation experiences as well as perceptions of the participants. Five significant themes with two subthemes that emerged are prevalent from within the collected data from the participants: 1) needs intake and leadership support, 2) safe space to practice, 3) innovation on current curricula, 4) higher degrees of engagement, and 5) positive measurement results. The resulting analysis also led to considerable collection of best practices and critical success factors in deciding to undertake a DBSG program, and the design, development and implementation of a DBS