Evaluation of the game development process of a location-based mobile game

There is a growing interest of government bodies and NGOs in using (serious) video games in awareness campaigns. Until now, however, little was known on how to set up such a campaign so as to effectively cater to the needs of different stakeholders including the target audience. Hence designing, developing and translating a game for educational purposes whilst balancing between fun and learning is a complex process, this paper aims to evaluate this by presenting a methodological framework for involving stakeholders in the design and development of a game-based awareness campaign based on a user-centered software design methodology and assesses its effectiveness in a concrete use case: the development of the location-based mobile game City Jam. The goal was to develop a game-based road safety campaign to confront adolescents with road traffic situations with the aim to positively influence road safety attitude and behavior. Mobile technologies offer new opportunities to embed digital game based learning by in different contexts. Given the nature of the road safety campaign, a location-based game format was chosen, aiming to facilitate learning by means of an extended three-way interaction (human interaction, game and context). Different user-centered design methods were deployed throughout several phases of the game development process: In phase one (the opportunity identification) a literature review was performed to investigate relevant fields for the game’s goal. In phase two (the game concept development) expert interviews and a focus groups were conducted with relevant stakeholders and in phase three (the game concept design) co-design sessions and a focus group resulted in a game design document. In phase four (game development and testing) the beta version of City jam was developed and tested in an iterative field testing design and resulted in the final game. Results obtained throughout the game development process provided us the opportunity to evaluate several major aspects. Firstly the impact of stakeholder involvement on the different phases of the design process and the final product resulted in a game that was tailored to the preferences and needs of the target group. Secondly translating the game concept into practice, such as game elements, proposed educational game elements, were evaluated based on the usability, playability principles and social and technological aspects. Benefits and challenges of user-centered design methods are discussed and how budget constraints and differing desired outcomes of different stakeholders challenge but also enrich the process

Gamified-Assessment For Learning Indonesian as A Foreign Language: Heuristic Evaluation Approach

While the current assessment mostly repletes with paper-based or switching to online-based to see the assessment efficiency, gamified-assessment is underexplored yet. Even though the widespread of gamification phenomenon has been observed in the particular foreign language, the scarcity of game-based for assessment in learning Indonesian as foreign language forces this study to heuristically evaluate ‘travelling-like’ game. It aims to assess non-native students in higher education for learning Indonesian as a foreign language (BIPA). To this end, the study was supported by six Indonesian teachers who are currently teaching the Indonesian language in various countries or regions. The outcome of the study is thirteen heuristics which contains a set of checklist items related to an educational game framework called HEDEERS. Both the heuristics and the discussions can identify essential aspects of assessment design in both educational and game perspectives that will impact users experiences for learning the Indonesian language in a better approac

Youth and Digital Media: From Credibility to Information Quality

Building upon a process-and context-oriented information quality framework, this paper seeks to map and explore what we know about the ways in which young users of age 18 and under search for information online, how they evaluate information, and how their related practices of content creation, levels of new literacies, general digital media usage, and social patterns affect these activities. A review of selected literature at the intersection of digital media, youth, and information quality -- primarily works from library and information science, sociology, education, and selected ethnographic studies -- reveals patterns in youth's information-seeking behavior, but also highlights the importance of contextual and demographic factors both for search and evaluation. Looking at the phenomenon from an information-learning and educational perspective, the literature shows that youth develop competencies for personal goals that sometimes do not transfer to school, and are sometimes not appropriate for school. Thus far, educational initiatives to educate youth about search, evaluation, or creation have depended greatly on the local circumstances for their success or failure

3D virtual worlds as environments for literacy learning

Background: Although much has been written about the ways in which new technology might transform educational practice, particularly in the area of literacy learning, there is relatively little empirical work that explores the possibilities and problems - or even what such a transformation might look like in the classroom. 3D virtual worlds offer a range of opportunities for children to use digital literacies in school, and suggest one way in which we might explore changing literacy practices in a playful, yet meaningful context. Purpose: This paper identifies some of the key issues that emerged in designing and implementing virtual world work in a small number of primary schools in the UK. It examines the tensions between different discourses about literacy and literacy learning and shows how these were played out by teachers and pupils in classroom settings.Sources of evidence: Case study data are used as a basis for exploring and illustrating key aspects of design and implementation. The case study material includes views from a number of perspectives including classroom observations, chatlogs, in-world avatar interviews with teachers and also pupils, as well as the author’s field notes of the planning process with accompanying minutes and meeting documents.Main argument: From a Foucauldian perspective, the article suggests that social control of pedagogical practice through the regulation of curriculum time, the normalisation of teaching routines and the regimes of individual assessment restricts teachers’ and pupils’ conceptions of what constitutes literacy. The counternarrative, found in recent work in new litearcies (Lankshear & Knobel, 2006) provides an attractive alternative, but a movement in this direction requires a fundamental shift of emphasis and a re-conceptualisation of what counts as learning.Conclusions: This work on 3D virtual worlds questions the notion of how transformative practice can be achieved with the use of new technologies. It suggests that changes in teacher preparation, continuing professional development as well as wider educational reform may be needed

Educational Technology as Seen Through the Eyes of the Readers

In this paper, I present the evaluation of a novel knowledge domain visualization of educational technology. The interactive visualization is based on readership patterns in the online reference management system Mendeley. It comprises of 13 topic areas, spanning psychological, pedagogical, and methodological foundations, learning methods and technologies, and social and technological developments. The visualization was evaluated with (1) a qualitative comparison to knowledge domain visualizations based on citations, and (2) expert interviews. The results show that the co-readership visualization is a recent representation of pedagogical and psychological research in educational technology. Furthermore, the co-readership analysis covers more areas than comparable visualizations based on co-citation patterns. Areas related to computer science, however, are missing from the co-readership visualization and more research is needed to explore the interpretations of size and placement of research areas on the map.Comment: Forthcoming article in the International Journal of Technology Enhanced Learnin

A Mixed Method Approach for Evaluating and Improving the Design of Learning in Puzzle Games

Despite the acknowledgment that learning is a necessary part of all gameplay, the area of Games User Research lacks an established evidence based method through which designers and researchers can understand, assess, and improve how commercial games teach players game-specific skills and information. In this paper, we propose a mixed method procedure that draws together both quantitative and experiential approaches to examine the extent to which players are supported in learning about the game world and mechanics. We demonstrate the method through presenting a case study of the game Portal involving 14 participants, who differed in terms of their gaming expertise. By comparing optimum solutions to puzzles against observed player performance, we illustrate how the method can indicate particular problems with how learning is structured within a game. We argue that the method can highlight where major breakdowns occur and yield design insights that can improve the player experience with puzzle games

Critical thinking and systems thinking: towards a critical literacy for systems thinking in practice

About the book: In reflective problem solving and thoughtful decision making using critical thinking one considers evidence, the context of judgment, the relevant criteria for making the judgment well, the applicable methods or techniques for forming the judgment, and the applicable theoretical constructs for understanding the problem and the question at hand. In this book, the authors present topical research in the study of critical thinking. Topics discussed include developing critical thinking through probability models; the promotion of critical thinking skills through argument mapping; an instructional model for teacher training in critical thinking; advanced academic literacy and critical thinking and critical thinking and higher education