PLU-E: a proposed framework for planning and conducting evaluation studies with children.

While many models exist to support the design process of a software development project, the evaluation process is far less well defined and this lack of definition often leads to poorly designed evaluations, or the use of the wrong evaluation method. Evaluations of products for children can be especially complex as they need to consider the different requirements and aims that such a product may have, and often use new or developing evaluation methods. This paper takes the view that evaluations should be planned from the start of a project in order to yield the best results, and proposes a framework to facilitate this. This framework is particularly intended to support the varied and often conflicting requirements of a product designed for children, as defined by the PLU model, but could be adapted for other user groups

Advances in Teaching & Learning Day Abstracts 2005

Proceedings of the Advances in Teaching & Learning Day Regional Conference held at The University of Texas Health Science Center at Houston in 2005

The Limited Effect of Graphic Elements in Video and Augmented Reality on Children’s Listening Comprehension

There is currently significant interest in the use of instructional strategies in learning environments thanks to the emergence of new multimedia systems that combine text, audio, graphics and video, such as augmented reality (AR). In this light, this study compares the effectiveness of AR and video for listening comprehension tasks. The sample consisted of thirty-two elementary school students with different reading comprehension. Firstly, the experience, instructions and objectives were introduced to all the students. Next, they were divided into two groups to perform activities—one group performed an activity involving watching an Educational Video Story of the Laika dog and her Space Journey available by mobile devices app Blue Planet Tales, while the other performed an activity involving the use of AR, whose contents of the same history were visualized by means of the app Augment Sales. Once the activities were completed participants answered a comprehension test. Results (p = 0.180) indicate there are no meaningful differences between the lesson format and test performance. But there are differences between the participants of the AR group according to their reading comprehension level. With respect to the time taken to perform the comprehension test, there is no significant difference between the two groups but there is a difference between participants with a high and low level of comprehension. To conclude SUS (System Usability Scale) questionnaire was used to establish the measure usability for the AR app on a smartphone. An average score of 77.5 out of 100 was obtained in this questionnaire, which indicates that the app has fairly good user-centered design

Making in-class skills training more effective: the scope for interactive videos to complement the delivery of practical pedestrian training

Skills and awareness of young pedestrians can be improved with on-street practical pedestrian training, often delivered in schools in the United Kingdom by local authorities with the intention of improving road safety. This training is often supplemented by in-class paper based worksheet activities which are seen to be less effective than practical training in that they focus on knowledge acquisition rather than directly improving the correct application of safe pedestrian skills at the roadside. Previous research indicates that interactive video tools have the potential to develop procedural skills whilst offering an engaging road safety educational experience, which could positively impact on road crossing behaviour.In this paper, the design and development of a hazard-identification interactive road safety training video targeting child road crossing skills is presented. The interactive video was shown to be an engaging training resource for 6-7 year old children. The tool’s scope for improving pedestrians’ roadside skills is considered along with the wider implications for interactive video to aid safety training in other areas

App creation in schools for different curricula subjects - lesson learned

The next generation of jobs will be characterized by an increased demand for people with computational and problem solving skills. In Austria, computer science topics are underrepresented in school curricula hence teaching time for these topics is limited. From primary through secondary school, only a few opportunities exist for young students to explore programming. Furthermore, today's teachers are rarely trained in computer science, which impairs their potential to motivate students in these courses. Within the "No One Left Behind" (NOLB) project, teachers were supported to guide and assist their students in their learning processes by constructing ideas through game making. Thus, students created games that referred to different subject areas by using the programming tool Pocket Code, an app developed at Graz University of Technology (TU-Graz). This tool helps students to take control of their own education, becoming more engaged, interested, and empowered as a result. To ensure an optimal integration of the app in diverse subjects the different backgrounds (technical and non-technical) of teachers must be considered as well. First, teachers were supported to use Pocket Code in the different subjects in school within the feasibility study of the project. Observed challenges and difficulties using the app have been gathered. Second, we conducted interviews with teachers and students to underpin our onsite observations. As a result, it was possible to validate Pocket Codes' potential to be used in a diverse range of subjects. Third, we focused especially on those teachers who were not technically trained to provide them with a framework for Pocket Code units, e.g., with the help of structured lesson plans and predefined templates.Comment: 10 pages, 5 tables EduLearn 201

Mobile learning: benefits of augmented reality in geometry teaching

As a consequence of the technological advances and the widespread use of mobile devices to access information and communication in the last decades, mobile learning has become a spontaneous learning model, providing a more flexible and collaborative technology-based learning. Thus, mobile technologies can create new opportunities for enhancing the pupils’ learning experiences. This paper presents the development of a game to assist teaching and learning, aiming to help students acquire knowledge in the field of geometry. The game was intended to develop the following competences in primary school learners (8-10 years): a better visualization of geometric objects on a plane and in space; understanding of the properties of geometric solids; and familiarization with the vocabulary of geometry. Findings show that by using the game, students have improved around 35% the hits of correct responses to the classification and differentiation between edge, vertex and face in 3D solids.This research was supported by the Arts and Humanities Research Council Design Star CDT (AH/L503770/1), the Portuguese Foundation for Science and Technology (FCT) projects LARSyS (UID/EEA/50009/2013) and CIAC-Research Centre for Arts and Communication.info:eu-repo/semantics/publishedVersio

Native IYG: Improving Psychosocial Protective Factors for HIV/STI and Teen Pregnancy Prevention among Youth in American Indian/Alaska Native Communities

Background: Few HIV/STI and pregnancy prevention programs for youth in American Indian and Alaska Native (AI/AN) communities have been rigorously evaluated despite sexual health disparities in this population. This study reports the evaluation of a culturally adapted Internet-based HIV/STI and pregnancy prevention program for AI/AN youth, Native It’s Your Game (Native IYG). Methods: A randomized study was conducted with 523 youth (12 to 14 years old), recruited from 25 tribal sites in Alaska, Arizona, and the Pacific Northwest. Participants were surveyed at baseline and upon completion of treatment or comparison interventions. Multivariable linear regression models were used to assess impact on short term psychosocial determinants of sexual initiation. Results: A sample of 402 intervention (n=290) and comparison (n=112) youth completed the post-intervention survey (76.9% retention) from 1 to 462 days post-baseline (mean = 114, SD = ±96.67). Participants were 55.5% female, mean age of 13.0 (± 0.97) years with 86.1% self-reporting as AI/AN. Reasons not to have sex, STI knowledge, condom knowledge, condom availability self-efficacy, and condom use self-efficacy were significantly impacted (all P ≤ .01). Limitations included variability in intervention exposure and time between data collection time points. Conclusions: Native IYG demonstrated efficacy to impact short-term psychosocial determinants of sexual behavior in a sample of predominantly AI/AN middle school youth

Heuristic usability evaluation on games: a modular approach

Heuristic evaluation is the preferred method to assess usability in games when experts conduct this evaluation. Many heuristics guidelines have been proposed attending to specificities of games but they only focus on specific subsets of games or platforms. In fact, to date the most used guideline to evaluate games usability is still Nielsen’s proposal, which is focused on generic software. As a result, most evaluations do not cover important aspects in games such as mobility, multiplayer interactions, enjoyability and playability, etc. To promote the usage of new heuristics adapted to different game and platform aspects we propose a modular approach based on the classification of existing game heuristics using metadata and a tool, MUSE (Meta-heUristics uSability Evaluation tool) for games, which allows a rebuild of heuristic guidelines based on metadata selection in order to obtain a customized list for every real evaluation case. The usage of these new rebuilt heuristic guidelines allows an explicit attendance to a wide range of usability aspects in games and a better detection of usability issues. We preliminarily evaluate MUSE with an analysis of two different games, using both the Nielsen’s heuristics and the customized heuristic lists generated by our tool.Unión Europea PI055-15/E0