Assessment in and of serious games: an overview

There is a consensus that serious games have a significant potential as a tool for instruction. However, their effectiveness in terms of learning outcomes is still understudied mainly due to the complexity involved in assessing intangible measures. A systematic approach—based on established principles and guidelines—is necessary to enhance the design of serious games, and many studies lack a rigorous assessment. An important aspect in the evaluation of serious games, like other educational tools, is user performance assessment. This is an important area of exploration because serious games are intended to evaluate the learning progress as well as the outcomes. This also emphasizes the importance of providing appropriate feedback to the player. Moreover, performance assessment enables adaptivity and personalization to meet individual needs in various aspects, such as learning styles, information provision rates, feedback, and so forth. This paper first reviews related literature regarding the educational effectiveness of serious games. It then discusses how to assess the learning impact of serious games and methods for competence and skill assessment. Finally, it suggests two major directions for future research: characterization of the player's activity and better integration of assessment in games

Augmented Reality and Context Awareness for Mobile Learning Systems

Learning is one of the most interactive processes that humans practice. The level of interaction between the instructor and his or her audience has the greatest effect on the output of the learning process. Recent years have witnessed the introduction of e-learning (electronic learning), which was then followed by m-learning (mobile learning). While researchers have studied e-learning and m-learning to devise a framework that can be followed to provide the best possible output of the learning process, m-learning is still being studied in the shadow of e-learning. Such an approach might be valid to a limited extent, since both aims to provide educational material over electronic channels. However, m-learning has more space for user interaction because of the nature of the devices and their capabilities. The objective of this work is to devise a framework that utilises augmented reality and context awareness in m-learning systems to increase their level of interaction and, hence, their usability. The proposed framework was implemented and deployed over an iPhone device. The implementation focused on a specific course. Its material represented the use of augmented reality and the flow of the material utilised context awareness. Furthermore, a software prototype application for smart phones, to assess usability issues of m-learning applications, was designed and implemented. This prototype application was developed using the Java language and the Android software development kit, so that the recommended guidelines of the proposed framework were maintained. A questionnaire survey was conducted at the University, with approximately twenty-four undergraduate computer science students. Twenty-four identical smart phones were used to evaluate the developed prototype, in terms of ease of use, ease of navigating the application content, user satisfaction, attractiveness and learnability. Several validation tests were conducted on the proposed augmented reality m-learning verses m-learning. Generally, the respondents rated m-learning with augmented reality as superior to m-learning alone

Internet on mobiles: evolution of usability and user experience

The mobile Internet is no longer a new phenomenon; the first mobile devices supporting web access were introduced over 10 years ago. During the past ten years technology and business infrastructure have evolved and the number of mobile Internet users has increased all over the world. Service user interface, technology and business infrastructure have built a framework for service adaptation: they can act as enablers or as barriers. Users evaluate how the new technology adds value to their life based on multiple factors. This dissertation has its focus in the area of human-computer interaction research and practices. The overall goal of my research has been to improve the usability and the user experience of mobile Internet services. My research has sought answers to questions relevant in service development process. Questions have varied during the years, the main question being: How to design and create mobile Internet services that people can use and want to use? I have sought answers mostly from a human factors perspective, but have also taken the elements form technology and business infrastructure into consideration. In order to answer the questions raised in service development projects, we have investigated the mobile Internet services in the laboratory and in the field. My research has been conducted in various countries in 3 continents: Asia, Europe and North America. These studies revealed differences in mobile Internet use in different countries and between user groups. Studies in this dissertation were conducted between years 1998 and 2007 and show how questions and research methods have evolved during the time. Good service creation requires that all three factors: technology, business infrastructure and users are taken in consideration. When using knowledge on users in decision making, it is important to understand that the different phases of the service development cycle require the different kind of information on users. It is not enough to know about the users, the knowledge about users has to be transferred into decisions. The service has to be easy to use so that people can use it. This is related to usability. Usability is a very important factor in service adoption, but it is not enough. The service has to have relevant content from user perspective. The content is the reason why people want to use the service. In addition to the content and the ease of use, people evaluate the goodness of the service based on many other aspects: the cost, the availability and the reliability of the system for example. A good service is worth trying and after the first experience, is it worth using. These aspects are considered to influence the 'user experience' of the system. In this work I use lexical analysis to evaluate how the words "usability" and "user experience" are used in mobile HCI conference papers during the past 10 years. The use of both words has increased during the period and reflects the evolution of research questions and methodology over time