Evaluating the use of a mobile annotation system for geography education

ASTAR partia

User-interface evaluation metrics for a typical M-Learning application

Usability is seen as an important aspect for the quality of an M-learning application. Yet very little research has been conducted in this area – particularly in South Africa. Even though the trials of M-learning projects have been witnessed in the country during the last five years, very little is known about the systems that were implemented as regards their usability. Additionally, metrics and measures used in evaluating usability have not been reported. A need exists for relevant metrics to M-learning usability. The primary objective of this work was to propose metrics and measures – for the purpose of evaluating the User-Interfacedesign usability of M-learning application. The research included a literature review of M-learning, as well as the development of metrics and measures based on the Goal Question Metric (GQM) Model. This model has helped provide a reference model and measurements for evaluating the User-InterfaceUsability. A case study was used as a research strategy. An application called Kontax was selected for evaluation by users and expert reviewers. Data-collection methods consisted of User Testing and Heuristics evaluations. Data-gathering instruments included the use of surveys and user- satisfaction questionnaires based on the proposed metrics, task scenarios and expert-reviewed questionnaires based on the proposed metrics; all these instruments were developed. It was found that, although the users thought the system was very interesting, and they wished to hear more about it in the future, the system nevertheless had usability flaws which made it difficult to use. All the users failed to register so that they could use the system; additionally, the system-error messages did not help the users recognize, and recover from an error – leaving the user to simply log out. Help was not adequate, thus making it difficult for first-time users to know what to do when they needed support. The system was also said to have a lot of information presented on its home page, which caused the user to be disoriented. The Kontax application has usability flaws which should be III attended to, in order to improve its usability. The proposed metrics proved to be very useful in evaluating the usability of the tool

Interface design and evaluation of a personal information space for mobile learners

In response to the market penetration of mobile phones, educational institutions will soon focus on delivering information to mobile phones. This paper presents the design and evaluation of a prototype mobile application for lifelong learning. The application is a personal information space for mobile learners to access, compose and manage their learning in a variety of settings. As a result of the evaluation, a revised set of design guidelines is produced that can potentially feed into other attempts to develop a framework for designing applications for mobile learners