Combinations of methods for collaborative evaluation of the usability of interactive software systems

Usability is a fundamental quality characteristic for the success of an interactive system. It is a concept that includes a set of metrics and methods in order to obtain easy-to-learn and easy-to-use systems. Usability Evaluation Methods, UEM, are quite diverse; their application depends on variables such as costs, time availability, and human resources. A large number of UEM can be employed to assess interactive software systems, but questions arise when deciding which method and/or combination of methods gives more (relevant) information. We propose Collaborative Usability Evaluation Methods, CUEM, following the principles defined by the Collaboration Engineering. This paper analyzes a set of CUEM conducted on different interactive software systems. It proposes combinations of CUEM that provide more complete and comprehensive information about the usability of interactive software systems than those evaluation methods conducted independentl

Combinations of Methods for Collaborative Evaluation of the Usability of Interactive Software Systems

Usability is a fundamental quality characteristic for the success of an interactive system. It is a concept that includes a set of metrics and methods in order to obtain easy-to-learn and easy-to-use systems. Usability Evaluation Methods, UEM, are quite diverse; their application depends on variables such as costs, time availability, and human resources. A large number of UEM can be employed to assess interactive software systems, but questions arise when deciding which method and/or combination of methods gives more (relevant) information. We propose Collaborative Usability Evaluation Methods, CUEM, following the principles defined by the Collaboration Engineering. This paper analyzes a set of CUEM conducted on different interactive software systems. It proposes combinations of CUEM that provide more complete and comprehensive information about the usability of interactive software systems than those evaluation methods conducted independently

Combinations of Methods for Collaborative Evaluation of the Usability of Interactive Software Systems

Usability is a fundamental quality characteristic for the success of an interactive system. It is a concept that includes a set of metrics and methods in order to obtain easy-to-learn and easy-to-use systems. Usability Evaluation Methods, UEM, are quite diverse; their application depends on variables such as costs, time availability, and human resources. A large number of UEM can be employed to assess interactive software systems, but questions arise when deciding which method and/or combination of methods gives more (relevant) information. We propose Collaborative Usability Evaluation Methods, CUEM, following the principles defined by the Collaboration Engineering. This paper analyzes a set of CUEM conducted on different interactive software systems. It proposes combinations of CUEM that provide more complete and comprehensive information about the usability of interactive software systems than those evaluation methods conducted independently

Desktop multimedia environments to support collaborative distance learning

Desktop multimedia conferencing, when two or more persons can communicate among themselves via personal computers with the opportunity to see and hear one another as well as communicate via text messages while working with commonly available stored resources, appears to have important applications to the support of collaborative learning. In this paper we explore this potential in three ways: (a) through an analysis of particular learner needs when learning and working collaboratively with others outside of face-to-face situations; (b) through an analysis of different forms of conferencing environments, including desktop multimedia environments, relative to their effectiveness in terms of meeting learner needs for distributed collaboration; and (c) through reporting the results of a formative evaluation of a prototype desktop multimedia conferencing system developed especially for the support of collaborative learning. Via these analyses, suggestions are offered relating to the functionalities of desktop multimedia conferencing systems for the support of collaborative learning, reflecting new developments in both the technologies available for such systems and in our awareness of learner needs when working collaboratively with one other outside of face-to-face situations

Usability Evaluation in Virtual Environments: Classification and Comparison of Methods

Virtual environments (VEs) are a relatively new type of human-computer interface in which users perceive and act in a three-dimensional world. The designers of such systems cannot rely solely on design guidelines for traditional two-dimensional interfaces, so usability evaluation is crucial for VEs. We present an overview of VE usability evaluation. First, we discuss some of the issues that differentiate VE usability evaluation from evaluation of traditional user interfaces such as GUIs. We also present a review of VE evaluation methods currently in use, and discuss a simple classification space for VE usability evaluation methods. This classification space provides a structured means for comparing evaluation methods according to three key characteristics: involvement of representative users, context of evaluation, and types of results produced. To illustrate these concepts, we compare two existing evaluation approaches: testbed evaluation [Bowman, Johnson, & Hodges, 1999], and sequential evaluation [Gabbard, Hix, & Swan, 1999]. We conclude by presenting novel ways to effectively link these two approaches to VE usability evaluation

Layered evaluation of interactive adaptive systems : framework and formative methods

Peer reviewedPostprin

Usability dimensions in collaborative GIS

Collaborative GIS requires careful consideration of the Human-Computer Interaction (HCI) and Usability aspects, given the variety of users that are expected to use these systems, and the need to ensure that users will find the system effective, efficient, and enjoyable. The chapter explains the link between collaborative GIS and usability engineering/HCI studies. The integration of usability considerations into collaborative GIS is demonstrated in two case studies of Web-based GIS implementation. In the first, the process of digitising an area on Web-based GIS is improved to enhance the user's experience, and to allow interaction over narrowband Internet connections. In the second, server-side rendering of 3D scenes allows users who are not equipped with powerful computers to request sophisticated visualisation without the need to download complex software. The chapter concludes by emphasising the need to understand the users' context and conditions within any collaborative GIS project. © 2006, Idea Group Inc

Evaluating Collaborative Information Seeking Interfaces with a Search-Oriented Inspection Method and Re-framed Information Seeking Theory

Despite the many implicit references to the social contexts of search within Information Seeking and Retrieval research, there has been relatively little work that has specifically investigated the additional requirements for collaborative information seeking interfaces. Here, we re-assess a recent analytical inspection framework, designed for individual information seeking, and then apply it to evaluate a recent collaborative information seeking interface: SearchTogether. The framework was built upon two models of solitary information seeking, and so as part of the re-assessment we first re-frame the models for collaborative contexts. We re-frame a model of search tactics, providing revised definitions that consider known collaborators. We then re-frame a model of user profiles to analyse support for different group dynamics. After presenting an analysis of SearchTogether, we reflect on its accuracy, showing that the framework identified 8 known truths, 8 new insights, and no known-to-be-untrue insights into the design. We conclude that the framework a) can still be applied to collaborative information seeking interfaces; b) can successfully produce additional requirements for collaborative information seeking interfaces; and c) can successfully model different dynamics of collaborating searchers