Utility-Based Evaluation of Adaptive Systems

The variety of user-adaptive hypermedia systems available calls for methods of comparison. Layered evaluation techniques appear to be useful for this purpose. In this paper we present a utility-based evaluation approach that is based on these techniques. Issues that arise when putting utility-based evaluation into practice are dealt with. We also explain the need for interpretative user models and common sets of evaluation criteria for different domains

Layered evaluation of interactive adaptive systems : framework and formative methods

Peer reviewedPostprin

An Exploratory Study of Hypermedia Support for Problem Decomposition

Empirical hypermedia research has concentrated on usability rather than utility, and the research on utility has focused on information access as opposed to problem solving and decision making in organizations. This study, based on problem reduction theory, uses a hypermedia prototype system to support decision processes for solving a financial analysis problem. An exploratory laboratory experiment was conducted to study the feasibility of the prototype for hypermedia support of decision making. The process tracing techniques used suggest that a cognitive map of a decision maker\u27s thought process may be constructed. Results offer a great deal of promise in the use of hypermedia for organizational decision support. The implications of this study for further research are discussed

User-centred design of flexible hypermedia for a mobile guide: Reflections on the hyperaudio experience

A user-centred design approach involves end-users from the very beginning. Considering users at the early stages compels designers to think in terms of utility and usability and helps develop the system on what is actually needed. This paper discusses the case of HyperAudio, a context-sensitive adaptive and mobile guide to museums developed in the late 90s. User requirements were collected via a survey to understand visitors’ profiles and visit styles in Natural Science museums. The knowledge acquired supported the specification of system requirements, helping defining user model, data structure and adaptive behaviour of the system. User requirements guided the design decisions on what could be implemented by using simple adaptable triggers and what instead needed more sophisticated adaptive techniques, a fundamental choice when all the computation must be done on a PDA. Graphical and interactive environments for developing and testing complex adaptive systems are discussed as a further step towards an iterative design that considers the user interaction a central point. The paper discusses how such an environment allows designers and developers to experiment with different system’s behaviours and to widely test it under realistic conditions by simulation of the actual context evolving over time. The understanding gained in HyperAudio is then considered in the perspective of the developments that followed that first experience: our findings seem still valid despite the passed time

Mobile banking customization via user-defined tags

In this paper, we describe on-going work on mobile banking customization, particularly in the Australian context. The use of user-defined tags to facilitate personalized interactions in the mobile context is explored. The aim of this research is to find ways to improve mobile banking interaction. Customization is more significant in the mobile context than online due to factors such as smaller screen sizes and limited software and hardware capabilities, placing an increased emphasis on usability. This paper explains how user-defined tags can aid different types of customization at the interaction level. A preliminary prototype has been developed to demonstrate the mechanics of the proposed approach. Potential implications, design decisions and limitations are discussed with an outline of future work

Quality of experience aware adaptive hypermedia system

The research reported in this thesis proposes, designs and tests a novel Quality of Experience Layer (QoE-layer) for the classic Adaptive Hypermedia Systems (AHS) architecture. Its goal is to improve the end-user perceived Quality of Service in different operational environments suitable for residential users. While the AHS’ main role of delivering personalised content is not altered, its functionality and performance is improved and thus the user satisfaction with the service provided. The QoE Layer takes into account multiple factors that affect Quality of Experience (QoE), such as Web components and network connection. It uses a novel Perceived Performance Model that takes into consideration a variety of performance metrics, in order to learn about the Web user operational environment characteristics, about changes in network connection and the consequences of these changes on the user’s quality of experience. This model also considers the user’s subjective opinion about his/her QoE, increasing its effectiveness and suggests strategies for tailoring Web content in order to improve QoE. The user related information is modelled using a stereotype-based technique that makes use of probability and distribution theory. The QoE-Layer has been assessed through both simulations and qualitative evaluation in the educational area (mainly distance learning), when users interact with the system in a low bit rate operational environment. The simulations have assessed “learning” and “adaptability” behaviour of the proposed layer in different and variable home connections when a learning task is performed. The correctness of Perceived Performance Model (PPM) suggestions, access time of the learning process and quantity of transmitted data were analysed. The results show that the QoE layer significantly improves the performance in terms of the access time of the learning process with a reduction in the quantity of data sent by using image compression and/or elimination. A visual quality assessment confirmed that this image quality reduction does not significantly affect the viewers’ perceived quality that was close to “good” perceptual level. For qualitative evaluation the QoE layer has been deployed on the open-source AHA! system. The goal of this evaluation was to compare the learning outcome, system usability and user satisfaction when AHA! and QoE-ware AHA systems were used. The assessment was performed in terms of learner achievement, learning performance and usability assessment. The results indicate that QoE-aware AHA system did not affect the learning outcome (the students have similar-learning achievements) but the learning performance was improved in terms of study time. Most significantly, QoE-aware AHA provides an important improvement in system usability as indicated by users’ opinion about their satisfaction related to QoE

Human Factors As A Parameter For Improving Interface Usability And User Satisfaction

The endeavour to optimize HCI should integrate a wide array of user characteristics that have an effect throughout users’ interactions with a system. Human factors such as cognitive traits and current state, from a psychological point of view, are undoubtedly significant in the shaping of the perceived and objective quality of interactions with a system. The research that is presented in this paper focuses on identifying human factors that relate to users’ performance in Web applications that involve information processing, and a framework of personalization rules that are expected to increase users’ performance is depicted. The empirical results that are presented are derived from environments both learning and commercial; in the case of e-learning personalization was beneficial, while the interaction with a commercial site needs to be further investigated due to the implicit character of information processing in the Web

RFID-Integrated Retail Supply Chain Services: Lessons Learnt From The Smart Project

This paper proposes a service-oriented architecture that utilizes the automatic, unique identification capabilities of RFID technology, data stream management systems and web services, to support RFID-integrated supply chain services. In the lifespan of SMART project (IST-2005, FP6) two services have been deployed supporting dynamic-pricing of fresh products and management of promotion events. The two services have been field-tested in three retail stores in Greece, Ireland, and Cyprus. The valuable lessons learnt, concerning RFID readability challenges, consumer privacy, customers and store staff health concerns, investment cost, and so on, are reported to provide guidance to future developers of RFID-integrated supply chain services as well as to set an agenda for academic research

Online banking customization via tag-based interaction

In this paper, we describe ongoing work on online banking customization with a particular focus on interaction. The scope of the study is confined to the Australian banking context where the lack of customization is evident. This paper puts forward the notion of using tags to facilitate personalized interactions in online banking. We argue that tags can afford simple and intuitive interactions unique to every individual in both online and mobile environments. Firstly, through a review of related literature, we frame our work in the customization domain. Secondly, we define a range of taggable resources in online banking. Thirdly, we describe our preliminary prototype implementation with respect to interaction customization types. Lastly, we conclude with a discussion on future work