From Personalization to Adaptivity: Creating Immersive Visits through Interactive Digital Storytelling at the Acropolis Museum

Storytelling has recently become a popular way to guide museum visitors, replacing traditional exhibit-centric descriptions by story-centric cohesive narrations with references to the exhibits and multimedia content. This work presents the fundamental elements of the CHESS project approach, the goal of which is to provide adaptive, personalized, interactive storytelling for museum visits. We shortly present the CHESS project and its background, we detail the proposed storytelling and user models, we describe the provided functionality and we outline the main tools and mechanisms employed. Finally, we present the preliminary results of a recent evaluation study that are informing several directions for future work

Content-aware power saving multimedia adaptation for mobile learning

Due to the tremendous enhancements in the capabilities of mobile devices in recent years and accessibility to higher bandwidth mobile internet, the use of online multimedia learning resources on mobile devices is increasingly becoming popular. Improvements in battery capacity have not matched the same advancements compared to other features of mobile devices. Limited Battery power is introducing a significant challenge in making better use of online educational multimedia resources. Online Multimedia Resources drains more battery power as a result of higher amount of wireless data transfer and therefore limiting learning opportunities on the move. Many power saving multimedia adaptation techniques have been suggested. Majority of these techniques achieve battery efficiency while reducing multimedia quality. So far, however, to the best of our knowledge no previous effort has considered the factor of learning efficacy in multimedia adaptation process. Existing adaptation techniques are susceptible to information loss as a result of quality of reduction. Such loss affects the learning content efficacy and jeopardizes the learning process. In this paper, we recommend a novel power save educational multimedia adaptation approach that considers the learning aspect of multimedia in the adaptation process. Our technique enables learning for extended duration by battery power saving without putting the learning process at risk. Efficacy of entire learning resources is managed by not allowing any part of the learning multimedia to be delivered in a quality that will negatively affect the learning outcome. We also present a framework that guides the implementation of our approach followed by description of our prototype application that uses educational multimedia metadata implemented in semantic web technologies

Enabling Personalized Composition and Adaptive Provisioning of Web Services

The proliferation of interconnected computing devices is fostering the emergence of environments where Web services made available to mobile users are a commodity. Unfortunately, inherent limitations of mobile devices still hinder the seamless access to Web services, and their use in supporting complex user activities. In this paper, we describe the design and implementation of a distributed, adaptive, and context-aware framework for personalized service composition and provisioning adapted to mobile users. Users specify their preferences by annotating existing process templates, leading to personalized service-based processes. To cater for the possibility of low bandwidth communication channels and frequent disconnections, an execution model is proposed whereby the responsibility of orchestrating personalized processes is spread across the participating services and user agents. In addition, the execution model is adaptive in the sense that the runtime environment is able to detect exceptions and react to them according to a set of rules

User-centred design of flexible hypermedia for a mobile guide: Reflections on the hyperaudio experience

A user-centred design approach involves end-users from the very beginning. Considering users at the early stages compels designers to think in terms of utility and usability and helps develop the system on what is actually needed. This paper discusses the case of HyperAudio, a context-sensitive adaptive and mobile guide to museums developed in the late 90s. User requirements were collected via a survey to understand visitors’ profiles and visit styles in Natural Science museums. The knowledge acquired supported the specification of system requirements, helping defining user model, data structure and adaptive behaviour of the system. User requirements guided the design decisions on what could be implemented by using simple adaptable triggers and what instead needed more sophisticated adaptive techniques, a fundamental choice when all the computation must be done on a PDA. Graphical and interactive environments for developing and testing complex adaptive systems are discussed as a further step towards an iterative design that considers the user interaction a central point. The paper discusses how such an environment allows designers and developers to experiment with different system’s behaviours and to widely test it under realistic conditions by simulation of the actual context evolving over time. The understanding gained in HyperAudio is then considered in the perspective of the developments that followed that first experience: our findings seem still valid despite the passed time

Personalization in cultural heritage: the road travelled and the one ahead

Over the last 20 years, cultural heritage has been a favored domain for personalization research. For years, researchers have experimented with the cutting edge technology of the day; now, with the convergence of internet and wireless technology, and the increasing adoption of the Web as a platform for the publication of information, the visitor is able to exploit cultural heritage material before, during and after the visit, having different goals and requirements in each phase. However, cultural heritage sites have a huge amount of information to present, which must be filtered and personalized in order to enable the individual user to easily access it. Personalization of cultural heritage information requires a system that is able to model the user (e.g., interest, knowledge and other personal characteristics), as well as contextual aspects, select the most appropriate content, and deliver it in the most suitable way. It should be noted that achieving this result is extremely challenging in the case of first-time users, such as tourists who visit a cultural heritage site for the first time (and maybe the only time in their life). In addition, as tourism is a social activity, adapting to the individual is not enough because groups and communities have to be modeled and supported as well, taking into account their mutual interests, previous mutual experience, and requirements. How to model and represent the user(s) and the context of the visit and how to reason with regard to the information that is available are the challenges faced by researchers in personalization of cultural heritage. Notwithstanding the effort invested so far, a definite solution is far from being reached, mainly because new technology and new aspects of personalization are constantly being introduced. This article surveys the research in this area. Starting from the earlier systems, which presented cultural heritage information in kiosks, it summarizes the evolution of personalization techniques in museum web sites, virtual collections and mobile guides, until recent extension of cultural heritage toward the semantic and social web. The paper concludes with current challenges and points out areas where future research is needed

Sensory semantic user interfaces (SenSUI)

Rapid evolution of the World Wide Web with its underlying sources of data, knowledge, services and applications continually attempts to support a variety of users, with different backgrounds, requirements and capabilities. In such an environment, it is highly unlikely that a single user interface will prevail and be able to fulfill the requirements of each user adequately. Adaptive user interfaces are able to adapt information and application functionalities to the user context. In contrast, pervasive computing and sensor networks open new opportunities for context aware platforms, one that is able to improve user interface adaptation reacting to environmental and user sensors. Semantic web technologies and ontologies are able to capture sensor data and provide contextual information about the user, their actions, required applications and environment. This paper investigates the viability of an approach where semantic web technologies are used to maximize the efficacy of interface adaptation through the use of available ontology

Staging Transformations for Multimodal Web Interaction Management

Multimodal interfaces are becoming increasingly ubiquitous with the advent of mobile devices, accessibility considerations, and novel software technologies that combine diverse interaction media. In addition to improving access and delivery capabilities, such interfaces enable flexible and personalized dialogs with websites, much like a conversation between humans. In this paper, we present a software framework for multimodal web interaction management that supports mixed-initiative dialogs between users and websites. A mixed-initiative dialog is one where the user and the website take turns changing the flow of interaction. The framework supports the functional specification and realization of such dialogs using staging transformations -- a theory for representing and reasoning about dialogs based on partial input. It supports multiple interaction interfaces, and offers sessioning, caching, and co-ordination functions through the use of an interaction manager. Two case studies are presented to illustrate the promise of this approach.Comment: Describes framework and software architecture for multimodal web interaction managemen

Profile transformation in mobile technology based educational systems : a thesis presented in partial fulfillment of the requirements for the degree of Master of Information Science in Information Systems at Massey University, Palmerston North, New Zealand

In order to meet the learning needs from various types of students, computer aided education systems try to include new methods to provide personalized education to every student. From the early 1970s, a lot of adaptive educational systems have been created to provide training on a variety of subjects. Combined with the Internet, the adaptive educational systems have become web-based and even more popular. Recently, the development of mobile technology has made the web-based adaptive educational systems accessible through mobile phones. It is necessary that the students can also receive adaptive educational contents on mobile phones. This research project investigated the possible student's preference differences between Personal Computer (PC) and mobile phone, and then proposed a student profile transformation framework to address such differences. This research project conducted two surveys on the student profile transformation between PC and mobile phone. A demo web-based educational system that could be accessed from both PC and mobile phone was also developed for participants of the surveys to give more real and precise responses. Based on Felder-Silverman Learning Style Theory (Felder, 1993; Felder & Silverman, 1988) and the results of the surveys, this thesis proposes a student profile template and a student profile transformation framework, which both fully considered the influences of device capabilities and locations on students' preferences on mobile phones. Furthermore, the proposed framework integrates a solution for unsupported preferences and preference conflicts. By implementing the proposed template and framework, the students' preference changes between PC and mobile phone are automatically updated according to various device capabilities and locations, and then the students can receive adaptive educational contents that meet their updated preferences