Rules and ontologies in support of real-time ubiquitous application

The focus of this paper is the practical evaluation of the challenges and capabilities of combination of ontologies and rules in the context of realtime ubiquitous application. The ec(h)o project designed a platform to create a museum experience that consists of a physical installation and an interactive virtual layer of three-dimensional soundscapes that are physically mapped to the museum displays. The retrieval mechanism is built on the user model and conceptual descriptions of sound objects and museum artifacts. The rule-based user model was specifically designed to work in environments where the rich semantic descriptions are available. The retrieval criteria are represented as inference rules that combine knowledge from psychoacoustics and cognitive domains with compositional aspects of interaction. Evaluation results both from the laboratory and museum deployment testing are presented together with the end user usability evaluations.We also summarize our findings in the lessons learned that provide a transferable generic knowledge for similar type of applications. The ec(h)o proved that ontologies and rules provide an excellent platform for building a highly-responsive context-aware interactive application

Interactive Audio Content: An Approach to Audio Content for a Dynamic Museum Experience through Augmented Audio Reality and Adaptive Information Retrieval

ec(h)o is an “audio augmented reality interface” utilizing spatialized soundscapes and a semantic web approach to information. The paper discusses our approach to conceptualizing museum content and its creation as audio objects in order to satisfy the requirements of the ec(h)o system. This includes, the conceptualizing of information relevant to an existing exhibition design (an exhibition from the Canadian Museum of Nature in Ottawa). We will discuss the process of acquiring, designing and developing information relevant to the exhibition and its mapping to the requirements of adaptive information retrieval and the interaction model. The development of the audio objects is based on an audio display model that addresses issues of psychoacoustics, composition and cognition. The paper will outline the challenges and identify the limitations of our approach

Ontology-based user modeling in an augmented audio reality system for museums

Ubiquitous computing is a challenging area that allows us to further our understanding and techniques of context-aware and adaptive systems. Among the challenges is the general problem of capturing the larger context in interaction from the perspective of user modeling and human–computer interaction (HCI). The imperative to address this issue is great considering the emergence of ubiquitous and mobile computing environments. This paper provides an account of our addressing the specific problem of supporting functionality as well as the experience design issues related to museum visits through user modeling in combination with an audio augmented reality and tangible user interface system. This paper details our deployment and evaluation of ec(h)o – an augmented audio reality system for museums. We explore the possibility of supporting a context-aware adaptive system by linking environment, interaction object and users at an abstract semantic level instead of at the content level. From the user modeling perspective ec(h)o is a knowledge based recommender system. In this paper we present our findings from user testing and how our approach works well with an audio and tangible user interface within a ubiquitous computing system. We conclude by showing where further research is needed

Personalization in cultural heritage: the road travelled and the one ahead

Over the last 20 years, cultural heritage has been a favored domain for personalization research. For years, researchers have experimented with the cutting edge technology of the day; now, with the convergence of internet and wireless technology, and the increasing adoption of the Web as a platform for the publication of information, the visitor is able to exploit cultural heritage material before, during and after the visit, having different goals and requirements in each phase. However, cultural heritage sites have a huge amount of information to present, which must be filtered and personalized in order to enable the individual user to easily access it. Personalization of cultural heritage information requires a system that is able to model the user (e.g., interest, knowledge and other personal characteristics), as well as contextual aspects, select the most appropriate content, and deliver it in the most suitable way. It should be noted that achieving this result is extremely challenging in the case of first-time users, such as tourists who visit a cultural heritage site for the first time (and maybe the only time in their life). In addition, as tourism is a social activity, adapting to the individual is not enough because groups and communities have to be modeled and supported as well, taking into account their mutual interests, previous mutual experience, and requirements. How to model and represent the user(s) and the context of the visit and how to reason with regard to the information that is available are the challenges faced by researchers in personalization of cultural heritage. Notwithstanding the effort invested so far, a definite solution is far from being reached, mainly because new technology and new aspects of personalization are constantly being introduced. This article surveys the research in this area. Starting from the earlier systems, which presented cultural heritage information in kiosks, it summarizes the evolution of personalization techniques in museum web sites, virtual collections and mobile guides, until recent extension of cultural heritage toward the semantic and social web. The paper concludes with current challenges and points out areas where future research is needed

Situated play in a tangible interface and adaptive audio museum guide

This paper explores the design issues of 9 situated play within a museum through the study of a 10 museum guide prototype that integrates a tangible interface, audio display, and adaptive modeling. We discuss our use of design ethnography in order to situate our interaction and to investigate the liminal and engagement qualities of a museum visit. The paper provides an overview of our case study and analysis of our user evaluation. We discuss the implications including degrees of balance in the experience design of play in interaction; the challenge in developing a discovery-based information model, and the need for a better understanding of the contextual aspects of tangible user interfaces (TUIs). We conclude that learning effectiveness and functionality can be balanced productively with playful interaction through an adaptive audio and TUI if designers balance the engagement between play and the environment, and the space between imagination and interpretation that links the audio content to the artifacts

ECLAP 2012 Conference on Information Technologies for Performing Arts, Media Access and Entertainment

It has been a long history of Information Technology innovations within the Cultural Heritage areas. The Performing arts has also been enforced with a number of new innovations which unveil a range of synergies and possibilities. Most of the technologies and innovations produced for digital libraries, media entertainment and education can be exploited in the field of performing arts, with adaptation and repurposing. Performing arts offer many interesting challenges and opportunities for research and innovations and exploitation of cutting edge research results from interdisciplinary areas. For these reasons, the ECLAP 2012 can be regarded as a continuation of past conferences such as AXMEDIS and WEDELMUSIC (both pressed by IEEE and FUP). ECLAP is an European Commission project to create a social network and media access service for performing arts institutions in Europe, to create the e-library of performing arts, exploiting innovative solutions coming from the ICT

Museum as ecology: A case study analysis of an ambient intelligent museum guide

This paper explores the usefulness of the ecology concept as an analytical framework for designing interactive technology in museums. We aim to describe and evaluate an ecological approach to understanding museums and to examine information and cultural ecologies as analytical tools for guiding the design of interactive systems. We focus on two related concepts of ecology, cultural ecology (Bell 2002) and information ecology (Nardi and O\u27Day 1999). Utilizing each of the two frameworks, we analyze observational and interview data we collected during the research for an ambient intelligent museum guide. We also discuss the design implications of our analysis. In this paper we found that an ecology framework is highly appropriate for representing the complexities of activities, relationships, technologies and people connected to museums. We also found the information

Situated play in a tangible interface and adaptive audio museum guide

Abstract This paper explores the design issues of situated play within a museum through the study of a museum guide prototype that integrates a tangible interface, audio display, and adaptive modeling. We discuss our use of design ethnography in order to situate our interaction and to investigate the liminal and engagement qualities of a museum visit. The paper provides an overview of our case study and analysis of our user evaluation. We discuss the implications including degrees of balance in the experience design of play in interaction; the challenge in developing a discovery-based information model, and the need for a better understanding of the contextual aspects of tangible user interfaces (TUIs). We conclude that learning effectiveness and functionality can be balanced productively with playful interaction through an adaptive audio and TUI if designers balance the engagement between play and the environment, and the space between imagination and interpretation that links the audio content to the artifacts