Personalization in cultural heritage: the road travelled and the one ahead

Over the last 20 years, cultural heritage has been a favored domain for personalization research. For years, researchers have experimented with the cutting edge technology of the day; now, with the convergence of internet and wireless technology, and the increasing adoption of the Web as a platform for the publication of information, the visitor is able to exploit cultural heritage material before, during and after the visit, having different goals and requirements in each phase. However, cultural heritage sites have a huge amount of information to present, which must be filtered and personalized in order to enable the individual user to easily access it. Personalization of cultural heritage information requires a system that is able to model the user (e.g., interest, knowledge and other personal characteristics), as well as contextual aspects, select the most appropriate content, and deliver it in the most suitable way. It should be noted that achieving this result is extremely challenging in the case of first-time users, such as tourists who visit a cultural heritage site for the first time (and maybe the only time in their life). In addition, as tourism is a social activity, adapting to the individual is not enough because groups and communities have to be modeled and supported as well, taking into account their mutual interests, previous mutual experience, and requirements. How to model and represent the user(s) and the context of the visit and how to reason with regard to the information that is available are the challenges faced by researchers in personalization of cultural heritage. Notwithstanding the effort invested so far, a definite solution is far from being reached, mainly because new technology and new aspects of personalization are constantly being introduced. This article surveys the research in this area. Starting from the earlier systems, which presented cultural heritage information in kiosks, it summarizes the evolution of personalization techniques in museum web sites, virtual collections and mobile guides, until recent extension of cultural heritage toward the semantic and social web. The paper concludes with current challenges and points out areas where future research is needed

The Literacy Fieldtrip: Using UbiComp to Support Children's Creative Writing

Fieldtrips, traditionally associated with science, history and geography teaching, have long been used to support children’s learning by allowing them to engage with environments first-hand. Recently, ubiquitous computing (UbiComp) has been used to enhance fieldtrips in these educational areas by augmenting environments with a range of instruments, devices and sensors. However, the sorts of interaction design that UbiComp makes possible have the potential not just to enhance the value of educational techniques in known application areas, but also to expand the application of those techniques into new areas of curriculum. We report on a UbiComp-supported fieldtrip to support creative writing, associated with the learning of literacy skills. We discuss how the fieldtrip, designed and run in the grounds of a historic English country house with Year 5 UK schoolchildren, engendered interactions which changed both the processes and products of creative writing, with benefits for both teachers and children

Human Computation and Convergence

Humans are the most effective integrators and producers of information, directly and through the use of information-processing inventions. As these inventions become increasingly sophisticated, the substantive role of humans in processing information will tend toward capabilities that derive from our most complex cognitive processes, e.g., abstraction, creativity, and applied world knowledge. Through the advancement of human computation - methods that leverage the respective strengths of humans and machines in distributed information-processing systems - formerly discrete processes will combine synergistically into increasingly integrated and complex information processing systems. These new, collective systems will exhibit an unprecedented degree of predictive accuracy in modeling physical and techno-social processes, and may ultimately coalesce into a single unified predictive organism, with the capacity to address societies most wicked problems and achieve planetary homeostasis.Comment: Pre-publication draft of chapter. 24 pages, 3 figures; added references to page 1 and 3, and corrected typ

Enhancing the museum experience with a sustainable solution based on contextual information obtained from an on-line analysis of users’ behaviour

Human computer interaction has evolved in the last years in order to enhance users’ experiences and provide more intuitive and usable systems. A major leap through in this scenario is obtained by embedding, in the physical environment, sensors capable of detecting and processing users’ context (position, pose, gaze, ...). Feeded by the so collected information flows, user interface paradigms may shift from stereotyped gestures on physical devices, to more direct and intuitive ones that reduce the semantic gap between the action and the corresponding system reaction or even anticipate the user’s needs, thus limiting the overall learning effort and increasing user satisfaction. In order to make this process effective, the context of the user (i.e. where s/he is, what is s/he doing, who s/he is, what are her/his preferences and also actual perception and needs) must be properly understood. While collecting data on some aspects can be easy, interpreting them all in a meaningful way in order to improve the overall user experience is much harder. This is more evident when we consider informal learning environments like museums, i.e. places that are designed to elicit visitor response towards the artifacts on display and the cultural themes proposed. In such a situation, in fact, the system should adapt to the attention paid by the user choosing the appropriate content for the user’s purposes, presenting an intuitive interface to navigate it. My research goal is focused on collecting, in a simple,unobtrusive, and sustainable way, contextual information about the visitors with the purpose of creating more engaging and personalized experiences

Exploring expressive augmented reality: The fing AR puppet system for social pretend play

We present “FingAR Puppet”, an Augmented Reality (AR) system enhancing social pretend play by young children. Un-like goal-oriented AR systems that augment reality with in-formative instructions, FingAR Puppet helps children asso-ciate expressive interpretations with immediate reality. Em-pirical results show that FingAR Puppet promotes reasoning about emotional states, communication and divergent think-ing during social pretend play for children 4-6 years old. We suggest that this study opens an interesting space for future AR systems to support complex cognitive and social devel-opment in early childhood. We also identify broader implica-tions from using theories of cognitive development to guide the design of tangible and augmented interactions

RTST Trend Report: lead theme Contextualisation

Specht, M., Börner, D., Tabuenca, B., Ternier, S., De Vries, F., Kalz, M., Drachsler, H., & Schmitz, B. (2012). RTST Trend Report: lead theme Contextualisation. Deliverable 1.7 of STELLAR network of excellence. Heerlen, The Netherlands.In summary this trend-scouting report highlights different design dimensions of contextualizing learning. On the one hand designing educational context: the components and constituents of the educational setting, which also have to be orchestrated in an instructional design or the process of orchestration (Luckin, 2010, Specht, 2009) on the other hand bridging and linking learning contexts for seamless learning support: Wong et al. define design dimensions of seamless learning experiences and which gaps they identify and what challenges must be tackled to create seamless learning experiences (Wong, 2011).STELLAR Network of Excellence, Grant 23191

Empowering cultural heritage professionals with tools for authoring and deploying personalised visitor experiences

This paper presents an authoring environment, which supports cultural heritage professionals in the process of creating and deploying a wide range of different personalised interactive experiences that combine the physical (objects, collection and spaces) and the digital (multimedia content). It is based on a novel flexible formalism that represents the content and the context as independent from one another and allows recombining them in multiple ways thus generating many different interactions from the same elements. The authoring environment was developed in a co-design process with heritage stakeholders and addresses the composition of the content, the definition of the personalisation, and the deployment on a physical configuration of bespoke devices. To simplify the editing while maintaining a powerful representation, the complex creation process is deconstructed into a limited number of elements and phases, including aspects to control personalisation both in content and in interaction. The user interface also includes examples of installations for inspiration and as a means for learning what is possible and how to do it. Throughout the paper, installations in public exhibitions are used to illustrate our points and what our authoring environment can produce. The expressiveness of the formalism and the variety of interactive experiences that could be created was assessed via a range of laboratory tests, while a user-centred evaluation with over 40 cultural heritage professionals assessed whether they feel confident in directly controlling personalisation