Reliving the experience of visiting a gallery : methods for evaluating informal learning in games for cultural heritage

When evaluating the effectiveness of gamified app experiences in cultural heritage venues in terms of informal learning outcomes, a core challenge is the complexity involved in assessing intangible measures such as visitors’ appraisal of artwork. A comprehensive summary of the literature for conducting museum visitor evaluations is needed in order to understand how to measure the impact of gamification on user engagement, and the enhancement of the cultural heritage experience on learning. This paper first reviews related literature regarding the application of intrusive versus nonintrusive user evaluation methods, focusing on the REMIND protocol for conducting experiments with museum visitors. We relay our findings when applying the REMIND protocol in four gamified cultural heritage applications in the CrossCult project. Focusing on the assessment of informal learning in an application specifically designed for the visitors of the National Gallery of London, the paper concludes with recommendations, challenges, and future steps in evaluating games for cultural heritage.peer-reviewe

Interactive Experience Design: Integrated and Tangible Storytelling with Maritime Museum Artefacts

Museums play the role of intermediary between cultural heritage and visitors, and are often described as places and environments for education and enjoyment. The European Union also encourages innovative uses of museums to support education through the cultural heritage resources. However, the importance of visitors’ active role in museums as places for education and entertainment, on the one hand, and the growing and indispensable presence of technology in the cultural heritage domain, on the other hand, provided the initial ideas to develop the research. This thesis, presents the study and design for an interactive storytelling installation for a maritime museum. The installation is designed to integrate different museum artefacts into the storytelling system to enrich the visitors experience through tangible storytelling. The project was conducted in collaboration with another PhD student, Luca Ciotoli. His contribution was mainly focused on the narrative and storytelling features of the research, while my contribution was focused on the interaction- and technology-related features, including the design and implementation of the prototype. The research is deployed using a four-phase iterative approach. The first phase of the research, Study, deals with literature review and different studies to identify the requirements. The second phase, Design, determines the broad outlines of the project i.e., an interactive storytelling installation. The design phase includes interaction and museum experience design. We investigated different design approaches, e.g., interaction and museum experience design, to develop a conceptual design. The third phase, prototype, allows us to determine how to fulfill the tasks and meet the requirements that are established for the research. Prototyping involves content creation, storyboarding, integrating augmented artefacts into the storytelling system. Th final phase, test, refers to the evaluations that are conducted during the aforementioned phases e.g., formative and the final usability testing with users. The outcome of the research confirms previous results in the literature about how digital narratives can be enriched with the tangible dimension, moreover it shows how this dimension can enable to communicate stories and knowledge of the past that are complex, such as the art of navigating in the past, by integrating tangible objects that play different roles in the storytelling process

Cognition-Based Evaluation of Visualisation Frameworks for Exploring Structured Cultural Heritage Data

It is often claimed that Information Visualisation (InfoVis) tools improve the audience’s engagement with the display of cultural heritage (CH) collections, open up CH content to new audiences and support teaching and learning through interactive experiences. But there is a lack of studies systematically evaluating these claims, particularly from the perspective of modern educational theory. As far as the author is aware no experimental investigation has been undertaken until now, that attempts to measure deeper levels of user engagement and learning with InfoVis tools. The investigation of this thesis complements InfoVis research by initiating a human-centric approach since little previous research has attempted to incorporate and integrate human cognition as one of the fundamental components of InfoVis. In this thesis, using Bloom’s taxonomy of learning objectives as well as individual learning characteristics (i.e. cognitive preferences), I have evaluated the visitor experience of an art collection both with and without InfoVis tools (between subjects design). Results indicate that whilst InfoVis tools have some positive effect on the lower levels of learning, they are less effective for higher levels. In addition, this thesis shows that InfoVis tools seem to be more effective when they match specific cognitive preferences. These results have implications for both the designers of tools and for CH venues in terms of expectation of effectiveness and exhibition design; the proposed cognitive based evaluation framework and the results of this investigation could provide a valuable baseline for assessing the effectiveness of visitors’ interaction with the artifacts of online and physical exhibitions where InfoVis tools such as Timelines and Maps along with storytelling techniques are being used

Cultural Heritage Storytelling, Engagement and Management in the Era of Big Data and the Semantic Web

The current Special Issue launched with the aim of further enlightening important CH areas, inviting researchers to submit original/featured multidisciplinary research works related to heritage crowdsourcing, documentation, management, authoring, storytelling, and dissemination. Audience engagement is considered very important at both sites of the CH production–consumption chain (i.e., push and pull ends). At the same time, sustainability factors are placed at the center of the envisioned analysis. A total of eleven (11) contributions were finally published within this Special Issue, enlightening various aspects of contemporary heritage strategies placed in today’s ubiquitous society. The finally published papers are related but not limited to the following multidisciplinary topics:Digital storytelling for cultural heritage;Audience engagement in cultural heritage;Sustainability impact indicators of cultural heritage;Cultural heritage digitization, organization, and management;Collaborative cultural heritage archiving, dissemination, and management;Cultural heritage communication and education for sustainable development;Semantic services of cultural heritage;Big data of cultural heritage;Smart systems for Historical cities – smart cities;Smart systems for cultural heritage sustainability

Mobile heritage practices. Implications for scholarly research, user experience design, and evaluation methods using mobile apps.

Mobile heritage apps have become one of the most popular means for audience engagement and curation of museum collections and heritage contexts. This raises practical and ethical questions for both researchers and practitioners, such as: what kind of audience engagement can be built using mobile apps? what are the current approaches? how can audience engagement with these experience be evaluated? how can those experiences be made more resilient, and in turn sustainable? In this thesis I explore experience design scholarships together with personal professional insights to analyse digital heritage practices with a view to accelerating thinking about and critique of mobile apps in particular. As a result, the chapters that follow here look at the evolution of digital heritage practices, examining the cultural, societal, and technological contexts in which mobile heritage apps are developed by the creative media industry, the academic institutions, and how these forces are shaping the user experience design methods. Drawing from studies in digital (critical) heritage, Human-Computer Interaction (HCI), and design thinking, this thesis provides a critical analysis of the development and use of mobile practices for the heritage. Furthermore, through an empirical and embedded approach to research, the thesis also presents auto-ethnographic case studies in order to show evidence that mobile experiences conceptualised by more organic design approaches, can result in more resilient and sustainable heritage practices. By doing so, this thesis encourages a renewed understanding of the pivotal role of these practices in the broader sociocultural, political and environmental changes.AHRC REAC

Transforming visitor experience with museum technologies: The development and impact evaluation of a recommender system in a physical museum

Over the past few decades, many attempts have been made to develop recommender systems (RSs) that could improve visitor experience (VX) in physical museums. Nevertheless, to determine the effectiveness of a museum RS, studies often encompass system performance evaluations, e.g., user experience (UX) and accuracy level tests, and rarely extend to the VX realm that museum RSs aim to support. The reported challenges with defining and evaluating VX might explain why the evidence that the interaction with an RS during the visit can enhance the quality of VX remains limited. Without this evidence, however, the purpose of developing museum RSs and the benefits of using RSs during a museum visit are in question. This thesis interrogates whether and how museum RSs can impact VX. It first consolidates the literature about VX-related constructs into one coherent analytical framework of museum experience which delineates the scope of VX. Following this analysis, this research develops and validates a VX instrument with cognitive, introspective, restorative, and affective variables which could be used to evaluate VX with or without museum technologies. Then, through a series of UX- and VX-related studies in the physical museum, this research implements a fully working content-based RS and establishes how the interaction with the developed RS transforms VX. The findings in this thesis demonstrate that the impact of an RS on the quality of VX can depend on the level of engagement with the system during a museum visit. Additionally, the impact can be insufficient on some mental processes within VX, and it can vary following the changes in contextual variables. The findings also reinforce that system performance tests cannot replace a VX-focused analysis, because a positive UX and additional information about museum objects in an RS do not imply an improved VX. Therefore, this thesis underscores that more VX-related evaluations of museum RSs are required to identify how to strengthen and extend their influence on the quality of VX

Investigating Linked Data Usability for Ancient World Research

Linked Data technologies are used to describe and connect entities, based on features they have in common. Rich semantic descriptions, disambiguation capabilities, and interoperability allow investigation of new research questions and reveal previously undiscovered relationships. However, previous studies have shown that uptake of Linked Data among Humanities researchers has, thus far, been low, partly due to usability issues with the resulting tools and resources. I therefore set out to investigate how their usability might be improved, and how Linked Data technologies might most effectively be integrated with existing research methods. My study focused on the Ancient World, where Linked Data implementation seems to be higher than in other Humanities disciplines, and involved a survey and interviews to elicit user and producer needs from researchers in this subject area. I start this thesis by introducing and contextualising my research topic in Chapter 1. In Chapter 2, I consult existing literature and datasets to discuss Linked Humanities Data implementation, its advantages, and current barriers. Chapter 3 provides an outline of my survey and interview methodologies, while Chapter 4 presents initial survey analysis and identifies themes for discussion in the subsequent chapters. Chapter 5 focuses on five research methods already embedded in the practices of Ancient World researchers, where Linked Data could effectively be integrated: Discovering, Gathering, Data Recognition, Annotating, and Visualization. In Chapter 6, I explore the user experience more broadly, including aspects such as interface design, reliability, and data quality. Chapter 7 then discusses areas of the production process that affect Linked Data usability: training, collaboration, user-centred design, documentation, access, and sustainability. My findings form the basis of a series of recommendations in Chapter 8, which focus on teamwork, openness and transparency, extensibility, user consultation, discoverability, sustainability, and communities, culminating in a Five-Star Model for Linked Humanities Data Usability.</i

Advanced Visual Interfaces to Represent Cultural ad Historical Facts and Associations in the CrossCult Eu Project

Proceedings of the International Conference Advances Visual Interfaces for Cultural Heritage (AVI-CH 2018), (Castiglione della Pescaia, 29 maggio-1 giugno 2018). The European CrossCult project, dedicated to the enhancement and dissemination of European cultural heritage thanks to new technologies, has offered the possibility to compare different research fields and, at the same time, to develop new methodological approaches. IT experts, computing engineers, historians, art historians and archaeologists have worked in four pilots for developing semantic knowledge and technological tools useful to create meaningful interactive experiences, both for individuals and groups. This paper provides an overview of the tools developed to display interactive visualizations of cultural and historical facts and associations. By Maddalena Bassani, Mart\uedn L\uf3pez-Nores, Ahmed Dahroug, Abdullah Daif, Silvia Gonz\ue1lez-Soutelo, Paola Zanovello, Susanna Reboreda-Morillo, Omar Gustavo Bravo Quezada