Museums and the Metaverse: Emerging Technologies to Promote Inclusivity and Engagement

Over the past two decades, museums have increasingly sought to build connections with the community and increase inclusivity of visitors. At the same time, emerging technologies, such as extended reality (XR) and virtual museums (VM) are increasingly adopted to engage with different generational expectations but also for the purposes of supporting inclusivity and neurodiverse populations. First such technologies were adopted to augment exhibitions in the physical museum space for edutainment. Since then, XR has expanded from room-size environments (CAVEs) and augmented exhibitions to the creation of entire virtual museums, such as The Museum of Pure Form and The Virtual Museum of Sculpture. Digital twins of museums are increasingly common, along with UNESCO World Heritage Sites. Such virtual experiences can be leveraged to prepare neurodiverse visitors prior to visiting a museum. This chapter will outline how existing approaches to social stories and sensory maps may be combined with XR experiences to support neurodiverse visitors and their families. While onsite, immersive technologies can be used both for engagement and to provide accommodations for greater inclusivity and diversity

Automatic Generation of Coherent Image Galleries in Virtual Reality

With the rapidly increasing size of digitized and born-digital multimedia collections in archives, museums and private collections, manually curating collections becomes a nearly impossible task without disregarding large parts of the collection. In this paper, we propose the use of Self-Organizing Maps (SOMs) to automatically generate coherent image galleries that allow intuitive, user-driven exploration of large multimedia collections in virtual reality (VR). We extend the open-source VR museum VIRTUE to support such exhibitions and apply it on different collections using various image features. A successful pilot test took place at the Basel Historical Museum with more than 300 participants

Museums and the Metaverse: Emerging Technologies to Promote Inclusivity and Engagement

Over the past two decades, museums have increasingly sought to build connections with the community and increase inclusivity of visitors. At the same time, emerging technologies, such as extended reality (XR) and virtual museums (VM) are increasingly adopted to engage with different generational expectations but also for the purposes of supporting inclusivity and neurodiverse populations. First such technologies were adopted to augment exhibitions in the physical museum space for edutainment. Since then, XR has expanded from room-size environments (CAVEs) and augmented exhibitions to the creation of entire virtual museums, such as The Museum of Pure Form and The Virtual Museum of Sculpture. Digital twins of museums are increasingly common, along with UNESCO World Heritage Sites. Such virtual experiences can be leveraged to prepare neurodiverse visitors prior to visiting a museum. This chapter will outline how existing approaches to social stories and sensory maps may be combined with XR experiences to support neurodiverse visitors and their families. While onsite, immersive technologies can be used both for engagement and to provide accommodations for greater inclusivity and diversity

Application of Digitizing Methods to Urban Area with an Example-- Zong-Ye Historic District, Tainan City

This article attempts to apply digitizing methods to historic assets in old downtown by map overlaying analysis after map rectifying, and then taking textual method through surveying images. After proving and conform through research, townscape could be connected with real historic traces by reality digitizing approach, and it will make a reality aura of formerly district for visitors. In this way the abundant, definite and impressive content of district can be the valuable materials in region development, and the time and space of this district could continue the history and culture of the city. Consequently, this article aims to set up a feasibility proposal applied to it concretely. This article puts forward 1.the district analysis through historic map rectifying 2.the reality digital reconstruction of streets digital archives elements 3.the application on AR(Augmented Reality) in historic district, and brings forward an technological approach which could respond to the challenge of losing regional characteristics in redevelopment process with an example of Zong-Ye historic district in traditional Tainan City. Therefore, this proposal which places great emphasis on local history and culture is equipped with applying value for European cities based on plentiful culture in cultural industries and regional development issues.

Serious Games in Cultural Heritage

Although the widespread use of gaming for leisure purposes has been well documented, the use of games to support cultural heritage purposes, such as historical teaching and learning, or for enhancing museum visits, has been less well considered. The state-of-the-art in serious game technology is identical to that of the state-of-the-art in entertainment games technology. As a result the field of serious heritage games concerns itself with recent advances in computer games, real-time computer graphics, virtual and augmented reality and artificial intelligence. On the other hand, the main strengths of serious gaming applications may be generalised as being in the areas of communication, visual expression of information, collaboration mechanisms, interactivity and entertainment. In this report, we will focus on the state-of-the-art with respect to the theories, methods and technologies used in serious heritage games. We provide an overview of existing literature of relevance to the domain, discuss the strengths and weaknesses of the described methods and point out unsolved problems and challenges. In addition, several case studies illustrating the application of methods and technologies used in cultural heritage are presented

Seamful interweaving: heterogeneity in the theory and design of interactive systems

Design experience and theoretical discussion suggest that a narrow design focus on one tool or medium as primary may clash with the way that everyday activity involves the interweaving and combination of many heterogeneous media. Interaction may become seamless and unproblematic, even if the differences, boundaries and 'seams' in media are objectively perceivable. People accommodate and take advantage of seams and heterogeneity, in and through the process of interaction. We use an experiment with a mixed reality system to ground and detail our discussion of seamful design, which takes account of this process, and theory that reflects and informs such design. We critique the 'disappearance' mentioned by Weiser as a goal for ubicomp, and Dourish's 'embodied interaction' approach to HCI, suggesting that these design ideals may be unachievable or incomplete because they underemphasise the interdependence of 'invisible' non-rationalising interaction and focused rationalising interaction within ongoing activity

Developing serious games for cultural heritage: a state-of-the-art review

Although the widespread use of gaming for leisure purposes has been well documented, the use of games to support cultural heritage purposes, such as historical teaching and learning, or for enhancing museum visits, has been less well considered. The state-of-the-art in serious game technology is identical to that of the state-of-the-art in entertainment games technology. As a result, the field of serious heritage games concerns itself with recent advances in computer games, real-time computer graphics, virtual and augmented reality and artificial intelligence. On the other hand, the main strengths of serious gaming applications may be generalised as being in the areas of communication, visual expression of information, collaboration mechanisms, interactivity and entertainment. In this report, we will focus on the state-of-the-art with respect to the theories, methods and technologies used in serious heritage games. We provide an overview of existing literature of relevance to the domain, discuss the strengths and weaknesses of the described methods and point out unsolved problems and challenges. In addition, several case studies illustrating the application of methods and technologies used in cultural heritage are presented

'Breaking the glass': preserving social history in virtual environments

New media technologies play an important role in the evolution of our society. Traditional museums and heritage sites have evolved from the ‘cabinets of curiosity’ that focused mainly on the authority of the voice organising content, to the places that offer interactivity as a means to experience historical and cultural events of the past. They attempt to break down the division between visitors and historical artefacts, employing modern technologies that allow the audience to perceive a range of perspectives of the historical event. In this paper, we discuss virtual reconstruction and interactive storytelling techniques as a research methodology and educational and presentation practices for cultural heritage sites. We present the Narrating the Past project as a case study, in order to illustrate recent changes in the preservation of social history and guided tourist trails that aim to make the visitor’s experience more than just an architectural walk through