Exploring Dual-Camera-Based Augmented Reality for Cultural Heritage Sites

Context: Augmented Reality (AR) provides a novel approach for presenting cultural heritage content. Recent advances in AR research and the uptake of powerful mobile devices means AR is a viable option for heritage institutions, but there are challenges that must be overcome before high-quality AR is commonplace. Aims: This project details the development of an AR “magic camera” system featuring novel dual-camera marker-based tracking, allowing users to take AR photos at outdoor heritage sites using a tablet computer. The aims of the project were to assess the feasibility of the tracking method, evaluate the usability of the AR system, and explore implications for the heritage sector. Method: A prototype system was developed. A user study was designed, where participants had to recreate reference images as closely as possible using an iPad and the AR system around the University grounds. Data, such as completion time and error rates, were collected for analysis. The images produced were rated for quality by three experts. Results: Participants responded positively to the system, and the new tracking method was used successfully. The usability study uncovered a number of issues, most of which are solvable in future software versions. However, some issues, such as difficulty orientating objects, rely on improving hardware and software before they can be fixed, but these problems did not affect the quality of the images produced. Participants completed each task more quickly after initial slowness, and while the system was frustrating for some, most found the experience enjoyable. Conclusion: The study successfully uncovered usability problems. The dual-camera tracking element was successful, but the marker-based element encountered lighting problems and high false-positive rates. Orientating objects using inertial sensors was not intuitive; more research in this area would be beneficial. The heritage sector must consider development, maintenance and training costs, and site modification issues

Development of Application Based on Augmented Reality as A Learning Of History and Culture In Architecture Case Study Pathok Negoro Mosques Yogyakarta

Pathok Negoro Mosques is an architectural masterpiece. These mosques are part of history in forming Yogyakarta. The existence of the Sultan’s Ngayogyakarta Palace is inseparable from the Pathok Negoro Mosques building. These mosques also have a function as a defensive system of the Islamic kingdom in Yogyakarta. Arguably, the current generation is getting deprived of the intellectual heritage of culture and history. The history and culture of the Pathok Negoro Mosques will be the content of this research. This research aims to develop an interactive application for learning history and culture of architecture based on augmented reality. Augmented reality applications developed using unity. This research proposed to be carried out in 2 stages. The first stage is related to the collection of the historical and cultural context of the mosque. The second stage is the development of an AR application for Android mobile devices. The reference data made into the AR application with several methods, such as plane detection and image tracking. The research showed a clear step of making an augmented reality as learning of history and culture of Pathok Negoro Mosques

Personalization in cultural heritage: the road travelled and the one ahead

Over the last 20 years, cultural heritage has been a favored domain for personalization research. For years, researchers have experimented with the cutting edge technology of the day; now, with the convergence of internet and wireless technology, and the increasing adoption of the Web as a platform for the publication of information, the visitor is able to exploit cultural heritage material before, during and after the visit, having different goals and requirements in each phase. However, cultural heritage sites have a huge amount of information to present, which must be filtered and personalized in order to enable the individual user to easily access it. Personalization of cultural heritage information requires a system that is able to model the user (e.g., interest, knowledge and other personal characteristics), as well as contextual aspects, select the most appropriate content, and deliver it in the most suitable way. It should be noted that achieving this result is extremely challenging in the case of first-time users, such as tourists who visit a cultural heritage site for the first time (and maybe the only time in their life). In addition, as tourism is a social activity, adapting to the individual is not enough because groups and communities have to be modeled and supported as well, taking into account their mutual interests, previous mutual experience, and requirements. How to model and represent the user(s) and the context of the visit and how to reason with regard to the information that is available are the challenges faced by researchers in personalization of cultural heritage. Notwithstanding the effort invested so far, a definite solution is far from being reached, mainly because new technology and new aspects of personalization are constantly being introduced. This article surveys the research in this area. Starting from the earlier systems, which presented cultural heritage information in kiosks, it summarizes the evolution of personalization techniques in museum web sites, virtual collections and mobile guides, until recent extension of cultural heritage toward the semantic and social web. The paper concludes with current challenges and points out areas where future research is needed

Development of Application Based on Augmented Reality as A Learning of History and Culture in Architecture Case Study Pathok Negoro Mosques Yogyakarta

Pathok Negoro Mosques is an architectural masterpiece. These mosques are part of history in forming Yogyakarta. The existence of the Sultan’s Ngayogyakarta Palace is inseparable from the Pathok Negoro Mosques building. These mosques also have a function as a defensive system of the Islamic kingdom in Yogyakarta. Arguably, the current generation is getting deprived of the intellectual heritage of culture and history. The history and culture of the Pathok Negoro Mosques will be the content of this research. This research aims to develop an interactive application for learning the history and culture of architecture based on augmented reality. Augmented reality applications developed using unity. This research is proposed to be carried out in 2 stages. The first stage is related to the collection of the historical and cultural context of the mosque. The second stage is the development of an AR application for Android mobile devices. The reference data was made into the AR application with several methods, such as plane detection and image tracking. The research managed to develop a mobile augmented reality application in Unity3D 2018.3.14f1 for android devices that consists of the narrative recorded voice of brief history and culture the Pathok Negoro Mosques. The app also shows a well-ordered animation of building structure such as roof, roof insulation, roof structure and column of Pathok Negoro Mosques. Moreover, the research showed a clear step and issue of making an augmented reality app as learning of history and culture of Pathok Negoro Mosque

Development of Application Based on Augmented Reality as A Learning of History and Culture in Architecture Case Study Pathok Negoro Mosques Yogyakarta

Pathok Negoro Mosques is an architectural masterpiece. These mosques are part of history in forming Yogyakarta. The existence of the Sultan’s Ngayogyakarta Palace is inseparable from the Pathok Negoro Mosques building. These mosques also have a function as a defensive system of the Islamic kingdom in Yogyakarta. Arguably, the current generation is getting deprived of the intellectual heritage of culture and history. The history and culture of the Pathok Negoro Mosques will be the content of this research. This research aims to develop an interactive application for learning the history and culture of architecture based on augmented reality. Augmented reality applications developed using unity. This research is proposed to be carried out in 2 stages. The first stage is related to the collection of the historical and cultural context of the mosque. The second stage is the development of an AR application for Android mobile devices. The reference data was made into the AR application with several methods, such as plane detection and image tracking. The research managed to develop a mobile augmented reality application in Unity3D 2018.3.14f1 for android devices that consists of the narrative recorded voice of brief history and culture the Pathok Negoro Mosques. The app also shows a well-ordered animation of building structure such as roof, roof insulation, roof structure and column of Pathok Negoro Mosques. Moreover, the research showed a clear step and issue of making an augmented reality app as learning of history and culture of Pathok Negoro Mosque

Enhancing cultural tourism by a mixed reality application for outdoor navigation and information browsing using immersive devices

In this paper a mixed reality application is introduced; this application runs on Microsoft Hololens and has been designed to provide information on a city scale. The application was developed to provide information about historical buildings, thus supporting cultural outdoor tourism. The huge amount of multimedia data stored in the archives of the Italian public broadcaster RAI, is used to enrich the user experience. A remote application of image and video analysis receives an image flow by the user and identifies known objects framed in the images. The user can select the object (monument/building/artwork) for which augmented contents have to be displayed (video, text audio); the user can interact with these contents by a set of defined gestures. Moreover, if the object of interest is detected and tracked by the mixed reality application, also 3D contents can be overlapped and aligned with the real world

Augmented reality in heritage apps: current trends in Europe

Although augmented reality (AR) has come to play an increasingly important role in a wide range of areas, its use remains rather limited in the realm of heritage education. This paper sets out to analyze which heritage-related apps can be found in Europe that partly or wholly use AR as a tool to help users learn about dierent types of heritage. Our study only identified a limited number of such apps and we used this sample both to paint a portrait of the current state of the question and also to highlight certain observable trends. The results showed that most such apps used AR to reconstruct spaces and buildings, and to a lesser extent, objects. Many of these apps used an academic mode of communication to provide a temporal perspective of monumental and (mainly) historical heritage. The paper also outlines future lines of research dedicated to finding more apps that could be used to increase the current sample size. This would allow for a more comprehensive assessment of such apps from an educational point of view. Several case studies are proffered in order to highlight the keys to successful use of AR in heritage apps