Correlating Eye Gaze with Object to Enrich Cultural Heritage Knowledge Graph

Virtual Reality (VR) technology has the potential to enhance cultural heritage experiences by providing immersive environments. This study proposes a novel approach that combines VR environments with eye-tracking data to identify users’ points of interest in exhibition paintings. By leveraging gaze patterns, valuable insights into user preferences, behavior, and attention can be extracted and integrated into the cultural heritage knowledge graph. To achieve this, an object detection model is fine-tuned on historical artwork datasets, and statistical tests are conducted to analyze gaze-object correlations. The results demonstrate the feasibility of using an object detection algorithm to detect points of interest and reveal correlations between eye gaze patterns and meaningful objects in paintings. This approach has the potential to enrich the knowledge graph, enabling more personalized and immersive experiences for art enthusiasts and visitors.</p

Correlating Eye Gaze with Object to Enrich Cultural Heritage Knowledge Graph

Virtual Reality (VR) technology has the potential to enhance cultural heritage experiences by providing immersive environments. This study proposes a novel approach that combines VR environments with eye-tracking data to identify users' points of interest in exhibition paintings. By leveraging gaze patterns, valuable insights into user preferences, behavior, and attention can be extracted and integrated into the cultural heritage knowledge graph. To achieve this, an object detection model is fine-tuned on historical artwork datasets, and statistical tests are conducted to analyze gaze-object correlations. The results demonstrate the feasibility of using an object detection algorithm to detect points of interest and reveal correlations between eye gaze patterns and meaningful objects in paintings. This approach has the potential to enrich the knowledge graph, enabling more personalized and immersive experiences for art enthusiasts and visitors

diVRsity: exploring diversity in VR

Nowadays, many museums are paying more attention to diversity, including their exhibitions, and many Dutch museums are now actively working towards this,contributing to the process of decolonization. Museum Het Rembrandthuis presented the exhibition ?HERE: Black in Rembrandt?s Time?, which gave a realistic and respectful picture of black people during the 17th century who lived in and around Amsterdam or who visited. In these paintings, Rembrandt and his contemporaries gave black people a central role, portraying them as individuals, not in the stereotyped roles as we often see in later work by others. However, the past two years have been difficult for museums, with many closing their exhibitions due to the Covid-19 pandemic. To preserve cultural information and exhibits in an efficient and attractive manner, many museums have taken initiative to present their collections through digital technologies such as virtual reality (VR). VR engages visitors, makes exhibits interactive, and assists museum curators in research and exhibit design. This paper presents a VR-based exhibition based on the aforementioned physical exhibition from Museum HetRembrandthuis. Using this demo, we investigated how going through this exhibition in VR can affect awareness and preferences of visitors for the representation of people of color in museums at the levels of artwork, artists, andpersonnel. Additionally, we present current and planned future developments toward using VR-specific data (e.g., eye-tracking data) to model user interest and semantically linking those data to the available knowledge graphs, and integrating a conversational agent as a museum guide in this environment