From pixel to mesh: accurate and straightforward 3D documentation of cultural heritage from the Cres/Lošinj archipelago

Most people like 3D visualizations. Whether it is in movies, holograms or games, 3D (literally) adds an extra dimension to conventional pictures. However, 3D data and their visualizations can also have scientic archaeological benets: they are crucial in removing relief distortions from photographs, facilitate the interpretation of an object or just support the aspiration to document archaeology as exhaustively as possible. Since archaeology is essentially a spatial discipline, the recording of the spatial data component is in most cases of the utmost importance to perform scientic archaeological research. For complex sites and precious artefacts, this can be a di€cult, time-consuming and very expensive operation. In this contribution, it is shown how a straightforward and cost-eective hard- and software combination is used to accurately document and inventory some of the cultural heritage of the Cres/Lošinj archipelago in three or four dimensions. First, standard photographs are acquired from the site or object under study. Secondly, the resulting image collection is processed with some recent advances in computer technology and so-called Structure from Motion (SfM) algorithms, which are known for their ability to reconstruct a sparse point cloud of scenes that were imaged by a series of overlapping photographs. When complemented by multi-view stereo matching algorithms, detailed 3D models can be built from such photo collections in a fully automated way. Moreover, the software packages implementing these tools are available for free or at very low-cost. Using a mixture of archaeological case studies, it will be shown that those computer vision applications produce excellent results from archaeological imagery with little eort needed. Besides serving the purpose of a pleasing 3D visualization for virtual display or publications, the 3D output additionally allows to extract accurate metric information about the archaeology under study (from single artefacts to entire landscapes)

Reflectance Transformation Imaging (RTI) System for Ancient Documentary Artefacts

This tutorial summarises our uses of reflectance transformation imaging in archaeological contexts. It introduces the UK AHRC funded project reflectance Transformation Imaging for Anciant Documentary Artefacts and demonstrates imaging methodologies

Scalable Exploration of Complex Objects and Environments Beyond Plain Visual Replication​

Digital multimedia content and presentation means are rapidly increasing their sophistication and are now capable of describing detailed representations of the physical world. 3D exploration experiences allow people to appreciate, understand and interact with intrinsically virtual objects. Communicating information on objects requires the ability to explore them under different angles, as well as to mix highly photorealistic or illustrative presentations of the object themselves with additional data that provides additional insights on these objects, typically represented in the form of annotations. Effectively providing these capabilities requires the solution of important problems in visualization and user interaction. In this thesis, I studied these problems in the cultural heritage-computing-domain, focusing on the very common and important special case of mostly planar, but visually, geometrically, and semantically rich objects. These could be generally roughly flat objects with a standard frontal viewing direction (e.g., paintings, inscriptions, bas-reliefs), as well as visualizations of fully 3D objects from a particular point of views (e.g., canonical views of buildings or statues). Selecting a precise application domain and a specific presentation mode allowed me to concentrate on the well defined use-case of the exploration of annotated relightable stratigraphic models (in particular, for local and remote museum presentation). My main results and contributions to the state of the art have been a novel technique for interactively controlling visualization lenses while automatically maintaining good focus-and-context parameters, a novel approach for avoiding clutter in an annotated model and for guiding users towards interesting areas, and a method for structuring audio-visual object annotations into a graph and for using that graph to improve guidance and support storytelling and automated tours. We demonstrated the effectiveness and potential of our techniques by performing interactive exploration sessions on various screen sizes and types ranging from desktop devices to large-screen displays for a walk-up-and-use museum installation. KEYWORDS - Computer Graphics, Human-Computer Interaction, Interactive Lenses, Focus-and-Context, Annotated Models, Cultural Heritage Computing

3D-Stereoscopic Immersive Analytics Projects at Monash University and University of Konstanz

Immersive Analytics investigates how novel interaction and display technologies may support analytical reasoning and decision making. The Immersive Analytics initiative of Monash University started early 2014. Over the last few years, a number of projects have been developed or extended in this context to meet the requirements of semi- or full-immersive stereoscopic environments. Different technologies are used for this purpose: CAVE2™ (a 330 degree large-scale visualization environment which can be used for educative and scientific group presentations, analyses and discussions), stereoscopic Powerwalls (miniCAVEs, representing a segment of the CAVE2 and used for development and communication), Fishtanks, and/or HMDs (such as Oculus, VIVE, and mobile HMD approaches). Apart from CAVE2™ all systems are or will be employed on both the Monash University and the University of Konstanz side, especially to investigate collaborative Immersive Analytics. In addition, sensiLab extends most of the previous approaches by involving all senses, 3D visualization is combined with multi-sensory feedback, 3D printing, robotics in a scientific-artistic-creative environment

Multimodal and multidimensional geodata interaction and visualization

This PhD proposes the development of a Science Data Visualization System, SdVS, that analyzes and presents different kinds of visualizing and interacting techniques with Geo-data, in order to deal with knowledge about Geo-data using GoogleEarth. After that, we apply the archaeological data as a case study, and, as a result, we develop the Archaeological Visualization System, ArVS, using new visualization paradigms and Human-Computer-Interaction techniques based on SdVS. Furthermore, SdVS provides guidelines for developing any other visualization and interacting applications in the future, and how the users can use SdVS system to enhance the understanding and dissemination of knowledge

Representing and Indexing Archaeological Information

The need to preserve and remember the past is a particular human trait. The richness of our cultural history is approached by a vast array of disciplines, that investigate and manage it. However, their effectiveness can be hindered by several technical issues. One of the concerns of experts in this area is the way the importance of cultural heritage is communicated in order to cultivate interest, curiosity and respect. Another concern is the lack of suitable tools that can handle the dimension and complexity of the collections with which they interact. With the emergence of digital tools and the creation of online repositories for the collections of cultural institutions, it is possible to suggest different solutions to tackle these problems. The proposed solution aims to facilitate access and interaction with cultural information, through the implementation of an application capable of integrating multiple forms of representation of historical artifacts. The application tackles two problems that arise from distinct goals. One is the need to represent, in a single view, collections of related items from different repositories. The other is how to, effectively, communicate the information associated with an artifact and its context. This MSc dissertation is part of a collaborative effort between NOVA LINCS researchers and several archaeological institutions of the Iberian Extremadura, aiming to develop tools that will support research and help sharing the cultural wealth of archaeological sites and artifacts from the region. In this dissertation, the developed application covers a general view of the aforementioned problems, while being flexible to the customization of the representation of cultural data. The solution was evaluated on usability and effectiveness on reaching the proposed goals, during a process that involved target audience users and experts in the area of culture and history, as well as human-computer interaction. The results provided positive conclusions

Virtually real or really virtual: towards a heritage metaverse

The hype surrounding the impending mainstreaming of Virtual Reality can seem to prioritize the digital above the critical. With the development of VR said to be at a pivotal point, there is an important opportunity to consider the emergence of virtual heritage and its potential futures. This paper argues that there is a disjunction between the present reality of virtual heritage and virtual reality, and discusses the twin challenges of presence and realism within virtual reality. In particular, it highlights a paradox inherent in virtual heritage and virtual reality and proposes the use of ‘loose-realism’ as a solution. Ultimately, the challenge is to address the claims that virtual reality represents a new class of information system, or metaverse, in order that virtual heritage fully engages with enquiry about the pas