PetroSurf3D - A Dataset for high-resolution 3D Surface Segmentation

The development of powerful 3D scanning hardware and reconstruction algorithms has strongly promoted the generation of 3D surface reconstructions in different domains. An area of special interest for such 3D reconstructions is the cultural heritage domain, where surface reconstructions are generated to digitally preserve historical artifacts. While reconstruction quality nowadays is sufficient in many cases, the robust analysis (e.g. segmentation, matching, and classification) of reconstructed 3D data is still an open topic. In this paper, we target the automatic and interactive segmentation of high-resolution 3D surface reconstructions from the archaeological domain. To foster research in this field, we introduce a fully annotated and publicly available large-scale 3D surface dataset including high-resolution meshes, depth maps and point clouds as a novel benchmark dataset to the community. We provide baseline results for our existing random forest-based approach and for the first time investigate segmentation with convolutional neural networks (CNNs) on the data. Results show that both approaches have complementary strengths and weaknesses and that the provided dataset represents a challenge for future research.Comment: CBMI Submission; Dataset and more information can be found at http://lrs.icg.tugraz.at/research/petroglyphsegmentation

Digitally interpreting traditional folk crafts

The cultural heritage preservation requires that objects persist throughout time to continue to communicate an intended meaning. The necessity of computer-based preservation and interpretation of traditional folk crafts is validated by the decreasing number of masters, fading technologies, and crafts losing economic ground. We present a long-term applied research project on the development of a mathematical basis, software tools, and technology for application of desktop or personal fabrication using compact, cheap, and environmentally friendly fabrication devices, including '3D printers', in traditional crafts. We illustrate the properties of this new modeling and fabrication system using several case studies involving the digital capture of traditional objects and craft patterns, which we also reuse in modern designs. The test application areas for the development are traditional crafts from different cultural backgrounds, namely Japanese lacquer ware and Norwegian carvings. Our project includes modeling existing artifacts, Web presentations of the models, automation of the models fabrication, and the experimental manufacturing of new designs and forms

Data Fusion of Objects Using Techniques Such as Laser Scanning, Structured Light and Photogrammetry for Cultural Heritage Applications

In this paper we present a semi-automatic 2D-3D local registration pipeline capable of coloring 3D models obtained from 3D scanners by using uncalibrated images. The proposed pipeline exploits the Structure from Motion (SfM) technique in order to reconstruct a sparse representation of the 3D object and obtain the camera parameters from image feature matches. We then coarsely register the reconstructed 3D model to the scanned one through the Scale Iterative Closest Point (SICP) algorithm. SICP provides the global scale, rotation and translation parameters, using minimal manual user intervention. In the final processing stage, a local registration refinement algorithm optimizes the color projection of the aligned photos on the 3D object removing the blurring/ghosting artefacts introduced due to small inaccuracies during the registration. The proposed pipeline is capable of handling real world cases with a range of characteristics from objects with low level geometric features to complex ones

3D scanning of cultural heritage with consumer depth cameras

Three dimensional reconstruction of cultural heritage objects is an expensive and time-consuming process. Recent consumer real-time depth acquisition devices, like Microsoft Kinect, allow very fast and simple acquisition of 3D views. However 3D scanning with such devices is a challenging task due to the limited accuracy and reliability of the acquired data. This paper introduces a 3D reconstruction pipeline suited to use consumer depth cameras as hand-held scanners for cultural heritage objects. Several new contributions have been made to achieve this result. They include an ad-hoc filtering scheme that exploits the model of the error on the acquired data and a novel algorithm for the extraction of salient points exploiting both depth and color data. Then the salient points are used within a modified version of the ICP algorithm that exploits both geometry and color distances to precisely align the views even when geometry information is not sufficient to constrain the registration. The proposed method, although applicable to generic scenes, has been tuned to the acquisition of sculptures and in this connection its performance is rather interesting as the experimental results indicate

Measuring the shape. Performance evaluation of a photogrammetry improvement applied to the Neanderthal skull Saccopastore 1

Several digital technologies are nowadays developed and applied to the study of the human fossil record. Here, we present a low-cost hardware implementation of the digital acquisition via photogrammetry, applied to a specimen of paleoanthropological interest: the Neanderthal skull Saccopastore 1. Such implementation has the purpose to semi-automatize the procedures of digital acquisition, by the introduction of an automatically rotating platform users can easily build on their own with minimum costs. We provide all the technical specifications, mostly based on the Arduino UNO™ microcontroller technology, and evaluate the performance and the resolution of the acquisition by comparing it with the CT-scan of the same specimen through the calculation of their shape differences. In our opinion, the replication of the automatic rotating platform, described in this work, may contribute to the improvement of the digital acquisition processes and may represent, in addition, a useful and affordable tool for both research and dissemination

Development of a synthetic phantom for the selection of optimal scanning parameters in CAD-CT colonography

The aim of this paper is to present the development of a synthetic phantom that can be used for the selection of optimal scanning parameters in computed tomography (CT) colonography. In this paper we attempt to evaluate the influence of the main scanning parameters including slice thickness, reconstruction interval, field of view, table speed and radiation dose on the overall performance of a computer aided detection (CAD)–CTC system. From these parameters the radiation dose received a special attention, as the major problem associated with CTC is the patient exposure to significant levels of ionising radiation. To examine the influence of the scanning parameters we performed 51 CT scans where the spread of scanning parameters was divided into seven different protocols. A large number of experimental tests were performed and the results analysed. The results show that automatic polyp detection is feasible even in cases when the CAD–CTC system was applied to low dose CT data acquired with the following protocol: 13 mAs/rotation with collimation of 1.5 mm × 16 mm, slice thickness of 3.0 mm, reconstruction interval of 1.5 mm, table speed of 30 mm per rotation. The CT phantom data acquired using this protocol was analysed by an automated CAD–CTC system and the experimental results indicate that our system identified all clinically significant polyps (i.e. larger than 5 mm)

Deep convolutional neural networks for segmenting 3D in vivo multiphoton images of vasculature in Alzheimer disease mouse models

The health and function of tissue rely on its vasculature network to provide reliable blood perfusion. Volumetric imaging approaches, such as multiphoton microscopy, are able to generate detailed 3D images of blood vessels that could contribute to our understanding of the role of vascular structure in normal physiology and in disease mechanisms. The segmentation of vessels, a core image analysis problem, is a bottleneck that has prevented the systematic comparison of 3D vascular architecture across experimental populations. We explored the use of convolutional neural networks to segment 3D vessels within volumetric in vivo images acquired by multiphoton microscopy. We evaluated different network architectures and machine learning techniques in the context of this segmentation problem. We show that our optimized convolutional neural network architecture, which we call DeepVess, yielded a segmentation accuracy that was better than both the current state-of-the-art and a trained human annotator, while also being orders of magnitude faster. To explore the effects of aging and Alzheimer's disease on capillaries, we applied DeepVess to 3D images of cortical blood vessels in young and old mouse models of Alzheimer's disease and wild type littermates. We found little difference in the distribution of capillary diameter or tortuosity between these groups, but did note a decrease in the number of longer capillary segments ($>75\mu m$) in aged animals as compared to young, in both wild type and Alzheimer's disease mouse models.Comment: 34 pages, 9 figure

Processing of microCT implant-bone systems images using Fuzzy Mathematical Morphology

The relationship between a metallic implant and the existing bone in a surgical permanent prosthesis is of great importance since the fixation and osseointegration of the system leads to the failure or success of the surgery. Micro Computed Tomography is atechnique that helps to visualize the structure of the bone. In this study, the microCT is used to analyze implant-bone systems images. However, one of the problems presented in the reconstruction of these images is the effect of the iron based implants, with a halo or fluorescence scattering distorting the micro CT image and leading to bad 3D reconstructions.In this work we introduce an automatic method for eliminate the effect of AISI 316L iron materials in the implant-b one system based on the application of Compensatory Fuzzy Mathematical Morphology for future investigate about the structural and mechanical properties of bone and cancellous materials.Fil: Bouchet, Agustina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad Nacional de Mar del Plata; ArgentinaFil: Colabella, Lucas. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones en Ciencia y Tecnología de Materiales. Universidad Nacional de Mar del Plata. Facultad de Ingeniería. Instituto de Investigaciones en Ciencia y Tecnología de Materiales; ArgentinaFil: Omar, Sheila Ayelén. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones en Ciencia y Tecnología de Materiales. Universidad Nacional de Mar del Plata. Facultad de Ingeniería. Instituto de Investigaciones en Ciencia y Tecnología de Materiales; ArgentinaFil: Ballarre, Josefina. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Mar del Plata. Instituto de Investigaciones en Ciencia y Tecnología de Materiales. Universidad Nacional de Mar del Plata. Facultad de Ingeniería. Instituto de Investigaciones en Ciencia y Tecnología de Materiales; ArgentinaFil: Pastore, Juan Ignacio. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Universidad Nacional de Mar del Plata; Argentin

Reflectance Transformation Imaging (RTI) System for Ancient Documentary Artefacts

This tutorial summarises our uses of reflectance transformation imaging in archaeological contexts. It introduces the UK AHRC funded project reflectance Transformation Imaging for Anciant Documentary Artefacts and demonstrates imaging methodologies