A comparative study of breast surface reconstruction for aesthetic outcome assessment

Breast cancer is the most prevalent cancer type in women, and while its survival rate is generally high the aesthetic outcome is an increasingly important factor when evaluating different treatment alternatives. 3D scanning and reconstruction techniques offer a flexible tool for building detailed and accurate 3D breast models that can be used both pre-operatively for surgical planning and post-operatively for aesthetic evaluation. This paper aims at comparing the accuracy of low-cost 3D scanning technologies with the significantly more expensive state-of-the-art 3D commercial scanners in the context of breast 3D reconstruction. We present results from 28 synthetic and clinical RGBD sequences, including 12 unique patients and an anthropomorphic phantom demonstrating the applicability of low-cost RGBD sensors to real clinical cases. Body deformation and homogeneous skin texture pose challenges to the studied reconstruction systems. Although these should be addressed appropriately if higher model quality is warranted, we observe that low-cost sensors are able to obtain valuable reconstructions comparable to the state-of-the-art within an error margin of 3 mm.Comment: This paper has been accepted to MICCAI201

Plane-Based Optimization of Geometry and Texture for RGB-D Reconstruction of Indoor Scenes

We present a novel approach to reconstruct RGB-D indoor scene with plane primitives. Our approach takes as input a RGB-D sequence and a dense coarse mesh reconstructed by some 3D reconstruction method on the sequence, and generate a lightweight, low-polygonal mesh with clear face textures and sharp features without losing geometry details from the original scene. To achieve this, we firstly partition the input mesh with plane primitives, simplify it into a lightweight mesh next, then optimize plane parameters, camera poses and texture colors to maximize the photometric consistency across frames, and finally optimize mesh geometry to maximize consistency between geometry and planes. Compared to existing planar reconstruction methods which only cover large planar regions in the scene, our method builds the entire scene by adaptive planes without losing geometry details and preserves sharp features in the final mesh. We demonstrate the effectiveness of our approach by applying it onto several RGB-D scans and comparing it to other state-of-the-art reconstruction methods.Comment: in International Conference on 3D Vision 2018; Models and Code: see https://github.com/chaowang15/plane-opt-rgbd. arXiv admin note: text overlap with arXiv:1905.0885

Active Image-based Modeling with a Toy Drone

Image-based modeling techniques can now generate photo-realistic 3D models from images. But it is up to users to provide high quality images with good coverage and view overlap, which makes the data capturing process tedious and time consuming. We seek to automate data capturing for image-based modeling. The core of our system is an iterative linear method to solve the multi-view stereo (MVS) problem quickly and plan the Next-Best-View (NBV) effectively. Our fast MVS algorithm enables online model reconstruction and quality assessment to determine the NBVs on the fly. We test our system with a toy unmanned aerial vehicle (UAV) in simulated, indoor and outdoor experiments. Results show that our system improves the efficiency of data acquisition and ensures the completeness of the final model.Comment: To be published on International Conference on Robotics and Automation 2018, Brisbane, Australia. Project Page: https://huangrui815.github.io/active-image-based-modeling/ The author's personal page: http://www.sfu.ca/~rha55

Heritage documentation techniques and methods

This methodology notebooks "Heritage documentation techniques and methods", contains • 3D modelling, digital photography and information dissemination • Creation of 3D models by using scanners • Low-cost desktop scanner • Photography notes: Exposure • Photography notes: Focal length, lenses and cross-polarization • White adjustment and colour calibration • Image-Based Modelling Systems • Focus stacking technique • Rollout photography and DStretch filter • Information dissemination • 3D diagram blocks • Simple animations of 3D modelsEsta serie de cuadernos tiene como objetivo difundir un conjunto de técnicas usadas principalmente para la construcción y documentación de modelos tridimensionales (3D) y fotografía de alta resolución de objetos arqueológicos. Estas técnicas posibilitan construir modelos con calidad métrica contrastada, color calibrado y alta resolución que se difunden por internet usando diversas plataformas.This series of notebooks aims to describe a set of techniques used mainly to construct and document the three-dimensional (3D) models and high-resolution photographs of archaeological objects. These techniques can be used to build models with a contrasting metric quality, calibrated colour and high resolution, to be disseminated on the Internet using various platforms and web services.Parte de la realización de estos cuadernos ha sido financiada a través del proyecto GR18028 (Grupo de investigación RNM026) el cual ha sido cofinanciado por los Fondos Europeos de Desarrollo Regional (FEDER) y el Gobierno de Extremadura