3D Face Reconstruction by Learning from Synthetic Data

Fast and robust three-dimensional reconstruction of facial geometric structure from a single image is a challenging task with numerous applications. Here, we introduce a learning-based approach for reconstructing a three-dimensional face from a single image. Recent face recovery methods rely on accurate localization of key characteristic points. In contrast, the proposed approach is based on a Convolutional-Neural-Network (CNN) which extracts the face geometry directly from its image. Although such deep architectures outperform other models in complex computer vision problems, training them properly requires a large dataset of annotated examples. In the case of three-dimensional faces, currently, there are no large volume data sets, while acquiring such big-data is a tedious task. As an alternative, we propose to generate random, yet nearly photo-realistic, facial images for which the geometric form is known. The suggested model successfully recovers facial shapes from real images, even for faces with extreme expressions and under various lighting conditions.Comment: The first two authors contributed equally to this wor

High dynamic range imaging for archaeological recording

This paper notes the adoption of digital photography as a primary recording means within archaeology, and reviews some issues and problems that this presents. Particular attention is given to the problems of recording high-contrast scenes in archaeology and High Dynamic Range imaging using multiple exposures is suggested as a means of providing an archive of high-contrast scenes that can later be tone-mapped to provide a variety of visualisations. Exposure fusion is also considered, although it is noted that this has some disadvantages. Three case studies are then presented (1) a very high contrast photograph taken from within a rock-cut tomb at Cala Morell, Menorca (2) an archaeological test pitting exercise requiring rapid acquisition of photographic records in challenging circumstances and (3) legacy material consisting of three differently exposed colour positive (slide) photographs of the same scene. In each case, HDR methods are shown to significantly aid the generation of a high quality illustrative record photograph, and it is concluded that HDR imaging could serve an effective role in archaeological photographic recording, although there remain problems of archiving and distributing HDR radiance map data

Design of a multimodal rendering system

This paper addresses the rendering of aligned regular multimodal datasets. It presents a general framework of multimodal data fusion that includes several data merging methods. We also analyze the requirements of a rendering system able to provide these different fusion methods. On the basis of these requirements, we propose a novel design for a multimodal rendering system. The design has been implemented and proved showing to be efficient and flexible.Postprint (published version

Vision technology/algorithms for space robotics applications

The thrust of automation and robotics for space applications has been proposed for increased productivity, improved reliability, increased flexibility, higher safety, and for the performance of automating time-consuming tasks, increasing productivity/performance of crew-accomplished tasks, and performing tasks beyond the capability of the crew. This paper provides a review of efforts currently in progress in the area of robotic vision. Both systems and algorithms are discussed. The evolution of future vision/sensing is projected to include the fusion of multisensors ranging from microwave to optical with multimode capability to include position, attitude, recognition, and motion parameters. The key feature of the overall system design will be small size and weight, fast signal processing, robust algorithms, and accurate parameter determination. These aspects of vision/sensing are also discussed

A Summary of Neural Radiance Fields for Shadow Removal and Relighting of Satellite Imagery

Multi-view stereo photogrammetric techniques are conventionally utilized to generate Global Digital Elevation Models (GDEM) of planetary and lunar surfaces. However, these methods, relying on conventional feature detectors, are often subject to inaccuracies caused by changes in lighting conditions, including diffuse reflection and harsh shading. This has limited the ability of these methods to accurately reconstruct shadowed regions in orbital imagery, such as highly shaded urban areas and the permanently shadowed regions (PSRs) located on the lunar surface, which are critical targets for NASA’s Artemis program. Neural Radiance Fields (NeRFs) offer a novel solution to these limitations by breaking away from traditional photogrammetric assumptions of ridged, opaque surfaces. NeRFs are capable of reconstructing 3D objects with variably transmissive properties and reflective surfaces. In this summary analysis, we articulate the robustness of NeRFs in generating high-fidelity 3D models of terrain from highly shaded orbital imagery acquired from satellites in low earth orbit (LEO) and emphasize their applicability to a lunar environment. We showcase emerging NeRF-derived methods that overcome the limitations of traditional photogrammetric methods and provide a promising solution for reconstructing complex scenes in challenging lighting conditions

Lighting in the third dimension : laser scanning as an architectural survey and representation method

This paper proposes tridimensional (3D) laser scanning to architects and lighting designers as a lighting enquiry and visualization method for existing built environments. The method constitutes a complement to existing lighting methods by responding to limitations of photometric measurements, computer simulation and HDR imagery in surveying and visualizing light in actual buildings. The research explores advantages and limitations of 3D laser scanning in a case study addressing a vast, geometrically complex and fragmented naturally and artificially lit space. Lighting patterns and geometry of the case study are captured with a 3D laser scanner through a series of four scans. A single 3D model of the entire space is produced from the aligned and fused scans. Lighting distribution patterns are showcased in relation to the materiality, geometry and position of windows, walls, lighting fixtures and day lighting sources. Results and presented through images similar to architectural presentation drawings. More specifically, the lighting distribution patterns are illustrated in a floor plan, a reflected ceiling plan, an axonometry and a cross-section. The point cloud model of the case study is also generated into a video format representing the entire building as well as different viewpoints. The study shows that the proposed method provides powerful visualization results due to the unlimited number of images that can be generated from a point cloud and facilitates understanding of existing lighting conditions in spaces

DEM shading method for the correction of pseudoscopic effect on multi-platform satellite imagery

This is an Accepted Manuscript of an article published by Taylor & Francis in GIScience & Remote Sensing on 2014, available online: http://www.tandfonline.com/10.1080/15481603.2014.988433The pseudoscopic effect in satellite imagery causes perception problems for rugged terrain. The topographic relief is perceived in reverse in images with southeast illumination because of the position of land shadows and the mechanisms of human vision and depth perception. This article presents a correction method for false topographic perception phenomena. Superposition of the orthoimage and the correctly shaded digital elevation model (DEM) provides the correct three-dimensional visualization of the relief. This study demonstrates the applicability of this processing technique for the correction of such effects to provide cartography with a more useful interpretation. The resolution of the DEM employed should be in accordance with the spatial resolution of each image. The opacity level proposed for the overlapping DEM is 50%, 30% and 45% for each image type. The selection of the most appropriate local incidence angle is determined by the level of terrain roughness in the work areaWe want to thank the Galician Territorial Information System (SITGA) for the images and the cartographic material provided for the realization of this workS