Towards High-Fidelity 3D Face Reconstruction from In-the-Wild Images Using Graph Convolutional Networks

3D Morphable Model (3DMM) based methods have achieved great success in recovering 3D face shapes from single-view images. However, the facial textures recovered by such methods lack the fidelity as exhibited in the input images. Recent work demonstrates high-quality facial texture recovering with generative networks trained from a large-scale database of high-resolution UV maps of face textures, which is hard to prepare and not publicly available. In this paper, we introduce a method to reconstruct 3D facial shapes with high-fidelity textures from single-view images in-the-wild, without the need to capture a large-scale face texture database. The main idea is to refine the initial texture generated by a 3DMM based method with facial details from the input image. To this end, we propose to use graph convolutional networks to reconstruct the detailed colors for the mesh vertices instead of reconstructing the UV map. Experiments show that our method can generate high-quality results and outperforms state-of-the-art methods in both qualitative and quantitative comparisons.Comment: Accepted to CVPR 2020. The source code is available at https://github.com/FuxiCV/3D-Face-GCN

Potential and Limitations of Open Satellite Data for Flood Mapping

Satellite remote sensing is a powerful tool to map flooded areas. In recent years, the availability of free satellite data significantly increased in terms of type and frequency, allowing the production of flood maps at low cost around the world. In this work, we propose a semi-automatic method for flood mapping, based only on free satellite images and open-source software. The proposed methods are suitable to be applied by the community involved in flood hazard management, not necessarily experts in remote sensing processing. As case studies, we selected three flood events that recently occurred in Spain and Italy. Multispectral satellite data acquired by MODIS, Proba-V, Landsat, and Sentinel-2 and synthetic aperture radar (SAR) data collected by Sentinel-1 were used to detect flooded areas using different methodologies (e.g., Modified Normalized Difference Water Index, SAR backscattering variation, and supervised classification). Then, we improved and manually refined the automatic mapping using free ancillary data such as the digital elevation model-based water depth model and available ground truth data. We calculated flood detection performance (flood ratio) for the different datasets by comparing with flood maps made by official river authorities. The results show that it is necessary to consider different factors when selecting the best satellite data. Among these factors, the time of the satellite pass with respect to the flood peak is the most important. With co-flood multispectral images, more than 90% of the flooded area was detected in the 2015 Ebro flood (Spain) case study. With post-flood multispectral data, the flood ratio showed values under 50% a few weeks after the 2016 flood in Po and Tanaro plains (Italy), but it remained useful to map the inundated pattern. The SAR could detect flooding only at the co-flood stage, and the flood ratio showed values below 5% only a few days after the 2016 Po River inundation. Another result of the research was the creation of geomorphology-based inundation maps that matched up to 95% with official flood maps

Airborne LiDAR for DEM generation: some critical issues

Airborne LiDAR is one of the most effective and reliable means of terrain data collection. Using LiDAR data for DEM generation is becoming a standard practice in spatial related areas. However, the effective processing of the raw LiDAR data and the generation of an efficient and high-quality DEM remain big challenges. This paper reviews the recent advances of airborne LiDAR systems and the use of LiDAR data for DEM generation, with special focus on LiDAR data filters, interpolation methods, DEM resolution, and LiDAR data reduction. Separating LiDAR points into ground and non-ground is the most critical and difficult step for DEM generation from LiDAR data. Commonly used and most recently developed LiDAR filtering methods are presented. Interpolation methods and choices of suitable interpolator and DEM resolution for LiDAR DEM generation are discussed in detail. In order to reduce the data redundancy and increase the efficiency in terms of storage and manipulation, LiDAR data reduction is required in the process of DEM generation. Feature specific elements such as breaklines contribute significantly to DEM quality. Therefore, data reduction should be conducted in such a way that critical elements are kept while less important elements are removed. Given the highdensity characteristic of LiDAR data, breaklines can be directly extracted from LiDAR data. Extraction of breaklines and integration of the breaklines into DEM generation are presented

Development and evaluation of packet video schemes

Reflecting the two tasks proposed for the current year, namely a feasibility study of simulating the NASA network, and a study of progressive transmission schemes, are presented. The view of the NASA network, gleaned from the various technical reports made available to use, is provided. Also included is a brief overview of how the current simulator could be modified to accomplish the goal of simulating the NASA network. As the material in this section would be the basis for the actual simulation, it is important to make sure that it is an accurate reflection of the requirements on the simulator. Brief descriptions of the set of progressive transmission algorithms selected for the study are contained. The results available in the literature were obtained under a variety of different assumptions, not all of which are stated. As such, the only way to compare the efficiency and the implementational complexity of the various algorithms is to simulate them

An overview of JPEG 2000

JPEG-2000 is an emerging standard for still image compression. This paper provides a brief history of the JPEG-2000 standardization process, an overview of the standard, and some description of the capabilities provided by the standard. Part I of the JPEG-2000 standard specifies the minimum compliant decoder, while Part II describes optional, value-added extensions. Although the standard specifies only the decoder and bitstream syntax, in this paper we describe JPEG-2000 from the point of view of encoding. We take this approach, as we believe it is more amenable to a compact description more easily understood by most readers.

Task-based Adaptation of Graphical Content in Smart Visual Interfaces

To be effective visual representations must be adapted to their respective context of use, especially in so-called Smart Visual Interfaces striving to present specifically those information required for the task at hand. This thesis proposes a generic approach that facilitate the automatic generation of task-specific visual representations from suitable task descriptions. It is discussed how the approach is applied to four principal content types raster images, 2D vector and 3D graphics as well as data visualizations, and how existing display techniques can be integrated into the approach.Effektive visuelle Repräsentationen müssen an den jeweiligen Nutzungskontext angepasst sein, insbesondere in sog. Smart Visual Interfaces, welche anstreben, möglichst genau für die aktuelle Aufgabe benötigte Informationen anzubieten. Diese Arbeit entwirft einen generischen Ansatz zur automatischen Erzeugung aufgabenspezifischer Darstellungen anhand geeigneter Aufgabenbeschreibungen. Es wird gezeigt, wie dieser Ansatz auf vier grundlegende Inhaltstypen Rasterbilder, 2D-Vektor- und 3D-Grafik sowie Datenvisualisierungen anwendbar ist, und wie existierende Darstellungstechniken integrierbar sind

Effect of Length Scales on Microstructure Evolution During Severe Plastic Deformation

Effect of length scales on microstructure evolution during Severe Plastic Deformation (SPD) was studied by machining commercial purity metals: Ni 200, Oxygen Free High Conductivity OFHC) Cu and Al 1100. By performing Orientation Imaging Microscopy (OIM) in the chips created, a switch over in microstructure evolution in small length scales was demonstrated. In this, microstructure refinement during SPD was replaced by an anomalous lack of refinement in small length scales. This switchover was found to be rampant in OFHC Cu, followed by Ni 200 but almost absent in Al 1100. It was hypothesized that the switchover is a consequence of a coupled effect of high strain gradients and small deformation volumes. In order to quantify the switchover, flow of material in the deformation zone of machining was characterized in-situ using SEM based Digital Image Correlation (DIC). For doing this, a deformation stage capable of machining within the chamber of a Scanning Electron Microscope (SEM) was designed and fabricated. It was seen that OFHC Cu develops a sharp deformation zone during machining followed by a significantly more diffuse deformation zone in Ni 200 and then Al 1100. It was hypothesized that the switchover kicks in when the dimensions of the deformation zone approach those associated with Geometrically Necessary Boundaries that form during SPD. Criteria for the aforementioned switchover based on this hypothesis were verified for Ni 200, OFHC Cu and Al 1100. Effect of pre-deformation was studied by rolling Ni 200 samples prior to machining. It was seen that pre-deformation instigates the aforementioned switchover in microstructure evolution, reasons for which were discussed. A phenomenological model for predicting microstructure statistics resulting from SPD on Ni 200 in small length scales was setup. Contrary to common perception, it was shown that larger strain gradients giving rise to larger crystallographic curvatures instigate the aforementioned switchover resulting in lack of microstructure refinement

Adaptive image vectorisation and brushing using mesh colours

We propose the use of curved triangles and mesh colours as a vector primitive for image vectorisation. We show that our representation has clear benefits for rendering performance, texture detail, as well as further editing of the resulting vector images. The proposed method focuses on efficiency, but it still leads to results that compare favourably with those from previous work. We show results over a variety of input images ranging from photos, drawings, paintings, all the way to designs and cartoons. We implemented several editing workflows facilitated by our representation: interactive user-guided vectorisation, and novel raster-style feature-aware brushing capabilities