Total Denoising: Unsupervised Learning of 3D Point Cloud Cleaning

We show that denoising of 3D point clouds can be learned unsupervised, directly from noisy 3D point cloud data only. This is achieved by extending recent ideas from learning of unsupervised image denoisers to unstructured 3D point clouds. Unsupervised image denoisers operate under the assumption that a noisy pixel observation is a random realization of a distribution around a clean pixel value, which allows appropriate learning on this distribution to eventually converge to the correct value. Regrettably, this assumption is not valid for unstructured points: 3D point clouds are subject to total noise, i.e. deviations in all coordinates, with no reliable pixel grid. Thus, an observation can be the realization of an entire manifold of clean 3D points, which makes the quality of a naive extension of unsupervised image denoisers to 3D point clouds unfortunately only little better than mean filtering. To overcome this, and to enable effective and unsupervised 3D point cloud denoising, we introduce a spatial prior term, that steers converges to the unique closest out of the many possible modes on the manifold. Our results demonstrate unsupervised denoising performance similar to that of supervised learning with clean data when given enough training examples - whereby we do not need any pairs of noisy and clean training data

Deep-learning the Latent Space of Light Transport

We suggest a method to directly deep‐learn light transport, i. e., the mapping from a 3D geometry‐illumination‐material configuration to a shaded 2D image. While many previous learning methods have employed 2D convolutional neural networks applied to images, we show for the first time that light transport can be learned directly in 3D. The benefit of 3D over 2D is, that the former can also correctly capture illumination effects related to occluded and/or semi‐transparent geometry. To learn 3D light transport, we represent the 3D scene as an unstructured 3D point cloud, which is later, during rendering, projected to the 2D output image. Thus, we suggest a two‐stage operator comprising a 3D network that first transforms the point cloud into a latent representation, which is later on projected to the 2D output image using a dedicated 3D‐2D network in a second step. We will show that our approach results in improved quality in terms of temporal coherence while retaining most of the computational efficiency of common 2D methods. As a consequence, the proposed two stage‐operator serves as a valuable extension to modern deferred shading approaches

Integrating Landsat pixel composites and change metrics with lidar plots to predictively map forest structure and aboveground biomass in Saskatchewan, Canada

Forest inventory and monitoring programs are needed to provide timely, spatially complete (i.e. mapped), and verifiable information to support forest management, policy formulation, and reporting obligations. Satellite images, in particular data from the Landsat Thematic Mapper and Enhanced Thematic Mapper (TM/ETM +) sensors, are often integrated with field plots from forest inventory programs, leveraging the complete spatial coverage of imagery with detailed ecological information from a sample of plots to spatially model forest conditions and resources. However, in remote and unmanaged areas such as Canada's northern forests, financial and logistic constraints can severely limit the availability of inventory plot data. Additionally, Landsat spectral information has known limitations for characterizing vertical vegetation structure and biomass; while clouds, snow, and short growing seasons can limit development of large area image mosaics that are spectrally and phenologically consistent across space and time. In this study we predict and map forest structure and aboveground biomass over 37 million ha of forestland in Saskatchewan, Canada. We utilize lidar plots—observations of forest structure collected from airborne discrete-return lidar transects acquired in 2010—as a surrogate for traditional field and photo plots. Mapped explanatory data included Tasseled Cap indices and multi-temporal change metrics derived from Landsat TM/ETM + pixel-based image composites. Maps of forest structure and total aboveground biomass were created using a Random Forest (RF) implementation of Nearest Neighbor (NN) imputation. The imputation model had moderate to high plot-level accuracy across all forest attributes (R2 values of 0.42–0.69), as well as reasonable attribute predictions and error estimates (for example, canopy cover above 2 m on validation plots averaged 35.77%, with an RMSE of 13.45%, while unsystematic and systematic agreement coefficients (ACuns and ACsys) had values of 0.63 and 0.97 respectively). Additionally, forest attributes displayed consistent trends in relation to the time since and magnitude of wildfires, indicating model predictions captured the dominant ecological patterns and processes in these forests. Acknowledging methodological and conceptual challenges based upon the use of lidar plots from transects, this study demonstrates that using lidar plots and pixel compositing in imputation mapping can provide forest inventory and monitoring information for regions lacking ongoing or up-to-date field data collection programs

Using street based metrics to characterize urban typologies

[EN] Urban spatial structures reflect local particularities produced during the development of a city. High spatial resolution imagery and LiDAR data are currently used to derive numerical attributes to describe in detail intra-urban structures and morphologies. Urban block boundaries have been frequently used to define the units for extracting metrics from remotely sensed data. In this paper, we propose to complement these metrics with a set of novel descriptors of the streets surrounding the urban blocks under consideration. These metrics numerically describe geometrical properties in addition to other distinctive aspects, such as presence and properties of vegetation and the relationship between the streets and buildings. For this purpose, we also introduce a methodology for partitioning the street area related to an urban block into polygons from which the street urban metrics are derived. We achieve the assessment of these metrics through application of a one-way ANOVA procedure, the winnowing technique, and a decision tree classifier. Our results suggest that street metrics, and particularly those describing the street geometry, are suitable for enhancing the discrimination of complex urban typologies and help to reduce the confusion between certain typologies. The overall classification accuracy increased from 72.7% to 81.1% after the addition street of descriptors. The results of this study demonstrate the usefulness of these metrics for describing street properties and complementing information derived from urban blocks to improve the description of urban areas. Street metrics are of particular use for the characterization of urban typologies and to study the dynamics of cities.The authors appreciate the financial support provided by the Spanish Ministry of Science and Innovation in the framework of the project CGL2010-19591/BTE, and the data made available by the Spanish Instituto Geográfico Nacional (IGN)Hermosilla, T.; Palomar-Vázquez, J.; Balaguer Beser, ÁA.; Balsa Barreiro, J.; Ruiz Fernández, LÁ. (2014). Using street based metrics to characterize urban typologies. Computers, Environment and Urban Systems. 44:68-79. https://doi.org/10.1016/j.compenvurbsys.2013.12.002S68794

Monte Carlo Convolution for Learning on Non-Uniformly Sampled Point Clouds

Deep learning systems extensively use convolution operations to process input data. Though convolution is clearly defined for structured data such as 2D images or 3D volumes, this is not true for other data types such as sparse point clouds. Previous techniques have developed approximations to convolutions for restricted conditions. Unfortunately, their applicability is limited and cannot be used for general point clouds. We propose an efficient and effective method to learn convolutions for non-uniformly sampled point clouds, as they are obtained with modern acquisition techniques. Learning is enabled by four key novelties: first, representing the convolution kernel itself as a multilayer perceptron; second, phrasing convolution as a Monte Carlo integration problem, third, using this notion to combine information from multiple samplings at different levels; and fourth using Poisson disk sampling as a scalable means of hierarchical point cloud learning. The key idea across all these contributions is to guarantee adequate consideration of the underlying non-uniform sample distribution function from a Monte Carlo perspective. To make the proposed concepts applicable to real-world tasks, we furthermore propose an efficient implementation which significantly reduces the GPU memory required during the training process. By employing our method in hierarchical network architectures we can outperform most of the state-of-the-art networks on established point cloud segmentation, classification and normal estimation benchmarks. Furthermore, in contrast to most existing approaches, we also demonstrate the robustness of our method with respect to sampling variations, even when training with uniformly sampled data only. To support the direct application of these concepts, we provide a ready-to-use TensorFlow implementation of these layers at https://github.com/viscom-ulm/MCCNN

Change detection of isolated housing using a new hybrid approach based on object classification with optical and TerraSAR-X data

Optical and microwave high spatial resolution images are now available for a wide range of applications. In this work, they have been applied for the semi-automatic change detection of isolated housing in agricultural areas. This article presents a new hybrid methodology based on segmentation of high-resolution images and image differencing. This new approach mixes the main techniques used in change detection methods and it also adds a final segmentation process in order to classify the change detection product. First, isolated building classification is carried out using only optical data. Then, synthetic aperture radar (SAR) information is added to the classification process, obtaining excellent results with lower complexity cost. Since the first classification step is improved, the total change detection scheme is also enhanced when the radar data are used for classification. Finally, a comparison between the different methods is presented and some conclusions are extracted from the study. © 2011 Taylor & Francis.Vidal Pantaleoni, A.; Moreno Cambroreno, MDR. (2011). Change detection of isolated housing using a new hybrid approach based on object classification with optical and TerraSAR-X data. International Journal of Remote Sensing. 32(24):9621-9635. doi:10.1080/01431161.2011.571297S962196353224BLAES, X., VANHALLE, L., & DEFOURNY, P. (2005). Efficiency of crop identification based on optical and SAR image time series. Remote Sensing of Environment, 96(3-4), 352-365. doi:10.1016/j.rse.2005.03.010Chen, Y., Shi, P., Fung, T., Wang, J., & Li, X. (2007). Object‐oriented classification for urban land cover mapping with ASTER imagery. International Journal of Remote Sensing, 28(20), 4645-4651. doi:10.1080/01431160500444731Dalla Mura, M., Benediktsson, J. A., Bovolo, F., & Bruzzone, L. (2008). An Unsupervised Technique Based on Morphological Filters for Change Detection in Very High Resolution Images. IEEE Geoscience and Remote Sensing Letters, 5(3), 433-437. doi:10.1109/lgrs.2008.917726Dell’Acqua, F., & Gamba, P. (2006). Discriminating urban environments using multiscale texture and multiple SAR images. International Journal of Remote Sensing, 27(18), 3797-3812. doi:10.1080/01431160600557572Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973). Textural Features for Image Classification. IEEE Transactions on Systems, Man, and Cybernetics, SMC-3(6), 610-621. doi:10.1109/tsmc.1973.4309314Im, J., Jensen, J. R., & Tullis, J. A. (2008). Object‐based change detection using correlation image analysis and image segmentation. International Journal of Remote Sensing, 29(2), 399-423. doi:10.1080/01431160601075582Lhomme, S., He, D., Weber, C., & Morin, D. (2009). A new approach to building identification from very‐high‐spatial‐resolution images. International Journal of Remote Sensing, 30(5), 1341-1354. doi:10.1080/01431160802509017LOBO, A., CHIC, O., & CASTERAD, A. (1996). Classification of Mediterranean crops with multisensor data: per-pixel versus per-object statistics and image segmentation. International Journal of Remote Sensing, 17(12), 2385-2400. doi:10.1080/01431169608948779Lu, D., Mausel, P., Brondízio, E., & Moran, E. (2004). Change detection techniques. International Journal of Remote Sensing, 25(12), 2365-2401. doi:10.1080/0143116031000139863Shimabukuro, Y. E., Almeida‐Filho, R., Kuplich, T. M., & de Freitas, R. M. (2007). Quantifying optical and SAR image relationships for tropical landscape features in the Amazônia. International Journal of Remote Sensing, 28(17), 3831-3840. doi:10.1080/01431160701236829Stramondo, S., Bignami, C., Chini, M., Pierdicca, N., & Tertulliani, A. (2006). Satellite radar and optical remote sensing for earthquake damage detection: results from different case studies. International Journal of Remote Sensing, 27(20), 4433-4447. doi:10.1080/01431160600675895Yuan, D., & Elvidge, C. D. (1996). Comparison of relative radiometric normalization techniques. ISPRS Journal of Photogrammetry and Remote Sensing, 51(3), 117-126. doi:10.1016/0924-2716(96)00018-

Prevalence and molecular identification of zoonotic Anisakis and Pseudoterranova species in fish destined to human consumption in Chile

Zoonotic larvae of the family Anisakidae found in several fish species represent a serious risk in public health since they may cause food-borne anisakidosis in humans. Chile has culinary preferences including eating raw fish in many traditional preparations. In the present study, a total of 180 fish specimens representing three different fish species, i.e., Chilean hake (Merluccius gayi), snoek (Thyrsites atun), and sea bream (Brama australis), were caught at central coast of Chile. Parasitological examination was performed on musculature and abdominal cavity for subsequent extraction and quantification of anisakid larvae. Estimation of infection parameters, such as prevalence, was performed indicating 100% (CI: 0.94-1.0) prevalence of anisakid L3 in Chilean hakes and snoeks. Moreover, sea breams reached a prevalence of 35% (CI: 0.23-0.48). Prevalence of anisakid larvae in muscle was also analyzed showing values of 18.6% (CI: 0.097-0.309) in Chilean hakes, 15% (CI: 0.07-0.26) in snoeks, and 1.7% (CI: 0-0.089) in sea breams. Meanwhile, prevalence of anisakid larvae in internal organs showed highest values for peritoneum (100% and 83.3%) for snoeks and Chilean hakes, respectively, for liver (96.7%) and gonads (86.6%) in Chilean hakes, and for intestine (98.3%) in snoeks. Molecular analysis of collected anisakid L3 unveiled presence of two potentially zoonotic nematode species, i.e., Pseudoterranova cattani and Anisakis pegreffii. P. cattani was found in Chilean hakes and snoeks being the first molecular host species report for Chilean snoeks. Besides, A. pegreffii was also identified in these species being the first molecular report on this regard. These findings are relevant for better understanding of epidemiology of anisakiasis in Chilean coasts and for public health issues considering potential risk of human population due to its culinary preferences in eating raw fish

Analysis of the factors affecting LiDAR DTM accuracy

This is an Accepted Manuscript of an article published by Taylor & Francis in International Journal of Digital Earth on 2011, available online: http://wwww.tandfonline.com/10.1080/17538947.2010.533201[EN] The creation of a quality Digital Terrain Model (DTM) is essential for representing and analyzing the Earth in a digital form. The continuous improvements in the acquisition and the potential of airborne Light Detection and Ranging (LiDAR) data are increasing the range of applications of this technique to the study of the Earth surface. The aim of this study was to determine the optimal parameters for calculating a DTM by using an iterative algorithm to select minimum elevations from LiDAR data in a steep mountain area with shrub vegetation. The parameters were: input data type, analysis window size, and height thresholds. The effects of slope, point density, and vegetation on DTM accuracy were also analyzed. The results showed that the lowest root mean square error (RMSE) was obtained with an analysis window size of 10 m, 5 m, and 2.5 m, rasterized data as input data, and height thresholds equal to or greater than 1.5 m. These parameters showed a RMSE of 0.19 m. When terrain slope varied from 0-10% to 50-60%, the RMSE increased by 0.11 m. The RMSE decreased by 0.06 m when point density was increased from 4 to 8 points/m2, and increased by 0.05 m in dense vegetation areas. © 2011 Taylor & Francis.This research has been supported by Vice-Rectorate for Research of Universidad Politecnica de Valencia (Grant PAID-06-08-3297).Estornell Cremades, J.; Ruiz Fernández, LÁ.; Velázquez Martí, B.; Hermosilla, T. (2011). Analysis of the factors affecting LiDAR DTM accuracy. International Journal of Digital Earth. 4(6):521-538. https://doi.org/10.1080/17538947.2010.533201S5215384

Electroactive Self-Healing Shape Memory Polymer Composites Based on Diels–Alder Chemistry

Both shape memory and self-healing polymers have received significant attention from the materials science community. The former, for their application as actuators, self-deployable structures, and medical devices; and the latter, for extending the lifetime of polymeric products. Both effects can be stimulated by heat, which makes resistive heating a practical approach to trigger these effects. Here we show a conductive polyketone polymer and carbon nanotube composite with cross-links based on the thermo-reversible furan/maleimide Diels–Alder chemistry. This approach resulted in products with efficient electroactive shape memory effect, shape reprogrammability, and self-healing. They exhibit electroactive shape memory behavior with recovery ratios of about 0.9; requiring less than a minute for shape recovery; electroactive self-healing behavior able to repair microcracks and almost fully recover their mechanical properties; requiring a voltage in the order of tens of volts for both shape memory and self-healing effects. To the best of our knowledge, this is the first report of electroactive self-healing shape memory polymer composites that use covalent reversible Diels–Alder linkages, which yield robust solvent-resistant polymer networks without jeopardizing their reprocessability. These responsive polymers may be ideal for soft robotics and actuators. They are also a step toward sustainable materials by allowing an increased lifetime of use and reprocessability