Multisource and Multitemporal Data Fusion in Remote Sensing

The sharp and recent increase in the availability of data captured by different sensors combined with their considerably heterogeneous natures poses a serious challenge for the effective and efficient processing of remotely sensed data. Such an increase in remote sensing and ancillary datasets, however, opens up the possibility of utilizing multimodal datasets in a joint manner to further improve the performance of the processing approaches with respect to the application at hand. Multisource data fusion has, therefore, received enormous attention from researchers worldwide for a wide variety of applications. Moreover, thanks to the revisit capability of several spaceborne sensors, the integration of the temporal information with the spatial and/or spectral/backscattering information of the remotely sensed data is possible and helps to move from a representation of 2D/3D data to 4D data structures, where the time variable adds new information as well as challenges for the information extraction algorithms. There are a huge number of research works dedicated to multisource and multitemporal data fusion, but the methods for the fusion of different modalities have expanded in different paths according to each research community. This paper brings together the advances of multisource and multitemporal data fusion approaches with respect to different research communities and provides a thorough and discipline-specific starting point for researchers at different levels (i.e., students, researchers, and senior researchers) willing to conduct novel investigations on this challenging topic by supplying sufficient detail and references

Multitemporal Feature-Level Fusion on Hyperspectral and LiDAR Data in the Urban Environment

publishedVersio

Airborne LiDAR and high resolution satellite data for rapid 3D feature extraction

This work uses the canopy height model (CHM) based workflow for individual tree crown delineation and 3D feature extraction approach (Overwatch Geospatial's proprietary algorithm) for building feature delineation from high-density light detection and ranging (LiDAR) point cloud data in an urban environment and evaluates its accuracy by using very high-resolution panchromatic (PAN) (spatial) and 8-band (multispectral) WorldView-2 (WV-2) imagery. LiDAR point cloud data over San Francisco, California, USA, recorded in June 2010, was used to detect tree and building features by classifying point elevation values. The workflow employed includes resampling of LiDAR point cloud to generate a raster surface or digital terrain model (DTM), generation of a hill-shade image and an intensity image, extraction of digital surface model, generation of bare earth digital elevation model (DEM) and extraction of tree and building features. First, the optical WV-2 data and the LiDAR intensity image were co-registered using ground control points (GCPs). The WV-2 rational polynomial coefficients model (RPC) was executed in ERDAS Leica Photogrammetry Suite (LPS) using supplementary?.RPB file. In the second stage, ortho-rectification was carried out using ERDAS LPS by incorporating well-distributed GCPs. The root mean square error (RMSE) for the WV-2 was estimated to be 0.25 m by using more than 10 well-distributed GCPs. In the second stage, we generated the bare earth DEM from LiDAR point cloud data. In most of the cases, bare earth DEM does not represent true ground elevation. Hence, the model was edited to get the most accurate DEM/ DTM possible and normalized the LiDAR point cloud data based on DTM in order to reduce the effect of undulating terrain. We normalized the vegetation point cloud values by subtracting the ground points (DEM) from the LiDAR point cloud. A normalized digital surface model (nDSM) or CHM was calculated from the LiDAR data by subtracting the DEM from the DSM. The CHM or the normalized DSM represents the absolute height of all aboveground urban features relative to the ground. After normalization, the elevation value of a point indicates the height from the ground to the point. The above-ground points were used for tree feature and building footprint extraction. In individual tree extraction, first and last return point clouds were used along with the bare earth and building footprint models discussed above. In this study, scene dependent extraction criteria were employed to improve the 3D feature extraction process. LiDAR-based refining/ filtering techniques used for bare earth layer extraction were crucial for improving the subsequent 3D features (tree and building) feature extraction. The PAN-sharpened WV-2 image (with 0.5 m spatial resolution) was used to assess the accuracy of LiDAR-based 3D feature extraction. Our analysis provided an accuracy of 98% for tree feature extraction and 96% for building feature extraction from LiDAR data. This study could extract total of 15143 tree features using CHM method, out of which total of 14841 were visually interpreted on PAN-sharpened WV-2 image data. The extracted tree features included both shadowed (total 13830) and non-shadowed (total 1011). We note that CHM method could overestimate total of 302 tree features, which were not observed on the WV-2 image. One of the potential sources for tree feature overestimation was observed in case of those tree features which were adjacent to buildings. In case of building feature extraction, the algorithm could extract total of 6117 building features which were interpreted on WV-2 image, even capturing buildings under the trees (total 605) and buildings under shadow (total 112). Overestimation of tree and building features was observed to be limiting factor in 3D feature extraction process. This is due to the incorrect filtering of point cloud in these areas. One of the potential sources of overestimation was the man-made structures, including skyscrapers and bridges, which were confounded and extracted as buildings. This can be attributed to low point density at building edges and on flat roofs or occlusions due to which LiDAR cannot give as much precise planimetric accuracy as photogrammetric techniques (in segmentation) and lack of optimum use of textural information as well as contextual information (especially at walls which are away from roof) in automatic extraction algorithm. In addition, there were no separate classes for bridges or the features lying inside the water and multiple water height levels were also not considered. Based on these inferences, we conclude that the LiDAR-based 3D feature extraction supplemented by high resolution satellite data is a potential application which can be used for understanding and characterization of urban setup

Cybergis-enabled remote sensing data analytics for deep learning of landscape patterns and dynamics

Mapping landscape patterns and dynamics is essential to various scientific domains and many practical applications. The availability of large-scale and high-resolution light detection and ranging (LiDAR) remote sensing data provides tremendous opportunities to unveil complex landscape patterns and better understand landscape dynamics from a 3D perspective. LiDAR data have been applied to diverse remote sensing applications where large-scale landscape mapping is among the most important topics. While researchers have used LiDAR for understanding landscape patterns and dynamics in many fields, to fully reap the benefits and potential of LiDAR is increasingly dependent on advanced cyberGIS and deep learning approaches. In this context, the central goal of this dissertation is to develop a suite of innovative cyberGIS-enabled deep-learning frameworks for combining LiDAR and optical remote sensing data to analyze landscape patterns and dynamics with four interrelated studies. The first study demonstrates a high-accuracy land-cover mapping method by integrating 3D information from LiDAR with multi-temporal remote sensing data using a 3D deep-learning model. The second study combines a point-based classification algorithm and an object-oriented change detection strategy for urban building change detection using deep learning. The third study develops a deep learning model for accurate hydrological streamline detection using LiDAR, which has paved a new way of harnessing LiDAR data to map landscape patterns and dynamics at unprecedented computational and spatiotemporal scales. The fourth study resolves computational challenges in handling remote sensing big data and deep learning of landscape feature extraction and classification through a cutting-edge cyberGIS approach

Mapping Chestnut Stands Using Bi-Temporal VHR Data

This study analyzes the potential of very high resolution (VHR) remote sensing images and extended morphological profiles for mapping Chestnut stands on Tenerife Island (Canary Islands, Spain). Regarding their relevance for ecosystem services in the region (cultural and provisioning services) the public sector demand up-to-date information on chestnut and a simple straight-forward approach is presented in this study. We used two VHR WorldView images (March and May 2015) to cover different phenological phases. Moreover, we included spatial information in the classification process by extended morphological profiles (EMPs). Random forest is used for the classification process and we analyzed the impact of the bi-temporal information as well as of the spatial information on the classification accuracies. The detailed accuracy assessment clearly reveals the benefit of bi-temporal VHR WorldView images and spatial information, derived by EMPs, in terms of the mapping accuracy. The bi-temporal classification outperforms or at least performs equally well when compared to the classification accuracies achieved by the mono-temporal data. The inclusion of spatial information by EMPs further increases the classification accuracy by 5% and reduces the quantity and allocation disagreements on the final map. Overall the new proposed classification strategy proves useful for mapping chestnut stands in a heterogeneous and complex landscape, such as the municipality of La Orotava, Tenerife

Airborne Laser Scanning to support forest resource management under alpine, temperate and Mediterranean environments in Italy

Abstract This paper aims to provide general considerations, in the form of a scientific review, with reference to selected experiences of ALS applications under alpine, temperate and Mediterranean environments in Italy as case studies. In Italy, the use of ALS data have been mainly focused on the stratification of forest stands and the estimation of their timber volume and biomass at local scale. Potential for ALS data exploitation concerns their integration in forest inventories on large territories, their usage for silvicultural systems detection and their use for the estimation of fuel load in forest and pre-forest stands. Multitemporal ALS may even be suitable to support the assessment of current annual volume increment and the harvesting rates. Keywords: Airborne laser scanning, area-based approaches, individual tree crown approaches, forest management, timber volume estimation, multitemporal ALS surveys. Introduction Information about the state and changes to forest stands is important for environmental and timber assessment on various levels of forest ecosystem planning and management and for the global change science community [Corona and Marchetti, 2007]. Standing volume and above-ground tree biomass are key parameters in this respect. Actually, fine-scale studies have demonstrated the influence of structural characteristics on ecosystem functioning: characterization of forest attributes at fine scales is necessary to manage resources in a manner that replicates, as closely as possible, natural ecological conditions. To apply this knowledge at broad scales is problematical because information on broad-scale patterns of vertical canopy structure has been very difficult to be obtained. Passive remote sensing tools cannot help for detailed height, total biomass, or leaf biomass estimates beyond early stages of succession in forests with high leaf area or biomass [Means et al., 1999]. Over the last decades, survey methods and techniques for assessing such biophysical attributes have greatly advanced [Corona, 2010]. Among others, laser scanning techniques from space o

An object-based approach for mapping forest structural types based on low-density LiDAR and multispectral imagery

[EN] Mapping forest structure variables provides important information for the estimation of forest biomass, carbon stocks, pasture suitability or for wildfire risk prevention and control. The optimization of the prediction models of these variables requires an adequate stratification of the forest landscape in order to create specific models for each structural type or strata. This paper aims to propose and validate the use of an object-oriented classification methodology based on low-density LiDAR data (0.5 m−2) available at national level, WorldView-2 and Sentinel-2 multispectral imagery to categorize Mediterranean forests in generic structural types. After preprocessing the data sets, the area was segmented using a multiresolution algorithm, features describing 3D vertical structure were extracted from LiDAR data and spectral and texture features from satellite images. Objects were classified after feature selection in the following structural classes: grasslands, shrubs, forest (without shrubs), mixed forest (trees and shrubs) and dense young forest. Four classification algorithms (C4.5 decision trees, random forest, k-nearest neighbour and support vector machine) were evaluated using cross-validation techniques. The results show that the integration of low-density LiDAR and multispectral imagery provide a set of complementary features that improve the results (90.75% overall accuracy), and the object-oriented classification techniques are efficient for stratification of Mediterranean forest areas in structural- and fuel-related categories. Further work will be focused on the creation and validation of a different prediction model adapted to the various strata.This work was supported by the Spanish Ministerio de Economia y Competitividad and FEDER under [grant number CGL2013-46387-C2-1-R]; Fondo de Garantia Juvenil under [contract number PEJ-2014-A-45358].Ruiz Fernández, LÁ.; Recio Recio, JA.; Crespo-Peremarch, P.; Sapena, M. (2018). An object-based approach for mapping forest structural types based on low-density LiDAR and multispectral imagery. Geocarto International. 33(5):443-457. https://doi.org/10.1080/10106049.2016.1265595S44345733