Filmy Cloud Removal on Satellite Imagery with Multispectral Conditional Generative Adversarial Nets

In this paper, we propose a method for cloud removal from visible light RGB satellite images by extending the conditional Generative Adversarial Networks (cGANs) from RGB images to multispectral images. Satellite images have been widely utilized for various purposes, such as natural environment monitoring (pollution, forest or rivers), transportation improvement and prompt emergency response to disasters. However, the obscurity caused by clouds makes it unstable to monitor the situation on the ground with the visible light camera. Images captured by a longer wavelength are introduced to reduce the effects of clouds. Synthetic Aperture Radar (SAR) is such an example that improves visibility even the clouds exist. On the other hand, the spatial resolution decreases as the wavelength increases. Furthermore, the images captured by long wavelengths differs considerably from those captured by visible light in terms of their appearance. Therefore, we propose a network that can remove clouds and generate visible light images from the multispectral images taken as inputs. This is achieved by extending the input channels of cGANs to be compatible with multispectral images. The networks are trained to output images that are close to the ground truth using the images synthesized with clouds over the ground truth as inputs. In the available dataset, the proportion of images of the forest or the sea is very high, which will introduce bias in the training dataset if uniformly sampled from the original dataset. Thus, we utilize the t-Distributed Stochastic Neighbor Embedding (t-SNE) to improve the problem of bias in the training dataset. Finally, we confirm the feasibility of the proposed network on the dataset of four bands images, which include three visible light bands and one near-infrared (NIR) band

Towards quantifying the effects of resource extraction on land cover and topography through remote sensing analysis: Confronting issues of scale and data scarcity

This dissertation focuses on the mapping and monitoring of mineral mining activity using remotely sensed data. More specifically, it explores the challenges and issues associated with remote sensing-based analysis of land use land cover (LULC) and topographic changes in the landscape associated with artisanal and industrial-scale mining. It explores broad themes of image analysis, including evaluation of error in digital elevation models (DEMs), integration of multiple scales and data sources, quantification of change, and remote sensing classification in data-scarce environments. The dissertation comprises three case studies.;The first case study examines the LULC change associated with two scales of mining activity (industrial and artisanal) near Tortiya, Cote d\u27Ivoire. Industrial mining activity was successfully mapped in a regional LULC classification using Landsat multispectral imagery and support vector machines (SVMs). However, mapping artisanal mining required high-resolution imagery to discriminate the small, complex patterns of associated disturbance.;The second case study is an investigation of the potential for quantifying topographic change associated with mountain top removal mining and the associated valley-fill operations for a region in West Virginia, USA, using publicly available DEMs. A 1:24,000 topographic map data, the shuttle radar topography mission (SRTM) DEM, a state-wide photogrammetric DEM, and the Advanced Spaceborne Thermal Emission Radiometer (ASTER) Global DEM (GDEM) were compared to a lidar bare-earth reference DEM. The observed mean error in both the SRTM and GDEM was statistically different than zero and modeled a surface well above the reference DEM surface. Mean error in the other DEMs was lower, and not significantly different than zero. The magnitude of the root mean square error (RMSE) suggests that only topographic change associated with the largest topographic disturbances would be separable from background noise using global DEMS such as the SRTM. Nevertheless, regionally available DEMs from photogrammetric sources allow mapping of mining change and quantification of the total volume of earth removal.;Monitoring topographic change associated with mining is challenging in regions where publicly available DEMs are limited or not available. This challenge is particularly acute for artisanal mining, where the topographic disturbance, though locally important, is unlikely to be detected in global elevation data sets. Therefore, the third and final case study explored the potential for creating fine-spatial resolution bare-earth DEMs from digital surface models (DSMs) using high spatial resolution commercial satellite imagery and subsequent filtering of elevation artifacts using commercial lidar software and other spatial filtering techniques. Leaf-on and leaf-off DSMs were compared to highlight the effect of vegetation on derived bare-earth DEM accuracy. The raw leaf-off DSM was found to have very low error overall, with notably higher error in areas of evergreen vegetation. The raw leaf-on DSM was found to have a RMSE error much higher than the leaf-off data, and similar to that of the SRTM in dense deciduous forest. However, filtering using the commercial techniques developed for lidar notably reduced the error present in the raw DSMs, suggesting that such approaches could help overcome data scarcity in regions where regional or national elevation data sets are not available.;Collectively this research addressed data issues and methodological challenges in the analysis of 3D changes caused by resource extraction. Elevation and optical imagery are key data sets for mapping the disturbance associated with mining. The particular combination required regarding data spatial scale, and for elevation, accuracy, is a function of the type and scale of the mining

Investigation of Coastal Vegetation Dynamics and Persistence in Response to Hydrologic and Climatic Events Using Remote Sensing

Coastal Wetlands (CW) provide numerous imperative functions and provide an economic base for human societies. Therefore, it is imperative to track and quantify both short and long-term changes in these systems. In this dissertation, CW dynamics related to hydro-meteorological signals were investigated using a series of LANDSAT-derived normalized difference vegetation index (NDVI) data and hydro-meteorological time-series data in Apalachicola Bay, Florida, from 1984 to 2015. NDVI in forested wetlands exhibited more persistence compared to that for scrub and emergent wetlands. NDVI fluctuations generally lagged temperature by approximately three months, and water level by approximately two months. This analysis provided insight into long-term CW dynamics in the Northern Gulf of Mexico. Long-term studies like this are dependent on optical remote sensing data such as Landsat which is frequently partially obscured due to clouds and this can that makes the time-series sparse and unusable during meteorologically active seasons. Therefore, a multi-sensor, virtual constellation method is proposed and demonstrated to recover the information lost due to cloud cover. This method, named Tri-Sensor Fusion (TSF), produces a simulated constellation for NDVI by integrating data from three compatible satellite sensors. The visible and near-infrared (VNIR) bands of Landsat-8 (L8), Sentinel-2, and the Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) were utilized to map NDVI and to compensate each satellite sensor\u27s shortcomings in visible coverage area. The quantitative comparison results showed a Root Mean Squared Error (RMSE) and Coefficient of Determination (R2) of 0.0020 sr-1 and 0.88, respectively between true observed and fused L8 NDVI. Statistical test results and qualitative performance evaluation suggest that TSF was able to synthesize the missing pixels accurately in terms of the absolute magnitude of NDVI. The fusion improved the spatial coverage of CWs reasonably well and ultimately increases the continuity of NDVI data for long term studies

Monitoring Cloud-prone Complex Landscapes At Multiple Spatial Scales Using Medium And High Resolution Optical Data: A Case Study In Central Africa

Tracking land surface dynamics over cloud-prone areas with complex mountainous terrain and a landscape that is heterogeneous at a scale of approximately 10 m, is an important challenge in the remote sensing of tropical regions in developing nations, due to the small plot sizes. Persistent monitoring of natural resources in these regions at multiple spatial scales requires development of tools to identify emerging land cover transformation due to anthropogenic causes, such as agricultural expansion and climate change. Along with the cloud cover and obstructions by topographic distortions due to steep terrain, there are limitations to the accuracy of monitoring change using available historical satellite imagery, largely due to sparse data access and the lack of high quality ground truth for classifier training. One such complex region is the Lake Kivu region in Central Africa. This work addressed these problems to create an effective process for monitoring the Lake Kivu region located in Central Africa. The Lake Kivu region is a biodiversity hotspot with a complex and heterogeneous landscape and intensive agricultural development, where individual plot sizes are often at the scale of 10m. Procedures were developed that use optical data from satellite and aerial observations at multiple scales to tackle the monitoring challenges. First, a novel processing chain was developed to systematically monitor the spatio-temporal land cover dynamics of this region over the years 1988, 2001, and 2011 using Landsat data, complemented by ancillary data. Topographic compensation was performed on Landsat reflectances to avoid the strong illumination angle impacts and image compositing was used to compensate for frequent cloud cover and thus incomplete annual data availability in the archive. A systematic supervised classification, using the state-of-the-art machine learning classifier Random Forest, was applied to the composite Landsat imagery to obtain land cover thematic maps with overall accuracies of 90% and higher. Subsequent change analysis between these years found extensive conversions of the natural environment as a result of human related activities. The gross forest cover loss for 1988-2001 and 2001- 2011 periods was 216.4 and 130.5 thousand hectares, respectively, signifying significant deforestation in the period of civil war and a relatively stable and lower deforestation rate later, possibly due to conservation and reforestation efforts in the region. The other dominant land cover changes in the region were aggressive subsistence farming and urban expansion displacing natural vegetation and arable lands. Despite limited data availability, this study fills the gap of much needed detailed and updated land cover change information for this biologically important region of Central Africa. While useful on a regional scale, Landsat data can be inadequate for more detailed studies of land cover change. Based on an increasing availability of high resolution imagery and light detection and ranging (LiDAR) data from manned and unmanned aerial platforms (\u3c1m \u3eresolution), a study was performed leading to a novel generic framework for land cover monitoring at fine spatial scales. The approach fuses high spatial resolution aerial imagery and LiDAR data to produce land cover maps with high spatial detail using object-based image analysis techniques. The classification framework was tested for a scene with both natural and cultural features and was found to be more than 90 percent accurate, sufficient for detailed land cover change studies

Potential of VIIRS Time Series Data for Aiding the USDA Forest Service Early Warning System for Forest Health Threats: A Gypsy Moth Defoliation Case Study

This report details one of three experiments performed during FY 2007 for the NASA RPC (Rapid Prototyping Capability) at Stennis Space Center. This RPC experiment assesses the potential of VIIRS (Visible/Infrared Imager/Radiometer Suite) and MODIS (Moderate Resolution Imaging Spectroradiometer) data for detecting and monitoring forest defoliation from the non-native Eurasian gypsy moth (Lymantria dispar). The intent of the RPC experiment was to assess the degree to which VIIRS data can provide forest disturbance monitoring information as an input to a forest threat EWS (Early Warning System) as compared to the level of information that can be obtained from MODIS data. The USDA Forest Service (USFS) plans to use MODIS products for generating broad-scaled, regional monitoring products as input to an EWS for forest health threat assessment. NASA SSC is helping the USFS to evaluate and integrate currently available satellite remote sensing technologies and data products for the EWS, including the use of MODIS products for regional monitoring of forest disturbance. Gypsy moth defoliation of the mid-Appalachian highland region was selected as a case study. Gypsy moth is one of eight major forest insect threats listed in the Healthy Forest Restoration Act (HFRA) of 2003; the gypsy moth threatens eastern U.S. hardwood forests, which are also a concern highlighted in the HFRA of 2003. This region was selected for the project because extensive gypsy moth defoliation occurred there over multiple years during the MODIS operational period. This RPC experiment is relevant to several nationally important mapping applications, including agricultural efficiency, coastal management, ecological forecasting, disaster management, and carbon management. In this experiment, MODIS data and VIIRS data simulated from MODIS were assessed for their ability to contribute broad, regional geospatial information on gypsy moth defoliation. Landsat and ASTER (Advanced Spaceborne Thermal Emission and Reflection Radiometer) data were used to assess the quality of gypsy moth defoliation mapping products derived from MODIS data and from simulated VIIRS data. The project focused on use of data from MODIS Terra as opposed to MODIS Aqua mainly because only MODIS Terra data was collected during 2000 and 2001-years with comparatively high amounts of gypsy moth defoliation within the study area. The project assessed the quality of VIIRS data simulation products. Hyperion data was employed to assess the quality of MODIS-based VIIRS simulation datasets using image correlation analysis techniques. The ART (Application Research Toolbox) software was used for data simulation. Correlation analysis between MODIS-simulated VIIRS data and Hyperion-simulated VIIRS data for red, NIR (near-infrared), and NDVI (Normalized Difference Vegetation Index) image data products collectively indicate that useful, effective VIIRS simulations can be produced using Hyperion and MODIS data sources. The r(exp 2) for red, NIR, and NDVI products were 0.56, 0.63, and 0.62, respectively, indicating a moderately high correlation between the 2 data sources. Temporal decorrelation from different data acquisition times and image misregistration may have lowered correlation results. The RPC experiment also generated MODIS-based time series data products using the TSPT (Time Series Product Tool) software. Time series of simulated VIIRS NDVI products were produced at approximately 400-meter resolution GSD (Ground Sampling Distance) at nadir for comparison to MODIS NDVI products at either 250- or 500-meter GSD. The project also computed MODIS (MOD02) NDMI (Normalized Difference Moisture Index) products at 500-meter GSD for comparison to NDVI-based products. For each year during 2000-2006, MODIS and VIIRS (simulated from MOD02) time series were computed during the peak gypsy moth defoliation time frame in the study area (approximately June 10 through July 27). Gypsy moth defoliation mapping products from simated VIIRS and MOD02 time series were produced using multiple methods, including image classification and change detection via image differencing. The latter enabled an automated defoliation detection product computed using percent change in maximum NDVI for a peak defoliation period during 2001 compared to maximum NDVI across the entire 2000-2006 time frame. Final gypsy moth defoliation mapping products were assessed for accuracy using randomly sampled locations found on available geospatial reference data (Landsat and ASTER data in conjunction with defoliation map data from the USFS). Extensive gypsy moth defoliation patches were evident on screen displays of multitemporal color composites derived from MODIS data and from simulated VIIRS vegetation index data. Such defoliation was particularly evident for 2001, although widespread denuded forests were also seen for 2000 and 2003. These visualizations were validated using aforementioned reference data. Defoliation patches were visible on displays of MODIS-based NDVI and NDMI data. The viewing of apparent defoliation patches on all of these products necessitated adoption of a specialized temporal data processing method (e.g., maximum NDVI during the peak defoliation time frame). The frequency of cloud cover necessitated this approach. Multitemporal simulated VIIRS and MODIS Terra data both produced effective general classifications of defoliated forest versus other land cover. For 2001, the MOD02-simulated VIIRS 400-meter NDVI classification produced a similar yet slightly lower overall accuracy (87.28 percent with 0.72 Kappa) than the MOD02 250-meter NDVI classification (88.44 percent with 0.75 Kappa). The MOD13 250-meter NDVI classification had a lower overall accuracy (79.13 percent) and a much lower Kappa (0.46). The report discusses accuracy assessment results in much more detail, comparing overall classification and individual class accuracy statistics for simulated VIIRS 400-meter NDVI, MOD02 250-meter NDVI, MOD02-500 meter NDVI, MOD13 250-meter NDVI, and MOD02 500-meter NDMI classifications. Automated defoliation detection products from simulated VIIRS and MOD02 data for 2001 also yielded similar, relatively high overall classification accuracy (85.55 percent for the VIIRS 400-meter NDVI versus 87.28 percent for the MOD02 250-meter NDVI). In contrast, the USFS aerial sketch map of gypsy moth defoliation showed a lower overall classification accuracy at 73.64 percent. The overall classification Kappa values were also similar for the VIIRS (approximately 0.67 Kappa) versus the MOD02 (approximately 0.72 Kappa) automated defoliation detection product, which were much higher than the values exhibited by the USFS sketch map product (overall Kappa of approximately 0.47). The report provides additional details on the accuracy of automated gypsy moth defoliation detection products compared with USFS sketch maps. The results suggest that VIIRS data can be effectively simulated from MODIS data and that VIIRS data will produce gypsy moth defoliation mapping products that are similar to MODIS-based products. The results of the RPC experiment indicate that VIIRS and MODIS data products have good potential for integration into the forest threat EWS. The accuracy assessment was performed only for 2001 because of time constraints and a relative scarcity of cloud-free Landsat and ASTER data for the peak defoliation period of the other years in the 2000-2006 time series. Additional work should be performed to assess the accuracy of gypsy moth defoliation detection products for additional years.The study area (mid-Appalachian highlands) and application (gypsy moth forest defoliation) are not necessarily representative of all forested regions and of all forest threat disturbance agents. Additional work should be performed on other inland and coastal regions as well as for other major forest threats

A multi-scale flood monitoring system based on fully automatic MODIS and TerraSAR-X processing chains

A two-component fully automated flood monitoring system is described and evaluated. This is a result of combining two individual flood services that are currently under development at DLR’s (German Aerospace Center) Center for Satellite based Crisis Information (ZKI) to rapidly support disaster management activities. A first-phase monitoring component of the system systematically detects potential flood events on a continental scale using daily-acquired medium spatial resolution optical data from the Moderate Resolution Imaging Spectroradiometer (MODIS). A threshold set controls the activation of the second-phase crisis component of the system, which derives flood information at higher spatial detail using a Synthetic Aperture Radar (SAR) based satellite mission (TerraSAR-X). The proposed activation procedure finds use in the identification of flood situations in different spatial resolutions and in the time-critical and on demand programming of SAR satellite acquisitions at an early stage of an evolving flood situation. The automated processing chains of the MODIS (MFS) and the TerraSAR-X Flood Service (TFS) include data pre-processing, the computation and adaptation of global auxiliary data, thematic classification, and the subsequent dissemination of flood maps using an interactive web-client. The system is operationally demonstrated and evaluated via the monitoring two recent flood events in Russia 2013 and Albania/Montenegro 2013