Multi-level Feature Fusion-based CNN for Local Climate Zone Classification from Sentinel-2 Images: Benchmark Results on the So2Sat LCZ42 Dataset

As a unique classification scheme for urban forms and functions, the local climate zone (LCZ) system provides essential general information for any studies related to urban environments, especially on a large scale. Remote sensing data-based classification approaches are the key to large-scale mapping and monitoring of LCZs. The potential of deep learning-based approaches is not yet fully explored, even though advanced convolutional neural networks (CNNs) continue to push the frontiers for various computer vision tasks. One reason is that published studies are based on different datasets, usually at a regional scale, which makes it impossible to fairly and consistently compare the potential of different CNNs for real-world scenarios. This study is based on the big So2Sat LCZ42 benchmark dataset dedicated to LCZ classification. Using this dataset, we studied a range of CNNs of varying sizes. In addition, we proposed a CNN to classify LCZs from Sentinel-2 images, Sen2LCZ-Net. Using this base network, we propose fusing multi-level features using the extended Sen2LCZ-Net-MF. With this proposed simple network architecture and the highly competitive benchmark dataset, we obtain results that are better than those obtained by the state-of-the-art CNNs, while requiring less computation with fewer layers and parameters. Large-scale LCZ classification examples of completely unseen areas are presented, demonstrating the potential of our proposed Sen2LCZ-Net-MF as well as the So2Sat LCZ42 dataset. We also intensively investigated the influence of network depth and width and the effectiveness of the design choices made for Sen2LCZ-Net-MF. Our work will provide important baselines for future CNN-based algorithm developments for both LCZ classification and other urban land cover land use classification

Delineation of high resolution climate regions over the Korean Peninsula using machine learning approaches

In this research, climate classification maps over the Korean Peninsula at 1 km resolution were generated using the satellite-based climatic variables of monthly temperature and precipitation based on machine learning approaches. Random forest (RF), artificial neural networks (ANN), k-nearest neighbor (KNN), logistic regression (LR), and support vector machines (SVM) were used to develop models. Training and validation of these models were conducted using in-situ observations from the Korea Meteorological Administration (KMA) from 2001 to 2016. The rule of the traditional Koppen-Geiger (K-G) climate classification was used to classify climate regions. The input variables were land surface temperature (LST) of the Moderate Resolution Imaging Spectroradiometer (MODIS), monthly precipitation data from the Tropical Rainfall Measuring Mission (TRMM) 3B43 product, and the Digital Elevation Map (DEM) from the Shuttle Radar Topography Mission (SRTM). The overall accuracy (OA) based on validation data from 2001 to 2016 for all models was high over 95%. DEM and minimum winter temperature were two distinct variables over the study area with particularly high relative importance. ANN produced more realistic spatial distribution of the classified climates despite having a slightly lower OA than the others. The accuracy of the models using high altitudinal in-situ data of the Mountain Meteorology Observation System (MMOS) was also assessed. Although the data length of the MMOS data was relatively short (2013 to 2017), it proved that the snowy, dry and cold winter and cool summer class (Dwc) is widely located in the eastern coastal region of South Korea. Temporal shifting of climate was examined through a comparison of climate maps produced by period: from 1950 to 2000, from 1983 to 2000, and from 2001 to 2013. A shrinking trend of snow classes (D) over the Korean Peninsula was clearly observed from the ANN-based climate classification results. Shifting trends of climate with the decrease/increase of snow (D)/temperate (C) classes were clearly shown in the maps produced using the proposed approaches, consistent with the results from the reanalysis data of the Climatic Research Unit (CRU) and Global Precipitation Climatology Centre (GPCC)

Mapping Europe into local climate zones

Cities are major drivers of environmental change at all scales and are especially at risk from the ensuing effects, which include poor air quality, flooding and heat waves. Typically, these issues are studied on a city-by-city basis owing to the spatial complexity of built landscapes, local topography and emission patterns. However, to ensure knowledge sharing and to integrate local-scale processes with regional and global scale modelling initiatives, there is a pressing need for a world-wide database on cities that is suited for environmental studies. In this paper we present a European database that has a particular focus on characterising urbanised landscapes. It has been derived using tools and techniques developed as part of the World Urban Database and Access Portal Tools (WUDAPT) project, which has the goal of acquiring and disseminating climate-relevant information on cities worldwide. The European map is the first major step toward creating a global database on cities that can be integrated with existing topographic and natural land-cover databases to support modelling initiatives

Fusion of Heterogeneous Earth Observation Data for the Classification of Local Climate Zones

This paper proposes a novel framework for fusing multi-temporal, multispectral satellite images and OpenStreetMap (OSM) data for the classification of local climate zones (LCZs). Feature stacking is the most commonly-used method of data fusion but does not consider the heterogeneity of multimodal optical images and OSM data, which becomes its main drawback. The proposed framework processes two data sources separately and then combines them at the model level through two fusion models (the landuse fusion model and building fusion model), which aim to fuse optical images with landuse and buildings layers of OSM data, respectively. In addition, a new approach to detecting building incompleteness of OSM data is proposed. The proposed framework was trained and tested using data from the 2017 IEEE GRSS Data Fusion Contest, and further validated on one additional test set containing test samples which are manually labeled in Munich and New York. Experimental results have indicated that compared to the feature stacking-based baseline framework the proposed framework is effective in fusing optical images with OSM data for the classification of LCZs with high generalization capability on a large scale. The classification accuracy of the proposed framework outperforms the baseline framework by more than 6% and 2%, while testing on the test set of 2017 IEEE GRSS Data Fusion Contest and the additional test set, respectively. In addition, the proposed framework is less sensitive to spectral diversities of optical satellite images and thus achieves more stable classification performance than state-of-the art frameworks.Comment: accepted by TGR

Soil erosion in the Alps : causes and risk assessment

The issue of soil erosion in the Alps has long been neglected due to the low economic value of the agricultural land. However, soil stability is a key parameter which affects ecosystem services like slope stability, water budgets (drinking water reservoirs as well as flood prevention), vegetation productivity, ecosystem biodiversity and nutrient production. In alpine regions, spatial estimates on soil erosion are difficult to derive because the highly heterogeneous biogeophysical structure impedes measurement of soil erosion and the applicability of soil erosion models. However, remote sensing and geographic information system (GIS) methods allow for spatial estimation of soil erosion by direct detection of erosion features and supply of input data for soil erosion models. Thus, the main objective of this work is to address the problem of soil erosion risk assessment in the Alps on catchment scale with remote sensing and GIS tools. Regarding soil erosion processes the focus is on soil erosion by water (here sheet erosion) and gravity (here landslides). For these two processes we address i) the monitoring and mapping of the erosion features and related causal factors ii) soil erosion risk assessment with special emphasis on iii) the validation of existing models for alpine areas. All investigations were accomplished in the Urseren Valley (Central Swiss Alps) where the valley slopes are dramatically affected by sheet erosion and landslides. For landslides, a natural susceptibility of the catchment has been indicated by bivariate and multivariate statistical analysis. Geology, slope and stream density are the most significant static landslide causal factors. Static factors are here defined as factors that do not change their attributes during the considered time span of the study (45 years), e.g. geology, stream network. The occurrence of landslides might be significantly increased by the combined effects of global climate and land use change. Thus, our hypothesis is that more recent changes in land use and climate affected the spatial and temporal occurrence of landslides. The increase of the landslide area of 92% within 45 years in the study site confirmed our hypothesis. In order to identify the cause for the trend in landslide occurrence time-series of landslide causal factors were analysed. The analysis revealed increasing trends in the frequency and intensity of extreme rainfall events and stocking of pasture animals. These developments presumably enhanced landslide hazard. Moreover, changes in land-cover and land use were shown to have affected landslide occurrence. For instance, abandoned areas and areas with recently emerging shrub vegetation show very low landslide densities. Detailed spatial analysis of the land use with GIS and interviews with farmers confirmed the strong influence of the land use management practises on slope stability. The definite identification and quantification of the impact of these non-stationary landslide causal factors (dynamic factors) on the landslide trend was not possible due to the simultaneous change of several factors. The consideration of dynamic factors in statistical landslide susceptibility assessments is still unsolved. The latter may lead to erroneous model predictions, especially in times of dramatic environmental change. Thus, we evaluated the effect of dynamic landslide causal factors on the validity of landslide susceptibility maps for spatial and temporal predictions. For this purpose, a logistic regression model based on data of the year 2000 was set up. The resulting landslide susceptibility map was valid for spatial predictions. However, the model failed to predict the landslides that occurred in a subsequent event. In order to handle this weakness of statistic landslide modelling a multitemporal approach was developed. It is based on establishing logistic regression models for two points in time (here 1959 and 2000). Both models could correctly classify >70% of the independent spatial validation dataset. By subtracting the 1959 susceptibility map from the 2000 susceptibility map a deviation susceptibility map was obtained. Our interpretation was that these susceptibility deviations indicate the effect of dynamic causal factors on the landslide probability. The deviation map explained 85% of new independent landslides occurring after 2000. Thus, we believe it to be a suitable tool to add a time element to a susceptibility map pointing to areas with changing susceptibility due to recently changing environmental conditions or human interactions. In contrast to landslides that are a direct threat to buildings and infrastructure, sheet erosion attracts less attention because it is often an unseen process. Nonetheless, sheet erosion may account for a major proportion of soil loss. Soil loss by sheet erosion is related to high spatial variability, however, in contrast to arable fields for alpine grasslands erosion damages are long lasting and visible over longer time periods. A crucial erosion triggering parameter that can be derived from satellite imagery is fractional vegetation cover (FVC). Measurements of the radiogenic isotope Cs-137, which is a common tracer for soil erosion, confirm the importance of FVC for soil erosion yield in alpine areas. Linear spectral unmixing (LSU), mixture tuned matched filtering (MTMF) and the spectral index NDVI are applied for estimating fractional abundance of vegetation and bare soil. To account for the small scale heterogeneity of the alpine landscape very high resolved multispectral QuickBird imagery is used. The performance of LSU and MTMF for estimating percent vegetation cover is good (r²=0.85, r²=0.71 respectively). A poorer performance is achieved for bare soil (r²=0.28, r²=0.39 respectively) because compared to vegetation, bare soil has a less characteristic spectral signature in the wavelength domain detected by the QuickBird sensor. Apart from monitoring erosion controlling factors, quantification of soil erosion by applying soil erosion risk models is done. The performance of the two established models Universal Soil Loss Equation (USLE) and Pan-European Soil Erosion Risk Assessment (PESERA) for their suitability to model erosion for mountain environments is tested. Cs-137 is used to verify the resulting erosion rates from USLE and PESERA. PESERA yields no correlation to measured Cs-137 long term erosion rates and shows lower sensitivity to FVC. Thus, USLE is used to model the entire study site. The LSU-derived FVC map is used to adapt the C factor of the USLE. Compared to the low erosion rates computed with the former available low resolution dataset (1:25000) the satellite supported USLE map shows “hotspots” of soil erosion of up to 16 t ha-1 a-1. In general, Cs-137 in combination with the USLE is a very suitable method to assess soil erosion for larger areas, as both give estimates on long-term soil erosion. Especially for inaccessible alpine areas, GIS and remote sensing proved to be powerful tools that can be used for repetitive measurements of erosion features and causal factors. In times of global change it is of crucial importance to account for temporal developments. However, the evaluation of the applied soil erosion risk models revealed that the implementation of temporal aspects, such as varying climate, land use and vegetation cover is still insufficient. Thus, the proposed validation strategies (spatial, temporal and via Cs-137) are essential. Further case studies in alpine regions are needed to test the methods elaborated for the Urseren Valley. However, the presented approaches are promising with respect to improve the monitoring and identification of soil erosion risk areas in alpine regions

Mapping Crop Cycles in China Using MODIS-EVI Time Series

As the Earth’s population continues to grow and demand for food increases, the need for improved and timely information related to the properties and dynamics of global agricultural systems is becoming increasingly important. Global land cover maps derived from satellite data provide indispensable information regarding the geographic distribution and areal extent of global croplands. However, land use information, such as cropping intensity (defined here as the number of cropping cycles per year), is not routinely available over large areas because mapping this information from remote sensing is challenging. In this study, we present a simple but efficient algorithm for automated mapping of cropping intensity based on data from NASA’s (NASA: The National Aeronautics and Space Administration) MODerate Resolution Imaging Spectroradiometer (MODIS). The proposed algorithm first applies an adaptive Savitzky-Golay filter to smooth Enhanced Vegetation Index (EVI) time series derived from MODIS surface reflectance data. It then uses an iterative moving-window methodology to identify cropping cycles from the smoothed EVI time series. Comparison of results from our algorithm with national survey data at both the provincial and prefectural level in China show that the algorithm provides estimates of gross sown area that agree well with inventory data. Accuracy assessment comparing visually interpreted time series with algorithm results for a random sample of agricultural areas in China indicates an overall accuracy of 91.0% for three classes defined based on the number of cycles observed in EVI time series. The algorithm therefore appears to provide a straightforward and efficient method for mapping cropping intensity from MODIS time series data

Bias adjustment of satellite-based precipitation estimation using artificial neural networks-cloud classification system over Saudi Arabia

Precipitation is a key input variable for hydrological and climate studies. Rain gauges can provide reliable precipitation measurements at a point of observations. However, the uncertainty of rain measurements increases when a rain gauge network is sparse. Satellite-based precipitation estimations SPEs appear to be an alternative source of measurements for regions with limited rain gauges. However, the systematic bias from satellite precipitation estimation should be estimated and adjusted. In this study, a method of removing the bias from the precipitation estimation from remotely sensed information using artificial neural networks-cloud classification system (PERSIANN-CCS) over a region where the rain gauge is sparse is investigated. The method consists of monthly empirical quantile mapping of gauge and satellite measurements over several climate zones as well as inverse-weighted distance for the interpolation of gauge measurements. Seven years (2010–2016) of daily precipitation estimation from PERSIANN-CCS was used to test and adjust the bias of estimation over Saudi Arabia. The first 6 years (2010–2015) are used for calibration, while 1 year (2016) is used for validation. The results show that the mean yearly bias is reduced by 90%, and the yearly root mean square error is reduced by 68% during the validation year. The experimental results confirm that the proposed method can effectively adjust the bias of satellite-based precipitation estimations

A multi-temporal phenology based classification approach for Crop Monitoring in Kenya

The SBAM (Satellite Based Agricultural Monitoring) project, funded by the Italian Space Agency aims at: developing a validated satellite imagery based method for estimating and updating the agricultural areas in the region of Central-Africa; implementing an automated process chain capable of providing periodical agricultural land cover maps of the area of interest and, possibly, an estimate of the crop yield. The project aims at filling the gap existing in the availability of high spatial resolution maps of the agricultural areas of Kenya. A high spatial resolution land cover map of Central-Eastern Africa including Kenya was compiled in the year 2000 in the framework of the Africover project using Landsat images acquired, mostly, in 1995. We investigated the use of phenological information in supporting the use of remotely sensed images for crop classification and monitoring based on Landsat 8 and, in the near future, Sentinel 2 imagery. Phenological information on crop condition was collected using time series of NDVI (Normalized Difference Vegetation Index) based on Landsat 8 images. Kenyan countryside is mainly characterized by a high number of fragmented small and medium size farmlands that dramatically increase the difficulty in classification; 30 m spatial resolution images are not enough for a proper classification of such areas. So, a pan-sharpening FIHS (Fast Intensity Hue Saturation) technique was implemented to increase image resolution from 30 m to 15 m. Ground test sites were selected, searching for agricultural vegetated areas from which phenological information was extracted. Therefore, the classification of agricultural areas is based on crop phenology, vegetation index behaviour retrieved from a time series of satellite images and on AEZ (Agro Ecological Zones) information made available by FAO (FAO, 1996) for the area of interest. This paper presents the results of the proposed classification procedure in comparison with land cover maps produced in the past years by other projects. The results refer to the Nakuru County and they were validated using field campaigns data. It showed a satisfactory overall accuracy of 92.66 % which is a significant improvement with respect to previous land cover maps

Urban imperviousness effects on summer surface temperatures nearby residential buildings in different urban zones of Parma

Rapid and unplanned urban growth is responsible for the continuous conversion of green or generally natural spaces into artificial surfaces. The high degree of imperviousness modifies the urban microclimate and no studies have quantified its influence on the surface temperature (ST) nearby residential building. This topic represents the aim of this study carried out during summer in different urban zones (densely urbanized or park/rural areas) of Parma (Northern Italy). Daytime and nighttime ASTER images, the local urban cartography and the Italian imperviousness databases were used. A reproducible/replicable framework was implemented named "Building Thermal Functional Area" (BTFA) useful to lead building-proxy thermal analyses by using remote sensing data. For each residential building (n = 8898), the BTFA was assessed and the correspondent ASTER-LST value (ST_BTFA) and the imperviousness density were calculated. Both daytime and nighttime ST_BTFA significantly (p < 0.001) increased when high levels of imperviousness density surrounded the residential buildings. These relationships were mostly consistent during daytime and in densely urbanized areas. ST_BTFA differences between urban and park/rural areas were higher during nighttime (above 1 °C) than daytime (about 0.5 °C). These results could help to identify "urban thermal Hot-Spots" that would benefit most from mitigation actions