Novel pattern recognition methods for classification and detection in remote sensing and power generation applications

Novel pattern recognition methods for classification and detection in remote sensing and power generation application

Advances in remote sensing applications for urban sustainability

Abstract: It is essential to monitor urban evolution at spatial and temporal scales to improve our understanding of the changes in cities and their impact on natural resources and environmental systems. Various aspects of remote sensing are routinely used to detect and map features and changes on land and sea surfaces, and in the atmosphere that affect urban sustainability. We provide a critical and comprehensive review of the characteristics of remote sensing systems, and in particular the trade-offs between various system parameters, as well as their use in two key research areas: (a) issues resulting from the expansion of urban environments, and (b) sustainable urban development. The analysis identifies three key trends in the existing literature: (a) the integration of heterogeneous remote sensing data, primarily for investigating or modelling urban environments as a complex system, (b) the development of new algorithms for effective extraction of urban features, and (c) the improvement in the accuracy of traditional spectral-based classification algorithms for addressing the spectral heterogeneity within urban areas. Growing interests in renewable energy have also resulted in the increased use of remote sensing—for planning, operation, and maintenance of energy infrastructures, in particular the ones with spatial variability, such as solar, wind, and geothermal energy. The proliferation of sustainability thinking in all facets of urban development and management also acts as a catalyst for the increased use of, and advances in, remote sensing for urban applications

Urban air pollution modelling with machine learning using fixed and mobile sensors

Detailed air quality (AQ) information is crucial for sustainable urban management, and many regions in the world have built static AQ monitoring networks to provide AQ information. However, they can only monitor the region-level AQ conditions or sparse point-based air pollutant measurements, but cannot capture the urban dynamics with high-resolution spatio-temporal variations over the region. Without pollution details, citizens will not be able to make fully informed decisions when choosing their everyday outdoor routes or activities, and policy-makers can only make macroscopic regulating decisions on controlling pollution triggering factors and emission sources. An increasing research effort has been paid on mobile and ubiquitous sampling campaigns as they are deemed the more economically and operationally feasible methods to collect urban AQ data with high spatio-temporal resolution. The current research proposes a Machine Learning based AQ Inference (Deep AQ) framework from data-driven perspective, consisting of data pre-processing, feature extraction and transformation, and pixelwise (grid-level) AQ inference. The Deep AQ framework is adaptable to integrate AQ measurements from the fixed monitoring sites (temporally dense but spatially sparse), and mobile low-cost sensors (temporally sparse but spatially dense). While instantaneous pollutant concentration varies in the micro-environment, this research samples representative values in each grid-cell-unit and achieves AQ inference at 1 km \times 1 km pixelwise scale. This research explores the predictive power of the Deep AQ framework based on samples from only 40 fixed monitoring sites in Chengdu, China (4,900 {\mathrm{km}}^\mathrm{2}, 26 April - 12 June 2019) and collaborative sampling from 28 fixed monitoring sites and 15 low-cost sensors equipped with taxis deployed in Beijing, China (3,025 {\mathrm{km}}^\mathrm{2}, 19 June - 16 July 2018). The proposed Deep AQ framework is capable of producing high-resolution (1 km \times 1 km, hourly) pixelwise AQ inference based on multi-source AQ samples (fixed or mobile) and urban features (land use, population, traffic, and meteorological information, etc.). This research has achieved high-resolution (1 km \times 1 km, hourly) AQ inference (Chengdu: less than 1% spatio-temporal coverage; Beijing: less than 5% spatio-temporal coverage) with reasonable and satisfactory accuracy by the proposed methods in urban cases (Chengdu: SMAPE \mathrm{<} 20%; Beijing: SMAPE \mathrm{<} 15%). Detailed outcomes and main conclusions are provided in this thesis on the aspects of fixed and mobile sensing, spatio-temporal coverage and density, and the relative importance of urban features. Outcomes from this research facilitate to provide a scientific and detailed health impact assessment framework for exposure analysis and inform policy-makers with data driven evidence for sustainable urban management.Open Acces

Multiscale Imaging of Evapotranspiration

Evapotranspiration (ET; evaporation + transpiration) is central to a wide range of biological, chemical, and physical processes in the Earth system. Accurate remote sensing of ET is challenging due to the interrelated and generally scale dependent nature of the physical factors which contribute to the process. The evaporation of water from porous media like sands and soils is an important subset of the complete ET problem. Chapter 1 presents a laboratory investigation into this question, examining the effects of grain size and composition on the evolution of drying sands. The effects of composition are found to be 2-5x greater than the effects of grain size, indicating that differences in heating caused by differences in reflectance may dominate hydrologic differences caused by grain size variation. In order to relate the results of Chapter 1 to the satellite image archive, however, the question of information loss between hyperspectral (measurements at 100s of wavelength intervals) laboratory measurements and multispectral (≤ 12 wavelength intervals) satellite images must be addressed. Chapter 2 focuses on this question as applied to substrate materials such as sediment, soil, rock, and non-photosynthetic vegetation. The results indicate that the continuum that is resolved by multispectral sensors is sufficient to resolve the gradient between sand-rich and clay-rich soils, and that this gradient is also a dominant feature in hyperspectral mixing spaces where the actual absorptions can be resolved. Multispectral measurements can be converted to biogeophysically relevant quantities using spectral mixture analysis (SMA). However, retrospective multitemporal analysis first requires cross-sensor calibration of the mixture model. Chapter 3 presents this calibration, allowing multispectral image data to be used interchangeably throughout the Landsat 4-8 archive. In addition, a theoretical explanation is advanced for the observed superior scaling properties of SMA-derived fraction images over spectral indices. The physical quantities estimated by the spectral mixture model are then compared to simultaneously imaged surface temperature, as well as to the derived parameters of ET Fraction and Moisture Availability. SMA-derived vegetation abundance is found to produce substantially more informative ET maps, and SMA-derived substrate fraction is found to yield a surprisingly strong linear relationship with surface temperature. These results provide context for agricultural applications. Chapter 5 investigates the question of mapping and monitoring rice agricultural using optical and thermal satellite image time series. Thermal image time series are found to produce more accurate maps of rice presence/absence, but optical image time series are found to produce more accurate maps of rice crop timing. Chapter 6 takes a more global approach, investigating the spatial structure of agricultural networks for a diverse set of landscapes. Surprisingly consistent scaling relations are found. These relations are assessed in the context of a network-based approach to land cover analysis, with potential implications for the scale dependence of ET estimates. In sum, this thesis present a novel approach to improving ET estimation based on a synthesis of complementary laboratory measurements, satellite image analysis, and field observations. Alone, each of these independent sources of information provides novel insights. Viewed together, these insights form the basis of a more accurate and complete geophysical understanding of the ET phenomenon

Rich probabilistic models for semantic labeling

Das Ziel dieser Monographie ist es die Methoden und Anwendungen des semantischen Labelings zu erforschen. Unsere Beiträge zu diesem sich rasch entwickelten Thema sind bestimmte Aspekte der Modellierung und der Inferenz in probabilistischen Modellen und ihre Anwendungen in den interdisziplinären Bereichen der Computer Vision sowie medizinischer Bildverarbeitung und Fernerkundung

Optimized and automated estimation of vegetation properties: Opportunities for Sentinel-2

La Biosfera es uno de los principales sistemas que conforman la Tierra. Su estudio permite comprender la relación entre la vegetación y el ciclo del carbono y cómo éste puede ser afectado por los cambios en los niveles de CO2 y los usos de suelo. Para el estudio de estas dinámicas a escala global y local, han sido desarrollados diversos modelos que son representaciones de la realidad en una escala y complejidad más simple. Parte de las variables de entrada de estos modelos son obtenidas mediante medidas de teledetección gracias al Global Climate Observing System (GCOS), que ha determinado un conjunto de 50 variables climáticas esenciales que contribuyen a los estudios de cambio climático que lidera la Convención Marco de las Naciones Unidas y el Panel Intergubernamental del Cambio Climático. En esta lista está incluido el índice de área foliar (LAI).El contenido de clorofila en hoja (LCC) es otro parámetro biofísico clave para los estudios de biosfera. El estudio de las propiedades de la vegetación desde el espacio requiere: (1) Métodos óptimos para el procesamiento y la estimación de la información y, (2) Disponibilidad de datos espaciales. Los métodos de procesado y estimación de parámetros biofísicos son necesarios ya que el sensor solo mide los flujos de energía reflejados por las cubiertas vegetales distribuidos espacialmente. Por ello, han sido desarrollados diversos modelos, que van desde complejos modelos con base física hasta modelos estadísticos o la combinación de los anteriores. En el desarrollo de esta tesis se ha reunido una amplia variedad de ellos. la Agencia Espacial Europea (ESA) ha desarrollado la misión Sentinel-2 que está especialmente diseñada para el monitoreo de las propiedades de la vegetación, con las capacidades operativas que cumplen los requerimientos espectrales, espaciales y temporales. Los datos que proporcionará la misión Sentinel-2 permitirán garantizar la continuidad de las misiones Spot y Landsat, aportando un tiempo de revisita menor, mejora de la amplitud de barrido, mayor resolución espectral y una mejor calibración y calidad de imagen. Para el procesamiento y la extracción de información de parámetros biofísicos han sido desarrollados diferentes paquetes computacionales por diversos grupos de investigación. Esta tesis pretende suministrar un conjunto de herramientas computacionales, dinámicas y flexibles que permitan automatizar y evaluar el potencial de los diferentes métodos que en la actualidad han sido publicados y están disponibles para su libre uso. Presenta los resultados científicos de la evaluación del impacto de diferentes parámetros de ajuste en los principales métodos de estimación de parámetros biofísicos, centrándonos en datos simulados del satélite Sentinel-2, previsto para ser lanzado en 2015. Para dicho trabajo se han reunido los principales métodos de estimación que van desde las simples relaciones espectrales hasta los complejos modelos de transferencia radiativa (RTM). Para esto, hemos implementado un conjunto de herramientas informáticas que permiten el diseño y evaluación de diversas estrategias de regularización como son la normalización de los datos, la sinergia entre datos simulados por RTM y datos de campañas de campo o de laboratorio, adición de modelos de ruido a los datos simulados y un amplio conjunto de métodos de regresión tanto paramétricos como no paramétricos. Este trabajo constituye la continuación de mi trabajo Final del Máster de Teledetección, donde he desarrolló una herramienta informática llamado ARTMO (por sus siglas en inglés Automated Radiative Transfer Models Operator) que reunió los RTM de la familia Prospect, SAIL y FLIGTH. Se implementó el método de estimación por tablas de búsqueda (LUT). Esta tesis presenta la evolución de ARTMO que pasa de ser una herramienta informática rígida que no permitía de manera sencilla la ampliación de sus funciones, a un flexible marco de desarrollo (framework software), donde ARTMO se convierte en una plataforma de soporte de diversos módulos implementados de manera independiente. Esta nueva versión de ARTMO permite a cualquier grupo de investigación desarrollar y compartir nuevas funciones, algoritmos y métodos de estimación de parámetros biofísicos. Además, hemos establecido las bases para la creación de una red tanto de usuarios como de desarrolladores en torno al estudio de las propiedades de la vegetación, sirviendo de apoyo para el estudio de nuevos algoritmos de estimación, diseño de nuevos sensores ópticos o para su uso en el campo de la educación.The biosphere is one of the main components of the Earth’s system since it regulates exchanges of energy and mass fluxes at the soil, vegetation and atmosphere level. To know the links between vegetation and the terrestrial energy, water and carbon cycles, and how these might change due to eco-physiological responses to elevated CO2 and changes in land use is of vital importance for the study of the biosphere. To study these exchanges, several kinds of models (scale and target) have been developed. In view of these models, the Global Climate Observing System (GCOS) aims to provide comprehensive information on the total climate system, involving a multidisciplinary range of physical, chemical and biological properties, and atmospheric, oceanic, hydrological, cryospheric and terrestrial processes. Fifty GCOS Essential Climate Variables (ECVs) are required to support the work of the United Nations Framework Convention on Climate Change (UNFCCC) and the Intergovernmental Panel on Climate Change. In support of these terrestrial models, but also in support of monitoring local-to-global vegetation dynamics, this Thesis focuses on improved estimation of vegetation properties from optical RS data, and more specifically leaf area index (LAI) and leaf chlorophyll content (LCC). Although LCC is currently not considered as an ECV due to the lack of a globally applicable retrieval algorithm, it is a key variable in vegetation studies. Monitoring the distribution and changes of LAI and LCC is important for assessing growth and vigour of vegetation on the planet. The quantification of these essential vegetation properties are fundamentally important in land-atmosphere processes and parametrization in climate models. LAI variable represents the amount of leaf material in ecosystems and controls the links between biosphere and atmosphere through various processes such as photosynthesis, respiration, transpiration and rain interception. LCC provides important information about the physiological status of plants and photosynthetic activity, therefore is related to the nitrogen content, water stress and yield forecasting The European Space Agency (ESA)’s forthcoming Sentinel-2 mission is particularly tailored to the monitoring vegetation properties mapping, with operational monitoring capabilities that goes beyond any existing operational mission. A pair of Sentinel-2 polar-orbiting satellites will provide systematic global acquisitions of high-resolution multispectral imagery (10-60 m) with a high revisit frequency on a free and open data policy basis. With the pair of satellites in operation it has a revisit time of five days at the equator (under cloud-free conditions) and 2–3 days at mid-latitudes. Sentinel-2 images will be used to derive the highly prioritized time series of ECVs such as LAI. Sentinel-2 images will also be used provide various experimental variables, e.g. biochemical variables such as LCC. This Thesis is dedicated to tackle the stated recommendation and turn it into consolidated guidelines. The undertaken road map was to work on both generating scientific outputs, as well on developing software to automate the retrieval routines. All essential tools to deliver a prototype retrieval approach that could be embedded into an operational Sentinel-2 processing scheme have been prepared into a scientific software package called ARTMO (Automated Radiative Transfer Models Operator). Physically-based approaches but also latest statisticallybased methods have been implemented into the software package and systematically evaluated. The retrieval methods have been applied to the estimation of LAI and LCC from simulated Sentinel-2 data, but the majority of investigated methods can essentially be applied to derive any detectable vegetation biochemical or biophysical variable. The fundamentals of ARTMO has been laid during J.P. Rivera’s MSc thesis project and has been further developed during the course of my PhD Thesis. The toolbox is built on a suite of radiative transfer models and image processing modules in a modular graphical user interface (GUI) environment. ARTMO has been mainly developed and tested for processing (simulated) Sentinel-2 data in a semiautomatic way, but in principle data from any optical sensor can be processed

Integration of Satellite Data, Physically-based Model, and Deep Neural Networks for Historical Terrestrial Water Storage Reconstruction

Terrestrial water storage (TWS) is an essential part of the global water cycle. Long-term monitoring of observed and modeled TWS is fundamental to analyze droughts, floods, and other meteorological extreme events caused by the effects of climate change on the hydrological cycle. Over the past several decades, hydrologists have been applying physically-based global hydrological model (GHM) and land surface model (LSM) to simulate TWS and the water components (e.g., groundwater storage) composing TWS. However, the reliability of these physically-based models is often affected by uncertainties in climatic forcing data, model parameters, model structure, and mechanisms for physical process representations. Launched in March 2002, the Gravity Recovery and Climate Experiment (GRACE) satellite mission exclusively applies remote sensing techniques to measure the variations in TWS on a global scale. The mission length of GRACE, however, is too short to meet the requirements for analyzing long-term TWS. Therefore, lots of effort has been devoted to the reconstruction of GRACE-like TWS data during the pre-GRACE era. Data-driven methods, such as multilinear regression and machine learning, exhibit a great potential to improve TWS assessments by integrating GRACE observations and physically-based simulations. The advances in artificial intelligence enable adaptive learning of correlations between variables in complex spatiotemporal systems. As for GRACE reconstruction, the applicability of various deep learning techniques has not been well studied previously. Thus, in this study, three deep learning-based models are developed based on the LSM-simulated TWS, to reconstruct the historical TWS in the Canadian landmass from 1979 to 2002. The performance of the models is evaluated against the GRACE-observed TWS anomalies from 2002 to 2004, and 2014 to 2016. The trained models achieve a mean correlation coefficient of 0.96, with a mean RMSE of 53 mm. The results show that the LSM-based deep learning models significantly improve the match between original LSM simulations and GRACE observations

Climate, land use and vegetation trends: Implication of land use change and climate change on northwestern drylands of Ethiopia

Land use / land cover (LULC) change assessment is getting more consideration by global environmental change studies as land use change is exposing dryland environments for transitions and higher rates of resource depletion. The semiarid regions of northwestern Ethiopia are not different as land use transition is the major problem of the region. However, there is no satisfactory study to quantify the change process of the region up to now. Hence, spatiotemporal change analysis is vital for understanding and identification of major threats and solicit solutions for sustainable management of the ecosystem. LULC change studies focus on understanding the patterns, processes and dynamics of land use transitions and driving forces of change. The change processes in dryland ecosystems can be either seasonal, gradual or abrupt changes of random or systematic change processes that result in a pattern or permanent transition in land use. Identification of these processes of change and their type supports adoption of monitoring options and indicate possible measures to be taken to safeguard this dynamic ecosystem. This study examines the spatiotemporal patterns of LULC change, temporal trends in climate variables and the insights of the communities on change patterns of ecosystems. Landsat imagery, MODIS NDVI, CRU temperature, TAMSAT rainfall and socio-ecological field data were used in order to identify change processes. LULC transformation was monitored using support vector machine (SVM) algorithm. A cross-tabulation matrix assessment was implemented in order to assess the total change of land use categories based on net change and swap change. In addition, the pattern of change was identified based on expected gain and loss under a random process of gain and loss, respectively. Breaks For Additive Seasonal and Trend (BFAST) analysis was employed for determining the time, direction and magnitude of seasonal, abrupt and trend changes within the time series datasets. In addition, Man Kendall test statistic and Sen’s slope estimator were used for assessing long term trends on detrended time series data components. Distributed lag (DL) model was also adopted in order to determine the time lag response of vegetation to the current and past rainfall distribution. Over the study period of 1972- 2014, there is a significant change in LULC as evidenced by a significant increase in size of cropland of about 53% and a net loss of over 61% of woodland area. The period 2000-2014 has shown a sharp increase of cropland and a sharp decline of woodland areas. Proximate causes include agricultural expansion and excessive wood harvesting; and underlying causes of demographic factor, economic factors and policy contributed the most to an overuse of existing natural resources. In both the observed and expected proportion of random process of change and of systematic changes, woodland has shown the highest loss compared to other land use types. The observed transition and expected transition under random process of gain of woodland to cropland is 1.7%, implies that cropland systematically gains to replace woodland. The comparison of the difference between observed and expected loss under random process of loss also showed that when woodland loses cropland systematically replaces it. The assessment of magnitude and time of breakpoints on climate data and NDVI showed different results. Accordingly, NDVI analysis demonstrated the existence of breakpoints that are statistically significant on the seasonal and long term trends. There is a positive trend, but no breakpoints on the long term precipitation data during the study period. The maximum temperature also showed a positive trend with two breakpoints which are not statistically significant. On the other hand, there is no seasonal and trend breakpoints in minimum temperature, though there is an overall positive trend along the study period. The Man-Kendall test statistic for long term average Tmin and Tmax showed significant variation where as there is no significant trend within the long term rainfall distribution. The lag regression between NDVI and precipitation indicated a lag of up to forty days. This proves that the vegetation growth in this area is not primarily determined by the current precipitation rather with the previous forty days rainfall. The combined analysis showed declining vegetation productivity and a loss of vegetation cover that contributed for an easy movement of dust clouds during the dry period of the year. This affects the land condition of the region, resulting in long term degradation of the environmen

Hyperspectral Imaging for Fine to Medium Scale Applications in Environmental Sciences

The aim of the Special Issue “Hyperspectral Imaging for Fine to Medium Scale Applications in Environmental Sciences” was to present a selection of innovative studies using hyperspectral imaging (HSI) in different thematic fields. This intention reflects the technical developments in the last three decades, which have brought the capacity of HSI to provide spectrally, spatially and temporally detailed data, favoured by e.g., hyperspectral snapshot technologies, miniaturized hyperspectral sensors and hyperspectral microscopy imaging. The present book comprises a suite of papers in various fields of environmental sciences—geology/mineral exploration, digital soil mapping, mapping and characterization of vegetation, and sensing of water bodies (including under-ice and underwater applications). In addition, there are two rather methodically/technically-oriented contributions dealing with the optimized processing of UAV data and on the design and test of a multi-channel optical receiver for ground-based applications. All in all, this compilation documents that HSI is a multi-faceted research topic and will remain so in the future