The future of Earth observation in hydrology

In just the past 5 years, the field of Earth observation has progressed beyond the offerings of conventional space-agency-based platforms to include a plethora of sensing opportunities afforded by CubeSats, unmanned aerial vehicles (UAVs), and smartphone technologies that are being embraced by both for-profit companies and individual researchers. Over the previous decades, space agency efforts have brought forth well-known and immensely useful satellites such as the Landsat series and the Gravity Research and Climate Experiment (GRACE) system, with costs typically of the order of 1 billion dollars per satellite and with concept-to-launch timelines of the order of 2 decades (for new missions). More recently, the proliferation of smart-phones has helped to miniaturize sensors and energy requirements, facilitating advances in the use of CubeSats that can be launched by the dozens, while providing ultra-high (3-5 m) resolution sensing of the Earth on a daily basis. Start-up companies that did not exist a decade ago now operate more satellites in orbit than any space agency, and at costs that are a mere fraction of traditional satellite missions. With these advances come new space-borne measurements, such as real-time high-definition video for tracking air pollution, storm-cell development, flood propagation, precipitation monitoring, or even for constructing digital surfaces using structure-from-motion techniques. Closer to the surface, measurements from small unmanned drones and tethered balloons have mapped snow depths, floods, and estimated evaporation at sub-metre resolutions, pushing back on spatio-temporal constraints and delivering new process insights. At ground level, precipitation has been measured using signal attenuation between antennae mounted on cell phone towers, while the proliferation of mobile devices has enabled citizen scientists to catalogue photos of environmental conditions, estimate daily average temperatures from battery state, and sense other hydrologically important variables such as channel depths using commercially available wireless devices. Global internet access is being pursued via high-altitude balloons, solar planes, and hundreds of planned satellite launches, providing a means to exploit the "internet of things" as an entirely new measurement domain. Such global access will enable real-time collection of data from billions of smartphones or from remote research platforms. This future will produce petabytes of data that can only be accessed via cloud storage and will require new analytical approaches to interpret. The extent to which today's hydrologic models can usefully ingest such massive data volumes is unclear. Nor is it clear whether this deluge of data will be usefully exploited, either because the measurements are superfluous, inconsistent, not accurate enough, or simply because we lack the capacity to process and analyse them. What is apparent is that the tools and techniques afforded by this array of novel and game-changing sensing platforms present our community with a unique opportunity to develop new insights that advance fundamental aspects of the hydrological sciences. To accomplish this will require more than just an application of the technology: in some cases, it will demand a radical rethink on how we utilize and exploit these new observing systems

JRC Experience on the Development of Drought Information Systems

From the definition of drought to its monitoring and assessment, this report summarizes the main steps towards an integrated drought information system. Europe, Africa and Latin America are examples, based on the experience of the JRC, that illustrate the challenges for establishing continental drought observatory initiatives. The document is structured in the following way: first an introduction explains what drought is and gives some examples of its impact in society; secondly the framework for establishing a drought monitoring system is described giving examples on the European Drought Observatory and on on-going activities in Africa and Latin America; thirdly the fundamental data and information for measuring drought is described; finally the setting up of an Integrated Drought Information System is discussed and two recent case studies, on Europe and on the Horn of Africa, are presented to illustrate the concept.JRC.H.7-Climate Risk Managemen

Coastal and Inland Aquatic Data Products for the Hyperspectral Infrared Imager (HyspIRI)

The HyspIRI Aquatic Studies Group (HASG) has developed a conceptual list of data products for the HyspIRI mission to support aquatic remote sensing of coastal and inland waters. These data products were based on mission capabilities, characteristics, and expected performance. The topic of coastal and inland water remote sensing is very broad. Thus, this report focuses on aquatic data products to keep the scope of this document manageable. The HyspIRI mission requirements already include the global production of surface reflectance and temperature. Atmospheric correction and surface temperature algorithms, which are critical to aquatic remote sensing, are covered in other mission documents. Hence, these algorithms and their products were not evaluated in this report. In addition, terrestrial products (e.g., land use land cover, dune vegetation, and beach replenishment) were not considered. It is recognized that coastal studies are inherently interdisciplinary across aquatic and terrestrial disciplines. However, products supporting the latter are expected to already be evaluated by other components of the mission. The coastal and inland water data products that were identified by the HASG, covered six major environmental and ecological areas for scientific research and applications: wetlands, shoreline processes, the water surface, the water column, bathymetry and benthic cover types. Accordingly, each candidate product was evaluated for feasibility based on the HyspIRI mission characteristics and whether it was unique and relevant to the HyspIRI science objectives

Exploring Neural Networks For Predicting Sentinel-C Backscatter Between Image Acquisitions

Measuring moisture dynamics in soil and overlying vegetation is key to understanding ecosystem and agricultural dynamics in many contexts. For many applications, moisture information is demanded at high temporal frequency over large areas. Sentinel-1 C-band radar backscatter satellite images provide a repeating sequence of fine-resolution (10-m) observations that can be used to infer soil and vegetation moisture, but the 12-day interval between satellite observations is infrequent relative to the sensed moisture dynamics. Machine learning approaches have been used to predict soil moisture at higher spatial resolutions than the original satellite images, but little effort has been made to increase the temporal resolution of the images. This study extends machine learning approaches to infer fine-resolution backscatter between observations relying on auxiliary data observations, including elevation and daily gridded weather. Several variations of Multi-modal Fully Convolutional Neural Network architectures, problem setup, and training methods are explored for a predominantly rural area in southwest Oklahoma near the transition between humid subtropical and semiarid climates. The training area lies in the overlap zone for adjacent Sentinel-1 satellite tracks, allowing for training with several different temporal offsets. We find that the UNET architecture produced the most accurate and robust estimated backscatter patterns, with superior prediction compared to a prior observation baseline in nearly all cases investigated when geography was included in the training data. This superior performance also generalized to nearby areas when training data for a given geography was not available, where 86% of predictions performed superior compared to a prior observation baseline

Estimation of water resources on continental surfaces by multi-sensor microwave remote sensing

L'estimació dels recursos hídrics de les superfícies continentals a escala regional i global és fonamental per a una bona gestió dels recursos hídrics. Aquesta estimació cobreix una àmplia gamma de temes i camps, incloent-hi la caracterització dels sòls i dels recursos hídrics a l’escala de la conca, la modelització hidrològica i la predicció i la cartografia d'inundacions. En aquest context, la caracterització dels estats de la superfície continental, per a obtenir millors paràmetres d’entrada als models hidrològics, és essencial per millorar la precisió en la simulació de cabals, sequeres i inundacions. L’estimació del contingut d’aigua en el sistema, incloses les diferents masses d’aigua i l’aigua lliure en el sòl, és especialment necessària per a una descripció precisa dels processos hidrològics i, en general, del cicle de l’aigua a les superfícies continentals. Per caracteritzar millor els processos hidrològics, les intervencions antropogèniques no es poden negligir. L'home influeix en el cicle de l'aigua, principalment mitjançant el reg i la construcció de preses, fet que s’ha de quantificar correctament. L’objectiu de la tesi és la millora de l’estimació remota dels recursos hídrics, incloent-hi la quantificació dels factors antròpics, mitjançant l’ús de diversos sensors llançats recentment, aprofitant recents desenvolupaments en la tecnologia de teledetecció. Amb l'arribada de les constel·lacions Sentinel (Sentinel-1, 2, 3), disposem de millors eines per estimar els recursos hídrics, incloent-hi els impactes humans, amb una major precisió i cobertura. Aquest treball de tesi consta principalment de dues línies de recerca on s’estimen les intervencions humanes en el cicle hidrològic: la cartografia del reg (com a aplicació en humitat del sòl), i el forçament d’embassaments en simulacions hidrològiques (com a aplicació de l’altimetria). En la primera linia s’estima la humitat del sòl a partir de l’anàlisi estadística de les dades SAR de Sentinel-1. Es desenvolupen dues metodologies per obtenir la humitat del sòl amb una resolució espacial de 100 m basant-se en la interpretació de les dades de Sentinel-1 obtingudes amb la polarització VV (vertical-vertical), que es combina amb dades òptiques Sentinel-2 per a l'anàlisi dels efectes de la vegetació. Com aplicació de la humitat del sòl, es cartografia el reg en diverses condicions meteorològiques, i amb una alta resolució espacial i temporal. Es proposa una metodologia per a la cartografia del reg mitjançant dades SAR obtingudes en polaritzacions VV (vertical-vertical) i VH (vertical-horitzontal). A partir de la sèrie temporal Sentinel-1, s’analitzen diferents estadístiques i mètriques, incloent-hi el valor mitjà, la variància del senyal, la longitud de la correlació i la dimensió fractal, a partir dels quals es classifiquen els arbres irrigats, els cultius irrigats i els cultius no irrigats. En la segona línia, s’estima el nivell dels embassaments a partir de les dades d’altimetria de Sentinel-3, amb l’altímetre SAR (SRAL), basant-se en diferents algorismes per millorar la precisió. Aquest estudi presenta tres algorismes especialitzats o retrackers destinats a obtenir el nivell de la superfície dels cossos d’aigua estudiats, minimitzant la contaminació de les formes d’ona degut al sòl que els envolta. Es compara el rendiment del mètode proposat de selecció de la porció d’ona amb tres retrackers, és a dir, un retracker de llindar, el retracker del centre de gravetat (OCOG) i un retracker de base física de dos passos. S’obtenen sèries temporals del nivell de la làmina d’aigua d’embassaments situats a la conca del riu Ebre (Espanya). Com aplicació, les sèries de nivell dels embassaments obtingudes s’utilitzen per a forçar els embassaments en simulacions hidrològiques.La estimación de los recursos hídricos de las superficies continentales a escala regional y global es fundamental para una buena gestión de los recursos hídricos. Esta estimación cubre una amplia gama de temas y campos, incluyendo la caracterización de los suelos y de los recursos hídricos a escala de cuenca, la modelización hidrológica y la predicción y la cartografía de inundaciones. En este contexto, la caracterización de los estados de la superficie continental, para obtener mejores parámetros de entrada para los modelos hidrológicos, es esencial para mejorar la precisión en la simulación de caudales, sequías e inundaciones. La estimación del contenido de agua en el sistema, incluidas las diferentes masas de agua y el agua libre en el suelo, es especialmente necesaria para una descripción precisa de los procesos hidrológicos y, en general, del ciclo del agua en las superficies continentales. Una caracterización precisa de los procesos hidrológicos requiere no descuidar las intervenciones humanas. El hombre influye en el ciclo del agua, principalmente mediante el riego y la construcción de embalses, lo que se debe cuantificar correctamente. El objetivo de la tesis es la mejora de la estimación remota de los recursos hídricos, incluyendo la cuantificación de los factores humanos, mediante el uso de varios sensores lanzados recientemente, aprovechando recientes desarrollos en la tecnología de teledetección. Con la llegada de las constelaciones Sentinel (Sentinel-1, 2, 3), disponemos de mejores herramientas para estimar los recursos hídricos, incluyendo los impactos humanos, con una mayor precisión y cobertura. Este trabajo de tesis consta principalmente en dos ejes de investigación donde se estiman las intervenciones humanas en el ciclo hidrológico: la cartografía del riego (como aplicación en humedad del suelo), y el forzamiento de embalses en simulaciones hidrológicas (como aplicación de la altimetría). En relación al primer eje, se estima la humedad del suelo a partir del análisis estadístico de los datos SAR de Sentinel-1. Se desarrollan dos metodologías para obtener la humedad del suelo con una resolución espacial de 100 m basándose en la interpretación de los datos de Sentinel-1 obtenidas con la polarización VV (vertical-vertical), que se combina con datos ópticas Sentinel-2 para el análisis de los efectos de la vegetación. Como aplicación de la humedad del suelo, se cartografía el riego en diversas condiciones meteorológicas, y con una alta resolución espacial y temporal. Se propone una metodología para la cartografía del riego mediante datos SAR obtenidos en polarizaciones VV (vertical-vertical) y VH (vertical-horizontal). A partir de la serie temporal Sentinel-1, se analizan diferentes estadísticas y métricas, incluyendo el valor medio, la varianza de la señal, la longitud de la correlación y la dimensión fractal, a partir de los cuales se clasifican los árboles irrigados, los cultivos irrigados y los cultivos no irrigados. En el segundo eje, se estima el nivel de los embalses a partir de los datos de altimetría de Sentinel-3, con el altímetro SAR (SRAL), basándose en diferentes algoritmos para mejorar la precisión. Este estudio presenta tres algoritmos especializados o retrackers destinados a obtener el nivel de la superficie de los cuerpos de agua estudiados, minimizando la contaminación de las formas de onda debido al suelo que los rodea. Se compara el rendimiento del método propuesto de selección de la porción de onda con tres retrackers, es decir, un retracker de umbral, el retracker del centro de gravedad (OCOG) y un retracker de base física de dos pasos. Se obtienen series temporales del nivel de la lámina de agua de embalses situados en la cuenca del río Ebro (España). Como aplicación, las series de nivel de los embalses obtenidas se utilizan para forzar los embalses en simulaciones hidrológicas.The estimation of the water resources of the continental surfaces at a regional and global scale is fundamental for good water resources management. This estimation covers a wide range of topics and fields, including the characterisation of soils and water resources at the basin scale, hydrological modelling and flood prediction and mapping. In this context, the characterisation of the states of the continental surface, to obtain better input parameters for hydrological models, is essential to improve the precision in the simulation of flows, droughts, and floods. The estimation of the water content in the system, including the different water bodies and the free water in the soil, is especially necessary for a precise description of the hydrological processes and, in general, of the water cycle on the continental surfaces. To better characterise hydrological processes, human interventions cannot be neglected. Humans influence the water cycle, mainly through irrigation and the construction of reservoirs, which must be correctly quantified. The objective of the thesis is the improvement of the remote estimation of water resources, including the quantification of human factors, using several sensors recently launched, taking advantage of recent developments in remote sensing technology. With the arrival of the Sentinel constellations (Sentinel-1, 2, 3), we have better tools to estimate water resources, including human impacts, with greater precision and coverage. This thesis consists mainly of two parts where human interventions in the water cycle are considered: irrigation cartography (as an application of soil moisture), and the forcing of reservoirs in hydrological simulations (as an application of altimetry). Firstly, soil moisture is estimated from the statistical analysis of Sentinel-1 SAR data. Two methodologies are developed to obtain soil moisture with a spatial resolution of 100 m based on the interpretation of Sentinel-1 data collected with the VV polarization (vertical-vertical), which is combined with optical data of Sentinel-2 for the analysis of the effects of vegetation. Secondly, irrigation is mapped under various meteorological conditions, including high spatial and temporal resolution. A methodology for irrigation mapping is proposed using SAR data obtained in VV (vertical-vertical) and VH (vertical-horizontal) polarizations. With Sentinel-1 time series, different statistics and metrics are analysed, including the mean value, the variance of the signal, the correlation length and the fractal dimension, based on which the classification of irrigated trees, irrigated crops, and non-irrigated crops are derived. Finally, the level of the reservoirs is estimated from the Sentinel-3 altimetry data, with the SAR altimeter (SRAL), based on different algorithms to improve the accuracy. This study presents three specialised algorithms or retrackers designed to obtain the level of the surface of the studied inland bodies of water, minimising the contamination of the waveforms due to the surrounding soil. The performance of the selection method of the proposed wave portion is compared with three retrackers, that is, the centre of gravity retracker (OCOG) and the two-step physical-based retracker. Temporal series of the water level of reservoirs located in the basin of the Ebro River (Spain) are obtained. As an application, the level series of the reservoirs obtained are used to force the reservoirs in hydrological simulations.L'estimation et le suivi des ressources en eau des surfaces continentales aux niveaux régional et global est essentielle pour la gestion du bilan hydrique, particulièrement dans le contexte des changements climatiques et anthropiques. Ils couvrent un large éventail de thèmes et de domaines, incluant la caractérisation des ressources en eau à l'échelle du bassin, la modélisation hydrologique ainsi que la prévision et la cartographie des inondations. Dans ce contexte, la caractérisation des états de surface, en tant que paramètres d’entrée dans les modèles hydrologiques, est essentielle pour obtenir une meilleure précision de la simulation, qui est liée à la précision prévisionnelle des débits des cours d’eau et le suivi des sécheresses et des inondations. L'estimation de la teneur en eau des surfaces continentales, incluant l’état hydrique du sol et les niveaux des surfaces couvertes d’eau, est particulièrement nécessaire pour une description précise des processus hydrologiques et plus généralement du cycle de l'eau sur les surfaces continentales. Afin de mieux comprendre les processus hydrologiques, l'influence humaine (l’effet anthropique) sur le cycle de l'eau nécessite une évaluation fine. Elle est particulièrement liée à la gestion de l’irrigation et la construction de barrages. L'objectif de la thèse était d'améliorer l'estimation des ressources en eau et une meilleure caractérisation des interventions anthropiques à travers l'utilisation de nouveaux capteurs satellitaires multi-configurations du programme européen Copernicus. Avec le développement de la technologie de télédétection spatiale, et plus particulièrement avec l’arrivée des constellations Sentinel (Sentinel-1, 2, 3) à haute résolution spatiale et temporelle, il existe un meilleur outil pour estimer les états des surfaces continentales. Ce travail de thèse comprend principalement deux priorités liées à des interventions humaines dans le cycle hydrologique:la cartographie de l'irrigation en tant que action humaine liée directement à l'humidité du sol et le forçage des barrages dans un modèle de simulation de rivière en tant qu'application liée à l’estimation du niveau de l'eau libre. Un premier axe de recherche a été basé sur une analyse statistique des données SAR Sentinel-1 pour caractériser l’état hydrique du sol. Deux méthodes ont été développées pour estimer ce paramètre avec une résolution spatiale de 100 m. Elles sont basées sur des approches de détection de changement à partir des données Sentinel-1 acquises en polarisation VV (verticale-verticale), combinées aux données optiques Sentinel-2 pour corriger les effets de la végétation. L’application consistait à cartographier l'irrigation, avec des résolutions spatiale et temporelle élevées. Une méthodologie de cartographie de l'irrigation utilisant des données SAR Sentinel-1 a été proposée. Elle estbasée sur les acquisitions en polarisations VV (vertical-vertical) et VH (vertical-horizontal). A partir de la série temporelle des mesures Sentinel-1, des paramètres statistiques tel que la valeur moyenne, la variance du signal, la longueur de corrélation temporelle et la dimension fractale, sont analysées, en fonction du type de culture; cultures annuelles irriguées, arbres irrigués et cultures pluviales. Des classifications supervisées utilisant les approches Random Forest et SVM sont testées. En deuxième axe, l'estimation de la hauteur de la surface de l'eau à partir des données altimétriques de Sentinel-3 avec l’altimètre SAR (SRAL) a été réalisée à l'aide de différents algorithmes afin d'améliorer la précision sur des petites surfaces. Cette étude présente trois algorithmes spécialisés (ou retrackers) dédiées à la minimisation de la contamination des sols par les formes d’ondes permettant de récupérer les niveaux d’eau à partir de données altimétriques SAR sur des masses d’eaux intérieures. Les performances de la méthode de sélection de portion de forme d'onde proposée avec trois retrackers, à savoir, le retracker à seuil, le retracker à centre de gravité décalé (OCOG) et le retracker à base physique à 2 étapes, sont comparées. Des séries chronologiques de niveaux d'eau sont extraites pour les masses d'eau du bassin de l'Èbre (Espagne). Une application des produits altimétriques est proposée. Le produit de niveau d’eau a été utilisé comme paramètre d’entrée pour analyser l’effet tampon des barrages dans les simulations de débits fluviaux

Machine learning to generate soil information

This thesis is concerned with the novel use of machine learning (ML) methods in soil science research. ML adoption in soil science has increased considerably, especially in pedometrics (the use of quantitative methods to study the variation of soils). In parallel, the size of the soil datasets has also increased thanks to projects of global impact that aim to rescue legacy data or new large extent surveys to collect new information. While we have big datasets and global projects, currently, modelling is mostly based on "traditional" ML approaches which do not take full advantage of these large data compilations. This compilation of these global datasets is severely limited by privacy concerns and, currently, no solution has been implemented to facilitate the process. If we consider the performance differences derived from the generality of global models versus the specificity of local models, there is still a debate on which approach is better. Either in global or local DSM, most applications are static. Even with the large soil datasets available to date, there is not enough soil data to perform a fully-empirical, space-time modelling. Considering these knowledge gaps, this thesis aims to introduce advanced ML algorithms and training techniques, specifically deep neural networks, for modelling large datasets at a global scale and provide new soil information. The research presented here has been successful at applying the latest advances in ML to improve upon some of the current approaches for soil modelling with large datasets. It has also created opportunities to utilise information, such as descriptive data, that has been generally disregarded. ML methods have been embraced by the soil community and their adoption is increasing. In the particular case of neural networks, their flexibility in terms of structure and training makes them a good candidate to improve on current soil modelling approaches

A systematic review of the use of Deep Learning in Satellite Imagery for Agriculture

Agricultural research is essential for increasing food production to meet the requirements of an increasing population in the coming decades. Recently, satellite technology has been improving rapidly and deep learning has seen much success in generic computer vision tasks and many application areas which presents an important opportunity to improve analysis of agricultural land. Here we present a systematic review of 150 studies to find the current uses of deep learning on satellite imagery for agricultural research. Although we identify 5 categories of agricultural monitoring tasks, the majority of the research interest is in crop segmentation and yield prediction. We found that, when used, modern deep learning methods consistently outperformed traditional machine learning across most tasks; the only exception was that Long Short-Term Memory (LSTM) Recurrent Neural Networks did not consistently outperform Random Forests (RF) for yield prediction. The reviewed studies have largely adopted methodologies from generic computer vision, except for one major omission: benchmark datasets are not utilised to evaluate models across studies, making it difficult to compare results. Additionally, some studies have specifically utilised the extra spectral resolution available in satellite imagery, but other divergent properties of satellite images - such as the hugely different scales of spatial patterns - are not being taken advantage of in the reviewed studies.Comment: 25 pages, 2 figures and lots of large tables. Supplementary materials section included here in main pd