Predictive spatio-temporal modelling with neural networks

Hongbin Liu studied the predictive spatio-temporal modelling using Neural Networks. Predictive spatio-temporal modelling is a challenge task due to the complex non-linear spatio-temporal dependencies, data sparsity and uncertainty. Hongbin Liu investigated the modelling difficulties and proposed three novel models to tackle the difficulties for three common spatio-temporal datasets. He also conducted extensive experiments on several real-world datasets for various spatio-temporal prediction tasks, such as travel mode classification, next-location prediction, weather forecasting and meteorological imagery prediction. The results show our proposed models consistently achieve exceptional improvements over state-of-the-art baselines

A Physics-Informed, Deep Double Reservoir Network for Forecasting Boundary Layer Velocity

When a fluid flows over a solid surface, it creates a thin boundary layer where the flow velocity is influenced by the surface through viscosity, and can transition from laminar to turbulent at sufficiently high speeds. Understanding and forecasting the wind dynamics under these conditions is one of the most challenging scientific problems in fluid dynamics. It is therefore of high interest to formulate models able to capture the nonlinear spatio-temporal velocity structure as well as produce forecasts in a computationally efficient manner. Traditional statistical approaches are limited in their ability to produce timely forecasts of complex, nonlinear spatio-temporal structures which are at the same time able to incorporate the underlying flow physics. In this work, we propose a model to accurately forecast boundary layer velocities with a deep double reservoir computing network which is capable of capturing the complex, nonlinear dynamics of the boundary layer while at the same time incorporating physical constraints via a penalty obtained by a Partial Differential Equation (PDE). Simulation studies on a one-dimensional viscous fluid demonstrate how the proposed model is able to produce accurate forecasts while simultaneously accounting for energy loss. The application focuses on boundary layer data on a wind tunnel with a PDE penalty derived from an appropriate simplification of the Navier-Stokes equations, showing forecasts more compliant with mass conservation

Spatial snow water equivalent estimation for mountainous areas using wireless-sensor networks and remote-sensing products

We developed an approach to estimate snow water equivalent (SWE) through interpolation of spatially representative point measurements using a k-nearest neighbors (k-NN) algorithm and historical spatial SWE data. It accurately reproduced measured SWE, using different data sources for training and evaluation. In the central-Sierra American River basin, we used a k-NN algorithm to interpolate data from continuous snow-depth measurements in 10 sensor clusters by fusing them with 14 years of daily 500-m resolution SWE-reconstruction maps. Accurate SWE estimation over the melt season shows the potential for providing daily, near real-time distributed snowmelt estimates. Further south, in the Merced-Tuolumne basins, we evaluated the potential of k-NN approach to improve real-time SWE estimates. Lacking dense ground-measurement networks, we simulated k-NN interpolation of sensor data using selected pixels of a bi-weekly Lidar-derived snow water equivalent product. k-NN extrapolations underestimate the Lidar-derived SWE, with a maximum bias of −10 cm at elevations below 3000 m and +15 cm above 3000 m. This bias was reduced by using a Gaussian-process regression model to spatially distribute residuals. Using as few as 10 scenes of Lidar-derived SWE from 2014 as training data in the k-NN to estimate the 2016 spatial SWE, both RMSEs and MAEs were reduced from around 20–25 cm to 10–15 cm comparing to using SWE reconstructions as training data. We found that the spatial accuracy of the historical data is more important for learning the spatial distribution of SWE than the number of historical scenes available. Blending continuous spatially representative ground-based sensors with a historical library of SWE reconstructions over the same basin can provide real-time spatial SWE maps that accurately represents Lidar-measured snow depth; and the estimates can be improved by using historical Lidar scans instead of SWE reconstructions

Mapping Soil Moisture from Remotely Sensed and In-situ Data with Statistical Methods

Soil moisture is an important factor for accurate prediction of agricultural productivity and rainfall runoff with hydrological models. Remote sensing satellites such as Soil Moisture Active Passive (SMAP) offer synoptic views of soil moisture distribution at a regional-to-global scale. To use the soil moisture product from these satellites, however, requires a downscaling of the data from an usually large instantaneous field of view (i.e. 36 km) to the watershed analysis scales ranging from 30 m to 1 km. In addition, validation of the soil moisture products using the ground station observations without an upscaling treatment would lead to cross-level fallacy. In the literature of geographical analysis, scale is one of the top research concens because of the needs for multi-source geospatial data fusion. This dissertation research introduced a multi-level soil moisture data assimilation and processing methodology framework based on spatial information theories. The research contains three sections: downscaling using machine learning and geographically weighted regression, upscaling ground network observation to calibrate satellite data, and spatial and temporal multi-scale data assimilation using spatio-temporal interpolation. (1) Soil moisture downscaling In the first section, a downscaling method is designed using 1-km geospatial data to obtain subpixel soil moisture from the 9-km soil moisture product of the SMAP satellite. The geospatial data includes normalized difference vegetation index (NDVI), land surface temperature (LST), gross primary productivity (GPP), topographical moisture index (TMI), with all resampled to 1-km resolution. The machine learning algorithm – random forest was used to create a prediction model of the soil moisture at a 1-km resolution. The 1-km soil moisture product was compared with the ground samples from the West Texas Mesonet (WTM) station data. The residual was then interpolated to compensate the unpredicted variability of the model. The entire process was based on the concept of regression kriging- where the regression was done by the random forest model. Results show that the downscaling approach was able to achieve better accuracy than the current statistical downscaling methods. (2) Station network data upscaling The Texas Soil Observation Network (TxSON) network was designed to test the feasibility of upscaling the in-situ data to match the scale of the SMAP data. I advanced the upscaling method by using the Voronoi polygons and block kriging with a Gaussian kernel aggregation. The upscaling algorithm was calibrated using different spatial aggregation parameters, such as the fishnet cell size and Gaussian kernel standard deviation. The use of the kriging can significantly reduce the spatial autocorrelation among the TxSON stations because of its declustering ability. The result proved the new upscaling method was better than the traditional ones. (3) Multi-scale data fusion in a spatio-temporal framework None of the current works for soil moisture statistical downscaling honors time and space equally. It is important, however, that the soil moisture products are consistent in both domains. In this section, the space-time kriging model for soil moisture downscaling and upscaling computation framework designed in the last two sections is implemented to create a spatio-temporal integrated solution to soil moisture multi-scale mapping. The present work has its novelty in using spatial statistics to reconcile the scale difference from satellite data and ground observations, and therefore proposes new theories and solutions for dealing with the modifiable areal unit problem (MAUP) incurred in soil moisture mapping from satellite and ground stations

Observation- and Modelling of Morphodynamics in Sandy Coastal Environments

The topic of sandy coast morphodynamics involves the mutual influences of coastal topography, local sedimentology, the driving meteorological and hydrodynamic boundary conditions, flora and fauna, and the activities of human beings: The latter as direct actors through coastal constructions and other interventions, as indirect actors through possible contributions to global change, but also as receiving agents - as living individuals confronted with the forces of the sea. The general aim of coastal research is to gain an as comprehensive as possible understanding of the different systems and their interaction in order to be able to evaluate their current state, assess their stability, explain past changes (in the geological record), and predict future developments under different conditions. Such systems dynamics involve a large bandwidth of spatial and temporal scales: from the microscopic interaction of turbulent fluid motions with single particles to meso-scale tidal dynamics of subaqueous bedforms to macro-scale seasonal adaptations of beach profiles or the meandering of tidal channels, to the mega-scale evolution of shorelines and shelf systems over decades to centuries. The process of understanding involves a continuous feedback of observations, abstractions, mathematical formulations, model development (ranging from conceptual models to mathematical formulations of processes, and to complex, process-based numerical modelling systems), and the testing of models on the basis of observations, new abstractions, and so forth. In the case of the morphodynamics of sandy coasts, the interaction of the physical processes involved in hydrodynamics, sediment dynamics, and their mutual adjustment to changing bed topographies seem most relevant, although biogeochemical processes play a (commonly underrated) additional role. This discourse presents an extended summary of the current state in the continuous process of gaining knowledge on coastal morphodynamics. It focuses on the dynamics of tidal channels and their main roughness elements: subaqueous compound bedforms. Methodological approaches involved are field measurements and numerical modelling, which are introduced and discussed

Radar rainfall forecasting for sewer flood modelling to support decision-making in sewer network operations

Radar quantitative precipitation estimates (QPEs) and forecasts (QPFs) are useful in urban hydrology because they can provide real time or forecasted rainfall information for flood forecasting/warning systems. Sewer flooding is a disruptive problem in England and Wales. Wastewater companies have reported that more than 4,700 customers are at risk of internal sewer flooding. Currently in the UK, mitigating sewer flooding before it occurs is difficult to achieve operationally because of the lack of accurate and specific data. As radar rainfall data is available from the UK Met Office, particularly radar QPFs with a maximum lead time of 6 hours, these datasets could be used to predict sewer flooding up to this maximum lead time. This research investigates the uses of radar Quantitative Precipitation Forecasts and Quantitative Precipitation Estimates to support short term decisions of sewer network operation in reducing the risk of sewer flooding. It is achieved by increasing the accuracy of deterministic radar quantitative precipitation forecasts, developing on probabilistic radar quantitative precipitation forecasts, and using spatial variability of radar quantitative precipitation estimates to estimate flood extents in sewer catchments from the North East of England. Radar rainfall data used in the case study is also sourced from this region of size 184 km x 140 km. The temporal and spatial resolutions of rainfall forecasts are important to producing accurate hydrological output. Hence, increasing these resolutions is identified to improving deterministic radar quantitative precipitation forecasts for hydrological applications. An interpolation method involving temporal interpolation by optical flow and spatial interpolation by Universal Kriging is proposed to increase the resolution of radar QPF from a native resolution of 15 mins and 2-km to 5 mins and 1-km. Key results are that the interpolation method proposed outperforms traditional interpolation approaches including simple linear temporal interpolation and spatial interpolation by inverse distance weighting. Probabilistic radar quantitative precipitation forecasts provide information of the uncertainty of the radar deterministic forecasts. However, probabilistic approaches have limitations in that they may not accurately depict the uncertainty range for different rainfall types. Hence, postprocessing probabilistic quantitative precipitation forecasts are required. A Bayesian postprocessing approach is introduced to postprocess probability distributions produced from an existing stochastic method using the latest radar QPE. Furthermore, non-normal distributions in the stochastic model are developed using gamma based generalised linear models. Key successes of this approach are that the postprocessed probabilistic QPFs are more accurate than the pre-processed QPFs in both cool and warm seasons of a year. Furthermore, the postprocessed QPFs of all the verification events better correlate with their QPE, thus improving the temporal structure. Spatial variability of radar QPE/QPF data influences flood dynamics in a sewer catchment. Moreover, combination of different percentiles of probabilistic QPFs, per radar grid, over a sewer catchment would produce different spatial distributions of rainfall over the area. Furthermore, simulating many probabilistic QPFs concurrently is computationally demanding. Therefore, generalised linear models have been used to estimate model flood variables using a spatial analysis of radar QPE. Spatial analysis involves using indexes representing specific information of the spatial distribution of rainfall. The novelty of this estimation method includes faster estimations of flood extents. The main points of success of this approach are that more detailed spatial analysis of large sewer catchments produce more accurate flood estimations that could be used without running hydraulic simulations. This makes the approach suitable for probabilistic sewer flood forecasting in real-time applications. A business case is proposed to use the outputs of this research for commercial applications. Probabilistic sewer flood forecasting is evaluated and recommended for industry application using a financial appraisal approach for Northumbrian Water Limited. The business case shows that the methods could be adopted by the wastewater company to mitigate sewer flooding before it occurs. This would support decision making and save costs with better intervention management