PERSIANN-CNN: Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks-Convolutional Neural Networks

Abstract Accurate and timely precipitation estimates are critical for monitoring and forecasting natural disasters such as floods. Despite having high-resolution satellite information, precipitation estimation from remotely sensed data still suffers from methodological limitations. State-of-the-art deep learning algorithms, renowned for their skill in learning accurate patterns within large and complex datasets, appear well suited to the task of precipitation estimation, given the ample amount of high-resolution satellite data. In this study, the effectiveness of applying convolutional neural networks (CNNs) together with the infrared (IR) and water vapor (WV) channels from geostationary satellites for estimating precipitation rate is explored. The proposed model performances are evaluated during summer 2012 and 2013 over central CONUS at the spatial resolution of 0.08° and at an hourly time scale. Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks (PERSIANN)–Cloud Classification System (CCS), which is an operational satellite-based product, and PERSIANN–Stacked Denoising Autoencoder (PERSIANN-SDAE) are employed as baseline models. Results demonstrate that the proposed model (PERSIANN-CNN) provides more accurate rainfall estimates compared to the baseline models at various temporal and spatial scales. Specifically, PERSIANN-CNN outperforms PERSIANN-CCS (and PERSIANN-SDAE) by 54% (and 23%) in the critical success index (CSI), demonstrating the detection skills of the model. Furthermore, the root-mean-square error (RMSE) of the rainfall estimates with respect to the National Centers for Environmental Prediction (NCEP) Stage IV gauge–radar data, for PERSIANN-CNN was lower than that of PERSIANN-CCS (PERSIANN-SDAE) by 37% (14%), showing the estimation accuracy of the proposed model

Machine learning-based fusion studies of rainfall estimation from spaceborne and ground-based radars

2019 Spring.Includes bibliographical references.Precipitation measurement by satellite radar plays a significant role in researching the water circle and forecasting extreme weather event. Tropical Rainfall Measuring Mission (TRMM) Precipitation Radar (PR) has capability of providing a high-resolution vertical profile of precipitation over the tropics regions. Its successor, Global Precipitation Measurement (GPM) Dual-frequency Precipitation Radar (DPR), can provide detailed information on the microphysical properties of precipitation particles, quantify particle size distribution and quantitatively measure light rain and falling snow. This thesis presents a novel Machine Learning system for ground-based and space borne radar rainfall estimation. The system first trains ground radar data for rainfall estimation using rainfall measurements from gauges and subsequently uses the ground radar based rainfall estimates to train spaceborne radar data in order to get space based rainfall product. Therein, data alignment between spaceborne and ground radar is conducted using the methodology proposed by Bolen and Chandrasekar (2013), which can minimize the effects of potential geometric distortion of spaceborne radar observations. For demonstration purposes, rainfall measurements from three rain gauge networks near Melbourne, Florida, are used for training and validation purposes. These three gauge networks, which are located in Kennedy Space Center (KSC), South Florida Water Management District (SFL), and St. Johns Water Management District (STJ), include 33, 46, and 99 rain gauge stations, respectively. Collocated ground radar observations from the National Weather Service (NWS) Weather Surveillance Radar – 1988 Doppler (WSR-88D) in Melbourne (i.e., KMLB radar) are trained with the gauge measurements. The trained model is then used to derive KMLB radar based rainfall product, which is used to train both TRMM PR and GPM DPR data collected from coincident overpasses events. The machine learning based rainfall product is compared against the standard satellite products, which shows great potential of the machine learning concept in satellite radar rainfall estimation. Also, the local rain maps generated by machine learning system at KMLB area are demonstrate the application potential

Estimation of physical variables from multichannel remotely sensed imagery using a neural network: Application to rainfall estimation

Satellite-based remotely sensed data have the potential to provide hydrologically relevant information about spatially and temporally varying physical variables. A methodology for estimating such variables from multichannel remotely sensed data is presented; the approach is based on a modified counterpropagation neural network (MCPN) and is both effective and efficient at building complex nonlinear input-output function mappings from large amounts of data. An application to high-resolution estimation of the spatial and temporal variation of surface rainfall using geostationary satellite infrared and visible imagery is presented. Test results also indicate that spatially and temporally sparse ground-based observations can be assimilated via an adaptive implementation of the MCPN method, thereby allowing on-line improvement of the estimates

Watershed rainfall forecasting using neuro-fuzzy networks with the assimilation of multi-sensor information

The complex temporal heterogeneity of rainfall coupled with mountainous physiographic context makes a great challenge in the development of accurate short-term rainfall forecasts. This study aims to explore the effectiveness of multiple rainfall sources (gauge measurement, and radar and satellite products) for assimilation-based multi-sensor precipitation estimates and make multi-step-ahead rainfall forecasts based on the assimilated precipitation. Bias correction procedures for both radar and satellite precipitation products were first built, and the radar and satellite precipitation products were generated through the Quantitative Precipitation Estimation and Segregation Using Multiple Sensors (QPESUMS) and the Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks-Cloud Classification System (PERSIANN-CCS), respectively. Next, the synthesized assimilated precipitation was obtained by merging three precipitation sources (gauges, radars and satellites) according to their individual weighting factors optimized by nonlinear search methods. Finally, the multi-step-ahead rainfall forecasting was carried out by using the adaptive network-based fuzzy inference system (ANFIS). The Shihmen Reservoir watershed in northern Taiwan was the study area, where 641 hourly data sets of thirteen historical typhoon events were collected. Results revealed that the bias adjustments in QPESUMS and PERSIANN-CCS products did improve the accuracy of these precipitation products (in particular, 30-60% improvement rates for the QPESUMS, in terms of RMSE), and the adjusted PERSIANN-CCS and QPESUMS individually provided about 10% and 24% contribution accordingly to the assimilated precipitation. As far as rainfall forecasting is concerned, the results demonstrated that the ANFIS fed with the assimilated precipitation provided reliable and stable forecasts with the correlation coefficients higher than 0.85 and 0.72 for one- and two-hour-ahead rainfall forecasting, respectively. The obtained forecasting results are very valuable information for the flood warning in the study watershed during typhoon periods. © 2013 Elsevier B.V

Improved streamflow forecasting using self-organizing radial basis function artificial neural networks

Streamflow forecasting has always been a challenging task for water resources engineers and managers and a major component of water resources system control. In this study, we explore the applicability of a Self Organizing Radial Basis (SORB) function to one-step ahead forecasting of daily streamflow. SORB uses a Gaussian Radial Basis Function architecture in conjunction with the Self-Organizing Feature Map (SOFM) used in data classification. SORB outperforms the two other ANN algorithms, the well known Multi-layer Feedforward Network (MFN) and Self-Organizing Linear Output map (SOLO) neural network for simulation of daily streamflow in the semi-arid Salt River basin. The applicability of the linear regression model was also investigated and concluded that the regression model is not reliable for this study. To generalize the model and derive a robust parameter set, cross-validation is applied and its outcome is compared with the split sample test. Cross-validation justifies the validity of the nonlinear relationship set up between input and output data. © 2004 Elsevier B.V. All rights reserved

Merging multiple precipitation sources for flash flood forecasting

We investigated the effectiveness of combining gauge observations and satellite-derived precipitation on flood forecasting. Two data merging processes were proposed: the first one assumes that the individual precipitation measurement is non-bias, while the second process assumes that each precipitation source is biased and both weighting factor and bias parameters are to be calculated. Best weighting factors as well as the bias parameters were calculated by minimizing the error of hourly runoff prediction over Wu-Tu watershed in Taiwan. To simulate the hydrologic response from various sources of rainfall sequences, in our experiment, a recurrent neural network (RNN) model was used. The results demonstrate that the merged method used in this study can efficiently combine the information from both rainfall sources to improve the accuracy of flood forecasting during typhoon periods. The contribution of satellite-based rainfall, being represented by the weighting factor, to the merging product, however, is highly related to the effectiveness of ground-based rainfall observation provided gauged. As the number of gauge observations in the basin is increased, the effectiveness of satellite-based observation to the merged rainfall is reduced. This is because the gauge measurements provide sufficient information for flood forecasting; as a result the improvements added on satellite-based rainfall are limited. This study provides a potential advantage for extending satellite-derived precipitation to those watersheds where gauge observations are limited. © 2007 Elsevier B.V. All rights reserved

Satellite-based precipitation estimation using watershed segmentation and growing hierarchical self-organizing map

This paper outlines the development of a multi-satellite precipitation estimation methodology that draws on techniques from machine learning and morphology to produce high-resolution, short-duration rainfall estimates in an automated fashion. First, cloud systems are identified from geostationary infrared imagery using morphology based watershed segmentation algorithm. Second, a novel pattern recognition technique, growing hierarchical self-organizing map (GHSOM), is used to classify clouds into a number of clusters with hierarchical architecture. Finally, each cloud cluster is associated with co-registered passive microwave rainfall observations through a cumulative histogram matching approach. The network was initially trained using remotely sensed geostationary infrared satellite imagery and hourly ground-radar data in lieu of a dense constellation of polar-orbiting spacecraft such as the proposed global precipitation measurement (GPM) mission. Ground-radar and gauge rainfall measurements were used to evaluate this technique for both warm (June 2004) and cold seasons (December 2004-February 2005) at various temporal (daily and monthly) and spatial (0.04 and 0.25) scales. Significant improvements of estimation accuracy are found classifying the clouds into hierarchical sub-layers rather than a single layer. Furthermore, 2-year (2003-2004) satellite rainfall estimates generated by the current algorithm were compared with gauge-corrected Stage IV radar rainfall at various time scales over continental United States. This study demonstrates the usefulness of the watershed segmentation and the GHSOM in satellite-based rainfall estimations