Rainfall-Runoff Modelling Using Artificial Neural Networks (ANNs)

Over the last decades or so, artificial neural networks (ANNs) have become one of the most promising tools for modelling hydrological processes such as rainfall-runoff processes. In most studies, ANNs have been demonstrated to show superior result compared to the traditional modelling approaches. They are able to map underlying relationships between input and output data without detailed knowledge of the processes under investigation, by finding an optimum set of network parameters through the learning or training process. This thesis considers two types of ANNs, namely, self-organizing map (SOM) and feed-forward multilayer perceptron (MLP). The thesis starts with the issue of understanding of a trained ANN model by using neural interpretation diagram (NID), Garson's algorithm and a randomization approach. Then the applicability of the SOM algorithm within water resources applications is reviewed and compared to the well-known feed-forward MLP. Moreover, the thesis deals with the problem of missing values in the context of a monthly precipitation database. This part deals with the problem of missing values by using SOM and feed-forward MLP models along with inclusion of regionalization properties obtained from the SOM. The problem of filling in of missing data in a daily precipitation-runoff database is also considered. This study deals with the filling in of missing values using SOM and feed-forward MLP along with multivariate nearest neighbour (MNN), regularized expectation-maximization algorithm (REGEM) and multiple imputation (MI). Finally, once a complete database was obtained, SOM and feed-forward MLP models were developed in order to forecast one-month ahead runoff. Some issues such as the applicability of the SOM algorithm for modularization and the effect of the number of modules in modelling performance were investigated. It was found that it is indeed possible to make an ANN reveal some information about the mechanisms governing rainfall-runoff processes. The literature review showed that SOMs are becoming increasingly popular but that there are hardly any reviews of SOM applications. In the case of imputation of missing values in the monthly precipitation, the results indicated the importance of the inclusion of regionalization properties of SOM prior to the application of SOM and feed-forward MLP models. In the case of gap-filling of the daily precipitation-runoff database, the results showed that most of the methods yield similar results. However, the SOM and MNN tended to give the most robust results. REGEM and MI hold the assumption of multivariate normality, which does not seem to fit the data at hand. The feed-forward MLP is sensitive to the location of missing values in the database and did not perform very well. Based on the one-month ahead forecasting, it was found that although the idea of modularization based on SOM is highly persuasive, the results indicated a need for more principled procedures to modularize the processes. Moreover, the modelling results indicated that a supervised SOM model can be considered as a viable alternative approach to the well-known feed-forward MLP model

Similarity networks for classification: a case study in the Horse Colic problem

This paper develops a two-layer neural network in which the neuron model computes a user-defined similarity function between inputs and weights. The neuron transfer function is formed by composition of an adapted logistic function with the mean of the partial input-weight similarities. The resulting neuron model is capable of dealing directly with variables of potentially different nature (continuous, fuzzy, ordinal, categorical). There is also provision for missing values. The network is trained using a two-stage procedure very similar to that used to train a radial basis function (RBF) neural network. The network is compared to two types of RBF networks in a non-trivial dataset: the Horse Colic problem, taken as a case study and analyzed in detail.Postprint (published version