7 research outputs found
Recommended from our members
An enhanced artificial neural network with a shuffled complex evolutionary global optimization with principal component analysis
The classical Back-Propagation (BP) scheme with gradient-based optimization in training Artificial Neural Networks (ANNs) suffers from many drawbacks, such as the premature convergence, and the tendency of being trapped in local optimums. Therefore, as an alternative for the BP and gradient-based optimization schemes, various Evolutionary Algorithms (EAs), i.e., Particle Swarm Optimization (PSO), Genetic Algorithm (GA), Simulated Annealing (SA), and Differential Evolution (DE), have gained popularity in the field of ANN weight training. This study applied a new efficient and effective Shuffled Complex Evolutionary Global Optimization Algorithm with Principal Component Analysis – University of California Irvine (SP-UCI) to the weight training process of a three-layer feed-forward ANN. A large-scale numerical comparison is conducted among the SP-UCI-, PSO-, GA-, SA-, and DE-based ANNs on 17 benchmark, complex, and real-world datasets. Results show that SP-UCI-based ANN outperforms other EA-based ANNs in the context of convergence and generalization. Results suggest that the SP-UCI algorithm possesses good potential in support of the weight training of ANN in real-word problems. In addition, the suitability of different kinds of EAs on training ANN is discussed. The large-scale comparison experiments conducted in this paper are fundamental references for selecting proper ANN weight training algorithms in practice
Deep Transfer Learning on Satellite Imagery Improves Air Quality Estimates in Developing Nations
Urban air pollution is a public health challenge in low- and middle-income countries (LMICs). However, LMICs lack adequate air quality (AQ) monitoring infrastructure. A persistent challenge has been our inability to estimate AQ accurately in LMIC cities, which hinders emergency preparedness and risk mitigation. Deep learning-based models that map satellite imagery to AQ can be built for high-income countries (HICs) with adequate ground data. Here we demonstrate that a scalable approach that adapts deep transfer learning on satellite imagery for AQ can extract meaningful estimates and insights in LMIC cities based on spatiotemporal patterns learned in HIC cities. The approach is demonstrated for Accra in Ghana, Africa, with AQ patterns learned from two US cities, specifically Los Angeles and New York
Recommended from our members
An enhanced artificial neural network with a shuffled complex evolutionary global optimization with principal component analysis
The classical Back-Propagation (BP) scheme with gradient-based optimization in training Artificial Neural Networks (ANNs) suffers from many drawbacks, such as the premature convergence, and the tendency of being trapped in local optimums. Therefore, as an alternative for the BP and gradient-based optimization schemes, various Evolutionary Algorithms (EAs), i.e., Particle Swarm Optimization (PSO), Genetic Algorithm (GA), Simulated Annealing (SA), and Differential Evolution (DE), have gained popularity in the field of ANN weight training. This study applied a new efficient and effective Shuffled Complex Evolutionary Global Optimization Algorithm with Principal Component Analysis – University of California Irvine (SP-UCI) to the weight training process of a three-layer feed-forward ANN. A large-scale numerical comparison is conducted among the SP-UCI-, PSO-, GA-, SA-, and DE-based ANNs on 17 benchmark, complex, and real-world datasets. Results show that SP-UCI-based ANN outperforms other EA-based ANNs in the context of convergence and generalization. Results suggest that the SP-UCI algorithm possesses good potential in support of the weight training of ANN in real-word problems. In addition, the suitability of different kinds of EAs on training ANN is discussed. The large-scale comparison experiments conducted in this paper are fundamental references for selecting proper ANN weight training algorithms in practice
Recommended from our members
Developing reservoir monthly inflow forecasts using artificial intelligence and climate phenomenon information
Reservoirs are fundamental human-built infrastructures that collect, store, and deliver fresh surface water in a timely manner for many purposes. Efficient reservoir operation requires policy makers and operators to understand how reservoir inflows are changing under different hydrological and climatic conditions to enable forecast-informed operations. Over the last decade, the uses of Artificial Intelligence and Data Mining [AI & DM] techniques in assisting reservoir streamflow subseasonal to seasonal forecasts have been increasing. In this study, Random Forest [RF), Artificial Neural Network (ANN), and Support Vector Regression (SVR) are employed and compared with respect to their capabilities for predicting 1 month-ahead reservoir inflows for two headwater reservoirs in USA and China. Both current and lagged hydrological information and 17 known climate phenomenon indices, i.e., PDO and ENSO, etc., are selected as predictors for simulating reservoir inflows. Results show (1) three methods are capable of providing monthly reservoir inflows with satisfactory statistics; (2) the results obtained by Random Forest have the best statistical performances compared with the other two methods; (3) another advantage of Random Forest algorithm is its capability of interpreting raw model inputs; (4) climate phenomenon indices are useful in assisting monthly or seasonal forecasts of reservoir inflow; and (5) different climate conditions are autocorrelated with up to several months, and the climatic information and their lags are cross correlated with local hydrological conditions in our case studies
Recommended from our members
PERSIANN-CNN: Precipitation estimation from remotely sensed information using artificial neural networks–convolutional neural networks
Accurate and timely precipitation estimates are critical for monitoring and forecasting natural disasters such as floods. Despite having highŠresolution satellite information, precipitation estimation from remotely sensed data still suffers from methodological limitations. StateŠofŠtheŠart deep learning algorithms, renowned for their skill in learning accurate patterns within large and complex datasets, appear well suited to the task of precipitation estimation, given the ample amount of highŠresolution satellite data. In this study, the effectiveness of applying convolutional neural networks (CNNs) together with the infrared (IR) and water vapor (WV) channels from geostationary satellites for estimating precipitation rate is explored. The proposed model performances are evaluated during summer 2012 and 2013 over central CONUS at the spatial resolution of 0.088 and at an hourly time scale. Precipitation Estimation from Remotely Sensed Information Using Artificial Neural Networks (PERSIANN)–Cloud Classification System (CCS), which is an operational satelliteŠbased product, and PERSIANN–Stacked Denoising Autoencoder (PERSIANNŠSDAE) are employed as baseline models. Results demonstrate that the proposed model (PERSIANNŠCNN) provides more accurate rainfall estimates compared to the baseline models at various temporal and spatial scales. Specifically, PERSIANNŠCNN outperforms PERSIANNŠCCS (and PERSIANNŠSDAE) by 54% (and 23%) in the critical success index (CSI), demonstrating the detection skills of the model. Furthermore, the rootŠmean-square error (RMSE) of the rainfall estimates with respect to the National Centers for Environmental Prediction (NCEP) Stage IV gauge–radar data, for PERSIANNŠCNN was lower than that of PERSIANNŠCCS (PERSIANNŠSDAE) by 37% (14%), showing the estimation accuracy of the proposed model
Recommended from our members
Evaluation of PERSIANN-CDR constructed using GPCP V2.2 and V2.3 and a comparison with TRMM 3B42 V7 and CPC unified gauge-based analysis in global scale
Providing reliable long-term global precipitation records at high spatial and temporal resolutions is crucial for climatological studies. Satellite-based precipitation estimations are a promising alternative to rain gauges for providing homogeneous precipitation information. Most satellite-based precipitation products suffer from short-term data records, which make them unsuitable for various climatological and hydrological applications. However, Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks-Climate Data Record (PERSIANN-CDR) provides more than 35 years of precipitation records at 0.25° × 0.25° spatial and daily temporal resolutions. The PERSIANN-CDR algorithm uses monthly Global Precipitation Climatology Project (GPCP) data, which has been recently updated to version 2.3, for reducing the biases in the output of the PERSIANN model. In this study, we constructed PERSIANN-CDR using the newest version of GPCP (V2.3). We compared the PERSIANN-CDR dataset that is constructed using GPCP V2.3 (from here on referred to as PERSIANN-CDR V2.3) with the PERSIANN-CDR constructed using GPCP V2.2 (from here on PERSIANN-CDR V2.2), at monthly and daily scales for the period from 2009 to 2013. First, we discuss the changes between PERSIANN-CDR V2.3 and V2.2 over the land and ocean. Second, we evaluate the improvements in PERSIANN-CDR V2.3 with respect to the Climate Prediction Center (CPC) unified gauge-based analysis, a gauged-based reference, and Tropical Rainfall Measuring Mission (TRMM 3B42 V7), a commonly used satellite reference, at monthly and daily scales. The results show noticeable differences between PERSIANN-CDR V2.3 and V2.2 over oceans between 40° and 60° latitude in both the northern and southern hemispheres. Monthly and daily scale comparisons of the two bias-adjusted versions of PERSIANN-CDR with the above-mentioned references emphasize that PERSIANN-CDR V2.3 has improved mostly over the global land area, especially over the CONUS and Australia. The updated PERSIANN-CDR V2.3 data has replaced V2.2 data for the 2009-2013 period on CHRS data portal and NOAA National Centers for Environmental Information (NCEI) Program
Using deep transfer learning and satellite imagery to estimate urban air quality in data-poor regions
Urban air pollution is a critical public health challenge in low-and-middle-income countries (LMICs). At the same time, LMICs tend to be data-poor, lacking adequate infrastructure to monitor air quality (AQ). As LMICs undergo rapid urbanization, the socio-economic burden of poor AQ will be immense. Here we present a globally scalable two-step deep learning (DL) based approach for AQ estimation in LMIC cities that mitigates the need for extensive AQ infrastructure on the ground. We train a DL model that can map satellite imagery to AQ in high-income countries (HICs) with sufficient ground data, and then adapt the model to learn meaningful AQ estimates in LMIC cities using transfer learning. The trained model can explain up to 54% of the variation in the AQ distribution of the target LMIC city without the need for target labels. The approach is demonstrated for Accra in Ghana, Africa, with AQ patterns learned and adapted from two HIC cities, specifically Los Angeles and New York