Collinsville solar thermal project: yield forecasting (draft report)

The final report has been published and is available here. Executive Summary 1        Introduction This report’s primary aim is to provide yield projections for the proposed Linear Fresnel Reflector (LFR) technology plant at Collinsville, Queensland, Australia.  However, the techniques developed in this report to overcome inadequate datasets at Collinsville to produce the yield projections are of interest to a wider audience because inadequate datasets for renewable energy projects are commonplace.  The subsequent report called ‘Energy economics and dispatch forecasting’ (Bell, Wild & Foster 2014a) uses the yield projections from this report to produce long-term wholesale market price and dispatch forecasts for the plant.  2        Literature review The literature review discusses the four drivers for yield for LFR technology: DNI (Direct Normal Irradiance) Temperature Humidity Pressure Collinsville lacks complete historical datasets of the four drivers to develop yield projects but its three nearby neighbours do possess complete datasets, so could act as proxies for Collinsville.  However, analysing the four drivers for Collinsville and its three nearby sites shows that there is considerable difference in their climates.  This difference makes them unsuitable to act as proxies for yield calculations.  Therefore, the review investigates modelling the four drivers for Collinsville. We introduce the term “effective” DNI to help clarify and ameliorate concerns over the dust and dew effects on terrestrial DNI measurement and LFR technology. We also introduce a modified TMY technique to overcome technology specific Typical Metrological Year (TMY).  We discuss the effect of climate change and the El Nino Southern Oscillation (ENSO) on yield and their implications for a TMY. 2.1     Research questions Research question arising from the literature review include: The overarching research question: Can modelling the weather with limited datasets produce greater yield predictive power than using the historically more complete datasets from nearby sites? This overarching question has a number of smaller supporting research questions: Is BoM’s DNI satellite dataset adequately adjusted for cloud cover at Collinsville? Given the dust and dew effects, is using raw satellite data sufficient to model yield? Does elevation between Collinsville and nearby sites affect yield? How does the ENSO affect yield? Given the 2007-2012 constraint, will the TMY process provide a “Typical” year over the ENSO cycle? How does climate change affect yield? A further research question arises in the methodology but is included here for completeness. What is the expected frequency of oversupply from the Linear Fresnel Novatec Solar Boiler? 3        Methodology In the methodology section, we discuss the data preparation and the model selection process for the four drivers of yield. 4        Results and analysis In the results section we present the four driver models selected and the process that was undertaken to arrive at the models. 5        Discussion We analyse the extent to which the research questions are informed by the results. 6        Conclusion In this report, we have identified the key research questions and established a methodology to address these questions.  The models for the four drivers have been established allowing the calculation of the yield projections for Collinsville

Merging multiple precipitation sources for flash flood forecasting

We investigated the effectiveness of combining gauge observations and satellite-derived precipitation on flood forecasting. Two data merging processes were proposed: the first one assumes that the individual precipitation measurement is non-bias, while the second process assumes that each precipitation source is biased and both weighting factor and bias parameters are to be calculated. Best weighting factors as well as the bias parameters were calculated by minimizing the error of hourly runoff prediction over Wu-Tu watershed in Taiwan. To simulate the hydrologic response from various sources of rainfall sequences, in our experiment, a recurrent neural network (RNN) model was used. The results demonstrate that the merged method used in this study can efficiently combine the information from both rainfall sources to improve the accuracy of flood forecasting during typhoon periods. The contribution of satellite-based rainfall, being represented by the weighting factor, to the merging product, however, is highly related to the effectiveness of ground-based rainfall observation provided gauged. As the number of gauge observations in the basin is increased, the effectiveness of satellite-based observation to the merged rainfall is reduced. This is because the gauge measurements provide sufficient information for flood forecasting; as a result the improvements added on satellite-based rainfall are limited. This study provides a potential advantage for extending satellite-derived precipitation to those watersheds where gauge observations are limited. © 2007 Elsevier B.V. All rights reserved

Machine learning for early detection of traffic congestion using public transport traffic data

The purpose of this project is to provide better knowledge of how the bus travel times is affected by congestion and other problems in the urban traffic environment. The main source of data for this study is second-level measurements coming from all buses in the Linköping region showing the location of each vehicle.The main goal of this thesis is to propose, implement, test and optimize a machine learning algorithm based on data collected from regional buses from Sweden so that it is able to perform predictions on the future state of the urban traffic.El objetivo principal de este proyecto es proponer, implementar, probar y optimizar un algoritmo de aprendizaje automático basado en datos recopilados de autobuses regionales de Suecia para que poder realizar predicciones sobre el estado futuro del tráfico urbano.L'objectiu principal d'aquest projecte és proposar, implementar, provar i optimitzar un algoritme de machine learning basat en dades recollides a partir d'autobusos regionals de Suècia de manera per poder realitzar prediccions sobre l'estat futur del trànsit urbà

Can social microblogging be used to forecast intraday exchange rates?

The Efficient Market Hypothesis (EMH) is widely accepted to hold true under certain assumptions. One of its implications is that the prediction of stock prices at least in the short run cannot outperform the random walk model. Yet, recently many studies stressing the psychological and social dimension of financial behavior have challenged the validity of the EMH. Towards this aim, over the last few years, internet-based communication platforms and search engines have been used to extract early indicators of social and economic trends. Here, we used Twitter's social networking platform to model and forecast the EUR/USD exchange rate in a high-frequency intradaily trading scale. Using time series and trading simulations analysis, we provide some evidence that the information provided in social microblogging platforms such as Twitter can in certain cases enhance the forecasting efficiency regarding the very short (intradaily) forex.Comment: This is a prior version of the paper published at NETNOMICS. The final publication is available at http://www.springer.com/economics/economic+theory/journal/1106

Collinsville solar thermal project: yield forecasting (final report)

Executive Summary 1        Introduction This report’s primary aim is to provide yield projections for the proposed Linear Fresnel Reflector (LFR) technology plant at Collinsville, Queensland, Australia.  However, the techniques developed in this report to overcome inadequate datasets at Collinsville to produce the yield projections are of interest to a wider audience because inadequate datasets for renewable energy projects are commonplace.  Our subsequent report called ‘Energy economics and dispatch forecasting’ (Bell, Wild & Foster 2014a) uses the yield projections from this report to produce long-term wholesale market price and dispatch forecasts for the plant.  2        Literature review The literature review discusses the four drivers for yield for LFR technology: DNI (Direct Normal Irradiance) Temperature Humidity Pressure Collinsville lacks complete historical datasets of the four drivers to develop yield projections but its three nearby neighbours possess complete datasets, so could act as proxies for Collinsville.  However, analysing the four drivers for Collinsville and its three nearby sites shows that there is considerable difference in their climates.  This difference makes them unsuitable to act as proxies for yield calculations.  Therefore, the review investigates modelling the four drivers for Collinsville. We introduce the term “effective” DNI to help clarify and ameliorate concerns over the dust and dew effects on terrestrial DNI measurement and LFR technology. We also introduce a modified Typical Metrological Year (TMY) technique to overcome technology specific TMYs.  We discuss the effect of climate change and the El Niño Southern Oscillation (ENSO) on yield and their implications for a TMY. 2.1     Research questions Research questions arising from the literature review include: The overarching research question: Can modelling the weather with limited datasets produce greater yield predictive power than using the historically more complete datasets from nearby sites? This overarching question has a number of smaller supporting research questions: Does BoM adequately adjust its DNI satellite dataset for cloud cover at Collinsville? Given the dust and dew effects, is using raw satellite data sufficient to model yield? Does elevation between Collinsville and nearby sites affect yield? How does the ENSO cycle affect yield? Given the 2007-12 electricity demand data constraint, will the 2007-13 based TMY provide a “Typical” year over the ENSO cycle? How does climate change affect yield? Is the method to use raw satellite DNI data to calculate yield and retrospectively adjusting the calculated yield with an effective to satellite DNI energy per area ratio suitable? How has climate change affected the ENSO cycle? A further research question arises in the methodology but is included here for completeness. What is the expected frequency of oversupply from the Linear Fresnel Novatec Solar Boiler? 3        Methodology In the methodology section, we discuss the data preparation and the model selection process for the four drivers of yield.  We also discuss the development of the technology specific TMY and sensitivity analysis to address the research questions on climate change and elevation. 4        Results and analysis In the results section we present the selection process for the four driver models.  We also present the effective to satellite DNI ratio, the annual variation in gross yield, the selection of TMMs for the TMY based on monthly yield, the sensitivity analysis results on climate change and elevation, and the frequency of gross yield exceeding 30 MW. 5        Discussion We analyse the results within a wider context, in particular, we make a comparison with the yield calculations for Rockhampton to address the overarching research question.  We find that the modelling of weather at Collinsville using incomplete weather data has higher predictive performance that using the complete weather data at Rockhampton but recommend using the BoM’s one-minute solar data to improve the comparative test.  Other findings include the requirement to increase the current TMM’s selection period 2007-13 to incorporate more of the ENSO cycle.  There is less than 0.3% change in gross yield from the plant in the most likely case of climate change but there is a requirement to determine the effect of climate change on electricity demand and the ensuing change in wholesale electricity prices. 6        Conclusion In this report, we have addressed the key research questions, produced the yield projections for our subsequent report ‘Energy economics and dispatch forecasting’ (Bell, Wild & Foster 2014a) and made recommendations for further research

Short-Term Forecasting of Passenger Demand under On-Demand Ride Services: A Spatio-Temporal Deep Learning Approach

Short-term passenger demand forecasting is of great importance to the on-demand ride service platform, which can incentivize vacant cars moving from over-supply regions to over-demand regions. The spatial dependences, temporal dependences, and exogenous dependences need to be considered simultaneously, however, which makes short-term passenger demand forecasting challenging. We propose a novel deep learning (DL) approach, named the fusion convolutional long short-term memory network (FCL-Net), to address these three dependences within one end-to-end learning architecture. The model is stacked and fused by multiple convolutional long short-term memory (LSTM) layers, standard LSTM layers, and convolutional layers. The fusion of convolutional techniques and the LSTM network enables the proposed DL approach to better capture the spatio-temporal characteristics and correlations of explanatory variables. A tailored spatially aggregated random forest is employed to rank the importance of the explanatory variables. The ranking is then used for feature selection. The proposed DL approach is applied to the short-term forecasting of passenger demand under an on-demand ride service platform in Hangzhou, China. Experimental results, validated on real-world data provided by DiDi Chuxing, show that the FCL-Net achieves better predictive performance than traditional approaches including both classical time-series prediction models and neural network based algorithms (e.g., artificial neural network and LSTM). This paper is one of the first DL studies to forecast the short-term passenger demand of an on-demand ride service platform by examining the spatio-temporal correlations.Comment: 39 pages, 10 figure