Cluster-based Aggregate Forecasting for Residential Electricity Demand using Smart Meter Data

While electricity demand forecasting literature has focused on large, industrial, and national demand, this paper focuses on short-term (1 and 24 hour ahead) electricity demand forecasting for residential customers at the individual and aggregate level. Since electricity consumption behavior may vary between households, we first build a feature universe, and then apply Correlation-based Feature Selection to select features relevant to each household. Additionally, smart meter data can be used to obtain aggregate forecasts with higher accuracy using the so-called Cluster-based Aggregate Forecasting (CBAF) strategy, i.e., by first clustering the households, forecasting the clusters' energy consumption separately, and finally aggregating the forecasts. We found that the improvement provided by CBAF depends not only on the number of clusters, but also more importantly on the size of the customer base

Application of Deep Learning Long Short-Term Memory in Energy Demand Forecasting

The smart metering infrastructure has changed how electricity is measured in both residential and industrial application. The large amount of data collected by smart meter per day provides a huge potential for analytics to support the operation of a smart grid, an example of which is energy demand forecasting. Short term energy forecasting can be used by utilities to assess if any forecasted peak energy demand would have an adverse effect on the power system transmission and distribution infrastructure. It can also help in load scheduling and demand side management. Many techniques have been proposed to forecast time series including Support Vector Machine, Artificial Neural Network and Deep Learning. In this work we use Long Short Term Memory architecture to forecast 3-day ahead energy demand across each month in the year. The results show that 3-day ahead demand can be accurately forecasted with a Mean Absolute Percentage Error of 3.15%. In addition to that, the paper proposes way to quantify the time as a feature to be used in the training phase which is shown to affect the network performance

Data Mining to Uncover Heterogeneous Water Use Behaviors From Smart Meter Data

Knowledge on the determinants and patterns of water demand for different consumers supports the design of customized demand management strategies. Smart meters coupled with big data analytics tools create a unique opportunity to support such strategies. Yet, at present, the information content of smart meter data is not fully mined and usually needs to be complemented with water fixture inventory and survey data to achieve detailed customer segmentation based on end use water usage. In this paper, we developed a data‐driven approach that extracts information on heterogeneous water end use routines, main end use components, and temporal characteristics, only via data mining existing smart meter readings at the scale of individual households. We tested our approach on data from 327 households in Australia, each monitored with smart meters logging water use readings every 5 s. As part of the approach, we first disaggregated the household‐level water use time series into different end uses via Autoflow. We then adapted a customer segmentation based on eigenbehavior analysis to discriminate among heterogeneous water end use routines and identify clusters of consumers presenting similar routines. Results revealed three main water end use profile clusters, each characterized by a primary end use: shower, clothes washing, and irrigation. Time‐of‐use and intensity‐of‐use differences exist within each class, as well as different characteristics of regularity and periodicity over time. Our customer segmentation analysis approach provides utilities with a concise snapshot of recurrent water use routines from smart meter data and can be used to support customized demand management strategies.TU Berlin, Open-Access-Mittel - 201

Review of Low Voltage Load Forecasting: Methods, Applications, and Recommendations

The increased digitalisation and monitoring of the energy system opens up numerous opportunities to decarbonise the energy system. Applications on low voltage, local networks, such as community energy markets and smart storage will facilitate decarbonisation, but they will require advanced control and management. Reliable forecasting will be a necessary component of many of these systems to anticipate key features and uncertainties. Despite this urgent need, there has not yet been an extensive investigation into the current state-of-the-art of low voltage level forecasts, other than at the smart meter level. This paper aims to provide a comprehensive overview of the landscape, current approaches, core applications, challenges and recommendations. Another aim of this paper is to facilitate the continued improvement and advancement in this area. To this end, the paper also surveys some of the most relevant and promising trends. It establishes an open, community-driven list of the known low voltage level open datasets to encourage further research and development.Comment: 37 pages, 6 figures, 2 tables, review pape

Machine Learning on residential electricity consumption: Which households are more responsive to weather?

The introduction of smart meters has created opportunities for both utilities and policymakers to understand residential electricity consumption in greater depth. Machine learning techniques have distinct advantages over traditional approaches in dealing with extremely large volumes of high-resolution usage data. We introduce a novel clustering method to detect household behaviour using different types of weather data as proxies. Based on this approach, we combine Irish smart meter and weather data to identify and characterize clear differences in the daily patterns between workdays and weekends in both summer and winter and investigate how households respond to changing weather patterns. We also examine the relationships between response groups and household demographic features using different statistical tests. We find the magnitude of the effect of occupancy-related variables in the clustering of weather sensitivity to be larger than incomerelated factors. This proposed new approach could be the basis of a classification model to identify households that are more responsive to different types of weather. Tariff design could benefit from such a model and enable specific schemes to be developed that would target weather-sensitive households and result in improved load management

Short-Term Load Forecasting Using AMI Data

Accurate short-term load forecasting is essential for efficient operation of the power sector. Predicting load at a fine granularity such as individual households or buildings is challenging due to higher volatility and uncertainty in the load. In aggregate loads such as at grids level, the inherent stochasticity and fluctuations are averaged-out, the problem becomes substantially easier. We propose an approach for short-term load forecasting at individual consumers (households) level, called Forecasting using Matrix Factorization (FMF). FMF does not use any consumers' demographic or activity patterns information. Therefore, it can be applied to any locality with the readily available smart meters and weather data. We perform extensive experiments on three benchmark datasets and demonstrate that FMF significantly outperforms the computationally expensive state-of-the-art methods for this problem. We achieve up to 26.5% and 24.4 % improvement in RMSE over Regression Tree and Support Vector Machine, respectively and up to 36% and 73.2% improvement in MAPE over Random Forest and Long Short-Term Memory neural network, respectively

Enhancing household-level load forecasts using daily load profile clustering

Forecasting the electricity demand for individual households is important for both consumers and utilities due to the increasing decentralized nature of the electricity system. Particularly, utilities often have very little information about their consumers except for aggregate building level loads, without knowledge of interior details about the household appliance sets or occupants. In this paper, we explore the possibility of enhancing the day-ahead load forecasts for hundreds of individual households by clustering their daily load profile history to obtain each consumer's specific typical consumption patterns. The clustering method is based on load profile shape using the Earth Mover's Distance metric to calculate similarity between load profiles. The forecasting methods then predict the next day shape from the empirical probability of previous cluster transitions in the consumer's load history and estimate the magnitude either by using historical load relationships with temperature and forecast temperatures or previous day consumption levels. The generated forecasts are compared to a benchmark Multiple Linear Regression (MLR) day-ahead forecast and persistence forecasts for all individuals. While at the aggregate level the MLR method represents a significant improvement over persistence forecasts, on an individual level we find that the best forecasting model is specific to the individual. In particular, we find that the MLR model produces lower errors when consumers have a consistent daily temperature response and the cluster model with previous day magnitude produces lower errors for consumers whose consumption changes abruptly in magnitude for several days at a time. Our work adds to the state of knowledge surrounding individual household load forecasting and demonstrates the potential for cluster-based methodologies to enhance short term load forecasts

Identifying residential consumption patterns using data-mining techniques: A large-scale study of smart meter data in Chengdu, China

The fine-grained electricity consumption data created by advanced metering technologies offers an opportunity to understand residential demand from new angles. Although there exists a large body of research on demand response in short- and long-term forecasting, a comprehensive analysis to identify household consumption behaviour in different scenarios has not been conducted. The study’s novelty lies in its use of unsupervised machine learning tools to explore residential customers’ demand patterns and response without the assistance of traditional survey tools. We investigate behavioural response in three different contexts: 1) seasonal (using weekly consumption profiles); 2) holidays/festivals; and 3) extreme weather situations. The analysis is based on the smart metering data of 2,000 households in Chengdu, China over three years from 2014 to 2016. Workday/weekend profiles indicate that there are two distinct groups of households that appear to be white-collar or relatively affluent families. Demand patterns at the major festivals in China, especially the Spring Festival, reveal various types of lifestyle and households. In terms of extreme weather response, the most striking finding was that in summer, at night-time, over 72% of households doubled (or more) their electricity usage, while consumption changes in winter do not seem to be significant. Our research offers more detailed insight into Chinese residential consumption and provides a practical framework to understand households’ behaviour patterns in different settings