Big Energy Data Management for Smart Grids—Issues, Challenges and Recent Developments

Urban areas suffer from tremendous pressure to cope with increasing population in a city. A smart city is a technological solution that integrates engineering and information systems to assist in managing these scarce resources. A smart city comprises several intelligent services such as smart grids, smart education, smart transportation, smart buildings, smart waste management and so on. Among all these, smart grids are the nucleus of all the facilities because these provide sustainable electrical supply for other smart services to operate seamlessly. Smart grids integrate information and communication technologies (ICT) into traditional energy grids, thereby capturing massive amounts of data from several devices like smart meters, sensors, and other electrical infrastructuresSCADA. The data collected in smart grids are heterogeneous and require data analytic techniques to extract meaningful information to make informed decisions. We term this enormous amount of data as big energy data. This book chapter discusses progress in the field of big energy data by enlisting different studies that cover several data management aspects such as data collection, data preprocessing, data integration, data storage, data analytics, data visualisation and decision-making. We also discuss various challenges in data management and report recent progress in this field. Finally, we present open research areas in big data managementBig data management especially in relation to smart grids