DSUALMH-A new high-resolution dataset for NILM

[Abstract]: The optimisation of energy consumption requires a reasonably accurate measurement, so an appropriate and advanced monitoring system of the relevant electrical variables in the electrical installations is of paramount importance. In this context, interoperable and highly configurable devices play a crucial role. A clear example is the OpenZMeter (OZM) which is an open source, open hardware, multi-purpose precision smart meter that can measure a wide range of electrical variables at a high sampling rate and provide processed data on power quality. The aim of this work is to show the use and possible applications of the new high sampling frequency data provided by the OZM device, which are much richer and more accurate than those obtained with other low-cost electrical meters. For this purpose, the opensource tool NILMTK has been used and adapted. Likewise, the use of two of the best known and most widely used algorithms such as Combinatorial Optimisation (CO) and the Factorial Hidden Markov Model (FHMM) has been considered, analysing the results obtained in the experimental study and offering a detailed comparison of the performance of the two different disaggregation algorithms using metrics for the different cases, as well as the incorporation of transients, and the comparison with other public DatasetsMinisterio de Ciencia, Innovación y Universidades; PGC2018-098813-B-C33Universidad de Almería; UAL2020-TIC-A208

Non-intrusive load monitoring solutions for low- and very low-rate granularity

Strathclyde theses - ask staff. Thesis no. : T15573Large-scale smart energy metering deployment worldwide and the integration of smart meters within the smart grid are enabling two-way communication between the consumer and energy network, thus ensuring an improved response to demand. Energy disaggregation or non-intrusive load monitoring (NILM), namely disaggregation of the total metered electricity consumption down to individual appliances using purely algorithmic tools, is gaining popularity as an added-value that makes the most of meter data.In this thesis, the first contribution tackles low-rate NILM problem by proposing an approach based on graph signal processing (GSP) that does not require any training.Note that Low-rate NILM refers to NILM of active power measurements only, at rates from 1 second to 1 minute. Adaptive thresholding, signal clustering and pattern matching are implemented via GSP concepts and applied to the NILM problem. Then for further demonstration of GSP potential, GSP concepts are applied at both, physical signal level via graph-based filtering and data level, via effective semi-supervised GSP-based feature matching. The proposed GSP-based NILM-improving methods are generic and can be used to improve the results of various event-based NILM approaches. NILM solutions for very low data rates (15-60 min) cannot leverage on low to highrates NILM approaches. Therefore, the third contribution of this thesis comprises three very low-rate load disaggregation solutions, based on supervised (i) K-nearest neighbours relying on features such as statistical measures of the energy signal, time usage profile of appliances and reactive power consumption (if available); unsupervised(ii) optimisation performing minimisation of error between aggregate and the sum of estimated individual loads, where energy consumed by always-on load is heuristically estimated prior to further disaggregation and appliance models are built only by manufacturer information; and (iii) GSP as a variant of aforementioned GSP-based solution proposed for low-rate load disaggregation, with an additional graph of time-of-day information.Large-scale smart energy metering deployment worldwide and the integration of smart meters within the smart grid are enabling two-way communication between the consumer and energy network, thus ensuring an improved response to demand. Energy disaggregation or non-intrusive load monitoring (NILM), namely disaggregation of the total metered electricity consumption down to individual appliances using purely algorithmic tools, is gaining popularity as an added-value that makes the most of meter data.In this thesis, the first contribution tackles low-rate NILM problem by proposing an approach based on graph signal processing (GSP) that does not require any training.Note that Low-rate NILM refers to NILM of active power measurements only, at rates from 1 second to 1 minute. Adaptive thresholding, signal clustering and pattern matching are implemented via GSP concepts and applied to the NILM problem. Then for further demonstration of GSP potential, GSP concepts are applied at both, physical signal level via graph-based filtering and data level, via effective semi-supervised GSP-based feature matching. The proposed GSP-based NILM-improving methods are generic and can be used to improve the results of various event-based NILM approaches. NILM solutions for very low data rates (15-60 min) cannot leverage on low to highrates NILM approaches. Therefore, the third contribution of this thesis comprises three very low-rate load disaggregation solutions, based on supervised (i) K-nearest neighbours relying on features such as statistical measures of the energy signal, time usage profile of appliances and reactive power consumption (if available); unsupervised(ii) optimisation performing minimisation of error between aggregate and the sum of estimated individual loads, where energy consumed by always-on load is heuristically estimated prior to further disaggregation and appliance models are built only by manufacturer information; and (iii) GSP as a variant of aforementioned GSP-based solution proposed for low-rate load disaggregation, with an additional graph of time-of-day information

Effective non-intrusive load monitoring of buildings based on a novel multi-descriptor fusion with dimensionality reduction

Recently, a growing interest has been dedicated towards developing and implementing low-cost energy efficiency solutions in buildings. Accordingly, non-intrusive load monitoring has been investigated in various academic and industrial projects for capturing device-specific consumption footprints without any additional hardware installation. However, its performance should be improved further to enable an accurate appliance identification from the aggregated load. This paper presents an efficient non-intrusive load monitoring framework that consists of the following main components: (i) a novel fusion of multiple time-domain features is proposed to extract appliance fingerprints; (ii) a dimensionality reduction scheme is introduced to be applied to the fused time-domain features, which relies on fuzzy-neighbors preserving analysis based QR-decomposition. The latter can not only reduce feature dimensionality, but it can also effectively decrease the intra-class distances and increase the extra-class distances of appliance features; and (iii) a powerful decision bagging tree classifier is implemented to accurately classify electrical devices using the reduced features. Empirical evaluations performed on three real datasets, namely ACS-F2, REDD and WHITED collected at different sampling rates have shown a promising performance, according to the accuracy and F1 score achieved using the proposed non-intrusive load monitoring system. Reported accuracy and F1 score have reached both 100% for the WHITED dataset, 99.79% and 99.76% for the REDD dataset, and up to 99.41% and 98.93% for the ACS-f2 dataset, respectively. The outstanding performance achieved using the proposed solution determines its effectiveness in collecting individual-appliance consumption data and in promoting energy saving behaviors. 2020 The AuthorsThis paper was made possible by National Priorities Research Program (NPRP) grant No. 10-0130-170288 from the Qatar National Research Fund (a member of Qatar Foundation). The statements made herein are solely the responsibility of the authors. All authors approved the version of the manuscript to be published.Scopu

Energy Data Analytics for Smart Meter Data

The principal advantage of smart electricity meters is their ability to transfer digitized electricity consumption data to remote processing systems. The data collected by these devices make the realization of many novel use cases possible, providing benefits to electricity providers and customers alike. This book includes 14 research articles that explore and exploit the information content of smart meter data, and provides insights into the realization of new digital solutions and services that support the transition towards a sustainable energy system. This volume has been edited by Andreas Reinhardt, head of the Energy Informatics research group at Technische Universität Clausthal, Germany, and Lucas Pereira, research fellow at Técnico Lisboa, Portugal

Next-generation energy systems for sustainable smart cities: Roles of transfer learning

Smart cities attempt to reach net-zero emissions goals by reducing wasted energy while improving grid stability and meeting service demand. This is possible by adopting next-generation energy systems, which leverage artificial intelligence, the Internet of things (IoT), and communication technologies to collect and analyze big data in real-time and effectively run city services. However, training machine learning algorithms to perform various energy-related tasks in sustainable smart cities is a challenging data science task. These algorithms might not perform as expected, take much time in training, or do not have enough input data to generalize well. To that end, transfer learning (TL) has been proposed as a promising solution to alleviate these issues. To the best of the authors’ knowledge, this paper presents the first review of the applicability of TL for energy systems by adopting a well-defined taxonomy of existing TL frameworks. Next, an in-depth analysis is carried out to identify the pros and cons of current techniques and discuss unsolved issues. Moving on, two case studies illustrating the use of TL for (i) energy prediction with mobility data and (ii) load forecasting in sports facilities are presented. Lastly, the paper ends with a discussion of the future directions

An intelligent nonintrusive load monitoring scheme based on 2D phase encoding of power signals

Nonintrusive load monitoring (NILM) is the de facto technique for extracting device-level power consumption fingerprints at (almost) no cost from only aggregated mains readings. Specifically, there is no need to install an individual meter for each appliance. However, a robust NILM system should incorporate a precise appliance identification module that can effectively discriminate between various devices. In this context, this paper proposes a powerful method to extract accurate power fingerprints for electrical appliance identification. Rather than relying solely on time-domain (TD) analysis, this framework abstracts the phase encoding of the TD description of power signals using a two-dimensional (2D) representation. This allows mapping power trajectories to a novel 2D binary representation space, and then performing a histogramming process after converting binary codes to new decimal representations. This yields the final histogram of 2D phase encoding of power signals, namely, 2D-PEP. An empirical performance evaluation conducted with three realistic power consumption databases collected at distinct resolutions indicates that the proposed 2D-PEP descriptor achieves outperformance for appliance identification in comparison with other recent techniques. Accordingly, high identification accuracies are attained on the GREEND, UK-DALE, and WHITED data sets, where 99.54%, 98.78%, and 100% rates have been achieved, respectively, using the proposed 2D-PEP descriptor. 2020 The Authors. International Journal of Intelligent Systems published by Wiley Periodicals LLCThis paper was made possible by National Priorities Research Program (NPRP) Grant No. 10-0130-170288 from the Qatar National Research Fund (a member of Qatar Foundation). The statements made herein are solely the responsibility of the authors. Open Access funding provided by the Qatar National Library.Scopu

TerraSenseTK: a toolkit for remote soil nutrient estimation

Intensive farming endangers soil quality in various ways. Researchers show that if these practices continue, humanity will be faced with food production issues. For this matter, Earth Observation, more concretely Soil Sensing, along with Machine Learning, can be employed to monitor several indicators of soil degradation, such as soil salinity, soil heavy metal contamination and soil nutrients estimation. More concretely, Soil Nutrients are of great importance. For instance, to understand which crop better suits the land, the soil nutrients must be identified. However, sampling soil is a laborous and expensive task, which can be leveraged by Remote Sensing and Machine Learning. Several studies have already been developed in this matter, although many gaps still exist. Among them, the lack of cross-dataset evaluations of existing algorithms, and also the steep learning curve to the Earth Observation domain that prevents many researchers from embracing this field. In this sense, we propose TerraSense ToolKit (TSTK), a python toolkit that addresses these challenges. In this work, the possibility to use Remote sensing along with Machine Learning algorithms to per form Soil Nutrient Estimation is explored, additionally, a nutrient estimation toolkit is proposed, and the effectivity of it is tested in a soil nutrient estimation case study. This toolkit is capable of simplifying Remote Sensing experiments and aims at reducing the barrier to entry to the field of Earth Observation. It comes with a preconfigured case study which implements a soil sensing pipeline. To evaluate the usability of the toolkit, experiments with five different crops were executed, namely with Wheat, Barley, Maize, Sunflower and Vineyards. This case study gave visibility to an underlying unbalanced data problem, which is not well addressed in the current State of the Art.A agricultura intensiva poe em perigo a qualidade do solo de v ˜ arias formas. Os investigadores ´ mostram que, se continuarmos com estas praticas, a humanidade ser ´ a confrontada com quest ´ oes de ˜ produc¸ao alimentar. Para este efeito, a Observac¸ ˜ ao da Terra, mais concretamente o Sensoriamento ˜ do Solo, juntamente com a aprendizagem automatica, podem ser utilizadas para monitorizar v ´ arios ´ indicadores da degradac¸ao do solo, tais como a salinidade do solo, a contaminac¸ ˜ ao do solo por metais ˜ pesados e a quantificac¸ao dos nutrientes do solo. Mais concretamente, os Nutrientes do Solo s ˜ ao de ˜ grande importancia. Por exemplo para compreender qual a cultura que melhor se adapta ao solo, os ˆ nutrientes do solo devem ser identificados. No entanto, a amostragem do solo e uma tarefa trabalhosa ´ e dispendiosa, que pode ser impulsionada pela percepc¸ao remota e pela aprendizagem autom ˜ atica. ´ Ja foram desenvolvidos v ´ arios estudos sobre este assunto, embora ainda existam muitas lacunas. ´ Entre eles, a falta de avaliac¸oes cruzadas dos algoritmos existentes, e tamb ˜ em a curva de aprendiza- ´ gem acentuada para o campo de Observac¸ao da Terra que impede muitos investigadores de enveredar ˜ por este campo. Neste sentido, propomos TSTK, um toolkit em python que aborda estes desafios. Neste trabalho, e explorada a possibilidade de usar a Percepc¸ ´ ao Remota juntamente com os algo- ˜ ritmos de Aprendizagem Automatica para realizar a Estimativa de Nutrientes do Solo. Al ´ em disso, ´ e´ proposto um toolkit de estimativa de nutrientes e tambem um pipeline para o devido efeito, a efetividade ´ do toolkit e testada num caso de estudo de Estimac¸ ´ ao de Nutrientes no Solo. ˜ Este toolkit e capaz de simplificar as experi ´ encias de Percepc¸ ˆ ao Remota e visa reduzir a barreira ˜ de entrada no campo da Observac¸ao da Terra. Para avaliar a usabilidade do toolkit, foram executadas ˜ experiencias com cinco culturas diferentes, nomeadamente Trigo, Cevada, Milho, Girassol e Vinha. Este ˆ caso de estudo deu visibilidade a um problema subjacente de dados desiquilibrados, o qual nao˜ e bem ´ identificado no Estado da Arte atual

Systematic Approaches for Telemedicine and Data Coordination for COVID-19 in Baja California, Mexico

Conference proceedings info: ICICT 2023: 2023 The 6th International Conference on Information and Computer Technologies Raleigh, HI, United States, March 24-26, 2023 Pages 529-542We provide a model for systematic implementation of telemedicine within a large evaluation center for COVID-19 in the area of Baja California, Mexico. Our model is based on human-centric design factors and cross disciplinary collaborations for scalable data-driven enablement of smartphone, cellular, and video Teleconsul-tation technologies to link hospitals, clinics, and emergency medical services for point-of-care assessments of COVID testing, and for subsequent treatment and quar-antine decisions. A multidisciplinary team was rapidly created, in cooperation with different institutions, including: the Autonomous University of Baja California, the Ministry of Health, the Command, Communication and Computer Control Center of the Ministry of the State of Baja California (C4), Colleges of Medicine, and the College of Psychologists. Our objective is to provide information to the public and to evaluate COVID-19 in real time and to track, regional, municipal, and state-wide data in real time that informs supply chains and resource allocation with the anticipation of a surge in COVID-19 cases. RESUMEN Proporcionamos un modelo para la implementación sistemática de la telemedicina dentro de un gran centro de evaluación de COVID-19 en el área de Baja California, México. Nuestro modelo se basa en factores de diseño centrados en el ser humano y colaboraciones interdisciplinarias para la habilitación escalable basada en datos de tecnologías de teleconsulta de teléfonos inteligentes, celulares y video para vincular hospitales, clínicas y servicios médicos de emergencia para evaluaciones de COVID en el punto de atención. pruebas, y para el tratamiento posterior y decisiones de cuarentena. Rápidamente se creó un equipo multidisciplinario, en cooperación con diferentes instituciones, entre ellas: la Universidad Autónoma de Baja California, la Secretaría de Salud, el Centro de Comando, Comunicaciones y Control Informático. de la Secretaría del Estado de Baja California (C4), Facultades de Medicina y Colegio de Psicólogos. Nuestro objetivo es proporcionar información al público y evaluar COVID-19 en tiempo real y rastrear datos regionales, municipales y estatales en tiempo real que informan las cadenas de suministro y la asignación de recursos con la anticipación de un aumento de COVID-19. 19 casos.ICICT 2023: 2023 The 6th International Conference on Information and Computer Technologieshttps://doi.org/10.1007/978-981-99-3236-

Energy, Science and Technology 2015. The energy conference for scientists and researchers. Book of Abstracts, EST, Energy Science Technology, International Conference & Exhibition, 20-22 May 2015, Karlsruhe, Germany

We are pleased to present you this Book of Abstracts, which contains the submitted contributions to the "Energy, Science and Technology Conference & Exhibition EST 2015". The EST 2015 took place from May, 20th until May, 22nd 2015 in Karlsruhe, Germany, and brought together many different stakeholders, who do research or work in the broad field of "Energy". Renewable energies have to present a relevant share in a sustainable energy system and energy efficiency has to guarantee that conventional as well as renewable energy sources are transformed and used in a reasonable way. The adaption of existing infrastructure and the establishment of new systems, storages and grids are necessary to face the challenges of a changing energy sector. Those three main topics have been the fundament of the EST 2015, which served as a platform for national and international attendees to discuss and interconnect the various disciplines within energy research and energy business. We thank the authors, who summarised their high-quality and important results and experiences within one-paged abstracts and made the conference and this book possible. The abstracts of this book have been peer-reviewed by an international Scientific Programme Committee and are ordered by type of presentation (oral or poster) and topics. You can navigate by using either the table of contents (page 3) or the conference programme (starting page 4 for oral presentations and page 21 for posters respectively)

A demonstration of reproducible state-of-the-art energy disaggregation using NILMTK

by Nipun Batra, Rithwik Kukunuri, Ayush Pandey, Raktim Malakar, Rajat Kumar, Odysseas Krystalakos, Mingjun Zhong, Paulo Meira, and Oliver Parso