Big Data and the Internet of Things

Advances in sensing and computing capabilities are making it possible to embed increasing computing power in small devices. This has enabled the sensing devices not just to passively capture data at very high resolution but also to take sophisticated actions in response. Combined with advances in communication, this is resulting in an ecosystem of highly interconnected devices referred to as the Internet of Things - IoT. In conjunction, the advances in machine learning have allowed building models on this ever increasing amounts of data. Consequently, devices all the way from heavy assets such as aircraft engines to wearables such as health monitors can all now not only generate massive amounts of data but can draw back on aggregate analytics to "improve" their performance over time. Big data analytics has been identified as a key enabler for the IoT. In this chapter, we discuss various avenues of the IoT where big data analytics either is already making a significant impact or is on the cusp of doing so. We also discuss social implications and areas of concern.Comment: 33 pages. draft of upcoming book chapter in Japkowicz and Stefanowski (eds.) Big Data Analysis: New algorithms for a new society, Springer Series on Studies in Big Data, to appea

Contributions to energy-aware demand-response systems using SDN and NFV for fog computing

Ever-increasing energy consumption, the depletion of non-renewable resources, the climate impact associated with energy generation, and finite energy-production capacity are important concerns worldwide that drive the urgent creation of new energy management and consumption schemes. In this regard, by leveraging the massive connectivity provided by emerging communications such as the 5G systems, this thesis proposes a long-term sustainable Demand-Response solution for the adaptive and efficient management of available energy consumption for Internet of Things (IoT) infrastructures, in which energy utilization is optimized based on the available supply. In the proposed approach, energy management focuses on consumer devices (e.g., appliances such as a light bulb or a screen). In this regard, by proposing that each consumer device be part of an IoT infrastructure, it is feasible to control its respective consumption. The proposal includes an architecture that uses Network Functions Virtualization (NFV) and Software Defined Networking technologies as enablers to promote the primary use of energy from renewable sources. Associated with architecture, this thesis presents a novel consumption model conditioned on availability in which consumers are part of the management process. To efficiently use the energy from renewable and non-renewable sources, several management strategies are herein proposed, such as the prioritization of the energy supply, workload scheduling using time-shifting capabilities, and quality degradation to decrease- the power demanded by consumers if needed. The adaptive energy management solution is modeled as an Integer Linear Programming, and its complexity has been identified to be NP-Hard. To verify the improvements in energy utilization, an optimal algorithmic solution based on a brute force search has been implemented and evaluated. Because the hardness of the adaptive energy management problem and the non-polynomial growth of its optimal solution, which is limited to energy management for a small number of energy demands (e.g., 10 energy demands) and small values of management mechanisms, several faster suboptimal algorithmic strategies have been proposed and implemented. In this context, at the first stage, we implemented three heuristic strategies: a greedy strategy (GreedyTs), a genetic-algorithm-based solution (GATs), and a dynamic programming approach (DPTs). Then, we incorporated into both the optimal and heuristic strategies a prepartitioning method in which the total set of analyzed services is divided into subsets of smaller size and complexity that are solved iteratively. As a result of the adaptive energy management in this thesis, we present eight strategies, one timal and seven heuristic, that when deployed in communications infrastructures such as the NFV domain, seek the best possible scheduling of demands, which lead to efficient energy utilization. The performance of the algorithmic strategies has been validated through extensive simulations in several scenarios, demonstrating improvements in energy consumption and the processing of energy demands. Additionally, the simulation results revealed that the heuristic approaches produce high-quality solutions close to the optimal while executing among two and seven orders of magnitude faster and with applicability to scenarios with thousands and hundreds of thousands of energy demands. This thesis also explores possible application scenarios of both the proposed architecture for adaptive energy management and algorithmic strategies. In this regard, we present some examples, including adaptive energy management in-home systems and 5G networks slicing, energy-aware management solutions for unmanned aerial vehicles, also known as drones, and applicability for the efficient allocation of spectrum in flex-grid optical networks. Finally, this thesis presents open research problems and discusses other application scenarios and future work.El constante aumento del consumo de energía, el agotamiento de los recursos no renovables, el impacto climático asociado con la generación de energía y la capacidad finita de producción de energía son preocupaciones importantes en todo el mundo que impulsan la creación urgente de nuevos esquemas de consumo y gestión de energía. Al aprovechar la conectividad masiva que brindan las comunicaciones emergentes como los sistemas 5G, esta tesis propone una solución de Respuesta a la Demanda sostenible a largo plazo para la gestión adaptativa y eficiente del consumo de energía disponible para las infraestructuras de Internet of Things (IoT), en el que se optimiza la utilización de la energía en función del suministro disponible. En el enfoque propuesto, la gestión de la energía se centra en los dispositivos de consumo (por ejemplo, electrodomésticos). En este sentido, al proponer que cada dispositivo de consumo sea parte de una infraestructura IoT, es factible controlar su respectivo consumo. La propuesta incluye una arquitectura que utiliza tecnologías de Network Functions Virtualization (NFV) y Software Defined Networking como habilitadores para promover el uso principal de energía de fuentes renovables. Asociada a la arquitectura, esta tesis presenta un modelo de consumo condicionado a la disponibilidad en el que los consumidores son parte del proceso de gestión. Para utilizar eficientemente la energía de fuentes renovables y no renovables, se proponen varias estrategias de gestión, como la priorización del suministro de energía, la programación de la carga de trabajo utilizando capacidades de cambio de tiempo y la degradación de la calidad para disminuir la potencia demandada. La solución de gestión de energía adaptativa se modela como un problema de programación lineal entera con complejidad NP-Hard. Para verificar las mejoras en la utilización de energía, se ha implementado y evaluado una solución algorítmica óptima basada en una búsqueda de fuerza bruta. Debido a la dureza del problema de gestión de energía adaptativa y el crecimiento no polinomial de su solución óptima, que se limita a la gestión de energía para un pequeño número de demandas de energía (por ejemplo, 10 demandas) y pequeños valores de los mecanismos de gestión, varias estrategias algorítmicas subóptimos más rápidos se han propuesto. En este contexto, en la primera etapa, implementamos tres estrategias heurísticas: una estrategia codiciosa (GreedyTs), una solución basada en algoritmos genéticos (GATs) y un enfoque de programación dinámica (DPTs). Luego, incorporamos tanto en la estrategia óptima como en la- heurística un método de prepartición en el que el conjunto total de servicios analizados se divide en subconjuntos de menor tamaño y complejidad que se resuelven iterativamente. Como resultado de la gestión adaptativa de la energía en esta tesis, presentamos ocho estrategias, una óptima y siete heurísticas, que cuando se despliegan en infraestructuras de comunicaciones como el dominio NFV, buscan la mejor programación posible de las demandas, que conduzcan a un uso eficiente de la energía. El desempeño de las estrategias algorítmicas ha sido validado a través de extensas simulaciones en varios escenarios, demostrando mejoras en el consumo de energía y el procesamiento de las demandas de energía. Los resultados de la simulación revelaron que los enfoques heurísticos producen soluciones de alta calidad cercanas a las óptimas mientras se ejecutan entre dos y siete órdenes de magnitud más rápido y con aplicabilidad a escenarios con miles y cientos de miles de demandas de energía. Esta tesis también explora posibles escenarios de aplicación tanto de la arquitectura propuesta para la gestión adaptativa de la energía como de las estrategias algorítmicas. En este sentido, presentamos algunos ejemplos, que incluyen sistemas de gestión de energía adaptativa en el hogar, en 5G networkPostprint (published version

A systematic literature review on the use of artificial intelligence in energy self-management in smart buildings

Buildings are one of the main consumers of energy in cities, which is why a lot of research has been generated around this problem. Especially, the buildings energy management systems must improve in the next years. Artificial intelligence techniques are playing and will play a fundamental role in these improvements. This work presents a systematic review of the literature on researches that have been done in recent years to improve energy management systems for smart building using artificial intelligence techniques. An originality of the work is that they are grouped according to the concept of "Autonomous Cycles of Data Analysis Tasks", which defines that an autonomous management system requires specialized tasks, such as monitoring, analysis, and decision-making tasks for reaching objectives in the environment, like improve the energy efficiency. This organization of the work allows us to establish not only the positioning of the researches, but also, the visualization of the current challenges and opportunities in each domain. We have identified that many types of researches are in the domain of decision-making (a large majority on optimization and control tasks), and defined potential projects related to the development of autonomous cycles of data analysis tasks, feature engineering, or multi-agent systems, among others.European Commissio

Investigation of Electric Water Heaters as Demand Response Resources and Their Impact on Power System Operational Reliability

The electricity consumption has increased dramatically in past decades due to the improvement of people’s life standard and the increase of their incomes. Some uncertainties have occurred because of an increasing electricity consumption at the household level. As a result, the high power consumption of massive households will affect power system reliability. Recently, the traditional power grid is being transformed to the smart grid, which is an effective way to deal with these issues. The electricity utility could manage the demand side resources using different kinds of Demand Response (DR) methods. Residential resource is an important part besides industrial resource and commercial resource. With the deployment of Home Energy Management System (HEMS) and smart household devices, users’ behavior could be adjusted to respond to the utility signal. Electric Water Heaters (EWHs) account for a huge percentage of energy consumption among all the home appliances. Aggregated EWHs are idea candidates as demand response resources whose power consumption pattern can be modified because they not only consume lots of energy but also have heat storage capability. Therefore, EWHs can react to the optimal operation signal without affecting customers’ daily needs. In this way, electricity utility could treat EWHs as a kind of interruptible load to provide operating reserves to improve power system reliability. In this thesis, a Binary Particle Swarm Optimization (BPSO) algorithm is utilized to perform the optimization of EWHs. The goal of each EWH optimization using BPSO is to minimize the customers’ electricity cost. Therefore, Time-Of-Use (TOU) electricity rate is utilized as the DR incentive. Meanwhile, the customers’ daily need for hot water should be guaranteed, so a comfort level index is enforced in the optimization process. The thermal model of EWH and water usage profile are used to calculate the real-time hot water temperature. Aggregating thousands of EWHs will have positive influences on power system reliability when massive EWHs are utilized as interruptible loads. EWHs could compensate for the Unit Commitment Risk (UCR) considering the operating reserve capacity they can provide. The UCR reduction is used to calculate and analyze the influence of aggregated EWHs. A Reliability Test System is modified to test the capacity of aggregated EWHs in this study. Based on the simulation results, the proposed optimization strategy for EWHs is proved to be practical. The customers’ electricity bill has declined effectively and the user’s comfort level, considering different water temperature set point ranges, is ensured. This thesis provides a practicable scheme for residential customers to arrange their EWHs more reasonably. The simulation results show the aggregated EWHs’ load curve and indicate that the proposed method shifts aggregated EWHs load effectively during some peak hours. According to the calculation results of UCR reduction, the aggregated EWHs is turned out to be a great candidate for power system to improve the reliability during peak-hours

Demand response performance and uncertainty: A systematic literature review

The present review has been carried out, resorting to the PRISMA methodology, analyzing 218 published articles. A comprehensive analysis has been conducted regarding the consumer's role in the energy market. Moreover, the methods used to address demand response uncertainty and the strategies used to enhance performance and motivate participation have been reviewed. The authors find that participants will be willing to change their consumption pattern and behavior given that they have a complete awareness of the market environment, seeking the optimal decision. The authors also find that a contextual solution, giving the right signals according to the different behaviors and to the different types of participants in the DR event, can improve the performance of consumers' participation, providing a reliable response. DR is a mean of demand-side management, so both these concepts are addressed in the present paper. Finally, the pathways for future research are discussed.This article is a result of the project RETINA (NORTE-01-0145- FEDER-000062), supported by Norte Portugal Regional Operational Programme (NORTE 2020), under the PORTUGAL 2020 Partnership Agreement, through the European Regional Development Fund (ERDF). We also acknowledge the work facilities and equipment provided by GECAD research center (UIDB/00760/2020) to the project team, and grants CEECIND/02887/2017 and SFRH/BD/144200/2019.info:eu-repo/semantics/publishedVersio

Optimization of energy consumption in smart homes using firefly algorithm and deep neural networks

Electronic gadget advancements have increased the demand for IoT-based smart homes as the number of connected devices grows rapidly. The most prevalent connected electronic devices are smart environments in houses, grids, structures, and metropolises. Smart grid technology advancements have enabled smart structures to cover every nanosecond of energy use. The problem with smart, intelligent operations is that they use a lot more energy than traditional ones. Because of the growing growth of smart cities and houses, there is an increasing demand for efficient resource management. Energy is a valuable resource with a high unit cost. Consequently, authors are endeavoring to decrease energy usage, specifically in smart urban areas, while simultaneously ensuring a consistent terrain. The objective of this study is to enhance energy efficiency in intelligent buildings for both homes and businesses. For the comfort indicator ("thermal, visual, and air quality"), three parameters are used: temperature, illumination, and CO2. A hybrid rule-based Deep Neural Network (DNN) and Fire Fly (FF) algorithm are used to read the sensor parameters and to operate the comfort indication, as well as optimize energy consumption, respectively. The anticipated user attributes contributed to the system's enhanced performance in terms of the ease of use of the smart system and its energy usage. When compared to traditional approaches in expressions of Multi View with 98.23%, convolutional neural network (CNN) with 99.17%, and traffic automatic vehicle (AV) with 98.14%, the activities of the contributed approach are negligibly commanding

Hemin Acquisition in Bartonella quintana

Bartonella quintana, a Gram-negative bacterial pathogen, causes Trench fever, bacillary angiomatosis and endocarditis. Transmitted by the human body louse (Pediculus humanus corporis), the agent has a tropism for erythrocytes in humans. In vitro growth requires an extraordinary concentration of hemin, and genomic analyses indicate several potential uptake systems and iron-responsive regulators. Transcription of the hbp genes (hemin binding protein genes) is responsive to alterations in available hemin and an HbpA homolog in B. henselae reportedly functions as a hemin receptor in E. coli hemA strain EB53. B. quintana hbpA was not able to complement EB53, indicating that it is not a hemin receptor. A functional hemin receptor and coordinate uptake system is encoded by the hemin utilization (hut) locus. B. quintana hutA was able to complement a hemA mutation in E. coli EB53 and was shown to be TonB-dependent using an isogenic E. coli hemA tonB strain. Fur (ferric uptake regulator) has been described as a global iron-responsive regulator in &gamma-proteobacteria. If expression is forced, B. quintana fur is able to complement an E. coli fur mutant, but an endogenous promoter for the gene could not be located and native expression in B. quintana was not detected. Overexpression of the iron response regulator (Irr), a Fur family member, in B. quintana repressed hut locus transcription. Previous studies showed that Irr interacted with a consensus motif, the H-box, in the promoter of the hbp genes. A region with homology to the H-box consensus is present in the divergent promoter between hutA and tonB and in the promoter region of hemS. The fate of hemin in the bacterial cytoplasm is not well understood. HemS is a potential hemin storage/degradation enzyme. Initial characterization indicates that HemS is able to bind hemin in a 1:1 fashion with an estimated dissociation constant (Kd) of 5.9 + 1.7 &muM. Complementation analyses using Corynebacterium ulcerans CU712hmuO&delta strain have not been successful but future experiments plan to use an E. coli chuS strain. These studies have characterized the principal hemin uptake system of B. quintana, identified its transcriptional regulator, and initiated investigation of a potential heme oxygenase

Residential Energy Management for Renewable Energy Systems Incorporating Data-Driven Unravelling of User Behavior

The penetration of distributed energy resources (DERs) such as photovoltaic (PV) at the residential level has increased rapidly over the past year. It will inevitably induce a paradigm shift in end-user and operations of local energy markets. The energy community with high integration of DERs initiative allows its users to manage their generation (for prosumers) and consumption more efficiently, resulting in various economic, social, and environmental benefits. Specifically, the local energy communities and their members can legally engage in energy generation, distribution, supply, consumption, storage, and sharing to increase levels of autonomy from the power grid, advance energy efficiency, reduce energy costs, and decrease carbon emissions. Reducing energy consumption costs is difficult for residential energy management without understanding the users' preferences. The advanced measurement and communication technologies provide opportunities for individual consumers/prosumers and local energy communities to adopt a more active role in renewable-rich smart grids. Non-intrusive load monitoring (NILM) monitors the load activities from a single point source, such as a smart meter, based on the assumption that different appliances have different power consumption levels and features. NILM can extract the users' load consumption from the smart meter to support the development of the smart grid for better energy management and demand response (DR). Yet to date, how to design residential energy management, including home energy management systems (HEMS) and community energy management systems (CEMS), with an understanding of user preferences and willingness to participate in energy management, is still far from being fully investigated. This thesis aims to develop methodologies for a resident energy management system for renewable energy systems (RES) incorporating data-driven unravelling of the user's energy consumption behaviour

Energy Management Systems for Optimal Operation of Electrical Micro/Nanogrids

Energy management systems (EMSs) are nowadays considered one of the most relevant technical solutions for enhancing the efficiency, reliability, and economy of smart micro/nanogrids, both in terrestrial and vehicular applications. For this reason, the recent technical literature includes numerous technical contributions on EMSs for residential/commercial/vehicular micro/nanogrids that encompass renewable generators and battery storage systems (BSS) The volume “Energy Management Systems for Optimal Operation of Electrical Micro/Nanogrids”, was released as a Special Issue of the journal Energies, published by MDPI, with the aim of expanding the knowledge on EMSs for the optimal operation of electrical micro/nanogrids by presenting topical and high-quality research papers that address open issues in the identified technical field. The volume is a collection of seven research papers authored by research teams from several countries, where different hot topics are accurately explored. The reader will have the possibility to benefit from original scientific results concerning, in particular, the following key topics: distribution systems; smart home/building; battery energy storage; demand uncertainty; energy forecasting; model predictive control; real-time control, microgrid planning; and electrical vehicles