Cost-Based Optimization of Integration Flows

Integration flows are increasingly used to specify and execute data-intensive integration tasks between heterogeneous systems and applications. There are many different application areas such as real-time ETL and data synchronization between operational systems. For the reasons of an increasing amount of data, highly distributed IT infrastructures, and high requirements for data consistency and up-to-dateness of query results, many instances of integration flows are executed over time. Due to this high load and blocking synchronous source systems, the performance of the central integration platform is crucial for an IT infrastructure. To tackle these high performance requirements, we introduce the concept of cost-based optimization of imperative integration flows that relies on incremental statistics maintenance and inter-instance plan re-optimization. As a foundation, we introduce the concept of periodical re-optimization including novel cost-based optimization techniques that are tailor-made for integration flows. Furthermore, we refine the periodical re-optimization to on-demand re-optimization in order to overcome the problems of many unnecessary re-optimization steps and adaptation delays, where we miss optimization opportunities. This approach ensures low optimization overhead and fast workload adaptation

Test-Cost Modeling and Optimal Test-Flow Selection of 3D-Stacked ICs

Three-dimensional (3D) integration is an attractive technology platform for next-generation ICs. Despite the benefits offered by 3D integration, test cost remains a major concern, and analysis and tools are needed to understand test flows and minimize test cost.We propose a generic cost model to account for various test costs involved in 3D integration and present a formal representation of the solution space to minimize the overall cost. We present an algorithm based on A*—a best-first search technique—to obtain an optimal solution. An approximation algorithm with provable bounds on optimality is proposed to further reduce the search space. In contrast to prior work, which is based on explicit enumeration of test flows, we adopt a formal optimization approach, which allows us to select an effective test flow by systematically exploring an exponentially large number of candidate test flows. Experimental results highlight the effectiveness of the proposed method. Adopting a formal approach to solving the cost-minimization problem provides useful insights that cannot be derived via selective enumeration of a smaller number of candidate test flows.This research was supported in part by the National Science Foundation under grant no. CCF-1017391, the Semiconductor Research Corporation under contract no. 2118, a grant from Intel Corporation, and a gift from Cisco Systems through the Silicon Valley Community Foundation

Tackling thermal integration in the synthesis of polygeneration systems for buildings

A novel methodology is proposed for the synthesis of polygeneration systems in tertiary sector buildings with detailed thermal integration. The methodology involves a systematic approach that combines Pinch Analysis, mathematical programming, and the definition of a superstructure with thermal flexibility whereby mass flows can exchange heat in various temperature intervals. With the detailed characterization of the thermal energy flows associated with the thermal energy technologies and services to be supplied to the building, the optimization procedure provides a more realistic system configuration, ensures that thermodynamic principles are satisfied, and allows for synergies and potential benefits to emerge. The methodology is first introduced through a simple example of a gas engine-based energy system, highlighting the necessity of a detailed characterization of the hot and cold flows regarding their quantity and quality levels. Then, the approach is applied to the case study of a Brazilian university hospital that requires electricity, steam, hot water, and chilled water. The optimization is formulated as a multi-period mixed integer linear programming model that minimizes the total annual cost of installing and operating the system using local-based data. The results show the technical and economic interest of deploying cogeneration gas engines to cover electricity and thermal energy services. Besides, a strong synergy is observed between the cogeneration gas engine and the single-effect absorption chiller. Thus, it is demonstrated how a preliminary analysis of thermal integration opportunities must be an integral part of the optimal synthesis of energy supply systems

A unified view of data-intensive flows in business intelligence systems : a survey

Data-intensive flows are central processes in today’s business intelligence (BI) systems, deploying different technologies to deliver data, from a multitude of data sources, in user-preferred and analysis-ready formats. To meet complex requirements of next generation BI systems, we often need an effective combination of the traditionally batched extract-transform-load (ETL) processes that populate a data warehouse (DW) from integrated data sources, and more real-time and operational data flows that integrate source data at runtime. Both academia and industry thus must have a clear understanding of the foundations of data-intensive flows and the challenges of moving towards next generation BI environments. In this paper we present a survey of today’s research on data-intensive flows and the related fundamental fields of database theory. The study is based on a proposed set of dimensions describing the important challenges of data-intensive flows in the next generation BI setting. As a result of this survey, we envision an architecture of a system for managing the lifecycle of data-intensive flows. The results further provide a comprehensive understanding of data-intensive flows, recognizing challenges that still are to be addressed, and how the current solutions can be applied for addressing these challenges.Peer ReviewedPostprint (author's final draft

Economic optimization of component sizing for residential battery storage systems

Battery energy storage systems (BESS) coupled with rooftop-mounted residential photovoltaic (PV) generation, designated as PV-BESS, draw increasing attention and market penetration as more and more such systems become available. The manifold BESS deployed to date rely on a variety of different battery technologies, show a great variation of battery size, and power electronics dimensioning. However, given today's high investment costs of BESS, a well-matched design and adequate sizing of the storage systems are prerequisites to allow profitability for the end-user. The economic viability of a PV-BESS depends also on the battery operation, storage technology, and aging of the system. In this paper, a general method for comprehensive PV-BESS techno-economic analysis and optimization is presented and applied to the state-of-art PV-BESS to determine its optimal parameters. Using a linear optimization method, a cost-optimal sizing of the battery and power electronics is derived based on solar energy availability and local demand. At the same time, the power flow optimization reveals the best storage operation patterns considering a trade-off between energy purchase, feed-in remuneration, and battery aging. Using up to date technology-specific aging information and the investment cost of battery and inverter systems, three mature battery chemistries are compared; a lead-acid (PbA) system and two lithium-ion systems, one with lithium-iron-phosphate (LFP) and another with lithium-nickel-manganese-cobalt (NMC) cathode. The results show that different storage technology and component sizing provide the best economic performances, depending on the scenario of load demand and PV generation.Web of Science107art. no. 83

Industrial water management by multiobjective optimization: from individual to collective solution through eco-industrial parks.

Industrial water networks are designed in the first part by a multiobjective optimization strategy, where fresh water, regenerated water flow rates as well as the number of network connections (integer variables) are minimized. The problem is formulated as a Mixed-Integer Linear Programming problem (MILP) and solved by the ε-constraint method. The linearization of the problem is based on the necessary conditions of optimality defined by Savelski and Bagajewicz (2000). The approach is validated on a published example involving only one contaminant. In the second part the MILP strategy is implemented for designing an Eco-Industrial Park (EIP) involving three companies. Three scenarios are considered: EIP without regeneration unit, EIP where each company owns its regeneration unit and EIP where the three companies share regeneration unit(s). Three possible regeneration units can be chosen, and the MILP is solved under two kinds of conditions: limited or unlimited number of connections, same or different gains for each company. All these cases are compared according to the global equivalent cost expressed in fresh water and taking also into account the network complexity through the number of connections. The best EIP solution for the three companies can be determined

Buildings-to-Grid Integration Framework

This paper puts forth a mathematical framework for Buildings-to-Grid (BtG) integration in smart cities. The framework explicitly couples power grid and building's control actions and operational decisions, and can be utilized by buildings and power grids operators to simultaneously optimize their performance. Simplified dynamics of building clusters and building-integrated power networks with algebraic equations are presented---both operating at different time-scales. A model predictive control (MPC)-based algorithm that formulates the BtG integration and accounts for the time-scale discrepancy is developed. The formulation captures dynamic and algebraic power flow constraints of power networks and is shown to be numerically advantageous. The paper analytically establishes that the BtG integration yields a reduced total system cost in comparison with decoupled designs where grid and building operators determine their controls separately. The developed framework is tested on standard power networks that include thousands of buildings modeled using industrial data. Case studies demonstrate building energy savings and significant frequency regulation, while these findings carry over in network simulations with nonlinear power flows and mismatch in building model parameters. Finally, simulations indicate that the performance does not significantly worsen when there is uncertainty in the forecasted weather and base load conditions.Comment: In Press, IEEE Transactions on Smart Gri