LINVIEW: Incremental View Maintenance for Complex Analytical Queries

Many analytics tasks and machine learning problems can be naturally expressed by iterative linear algebra programs. In this paper, we study the incremental view maintenance problem for such complex analytical queries. We develop a framework, called LINVIEW, for capturing deltas of linear algebra programs and understanding their computational cost. Linear algebra operations tend to cause an avalanche effect where even very local changes to the input matrices spread out and infect all of the intermediate results and the final view, causing incremental view maintenance to lose its performance benefit over re-evaluation. We develop techniques based on matrix factorizations to contain such epidemics of change. As a consequence, our techniques make incremental view maintenance of linear algebra practical and usually substantially cheaper than re-evaluation. We show, both analytically and experimentally, the usefulness of these techniques when applied to standard analytics tasks. Our evaluation demonstrates the efficiency of LINVIEW in generating parallel incremental programs that outperform re-evaluation techniques by more than an order of magnitude.Comment: 14 pages, SIGMO

A Review of integrity constraint maintenance and view updating techniques

Two interrelated problems may arise when updating a database. On one hand, when an update is applied to the database, integrity constraints may become violated. In such case, the integrity constraint maintenance approach tries to obtain additional updates to keep integrity constraints satisfied. On the other hand, when updates of derived or view facts are requested, a view updating mechanism must be applied to translate the update request into correct updates of the underlying base facts. This survey reviews the research performed on integrity constraint maintenance and view updating. It is proposed a general framework to classify and to compare methods that tackle integrity constraint maintenance and/or view updating. Then, we analyze some of these methods in more detail to identify their actual contribution and the main limitations they may present.Postprint (published version

Incremental View Maintenance For Collection Programming

In the context of incremental view maintenance (IVM), delta query derivation is an essential technique for speeding up the processing of large, dynamic datasets. The goal is to generate delta queries that, given a small change in the input, can update the materialized view more efficiently than via recomputation. In this work we propose the first solution for the efficient incrementalization of positive nested relational calculus (NRC+) on bags (with integer multiplicities). More precisely, we model the cost of NRC+ operators and classify queries as efficiently incrementalizable if their delta has a strictly lower cost than full re-evaluation. Then, we identify IncNRC+; a large fragment of NRC+ that is efficiently incrementalizable and we provide a semantics-preserving translation that takes any NRC+ query to a collection of IncNRC+ queries. Furthermore, we prove that incremental maintenance for NRC+ is within the complexity class NC0 and we showcase how recursive IVM, a technique that has provided significant speedups over traditional IVM in the case of flat queries [25], can also be applied to IncNRC+.Comment: 24 pages (12 pages plus appendix

Model based decision support for planning of road maintenance

In this article we describe a Decision Support Model, based on Operational Research methods, for the multi-period planning of maintenance of bituminous pavements. This model is a tool for the road manager to assist in generating an optimal maintenance plan for a road. Optimal means: minimising the Net Present Value of maintenance costs, while the plan is acceptable in terms of technical admissibility, resulting quality, etc. Global restrictions such as budget restrictions can also be imposed.\ud \ud Adequate grouping of maintenance activities in view of quantity discounts is an important aspect of our model. Our approach is to reduce the complexity of the optimisation by hierarchical structuring in four levels. In the lowest two levels maintenance per lane sector is considered, first with an unbounded planning horizon and next with a bounded planning horizon and time-windows for maintenance. The grouping of maintenance activities for a specific road is the topic of the third level. At the fourth level, which we will not consider in this article, the problem of optimal assignment of the available maintenance budgets over a set of roads or road sections takes place. Here, some results are presented to demonstrate the effects of grouping and to show that this hierarchical approach gives rise to improvements compared with previous work

View Selection in Semantic Web Databases

We consider the setting of a Semantic Web database, containing both explicit data encoded in RDF triples, and implicit data, implied by the RDF semantics. Based on a query workload, we address the problem of selecting a set of views to be materialized in the database, minimizing a combination of query processing, view storage, and view maintenance costs. Starting from an existing relational view selection method, we devise new algorithms for recommending view sets, and show that they scale significantly beyond the existing relational ones when adapted to the RDF context. To account for implicit triples in query answers, we propose a novel RDF query reformulation algorithm and an innovative way of incorporating it into view selection in order to avoid a combinatorial explosion in the complexity of the selection process. The interest of our techniques is demonstrated through a set of experiments.Comment: VLDB201

RDFViewS: A Storage Tuning Wizard for RDF Applications

In recent years, the significant growth of RDF data used in numerous applications has made its efficient and scalable manipulation an important issue. In this paper, we present RDFViewS, a system capable of choosing the most suitable views to materialize, in order to minimize the query response time for a specific SPARQL query workload, while taking into account the view maintenance cost and storage space constraints. Our system employs practical algorithms and heuristics to navigate through the search space of potential view configurations, and exploits the possibly available semantic information - expressed via an RDF Schema - to ensure the completeness of the query evaluation

A political scientist's view of the income maintenance experiments

Public welfare ; Public policy

Redefining Industrial Maintenance Activity in the Modern Organization of Industrial Companies

The maintenance activity isn’t a purpose in itself, it’s a necessity of which “the production suffers” and the financial agent “considers too expensive”. It often exists a conflict between the production units and the maintenance department, not only for a short term, but, sometimes, for a long term, imposing a rigorous definition of each person’s responsibilities. Considering the mutations in the industrial equipments’ technical complexity and the accidental failures’ catastrophic consequences from the economic and/or social point of view, it should be assigned a new dimension to the maintenance activity. One of the imperatives imposed to this action is represented by modern means of informing through the maintenance’s operational computerization.maintenance’s progress; total productive maintenance; cooperation in maintenance; the maintenance’s costs minimization; maintenance’s operational computerization.

An economist's view of the income maintenance experiments

Public welfare