Towards Comparative Analysis of Resumption Techniques in ETL

Data warehouses are loaded with data from sources such as operational data bases. Failure of loading process or failure of any of the process such as extraction or transformation is expensive because of the non-availability of data for analysis. With the advent of e-commerce and many real time application analysis of data in real time becomes a norm and hence any misses while the data is being loaded into data warehouse needs to be handled in an efficient and optimized way. The techniques to handle failure of process to populate the data are very much important as the actual loading process. Alternative arrangement needs to be made for in case of failure so that processes of populating the data warehouse are done in time. This paper explores the various ways through which a failed process of populating the data warehouse could be resumed. Various resumption techniques are compared and a novel block based technique is proposed to improve one of the existing resumption techniques

The Use of Olap Reporting Technology to Improve Patient Care Services Decision Making Within the University Health Center

The purpose of this paper is to demonstrate that it is feasible for the student health center to leverage existing clinical data in a data warehouse by using OLAP reporting in order to improve patient care and health care services decision making. Historically, University health care centers have relied mainly on operational data sources for critical health care decision making. These sources of data do not contain enough information to allow health officials to recognize trends or predict how future changes in health care services might vastly improve overall heath care. Four proof of concept artifacts are constructed through design science research methodology, and a feasibility study is presented to build the case for the adoption of OLAP reporting technology. The study concludes that it is feasible to implement an OLAP reporting infrastructure at the student health center if physicians, clinical staff, and administration clearly define the need for the new technology, develop proper data extraction, loading, and transformation strategy, and adequately provide project management and data warehouse design towards the implementation of the solution

Semantic web data warehousing for caGrid

The National Cancer Institute (NCI) is developing caGrid as a means for sharing cancer-related data and services. As more data sets become available on caGrid, we need effective ways of accessing and integrating this information. Although the data models exposed on caGrid are semantically well annotated, it is currently up to the caGrid client to infer relationships between the different models and their classes. In this paper, we present a Semantic Web-based data warehouse (Corvus) for creating relationships among caGrid models. This is accomplished through the transformation of semantically-annotated caBIG® Unified Modeling Language (UML) information models into Web Ontology Language (OWL) ontologies that preserve those semantics. We demonstrate the validity of the approach by Semantic Extraction, Transformation and Loading (SETL) of data from two caGrid data sources, caTissue and caArray, as well as alignment and query of those sources in Corvus. We argue that semantic integration is necessary for integration of data from distributed web services and that Corvus is a useful way of accomplishing this. Our approach is generalizable and of broad utility to researchers facing similar integration challenges

Rancang Bangun Real-Time Business Intelligence Untuk Subjek Kegiatan Akademik pada Universitas Menggunakan Change Data Capture

Abstract. The running of academic activities in university continuously adds more data to the existing operational system. The data are not ready for the university strategic decision making, preparing reports for accreditation purposes and academic units. Real-time business intelligence application using data warehouse can become a solution for data analysis. The process of creating a data warehouse includes designing data warehouse, retrieving academic data from multiple data sources, extracting, transforming, loading (ETL) process, creating cube; and generating report. ETL processes are conducted by using a Pull Change Data Capture approach so that data changes during a certain period can be transferred in real-time. The higher the frequency of data change requests brings us closer to real-time and requires less time than loading all the data.Keywords: real-time, business intelligence, data warehouse, academic, change data capture Abstrak.  Kegiatan akademik di universitas berjalan terus menerus dan semakin menambah banyak data pada sistem operasional yang sudah ada. Data tersebut masih belum dapat dimanfaatkan oleh pihak universitas dalam pengambilan keputusan strategis, pembuatan laporan untuk keperluan akreditasi dan unit-unit akademik. Aplikasi real-time business intelligence menggunakan data warehouse menjadi solusi untuk analisa data. Proses pembuatan data warehouse meliputi perancangan data warehouse; pengambilan data akademik dari sumber data; proses extraction, transformation, loading (ETL); pembuatan cube; dan pembuatan laporan. Proses ETL dilakukan menggunakan pendekatan Change Data Capture Pull agar perubahan data selama periode tertentu dapat dipindahkan secara real-time. Semakin tinggi frekuensi permintaan perubahan data akan semakin mendekati real-time dan semakin membutuhkan waktu yang singkat dibandingkan dengan me-load semua data.Kata Kunci: real-time, business intelligence, data warehouse, akademik, change data captur