Maine State Government Administrative Report 2004-2005

https://digitalmaine.com/me_annual_reports/1031/thumbnail.jp

Maine State Government Administrative Report 2011-2012

https://digitalmaine.com/me_annual_reports/1038/thumbnail.jp

An Improved Approach in the Data Warehousing ETLM Process for Detection of Changes in Source Data

The ETLM process (extraction, transformation, load, and materialization) comprises the basis for data acquisition and organization of a data warehouse (DW) environment. In the DW area, a well-known issue consists of the detection of changes in source data. This problem arises when the data source does not possess or does not provide the information about the changes that have occurred. The main scenarios in which this problem is found may be characterized by: (i) the impossibility to instrument the DBMS (triggers, transaction log, stored procedures, replication, materialized views, old and new versions of data, etc), due to security policies, data property or performance issues; (ii) the lack of instrumentation resources on the DBMS; (iii) the use of legacy technologies such as file systems or semi-structured data; (iv) the existence of application proprietary databases and ERP systems. In order to deal with this issue, controls have to be implemented to enable the detection of these changes and to reflect them into the DW environment. In this paper, a framework is proposed for the organization of the DW environment, and some of the main issues involved in the ETLM process are commented on. Having this framework as a basis, the main approaches to solve the detection of changes in source data are described. Our technique, using signatures to mark off and detect changes is presented. This technique was derived from the comparison of database snapshots approach: the technique is simple and can be applied to all four scenarios above. The paper also presents a case study in the DW project developed for Rio Sul Airlines, a regional aviation company owned by the Brazilian Varig group. 1

Maine State Government Administrative Report 1997-1998

https://digitalmaine.com/me_annual_reports/1024/thumbnail.jp

Maine State Government Administrative Report 1998-1999

https://digitalmaine.com/me_annual_reports/1025/thumbnail.jp

Maine State Government Administrative Report 1996-1997

https://digitalmaine.com/me_annual_reports/1023/thumbnail.jp

Maine State Government Administrative Report 1984-1985

https://digitalmaine.com/me_annual_reports/1011/thumbnail.jp

Maine State Government Administrative Report 1985-1986

https://digitalmaine.com/me_annual_reports/1012/thumbnail.jp

Maine State Government Administrative Report 1982-1983

https://digitalmaine.com/me_annual_reports/1009/thumbnail.jp