Quality measures for ETL processes: from goals to implementation

Extraction transformation loading (ETL) processes play an increasingly important role for the support of modern business operations. These business processes are centred around artifacts with high variability and diverse lifecycles, which correspond to key business entities. The apparent complexity of these activities has been examined through the prism of business process management, mainly focusing on functional requirements and performance optimization. However, the quality dimension has not yet been thoroughly investigated, and there is a need for a more human-centric approach to bring them closer to business-users requirements. In this paper, we take a first step towards this direction by defining a sound model for ETL process quality characteristics and quantitative measures for each characteristic, based on existing literature. Our model shows dependencies among quality characteristics and can provide the basis for subsequent analysis using goal modeling techniques. We showcase the use of goal modeling for ETL process design through a use case, where we employ the use of a goal model that includes quantitative components (i.e., indicators) for evaluation and analysis of alternative design decisions.Peer ReviewedPostprint (author's final draft

A unified view of data-intensive flows in business intelligence systems : a survey

Data-intensive flows are central processes in today’s business intelligence (BI) systems, deploying different technologies to deliver data, from a multitude of data sources, in user-preferred and analysis-ready formats. To meet complex requirements of next generation BI systems, we often need an effective combination of the traditionally batched extract-transform-load (ETL) processes that populate a data warehouse (DW) from integrated data sources, and more real-time and operational data flows that integrate source data at runtime. Both academia and industry thus must have a clear understanding of the foundations of data-intensive flows and the challenges of moving towards next generation BI environments. In this paper we present a survey of today’s research on data-intensive flows and the related fundamental fields of database theory. The study is based on a proposed set of dimensions describing the important challenges of data-intensive flows in the next generation BI setting. As a result of this survey, we envision an architecture of a system for managing the lifecycle of data-intensive flows. The results further provide a comprehensive understanding of data-intensive flows, recognizing challenges that still are to be addressed, and how the current solutions can be applied for addressing these challenges.Peer ReviewedPostprint (author's final draft

Incorporation of ontologies in data warehouse/business intelligence systems - A systematic literature review

Semantic Web (SW) techniques, such as ontologies, are used in Information Systems (IS) to cope with the growing need for sharing and reusing data and knowledge in various research areas. Despite the increasing emphasis on unstructured data analysis in IS, structured data and its analysis remain critical for organizational performance management. This systematic literature review aims at analyzing the incorporation and impact of ontologies in Data Warehouse/Business Intelligence (DW/BI) systems, contributing to the current literature by providing a classification of works based on the field of each case study, SW techniques used, and the authors’ motivations for using them, with a focus on DW/BI design, development and exploration tasks. A search strategy was developed, including the definition of keywords, inclusion and exclusion criteria, and the selection of search engines. Ontologies are mainly defined using the Ontology Web Language standard to support multiple DW/BI tasks, such as Dimensional Modeling, Requirement Analysis, Extract-Transform-Load, and BI Application Design. Reviewed authors present a variety of motivations for ontology-driven solutions in DW/BI, such as eliminating or solving data heterogeneity/semantics problems, increasing interoperability, facilitating integration, or providing semantic content for requirements and data analysis. Further, implications for practice and research agenda are indicated.info:eu-repo/semantics/publishedVersio

Requirement modeling for data warehouse using goal-UML approach: the case of health care

Decision makers use Data Warehouse (DW) for performing analysis on business information. DW development is a long term process with high risk of failure and it is difficult to estimate the future requirements for the decision-making. Further, the current DW design does not consider the early and late requirements analysis during its development, especially by using Unified Modeling Language (UML) approach. Due to this problem, it is crucial that current DW modeling approaches covered both early and late requirements analysis in the DW design. A case study was conducted on Malaysia Rural Health Care (MRH) to gather the requirements for DW design. The goal-oriented approach has been used to analyze the early requirements and later was mapped to UML approach to produce a new DW modeling called Goal-UML (G-UML). The proposed approach highlighted the mapping process of DW conceptual schema to a class diagram to produce a complete MRH-DW design. The correctness of the DW design was evaluated using expert reviews. The G-UML method can contribute to the development of DW and be a guideline to the DW developers to produce an improved DW design that meets all the user requirement

BROKERING SITUATIONS IN DATA WAREHOUSE DEVELOPMENT PROJECTS: AN EXPLORATORY STUDY

Data Warehouse (DWH) projects bring together different communities of practice to create one body of knowledge and help increase the competitive advantages of companies. In this paper we concentrate on the role of DWH professionals as a spanning community in DWH development projects. We argue that each time DWH professionals engage in a spanning activity towards neighboring communities of practice, representatives from these communities take spanning roles as well. As a result, a brokering situation resides within the social structure created by bridging multiple communities together, building a brokering community. In order to observe the roles of DWH professionals within these brokering situations more closely, we conducted interviews with experienced DWH professionals in two interconnected phases. Based on the results gathered, we argue that the selection of the community’s representatives with experience in the boundary communities can improve brokering situations

Data warehouse design for mobile environment

Analysis and design are very important roles in Data Warehouse (DW) system development and forms as a backbone of any successful or failure of the DWproject. The emergence trends of ubiquitous-based application required DW system to be implemented in the mobile environment.However, current analysis and design approaches are based on existing DW environments that focusing on the deployment of DW system in static client-based applications. This will create the limitations on user accessed and reduced the used of analytical information by the decision makers.Consequently, this will prolong the adoption of business intelligence (BI) applications to the users and organisations. This research is to suggest an approach for designing the DW and implement the DW system on the mobile environments.A variant dimension modeling technique will be used to enhance the DW modeling in order to accommodate the requirements of mobile characteristics in the DW design

A Systems Analysis Role-Play Exercise and Assignment

Systems analysis and design, System development life cycle (SDLC), Collaboration, User requirements, Requirements analysis & specification, Active learning, Role-play, Cost benefit analysi