On-Demand Big Data Integration: A Hybrid ETL Approach for Reproducible Scientific Research

Scientific research requires access, analysis, and sharing of data that is distributed across various heterogeneous data sources at the scale of the Internet. An eager ETL process constructs an integrated data repository as its first step, integrating and loading data in its entirety from the data sources. The bootstrapping of this process is not efficient for scientific research that requires access to data from very large and typically numerous distributed data sources. a lazy ETL process loads only the metadata, but still eagerly. Lazy ETL is faster in bootstrapping. However, queries on the integrated data repository of eager ETL perform faster, due to the availability of the entire data beforehand. In this paper, we propose a novel ETL approach for scientific data integration, as a hybrid of eager and lazy ETL approaches, and applied both to data as well as metadata. This way, Hybrid ETL supports incremental integration and loading of metadata and data from the data sources. We incorporate a human-in-the-loop approach, to enhance the hybrid ETL, with selective data integration driven by the user queries and sharing of integrated data between users. We implement our hybrid ETL approach in a prototype platform, Obidos, and evaluate it in the context of data sharing for medical research. Obidos outperforms both the eager ETL and lazy ETL approaches, for scientific research data integration and sharing, through its selective loading of data and metadata, while storing the integrated data in a scalable integrated data repository.Comment: Pre-print Submitted to the DMAH Special Issue of the Springer DAPD Journa

Requirement-driven creation and deployment of multidimensional and ETL designs

We present our tool for assisting designers in the error-prone and time-consuming tasks carried out at the early stages of a data warehousing project. Our tool semi-automatically produces multidimensional (MD) and ETL conceptual designs from a given set of business requirements (like SLAs) and data source descriptions. Subsequently, our tool translates both the MD and ETL conceptual designs produced into physical designs, so they can be further deployed on a DBMS and an ETL engine. In this paper, we describe the system architecture and present our demonstration proposal by means of an example.Peer ReviewedPostprint (author's final draft

Low-Temperature Solution-Processed Electron Transport Layers for Inverted Polymer Solar Cells

© 2016 WILEY-VCH Verlag GmbH & Co. KGaA, WeinheimProcessing temperature is highlighted as a convenient means of controlling the optical and charge transport properties of solution processed electron transport layers (ETLs) in inverted polymer solar cells. Using the well-studied active layer – poly(3-hexylthiophene-2,5-diyl):indene-C60 bisadduct – the influence of ETL processing temperatures from 25 to 450 °C is shown, reporting the role of crystallinity, structure, charge transport, and Fermi level (EF) on numerous device performance characteristics. It has been determined that an exceptionally low temperature processed ETL (110 °C) increases device power conversion efficiency by a factor greater than 50% compared with a high temperature (450 °C) processed ETL. Modulations in device series and shunt resistance, induced by changes in the ETL transport properties, are observed in parallel to significant changes in device open circuit voltage attributed to changes on the EF of the ETLs. This work highlights the importance of interlayer control in multilayer photovoltaic devices and presents a convenient material compatible with future flexible and roll-to-roll processes

POIESIS: A tool for quality-aware ETL process redesign

We present a tool, called POIESIS, for automatic ETL process enhancement. ETL processes are essential data-centric activities in modern business intelligence environments and they need to be examined through a viewpoint that concerns their quality characteristics (e.g., data quality, performance, manageability) in the era of Big Data. POIESIS responds to this need by providing a user-centered environment for quality-aware analysis and redesign of ETL flows. It generates thousands of alternative flows by adding flow patterns to the initial flow, in varying positions and combinations, thus creating alternative design options in a multidimensional space of different quality attributes. Through the demonstration of POIESIS we introduce the tool's capabilities and highlight its efficiency, usability and modifiability, thanks to its polymorphic design. © 2015, Copyright is with the authors.Peer ReviewedPostprint (published version

Post-Truth as a Governmental Practice – Applying post-truth as an alternative epistemology in Hungary

After the 2016 Brexit referendum and the US presidential elections, the concept of post-truth has become influential within both the media and academic discourse. However, this discussion remained rather theoretical, with relatively few empirical studies applying the concept. This article aims to broaden the empirical scope of the post-truth concept by introducing it in the Hungarian context. Following Lewandowsky, Ecker and Cook’s (2017a) argument post-truth will be approached as an alternative epistemology. After this, the empirical analysis captures how this alternative epistemology has gained a dominant position within the Hungarian society through direct governmental support. The case study reveals that the primary aim of post-truth as a conscious political strategy is to preserve the division between social epistemologies, instead of creating an exclusive one. Thus, post-truth politics cannot only effectively support anti-establishment initiatives but should also preserve and strengthen already-existing power structures.After the 2016 Brexit referendum and the US presidential elections, the concept of post-truth has become influential within both the media and academic discourse. However, this discussion remained rather theoretical, with relatively few empirical studies applying the concept. This article aims to broaden the empirical scope of the post-truth concept by introducing it in the Hungarian context. Following Lewandowsky, Ecker and Cook’s (2017a) argument post-truth will be approached as an alternative epistemology. After this, the empirical analysis captures how this alternative epistemology has gained a dominant position within the Hungarian society through direct governmental support. The case study reveals that the primary aim of post-truth as a conscious political strategy is to preserve the division between social epistemologies, instead of creating an exclusive one. Thus, post-truth politics cannot only effectively support anti-establishment initiatives but should also preserve and strengthen already-existing power structures

Quality measures for ETL processes: from goals to implementation

Extraction transformation loading (ETL) processes play an increasingly important role for the support of modern business operations. These business processes are centred around artifacts with high variability and diverse lifecycles, which correspond to key business entities. The apparent complexity of these activities has been examined through the prism of business process management, mainly focusing on functional requirements and performance optimization. However, the quality dimension has not yet been thoroughly investigated, and there is a need for a more human-centric approach to bring them closer to business-users requirements. In this paper, we take a first step towards this direction by defining a sound model for ETL process quality characteristics and quantitative measures for each characteristic, based on existing literature. Our model shows dependencies among quality characteristics and can provide the basis for subsequent analysis using goal modeling techniques. We showcase the use of goal modeling for ETL process design through a use case, where we employ the use of a goal model that includes quantitative components (i.e., indicators) for evaluation and analysis of alternative design decisions.Peer ReviewedPostprint (author's final draft