Mediated data integration and transformation for web service-based software architectures

Service-oriented architecture using XML-based web services has been widely accepted by many organisations as the standard infrastructure to integrate heterogeneous and autonomous data sources. As a result, many Web service providers are built up on top of the data sources to share the data by supporting provided and required interfaces and methods of data access in a unified manner. In the context of data integration, problems arise when Web services are assembled to deliver an integrated view of data, adaptable to the specific needs of individual clients and providers. Traditional approaches of data integration and transformation are not suitable to automate the construction of connectors dedicated to connect selected Web services to render integrated and tailored views of data. We propose a declarative approach that addresses the oftenneglected data integration and adaptivity aspects of serviceoriented architecture

Data integration through service-based mediation for web-enabled information systems

The Web and its underlying platform technologies have often been used to integrate existing software and information systems. Traditional techniques for data representation and transformations between documents are not sufficient to support a flexible and maintainable data integration solution that meets the requirements of modern complex Web-enabled software and information systems. The difficulty arises from the high degree of complexity of data structures, for example in business and technology applications, and from the constant change of data and its representation. In the Web context, where the Web platform is used to integrate different organisations or software systems, additionally the problem of heterogeneity arises. We introduce a specific data integration solution for Web applications such as Web-enabled information systems. Our contribution is an integration technology framework for Web-enabled information systems comprising, firstly, a data integration technique based on the declarative specification of transformation rules and the construction of connectors that handle the integration and, secondly, a mediator architecture based on information services and the constructed connectors to handle the integration process

Automated schema matching techniques: an exploratory study

Manual schema matching is a problem for many database applications that use multiple data sources including data warehousing and e-commerce applications. Current research attempts to address this problem by developing algorithms to automate aspects of the schema-matching task. In this paper, an approach using an external dictionary facilitates automated discovery of the semantic meaning of database schema terms. An experimental study was conducted to evaluate the performance and accuracy of five schema-matching techniques with the proposed approach, called SemMA. The proposed approach and results are compared with two existing semi-automated schema-matching approaches and suggestions for future research are made

Warehousing of object oriented petroleum data for knowledge mapping

Australia produces a-third of world?s natural resources. Enormous amounts of energy and financial resources are expended in order to tap these natural reserves from the earth?s surface. Vast amounts of these resources, however, remain unexplored and under exploited. Data pertaining natural resources, such as mineral and petroleum, are, in general, heterogeneous and complex in nature. Volumes of these types of data are geographically distributed among many companies in Australia and abroad. The existing historical resources data are logically and physically organized using warehousing techniques. Entity relationship (ER) and object oriented (OO) data mapping techniques are used for analyzing the data entities, dimensions and objects. In this paper object oriented data and warehousing of object class data models have been described. Data mining techniques can be employed to explore many more resources hidden, under great depths of the earth?s crust, without additional efforts of exploration and development. Warehoused object oriented resources data can significantly reduce the complexity of the resources data structuring and enhance the data integration and information sharing among various operational units of the resources industry. Large amount of financial inputs can be saved if these technologies are successfully implemented in the resources industry

Application of knowledge-based system in automated data warehouse design

Data warehouse has become more and more popular for an enterprise as a data repository system.Yet tools to appropriately design its conceptual model are rarely available, even though this model is known as a key for the successful of the overall design. In this paper we propose an approach and a tool to guide the decision makers in designing data warehouse conceptual model based on the Entity Relationship (ER) model of the existing operational database systems. Using this approach, the ER model is automatically transformed into the multidimensional model

Data warehouse structuring methodologies for efficient mining of Western Australian petroleum data sources

Representing the knowledge domain of a petroleum system is a complex problem. In the present study, logical modelling of shared attributes of resources industry entities (dimensions or objects) has been used for construction of a dynamic and time-variant metadata model. This work demonstrates effectiveness of multidimensional data modelling for petroleum industry, which will be further investigated for fine-grain data presentation and interpretation for quality knowledge discovery

Comparison of Time Taken And Compression Efficiency For Different Sizes of Databases

Data compress for object oriented data warehousing A data warehouse is an essential component to the decision support system The traditional data warehouse provides only numeric and character data analysis But as information technologies progress complex data such as semi-structured and unstructured data become vastly used Data Compression is of interest in business data warehousing both because of the cost saving it offers and because of the large volume of data manipulated in many business application 3 5 The entropy is used in many areas such as image processing document images But in our research we used the entropy in object oriented data warehousing Creation of different sizes of databases in oracle Employment of object oriented programming for compression using Datawarehousin

Modeling views in the layered view model for XML using UML

In data engineering, view formalisms are used to provide flexibility to users and user applications by allowing them to extract and elaborate data from the stored data sources. Conversely, since the introduction of Extensible Markup Language (XML), it is fast emerging as the dominant standard for storing, describing, and interchanging data among various web and heterogeneous data sources. In combination with XML Schema, XML provides rich facilities for defining and constraining user-defined data semantics and properties, a feature that is unique to XML. In this context, it is interesting to investigate traditional database features, such as view models and view design techniques for XML. However, traditional view formalisms are strongly coupled to the data language and its syntax, thus it proves to be a difficult task to support views in the case of semi-structured data models. Therefore, in this paper we propose a Layered View Model (LVM) for XML with conceptual and schemata extensions. Here our work is three-fold; first we propose an approach to separate the implementation and conceptual aspects of the views that provides a clear separation of concerns, thus, allowing analysis and design of views to be separated from their implementation. Secondly, we define representations to express and construct these views at the conceptual level. Thirdly, we define a view transformation methodology for XML views in the LVM, which carries out automated transformation to a view schema and a view query expression in an appropriate query language. Also, to validate and apply the LVM concepts, methods and transformations developed, we propose a view-driven application development framework with the flexibility to develop web and database applications for XML, at varying levels of abstraction