Geospatial queries on data collection using a common provenance model

Altres ajuts: Xavier Pons is the recipient of an ICREA Academia Excellence in Research Grant (2016-2020)Lineage information is the part of the metadata that describes "what", "when", "who", "how", and "where" geospatial data were generated. If it is well-presented and queryable, lineage becomes very useful information for inferring data quality, tracing error sources and increasing trust in geospatial information. In addition, if the lineage of a collection of datasets can be related and presented together, datasets, process chains, and methodologies can be compared. This paper proposes extending process step lineage descriptions into four explicit levels of abstraction (process run, tool, algorithm and functionality). Including functionalities and algorithm descriptions as a part of lineage provides high-level information that is independent from the details of the software used. Therefore, it is possible to transform lineage metadata that is initially documenting specific processing steps into a reusable workflow that describes a set of operations as a processing chain. This paper presents a system that provides lineage information as a service in a distributed environment. The system is complemented by an integrated provenance web application that is capable of visualizing and querying a provenance graph that is composed by the lineage of a collection of datasets. The International Organization for Standardization (ISO) 19115 standards family with World Wide Web Consortium (W3C) provenance initiative (W3C PROV) were combined in order to integrate provenance of a collection of datasets. To represent lineage elements, the ISO 19115-2 lineage class names were chosen, because they express the names of the geospatial objects that are involved more precisely. The relationship naming conventions of W3C PROV are used to represent relationships among these elements. The elements and relationships are presented in a queryable graph

Yellow Tree: A Distributed Main-memory Spatial Index Structure for Moving Objects

Mobile devices equipped with wireless technologies to communicate and positioning systems to locate objects of interest are common place today, providing the impetus to develop location-aware applications. At the heart of location-aware applications are moving objects or objects that continuously change location over time, such as cars in transportation networks or pedestrians or postal packages. Location-aware applications tend to support the tracking of very large numbers of such moving objects as well as many users that are interested in finding out about the locations of other moving objects. Such location-aware applications rely on support from database management systems to model, store, and query moving object data. The management of moving object data exposes the limitations of traditional (spatial) database management systems as well as their index structures designed to keep track of objects\u27 locations. Spatial index structures that have been designed for geographic objects in the past primarily assume data are foremost of static nature (e.g., land parcels, road networks, or airport locations), thus requiring a limited amount of index structure updates and reorganization over a period of time. While handling moving objects however, there is an incumbent need for continuous reorganization of spatial index structures to remain up to date with constantly and rapidly changing object locations. This research addresses some of the key issues surrounding the efficient database management of moving objects whose location update rate to the database system varies from 1 to 30 minutes. Furthermore, we address the design of a highly scaleable and efficient spatial index structure to support location tracking and querying of large amounts of moving objects. We explore the possible architectural and the data structure level changes that are required to handle large numbers of moving objects. We focus specifically on the index structures that are needed to process spatial range queries and object-based queries on constantly changing moving object data. We argue for the case of main memory spatial index structures that dynamically adapt to continuously changing moving object data and concurrently answer spatial range queries efficiently. A proof-of concept implementation called the yellow tree, which is a distributed main-memory index structure, and a simulated environment to generate moving objects is demonstrated. Using experiments conducted on simulated moving object data, we conclude that a distributed main-memory based spatial index structure is required to handle dynamic location updates and efficiently answer spatial range queries on moving objects. Future work on enhancing the query processing performance of yellow tree is also discussed

Domain Indices in Oracle 11g

Diplomová práce se zabývá problematikou doménových indexů v Oracle Database 11g. Popisuje architekturu databáze a rozebírá dostupné možnosti indexování. Jsou zde vysvětleny konkrétní způsoby implementace a použití doménových indexů, dále rozebírány způsoby indexování časoprostorových dat, především struktura TB-stromu, která je následně implementována v podobě doménového indexu. Spolu s doménovým indexem jsou implementovány také operátory, pomocí kterých je index následně využíván a testován.This thesis deals with the domain indexes in Oracle Database 11g. It describes the database architecture and discusses the available methods of indexing. There are explained concrete ways of the implementation and use of domain indexes, also discussed ways of indexing spatio-temporal data especially the TB-tree structure, which is then implemented as a domain index. Along with the domain index operators are also implemented by means of which the index is subsequently used and tested.

Um modelo de dados para objetos moveis

Orientador : Claudia Maria Bauzer MedeirosDissertação (mestrado) - Universidade Estadual de Campinas, Instituto de ComputaçãoResumo: A popularização dos dispositivos como GPS tem possibilitado o surgimento de aplicações que fazem coleta e análise de objetos móveis. Os sistemas de bancos de dados tradicionais não apóiam o gerenciamento de dados relativos a objetos móveis, caracterizados por gerarem um grande número de informações continuamente. As pesquisas nesta área são recentes, com relativamente poucos resultados específicos à gerencia de dados móveis. A dissertação propõe um modelo de dados orientado a objetos que incorpora duas características: tratamento uniforme de objetos estáticos, espaciais, temporais, espaço temporais e móveis; e um conjunto básico de operadores e os algoritmos destes operadores podem ser compostos progressivamente para criar uma grande variedade de operações para consultas ao banco de dados. Este modelo se diferencia das demais propostas por considerar não apenas objetos móveis lD, mas também aquelas com geometria 2DAbstract: The popularization of devices like G PS and wireless network have enabled new applications that collect and analyze mobile objects. Traditional database system do not support the management of mobile object data, since a great amount of information is generated continuously. Research in this area is recent with relatively few works on mobile data management. This Msc thesis proposes an object-oriented mobile object data model that incorporates two characteristics: it supports modeling of static, spatial, temporal, spatio-temporal and mobile objects in a homogeneous way; it specifies a set of basic operators and their algorithmic specification. These operators can be composed to obtain a wide variety of complex operators to query a mobile object database. Unlike most other proposals, this mode supports not only lD object, but also those with 2D geometric descriptionsMestradoMestre em Ciência da Computaçã

A framework for the management of deformable moving objects

There is an emergence of a growing number of applications and services based on spatiotemporal data in the most diverse areas of knowledge and human activity. The Internet of Things (IoT), the emergence of technologies that make it possible to collect information about the evolution of real world phenomena and the widespread use of devices that can use the Global Positioning System (GPS), such as smartphones and navigation systems, suggest that the volume and value of these data will increase significantly in the future. It is necessary to develop tools capable of extracting knowledge from these data and for this it is necessary to manage them: represent, manipulate, analyze and store, in an efficient way. But this data can be complex, its management is not trivial and there is not yet a complete system capable of performing this task. Works on moving points, that represent the position of objects over time, are frequent in the literature. On the contrary there are much less solutions for the representation of moving regions, that represent the continuous changes in position, shape and extent of objects over time, e.g., storms, fires and icebergs. The representation of the evolution of moving regions is complex and requires the use of more elaborate techniques, e.g., morphing and interpolation techniques, capable of producing realistic and geometrically valid representations. In this dissertation we present and propose a data model for moving objects (moving points and moving regions), in particular for moving regions, based on the concept of mesh and compatible triangulation and rigid interpolation methods. This model was implemented in a framework that is not client or application dependent and we also implemented a spatiotemporal extension for PostgreSQL that uses this framework to manipulate and analyze moving objects, as a proof of concept that our framework works with real applications. The tests’ results using real data, obtained from satellite images of the evolution of 2 icebergs over time, show that our data model works. Besides the results obtained one important contribution of this work is the development of a basic framework for moving objects that can be used as a basis for further investigation in this area. A few problems still remain that must be further studied and analyzed, in particular, the ones that were found when using the compatible triangulation and rigid interpolation methods with real data.Assistimos ao aparecimento de um número crescente de aplicações e serviços baseados em dados espácio-temporais nas mais diversas áreas do conhecimento e da atividade humana. A internet das coisas (IoT), o aparecimento de novas tecnologias que permitem obter dados sobre a evolução de fenómenos do mundo real e o uso generalizado de dispositivos que usam o sistema de posicionamento global (GPS), por exemplo, smartphones e sistemas de navegação, sugerem que o volume e o valor destes dados aumente significativamente no futuro. Torna-se necessário desenvolver ferramentas capazes de extrair conhecimento destes dados e para isso é necessário geri-los: representar, manipular, analisar e armazenar, de uma forma eficiente. Mas estes dados podem ser complexos, a sua gestão não é trivial e ainda não existe um sistema completo capaz de executar essa tarefa. Existe muito trabalho na literatura sobre pontos móveis, que representam as alterações da posição de objectos ao longo do tempo, mas existe muito menos trabalho realizado sobre regiões móveis, que representam as alterações da posição e da forma de regiões ao longo do tempo, por exemplo, uma tempestade, um incêndio ou um derramamento de petroleo. A representação da evolução de regiões móveis ao longo do tempo é complexa e exige o uso de técnicas mais elaboradas, por exemplo, técnicas de morphing e interpolação, capazes de produzir representações realistas e geometricamente válidas. Nesta dissertação apresentamos e propomos um modelo de dados para trabalhar com objetos móveis (pontos móveis e regiões móveis), em particular regiões móveis, baseado no conceito de malha e em métodos de triangulação compatível e interpolação rígida. Este modelo foi implementado num framework que é independente do cliente e da aplicação. Também implementámos uma extensão espácio-temporal para o sistema de gestão de base de dados PostgreSQL, que usa este framework para manipular e analisar objectos móveis, como uma prova de conceito que o nosso framework funciona com aplicações reais. Os resultados dos testes com dados reais, obtidos a partir de imagens de satélite da evolução de 2 icebergs ao longo do tempo, demonstram que o nosso modelo funciona. Para além dos resultados obtidos, um contributo importante desta dissertação é o desenvolvimento de um framework que pode ser usado como a base para trabalho futuro e investigação nesta área. Existem alguns problemas ainda por resolver e que devem ser analisados e estudados com mais cuidado, em particular, os que foram encontrados quando usámos os métodos de triangulação compatível e interpolação rigída em dados reais.Mestrado em Engenharia Informátic

Concepts for the Representation, Storage, and Retrieval of Spatio-Temporal Objects in 3D/4D Geo-Informations-Systems

The quickly increasing number of spatio-temporal applications in fields like environmental management or geology is a new challenge to the development of database systems. This thesis addresses three areas of the problem of integrating spatio-temporal objects into databases. First, a new representational model for continuously changing, spatial 3D objects is introduced and transferred into a small system of classes within an object-oriented database framework. The model extends simplicial cell complexes to the spatio-temporal setting. The problem of closure under certain operations is investigated. Second, internal data structures are introduced that represent instances of the (user-level) spatio-temporal classes. A new technique provides a compromise between compact storage and efficient retrieval of spatio-temporal objects. These structures correspond to temporal graphs and support updates as well as the maintainance of connected components over time. Third, it is shown how to realise further operations on the new type of objects. Among these operations are range queries, intersection tests, and the Euclidean distance function

A New Geographic Process Data Model

Processes, although the subject matter of geography, have not been represented in a manner that aids their querying and analysis. This dissertation develops an appropriate data model that allows for such a process oriented representation, which is built upon a theory of process. The data model, called nen, focuses existing modeling approaches on representing and storing process information. The flux simulation framework was created utilizing the nen data model to represent processes; it extends the RePast agent based modeling environment. This simulator includes basic classes for developing a domain specific simulation and a set of query tools for inquiring after the results of a simulation. The methodology was then prototyped with a watershed runoff simulation

Modeling and querying spatio-temporal clinical databases with multiple granularities

In molti campi di ricerca, i ricercatori hanno la necessit\ue0 di memorizzare, gestire e interrogare dati spazio-temporali. Tali dati sono classici dati alfanumerici arricchiti per\uf2 con una o pi\uf9 componenti temporali, spaziali e spazio-temporali che, con diversi possibili significati, li localizzano nel tempo e/o nello spazio. Ambiti in cui tali dati spazio-temporali devono essere raccolti e gestiti sono, per esempio, la gestione del territorio o delle risorse naturali, l'epidemiologia, l'archeologia e la geografia. Pi\uf9 in dettaglio, per esempio nelle ricerche epidemiologiche, i dati spazio-temporali possono servire a rappresentare diversi aspetti delle malattie e delle loro caratteristiche, quali per esempio la loro origine, espansione ed evoluzione e i fattori di rischio potenzialmente connessi alle malattie e al loro sviluppo. Le componenti spazio-temporali dei dati possono essere considerate come dei "meta-dati" che possono essere sfruttati per introdurre nuovi tipi di analisi sui dati stessi. La gestione di questi "meta-dati" pu\uf2 avvenire all'interno di diversi framework proposti in letteratura. Uno dei concetti proposti a tal fine \ue8 quello delle granularit\ue0. In letteratura c'\ue8 ampio consenso sul concetto di granularit\ue0 temporale, di cui esistono framework basati su diversi approcci. D'altro canto, non esiste invece un consenso generale sulla definizione di un framework completo, come quello delle granularit\ue0 temporali, per le granularit\ue0 spaziali e spazio-temporali. Questa tesi ha lo scopo di riempire questo vuoto proponendo un framework per le granularit\ue0 spaziali e, basandosi su questo e su quello gi\ue0 presente in letteratura per le granularit\ue0 temporali, un framework per le granularit\ue0 spazio-temporali. I framework proposti vogliono essere completi, per questo, oltre alle definizioni dei concetti di granularit\ue0 spaziale e spazio-temporale, includono anche la definizione di diversi concetti legati alle granularit\ue0, quali per esempio le relazioni e le operazioni tra granularit\ue0. Le relazioni permettono di conoscere come granularit\ue0 diverse sono legate tra loro, costruendone anche una gerarchia. Tali informazioni sono poi utili al fine di conoscere se e come \ue8 possibile confrontare dati associati e rappresentati con granularit\ue0 diverse. Le operazioni permettono invece di creare nuove granularit\ue0 a partire da altre granularit\ue0 gi\ue0 definite nel sistema, manipolando o selezionando alcune loro componenti. Basandosi su questi framework, l'obiettivo della tesi si sposta poi sul mostrare come le granularit\ue0 possano essere utilizzate per arricchire basi di dati spazio-temporali gi\ue0 esistenti al fine di una loro migliore e pi\uf9 ricca gestione e interrogazione. A tal fine, proponiamo qui una base di dati per la gestione dei dati riguardanti le granularit\ue0 temporali, spaziali e spazio-temporali. Nella base di dati proposta possono essere rappresentate tutte le componenti di una granularit\ue0 come definito nei framework proposti. La base di dati pu\uf2 poi essere utilizzata per estendere una base di dati spazio-temporale esistente aggiungendo alle tuple di quest'ultima delle referenze alle granularit\ue0 dove quei dati possono essere localizzati nel tempo e/o nel spazio. Per dimostrare come ci\uf2 possa essere fatto, nella tesi introduciamo la base di dati sviluppata ed utilizzata dal Servizio Psichiatrico Territoriale (SPT) di Verona. Tale base di dati memorizza le informazioni su tutti i pazienti venuti in contatto con l'SPT negli ultimi 30 anni e tutte le informazioni sui loro contatti con il servizio stesso (per esempio: chiamate telefoniche, visite a domicilio, ricoveri). Parte di tali informazioni hanno una componente spazio-temporale e possono essere quindi analizzate studiandone trend e pattern nel tempo e nello spazio. Nella tesi quindi estendiamo questa base di dati psichiatrica collegandola a quella proposta per la gestione delle granularit\ue0. A questo punto i dati psichiatrici possono essere interrogati anche sulla base di vincoli spazio-temporali basati su granularit\ue0. L'interrogazione di dati spazio-temporali associati a granularit\ue0 richiede l'utilizzo di un linguaggio d'interrogazione che includa, oltre a strutture, operatori e funzioni spazio-temporali per la gestione delle componenti spazio-temporali dei dati, anche costrutti per l'utilizzo delle granularit\ue0 nelle interrogazioni. Quindi, partendo da un linguaggio d'interrogazione spazio-temporale gi\ue0 presente in letteratura, in questa tesi proponiamo anche un linguaggio d'interrogazione che permetta ad un utente di recuperare dati da una base di dati spazio-temporale anche sulla base di vincoli basati su granularit\ue0. Il linguaggio viene introdotto fornendone la sintassi e la semantica. Inoltre per mostrare l'effettivo ruolo delle granularit\ue0 nell'interrogazione di una base di dati clinica, mostreremo diversi esempi di interrogazioni, scritte con il linguaggio d'interrogazione proposto, sulla base di dati psichiatrica dell'SPT di Verona. Tali interrogazioni spazio-temporali basate su granularit\ue0 possono essere utili ai ricercatori ai fini di analisi epidemiologiche dei dati psichiatrici.In several research fields, temporal, spatial, and spatio-temporal data have to be managed and queried with several purposes. These data are usually composed by classical data enriched with a temporal and/or a spatial qualification. For instance, in epidemiology spatio-temporal data may represent surveillance data, origins of disease and outbreaks, and risk factors. In order to better exploit the time and spatial dimensions, spatio-temporal data could be managed considering their spatio-temporal dimensions as meta-data useful to retrieve information. One way to manage spatio-temporal dimensions is by using spatio-temporal granularities. This dissertation aims to show how this is possible, in particular for epidemiological spatio-temporal data. For this purpose, in this thesis we propose a framework for the definition of spatio-temporal granularities (i.e., partitions of a spatio-temporal dimension) with the aim to improve the management and querying of spatio-temporal data. The framework includes the theoretical definitions of spatial and spatio-temporal granularities (while for temporal granularities we refer to the framework proposed by Bettini et al.) and all related notions useful for their management, e.g., relationships and operations over granularities. Relationships are useful for relating granularities and then knowing how data associated with different granularities can be compared. Operations allow one to create new granularities from already defined ones, manipulating or selecting their components. We show how granularities can be represented in a database and can be used to enrich an existing spatio-temporal database. For this purpose, we conceptually and logically design a relational database for temporal, spatial, and spatio-temporal granularities. The database stores all data about granularities and their related information we defined in the theoretical framework. This database can be used for enriching other spatio-temporal databases with spatio-temporal granularities. We introduce the spatio-temporal psychiatric case register, developed by the Verona Community-based Psychiatric Service (CPS), for storing and managing information about psychiatric patient, their personal information, and their contacts with the CPS occurred in last 30 years. The case register includes both clinical and statistical information about contacts, that are also temporally and spatially qualified. We show how the case register database can be enriched with spatio-temporal granularities both extending its structure and introducing a spatio-temporal query language dealing with spatio-temporal data and spatio-temporal granularities. Thus, we propose a new spatio-temporal query language, by defining its syntax and semantics, that includes ad-hoc features and constructs for dealing with spatio-temporal granularities. Finally, using the proposed query language, we report several examples of spatio-temporal queries on the psychiatric case register showing the ``usage'' of granularities and their role in spatio-temporal queries useful for epidemiological studies