Design of ETL Process on Spatio-temporal Data and Study of Quality Control

International audienceIn order to use the space-time data mining technology to conduct operation research in WuLiangSuHai Eutrophication, the water quality sensor parameters of heterogeneous data which reflect the characteristics should set up a spatial data warehouse through ETL process, and water quality sensors for quality control of spatial and temporal data plays a vital role in building an effective analytical environment. The paper designs the ETL process from the data and water quality sensors artificial duty and other heterogeneous data sources spatial data, and proposes data quality control strategy based on the incremental frequency rule engine and the space the inverse distance weighting on the Combination. Experiments show that the incremental frequency rule engine could more effectively find the missing sensor data and abnormal, Space inverse distance weighting method can find the missing data and outliers in the errors within the allowed interpolation processing, ETL procedure is effective and feasible

In search of microbial indicator taxa: shifts in stream bacterial communities along an urbanization gradient

A majority of environmental studies describe microbiomes at coarse scales of taxonomic resolution (bacterial community, phylum), ignoring key ecological knowledge gained from finer-scales and microbial indicator taxa. Here, we characterized the distribution of 940 bacterial taxa from 41 streams along an urbanization gradient (0%–83% developed watershed area) in the Raleigh-Durham area of North Carolina (USA). Using statistical approaches derived from macro-organismal ecology, we found that more bacterial taxa were classified as intolerant than as tolerant to increasing watershed urbanization (143 vs 48 OTUs), and we identified a threshold of 12.1% developed watershed area beyond which the majority of intolerant taxa were lost from streams. Two bacterial families strongly decreased with urbanization: Acidobacteriaceae (Acidobacteria) and Xanthobacteraceae (Alphaproteobacteria). Tolerant taxa were broadly distributed throughout the bacterial phylogeny, with members of the Comamonadaceae family (Betaproteobacteria) presenting the highest number of tolerant taxa. Shifts in microbial community structure were strongly correlated with a stream biotic index, based on macroinvertebrate composition, suggesting that microbial assemblages could be used to establish biotic criteria for monitoring aquatic ecosystems. In addition, our study shows that classic methods in community ecology can be applied to microbiome datasets to identify reliable microbial indicator taxa and determine the environmental constraints on individual taxa distributions along environmental gradients