511 research outputs found

    VerdictDB: Universalizing Approximate Query Processing

    Full text link
    Despite 25 years of research in academia, approximate query processing (AQP) has had little industrial adoption. One of the major causes of this slow adoption is the reluctance of traditional vendors to make radical changes to their legacy codebases, and the preoccupation of newer vendors (e.g., SQL-on-Hadoop products) with implementing standard features. Additionally, the few AQP engines that are available are each tied to a specific platform and require users to completely abandon their existing databases---an unrealistic expectation given the infancy of the AQP technology. Therefore, we argue that a universal solution is needed: a database-agnostic approximation engine that will widen the reach of this emerging technology across various platforms. Our proposal, called VerdictDB, uses a middleware architecture that requires no changes to the backend database, and thus, can work with all off-the-shelf engines. Operating at the driver-level, VerdictDB intercepts analytical queries issued to the database and rewrites them into another query that, if executed by any standard relational engine, will yield sufficient information for computing an approximate answer. VerdictDB uses the returned result set to compute an approximate answer and error estimates, which are then passed on to the user or application. However, lack of access to the query execution layer introduces significant challenges in terms of generality, correctness, and efficiency. This paper shows how VerdictDB overcomes these challenges and delivers up to 171×\times speedup (18.45×\times on average) for a variety of existing engines, such as Impala, Spark SQL, and Amazon Redshift, while incurring less than 2.6% relative error. VerdictDB is open-sourced under Apache License.Comment: Extended technical report of the paper that appeared in Proceedings of the 2018 International Conference on Management of Data, pp. 1461-1476. ACM, 201

    Characterization of soluble bromide measurements and a case study of BrO observations during ARCTAS

    Get PDF
    A focus of the Arctic Research of the Composition of the Troposphere from Aircraft and Satellites (ARCTAS) mission was examination of bromine photochemistry in the spring time high latitude troposphere based on aircraft and satellite measurements of bromine oxide (BrO) and related species. The NASA DC-8 aircraft utilized a chemical ionization mass spectrometer (CIMS) to measure BrO and a mist chamber (MC) to measure soluble bromide. We have determined that the MC detection efficiency to molecular bromine (Br2), hypobromous acid (HOBr), bromine oxide (BrO), and hydrogen bromide (HBr) as soluble bromide (Br−) was 0.9±0.1, 1.06+0.30/−0.35, 0.4±0.1, and 0.95±0.1, respectively. These efficiency factors were used to estimate soluble bromide levels along the DC-8 flight track of 17 April 2008 from photochemical calculations constrained to in situ BrO measured by CIMS. During this flight, the highest levels of soluble bromide and BrO were observed and atmospheric conditions were ideal for the space-borne observation of BrO. The good agreement (R2 = 0.76; slope = 0.95; intercept = −3.4 pmol mol−1) between modeled and observed soluble bromide, when BrO was above detection limit (\u3e2 pmol mol−1) under unpolluted conditions (NOmol−1), indicates that the CIMS BrO measurements were consistent with the MC soluble bromide and that a well characterized MC can be used to derive mixing ratios of some reactive bromine compounds. Tropospheric BrO vertical column densities (BrOVCD) derived from CIMS BrO observations compare well with BrOTROPVCD from OMI on 17 April 2008

    Analysis of Satellite-Derived Arctic Tropospheric BrO Columns in Conjunction with Aircraft Measurements During ARCTAS and ARCPAC

    Get PDF
    We derive tropospheric column BrO during the ARCTAS and ARCPAC field campaigns in spring 2008 using retrievals of total column BrO from the satellite UV nadir sensors OMI and GOME-2 using a radiative transfer model and stratospheric column BrO from a photochemical simulation. We conduct a comprehensive comparison of satellite-derived tropospheric BrO column to aircraft in-situ observations ofBrO and related species. The aircraft profiles reveal that tropospheric BrO, when present during April 2008, was distributed over a broad range of altitudes rather than being confined to the planetary boundary layer (PBL). Perturbations to the total column resulting from tropospheric BrO are the same magnitude as perturbations due to longitudinal variations in the stratospheric component, so proper accounting of the stratospheric signal is essential for accurate determination of satellite-derived tropospheric BrO. We find reasonably good agreement between satellite-derived tropospheric BrO and columns found using aircraft in-situ BrO profiles, particularly when satellite radiances were obtained over bright surfaces (albedo> 0.7), for solar zenith angle < 80 and clear sky conditions. The rapid activation of BrO due to surface processes (the bromine explosion) is apparent in both the OMI and GOME-2 based tropospheric columns. The wide orbital swath of OMI allows examination of the evolution of tropospheric BrO on about hourly time intervals near the pole. Low surface pressure, strong wind, and high PBL height are associated with an observed BrO activation event, supporting the notion of bromine activation by high winds over snow

    A new interpretation of total column BrO during Arctic spring

    Get PDF
    Emission of bromine from sea-salt aerosol, frost flowers, ice leads, and snow results in the nearly complete removal of surface ozone during Arctic spring. Regions of enhanced total column BrO observed by satellites have traditionally been associated with these emissions. However, airborne measurements of BrO and O3 within the convective boundary layer (CBL) during the ARCTAS and ARCPAC field campaigns at times bear little relation to enhanced column BrO. We show that the locations of numerous satellite BrO “hotspots” during Arctic spring are consistent with observations of total column ozone and tropopause height, suggesting a stratospheric origin to these regions of elevated BrO. Tropospheric enhancements of BrO large enough to affect the column abundance are also observed, with important contributions originating from above the CBL. Closure of the budget for total column BrO, albeit with significant uncertainty, is achieved by summing observed tropospheric partial columns with calculated stratospheric partial columns provided that natural, short-lived biogenic bromocarbons supply between 5 and 10 ppt of bromine to the Arctic lowermost stratosphere. Proper understanding of bromine and its effects on atmospheric composition requires accurate treatment of geographic variations in column BrO originating from both the stratosphere and troposphere

    Farm Area Segmentation in Satellite Images Using DeepLabv3+ Neural Networks

    Get PDF
    Farm detection using low resolution satellite images is an important part of digital agriculture applications such as crop yield monitoring. However, it has not received enough attention compared to high-resolution images. Although high resolution images are more efficient for detection of land cover components, the analysis of low-resolution images are yet important due to the low-resolution repositories of the past satellite images used for timeseries analysis, free availability and economic concerns. In this paper, semantic segmentation of farm areas is addressed using low resolution satellite images. The segmentation is performed in two stages; First, local patches or Regions of Interest (ROI) that include farm areas are detected. Next, deep semantic segmentation strategies are employed to detect the farm pixels. For patch classification, two previously developed local patch classification strategies are employed; a two-step semi-supervised methodology using hand-crafted features and Support Vector Machine (SVM) modelling and transfer learning using the pretrained Convolutional Neural Networks (CNNs). For the latter, the high-level features learnt from the massive filter banks of deep Visual Geometry Group Network (VGG-16) are utilized. After classifying the image patches that contain farm areas, the DeepLabv3+ model is used for semantic segmentation of farm pixels. Four different pretrained networks, resnet18, resnet50, resnet101 and mobilenetv2, are used to transfer their learnt features for the new farm segmentation problem. The first step results show the superiority of the transfer learning compared to hand-crafted features for classification of patches. The second step results show that the model trained based on resnet50 achieved the highest semantic segmentation accuracy.acceptedVersionPeer reviewe

    Understanding the role of growth factors in modulating stem cell tenogenesis

    Get PDF
    Current treatments for tendon injuries often fail to fully restore joint biomechanics leading to the recurrence of symptoms, and thus resulting in a significant health problem with a relevant social impact worldwide. Cell-based approaches involving the use of stem cells might enable tailoring a successful tendon regeneration outcome. As growth factors (GFs) powerfully regulate the cell biological response, their exogenous addition can further stimulate stem cells into the tenogenic lineage, which might eventually depend on stem cells source. In the present study we investigate the tenogenic differentiation potential of human- amniotic fluid stem cells (hAFSCs) and adipose-derived stem cells (hASCs) with several GFs associated to tendon development and healing; namely, EGF, bFGF, PDGF-BB and TGF-β1. Stem cells response to biochemical stimuli was studied by screening of tendon-related genes (collagen type I, III, decorin, tenascin C and scleraxis) and proteins found in tendon extracellular matrix (ECM) (Collagen I, III, and Tenascin C). Despite the fact that GFs did not seem to influence the synthesis of tendon ECM proteins, EGF and bFGF influenced the expression of tendon-related genes in hAFSCs, while EGF and PDGF-BB stimulated the genetic expression in hASCs. Overall results on cellular alignment morphology, immunolocalization and PCR analysis indicated that both stem cell source can be biochemically induced towards tenogenic commitment, validating the potential of hASCs and hAFSCs for tendon regeneration strategies.Authors thank the Portuguese Foundation for Science and Technology (FCT) for the research project BIBS (PTDC/CVT/102972/2008) and for the post-doc fellowship grant: SFRH/BPD/86775/2012. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript

    Testing for response shift in treatment evaluation of change in self-reported psychopathology amongst secondary psychiatric care outpatients

    Get PDF
    OBJECTIVES: If patients change their perspective due to treatment, this may alter the way they conceptualize, prioritize, or calibrate questionnaire items. These psychological changes, also called "response shifts," may pose a threat to the measurement of therapeutic change in patients. Therefore, it is important to test the occurrence of response shift in patients across their treatment. METHODS: This study focused on self-reported psychological distress/psychopathology in a naturalistic sample of 206 psychiatric outpatients. Longitudinal measurement invariance tests were computed across treatment in order to detect response shifts. RESULTS: Compared with before treatment, post-treatment psychopathology scores showed an increase in model fit and factor loading, suggesting that symptoms became more coherently interrelated within their psychopathology domains. Reconceptualization (depression/mood) and reprioritization (somatic and cognitive problems) response shift types were found in several items. We found no recalibration response shift. CONCLUSION: This study provides further evidence that response shift can occur in adult psychiatric patients across their mental health treatment. Future research is needed to determine whether response shift implies an unwanted potential bias in treatment evaluation or a desired cognitive change intended by treatment
    corecore