24,764 research outputs found

    GraphMP: An Efficient Semi-External-Memory Big Graph Processing System on a Single Machine

    Full text link
    Recent studies showed that single-machine graph processing systems can be as highly competitive as cluster-based approaches on large-scale problems. While several out-of-core graph processing systems and computation models have been proposed, the high disk I/O overhead could significantly reduce performance in many practical cases. In this paper, we propose GraphMP to tackle big graph analytics on a single machine. GraphMP achieves low disk I/O overhead with three techniques. First, we design a vertex-centric sliding window (VSW) computation model to avoid reading and writing vertices on disk. Second, we propose a selective scheduling method to skip loading and processing unnecessary edge shards on disk. Third, we use a compressed edge cache mechanism to fully utilize the available memory of a machine to reduce the amount of disk accesses for edges. Extensive evaluations have shown that GraphMP could outperform state-of-the-art systems such as GraphChi, X-Stream and GridGraph by 31.6x, 54.5x and 23.1x respectively, when running popular graph applications on a billion-vertex graph

    A Controlled Study on the Characterisation of Bioaerosols Emissions from Compost

    Get PDF
    Bioaerosol emissions arising from biowaste treatment are an issue of public concern. To better characterise the bioaerosols, and to assess a range of measurement methods, we aerosolised green waste compost under controlled conditions. Viable and non-viable Andersen samplers, cyclone samplers and a real time bioaerosol detection system (Spectral Intensity Bioaerosol Sensor (SIBS)) were deployed simultaneously. The number-weighted fraction of fluorescent particles was in the range 22–26% of all particles for low and high emission scenarios. Overall fluorescence spectral profiles seen by the SIBS exhibited several peaks across the 16 wavelength bands from 298 to 735 nm. The size-fractionated endotoxin profile showed most endotoxin resided in the 2.1–9 μm aerodynamic diameter fraction, though up to 27% was found in a finer size fraction. A range of microorganisms were detected through culture, Matrix Assisted Laser Desorption and Ionisation Time of Flight Mass Spectrometry (MALDI-TOF) and quantitative polymerase chain reaction (qPCR), including Legionella pneumophila serogroup 1. These findings contribute to our knowledge of the physico-chemical and biological characteristics of bioaerosols from composting sites, as well as informing future monitoring approaches and data interpretation for bioaerosol measurement
    • …
    corecore