24,764 research outputs found
GraphMP: An Efficient Semi-External-Memory Big Graph Processing System on a Single Machine
Recent studies showed that single-machine graph processing systems can be as
highly competitive as cluster-based approaches on large-scale problems. While
several out-of-core graph processing systems and computation models have been
proposed, the high disk I/O overhead could significantly reduce performance in
many practical cases. In this paper, we propose GraphMP to tackle big graph
analytics on a single machine. GraphMP achieves low disk I/O overhead with
three techniques. First, we design a vertex-centric sliding window (VSW)
computation model to avoid reading and writing vertices on disk. Second, we
propose a selective scheduling method to skip loading and processing
unnecessary edge shards on disk. Third, we use a compressed edge cache
mechanism to fully utilize the available memory of a machine to reduce the
amount of disk accesses for edges. Extensive evaluations have shown that
GraphMP could outperform state-of-the-art systems such as GraphChi, X-Stream
and GridGraph by 31.6x, 54.5x and 23.1x respectively, when running popular
graph applications on a billion-vertex graph
A Controlled Study on the Characterisation of Bioaerosols Emissions from Compost
Bioaerosol emissions arising from biowaste treatment are an issue of public concern. To better characterise the bioaerosols, and to assess a range of measurement methods, we aerosolised green waste compost under controlled conditions. Viable and non-viable Andersen samplers, cyclone samplers and a real time bioaerosol detection system (Spectral Intensity Bioaerosol Sensor (SIBS)) were deployed simultaneously. The number-weighted fraction of fluorescent particles was in the range 22–26% of all particles for low and high emission scenarios. Overall fluorescence spectral profiles seen by the SIBS exhibited several peaks across the 16 wavelength bands from 298 to 735 nm. The size-fractionated endotoxin profile showed most endotoxin resided in the 2.1–9 μm aerodynamic diameter fraction, though up to 27% was found in a finer size fraction. A range of microorganisms were detected through culture, Matrix Assisted Laser Desorption and Ionisation Time of Flight Mass Spectrometry (MALDI-TOF) and quantitative polymerase chain reaction (qPCR), including Legionella pneumophila serogroup 1. These findings contribute to our knowledge of the physico-chemical and biological characteristics of bioaerosols from composting sites, as well as informing future monitoring approaches and data interpretation for bioaerosol measurement
- …