Monitoring in a grid cluster

The monitoring of a grid cluster (or of any piece of reasonably scaled IT infrastructure) is a key element in the robust and consistent running of that site. There are several factors which are important to the selection of a useful monitoring framework, which include ease of use, reliability, data input and output. It is critical that data can be drawn from different instrumentation packages and collected in the framework to allow for a uniform view of the running of a site. It is also very useful to allow different views and transformations of this data to allow its manipulation for different purposes, perhaps unknown at the initial time of installation. In this context, we present the findings of an investigation of the Graphite monitoring framework and its use at the ScotGrid Glasgow site. In particular, we examine the messaging system used by the framework and means to extract data from different tools, including the existing framework Ganglia which is in use at many sites, in addition to adapting and parsing data streams from external monitoring frameworks and websites

Analysis and improvement of data-set level file distribution in Disk Pool Manager

Of the three most widely used implementations of the WLCG Storage Element specification, Disk Pool Manager[1, 2] (DPM) has the simplest implementation of file placement balancing (StoRM doesn't attempt this, leaving it up to the underlying filesystem, which can be very sophisticated in itself). DPM uses a round-robin algorithm (with optional filesystem weighting), for placing files across filesystems and servers. This does a reasonable job of evenly distributing files across the storage array provided to it. However, it does not offer any guarantees of the evenness of distribution of that subset of files associated with a given "dataset" (which often maps onto a "directory" in the DPM namespace (DPNS)). It is useful to consider a concept of "balance", where an optimally balanced set of files indicates that the files are distributed evenly across all of the pool nodes. The best case performance of the round robin algorithm is to maintain balance, it has no mechanism to improve balance.<p></p> In the past year or more, larger DPM sites have noticed load spikes on individual disk servers, and suspected that these were exacerbated by excesses of files from popular datasets on those servers. We present here a software tool which analyses file distribution for all datasets in a DPM SE, providing a measure of the poorness of file location in this context. Further, the tool provides a list of file movement actions which will improve dataset-level file distribution, and can action those file movements itself. We present results of such an analysis on the UKI-SCOTGRID-GLASGOW Production DPM

A voyage to Arcturus: a model for automated management of a WLCG Tier-2 facility

With the current trend towards "On Demand Computing" in big data environments it is crucial that the deployment of services and resources becomes increasingly automated. Deployment based on cloud platforms is available for large scale data centre environments but these solutions can be too complex and heavyweight for smaller, resource constrained WLCG Tier-2 sites. Along with a greater desire for bespoke monitoring and collection of Grid related metrics, a more lightweight and modular approach is desired. In this paper we present a model for a lightweight automated framework which can be use to build WLCG grid sites, based on "off the shelf" software components. As part of the research into an automation framework the use of both IPMI and SNMP for physical device management will be included, as well as the use of SNMP as a monitoring/data sampling layer such that more comprehensive decision making can take place and potentially be automated. This could lead to reduced down times and better performance as services are recognised to be in a non-functional state by autonomous systems

Mannosidosis: two brothers with different degrees of disease severity

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/65926/1/j.1399-0004.1981.tb01829.x.pd

Plasmodium falciparum: linkage disequilibrium between loci in chromosomes 7 and 5 and chloroquine selective pressure in Northern Nigeria.

In view of the recent discovery (Molecular Cell 6, 861-871) of a (Lys76Thr) codon change in gene pfcrt on chromosome 7 which determines in vitro chloroquine resistance in Plasmodium falciparum, we have re-examined samples taken before treatment in our study in Zaria, Northern Nigeria (Parasitology, 119, 343-348). Drug resistance was present in 5/5 cases where the pfcrt 76Thr codon change was seen (100% positive predictive value). Drug sensitivity was found in 26/28 cases where the change was absent (93% negative predictive value). Allele pfcrt 76Thr showed strong linkage disequilibrium with pfmdr1 Tyr86 on chromosome 5, more complete than that between pfcrt and cg2 alleles situated between recombination cross-over points on chromosome 7. Physical linkage of cg2 with pfcrt may account for linkage disequilibrium between their alleles but in the case of genes pfmdr1 and pfcrt, on different chromosomes, it is likely that this is maintained epistatically through the selective pressure of chloroquine

Resolving Length Scale Dependent Transient Disorder Through an Ultrafast Phase Transition

Material functionality can be strongly determined by structure extending only over nanoscale distances. The pair distribution function presents an opportunity to shift structural studies beyond idealized crystal models and investigate structure over varying length scales. Applying this method with ultrafast time resolution has the potential to similarly disrupt the study of structural dynamics and phase transitions. Here, we demonstrate such a measurement of CuIr$_{2}$S$_{4}$ optically pumped from its low temperature Ir-dimerized phase. Dimers are optically removed without spatial correlation, generating a structure whose level of disorder depends strongly on length scale. The re-development of structural ordering over tens of picoseconds is directly tracked over both space and time as a non-equilibrium state is approached. This measurement demonstrates both the crucial role of local structure and disorder in non-equilibrium processes and the feasibility of accessing this information with state-of-the-art XFEL facilities.Comment: 14 page manuscript with 5 figures. 6 page Supplementary with 8 figures. 20 pages and 11 figures in tota

Oligo- and Polymetastatic Progression in Lung Metastasis(es) Patients Is Associated with Specific MicroRNAs

Rationale: Strategies to stage and treat cancer rely on a presumption of either localized or widespread metastatic disease. An intermediate state of metastasis termed oligometastasis(es) characterized by limited progression has been proposed. Oligometastases are amenable to treatment by surgical resection or radiotherapy.Methods: We analyzed microRNA expression patterns from lung metastasis samples of patients with ≤5 initial metastases resected with curative intent.Results: Patients were stratified into subgroups based on their rate of metastatic progression. We prioritized microRNAs between patients with the highest and lowest rates of recurrence. We designated these as high rate of progression (HRP) and low rate of progression (LRP); the latter group included patients with no recurrences. The prioritized microRNAs distinguished HRP from LRP and were associated with rate of metastatic progression and survival in an independent validation dataset.Conclusion: Oligo- and poly- metastasis are distinct entities at the clinical and molecular level.</p

A human gut bacterial genome and culture collection for improved metagenomic analyses

Understanding gut microbiome functions requires cultivated bacteria for experimental validation and reference bacterial genome sequences to interpret metagenome datasets and guide functional analyses. We present the Human Gastrointestinal Bacteria Culture Collection (HBC), a comprehensive set of 737 whole-genome-sequenced bacterial isolates, representing 273 species (105 novel species) from 31 families found in the human gastrointestinal microbiota. The HBC increases the number of bacterial genomes derived from human gastrointestinal microbiota by 37%. The resulting global Human Gastrointestinal Bacteria Genome Collection (HGG) classifies 83% of genera by abundance across 13,490 shotgun-sequenced metagenomic samples, improves taxonomic classification by 61% compared to the Human Microbiome Project (HMP) genome collection and achieves subspecies-level classification for almost 50% of sequences. The improved resource of gastrointestinal bacterial reference sequences circumvents dependence on de novo assembly of metagenomes and enables accurate and cost-effective shotgun metagenomic analyses of human gastrointestinal microbiota