Improved Cloud resource allocation: how INDIGO-Datacloud is overcoming the current limitations in Cloud schedulers

Trabajo presentado a: 22nd International Conference on Computing in High Energy and Nuclear Physics (CHEP2016) 10–14 October 2016, San Francisco.Performing efficient resource provisioning is a fundamental aspect for any resource provider. Local Resource Management Systems (LRMS) have been used in data centers for decades in order to obtain the best usage of the resources, providing their fair usage and partitioning for the users. In contrast, current cloud schedulers are normally based on the immediate allocation of resources on a first-come, first-served basis, meaning that a request will fail if there are no resources (e.g. OpenStack) or it will be trivially queued ordered by entry time (e.g. OpenNebula). Moreover, these scheduling strategies are based on a static partitioning of the resources, meaning that existing quotas cannot be exceeded, even if there are idle resources allocated to other projects. This is a consequence of the fact that cloud instances are not associated with a maximum execution time and leads to a situation where the resources are under-utilized. These facts have been identified by the INDIGO-DataCloud project as being too simplistic for accommodating scientific workloads in an efficient way, leading to an underutilization of the resources, a non desirable situation in scientific data centers. In this work, we will present the work done in the scheduling area during the first year of the INDIGO project and the foreseen evolutions.The authors want to acknowledge the support of the INDIGO-DataCloud (grant number 653549) project, funded by the European Commission’s Horizon 2020 Framework Programme.Peer Reviewe

Implementation and use of a highly available and innovative IaaS solution: the Cloud Area Padovana

While in the business world the cloud paradigm is typically implemented purchasing resources and services from third party providers (e.g. Amazon), in the scientific environment there's usually the need of on-premises IaaS infrastructures which allow efficient usage of the hardware distributed among (and owned by) different scientific administrative domains. In addition, the requirement of open source adoption has led to the choice of products like OpenStack by many organizations. We describe a use case of the Italian National Institute for Nuclear Physics (INFN) which resulted in the implementation of a unique cloud service, called ’Cloud Area Padovana’, which encompasses resources spread over two different sites: the INFN Legnaro National Laboratories and the INFN Padova division. We describe how this IaaS has been implemented, which technologies have been adopted and how services have been configured in high-availability (HA) mode. We also discuss how identity and authorization management were implemented, adopting a widely accepted standard architecture based on SAML2 and OpenID: by leveraging the versatility of those standards the integration with authentication federations like IDEM was implemented. We also discuss some other innovative developments, such as a pluggable scheduler, implemented as an extension of the native OpenStack scheduler, which allows the allocation of resources according to a fair-share based model and which provides a persistent queuing mechanism for handling user requests that can not be immediately served. Tools, technologies, procedures used to install, configure, monitor, operate this cloud service are also discussed. Finally we present some examples that show how this IaaS infrastructure is being used

Search of the Orion spur for continuous gravitational waves using a loosely coherent algorithm on data from LIGO interferometers

We report results of a wideband search for periodic gravitational waves from isolated neutron stars within the Orion spur towards both the inner and outer regions of our Galaxy. As gravitational waves interact very weakly with matter, the search is unimpeded by dust and concentrations of stars. One search disk (A) is 6.87° in diameter and centered on 20h10m54.71s+33°33′25.29′′, and the other (B) is 7.45° in diameter and centered on 8h35m20.61s-46°49′25.151′′. We explored the frequency range of 50-1500 Hz and frequency derivative from 0 to -5×10-9 Hz/s. A multistage, loosely coherent search program allowed probing more deeply than before in these two regions, while increasing coherence length with every stage. Rigorous follow-up parameters have winnowed the initial coincidence set to only 70 candidates, to be examined manually. None of those 70 candidates proved to be consistent with an isolated gravitational-wave emitter, and 95% confidence level upper limits were placed on continuous-wave strain amplitudes. Near 169 Hz we achieve our lowest 95% C.L. upper limit on the worst-case linearly polarized strain amplitude h0 of 6.3×10-25, while at the high end of our frequency range we achieve a worst-case upper limit of 3.4×10-24 for all polarizations and sky locations. © 2016 American Physical Society

INDIGO-DataCloud: A data and computing platform to facilitate seamless access to e-infrastructures

This paper describes the achievements of the H2020 project INDIGO-DataCloud. The project has provided e-infrastructures with tools, applications and cloud framework enhancements to manage the demanding requirements of scientific communities, either locally or through enhanced interfaces. The middleware developed allows to federate hybrid resources, to easily write, port and run scientific applications to the cloud. In particular, we have extended existing PaaS (Platform as a Service) solutions, allowing public and private e-infrastructures, including those provided by EGI, EUDAT, and Helix Nebula, to integrate their existing services and make them available through AAI services compliant with GEANT interfederation policies, thus guaranteeing transparency and trust in the provisioning of such services. Our middleware facilitates the execution of applications using containers on Cloud and Grid based infrastructures, as well as on HPC clusters. Our developments are freely downloadable as open source components, and are already being integrated into many scientific applications

Search of the Orion spur for continuous gravitational waves using a loosely coherent algorithm on data from LIGO interferometers

We report results of a wideband search for periodic gravitational waves from isolated neutron stars within the Orion spur towards both the inner and outer regions of our Galaxy. As gravitational waves interact very weakly with matter, the search is unimpeded by dust and concentrations of stars. One search disk (A) is 6.87° in diameter and centered on 20[superscript h]10[superscript m]54.71[superscript s] + 33°33[superscript ′]25.29[superscript ′′], and the other (B) is 7.45° in diameter and centered on 8[superscript h]35[superscript m]20.61[superscript s] - 46°49[superscript ′]25.151[superscript ′′]. We explored the frequency range of 50–1500 Hz and frequency derivative from 0 to -5 × 10[superscript -9]  Hz/s. A multistage, loosely coherent search program allowed probing more deeply than before in these two regions, while increasing coherence length with every stage. Rigorous follow-up parameters have winnowed the initial coincidence set to only 70 candidates, to be examined manually. None of those 70 candidates proved to be consistent with an isolated gravitational-wave emitter, and 95% confidence level upper limits were placed on continuous-wave strain amplitudes. Near 169 Hz we achieve our lowest 95% C.L. upper limit on the worst-case linearly polarized strain amplitude h[subscript 0] of 6.3 × 10[superscript -25], while at the high end of our frequency range we achieve a worst-case upper limit of 3.4 × 10[superscript -24] for all polarizations and sky locations.National Science Foundation (U.S.)United States. National Aeronautics and Space AdministrationCarnegie TrustDavid & Lucile Packard FoundationAlfred P. Sloan Foundatio

All-sky search for long-duration gravitational wave transients with initial LIGO

We present the results of a search for long-duration gravitational wave transients in two sets of data collected by the LIGO Hanford and LIGO Livingston detectors between November 5, 2005 and September 30, 2007, and July 7, 2009 and October 20, 2010, with a total observational time of 283.0 days and 132.9 days, respectively. The search targets gravitational wave transients of duration 10–500 s in a frequency band of 40–1000 Hz, with minimal assumptions about the signal waveform, polarization, source direction, or time of occurrence. All candidate triggers were consistent with the expected background; as a result we set 90% confidence upper limits on the rate of long-duration gravitational wave transients for different types of gravitational wave signals. For signals from black hole accretion disk instabilities, we set upper limits on the source rate density between 3.4×10[superscript -5] and 9.4×10[superscript -4]  Mpc[superscript -3] yr[superscript -1] at 90% confidence. These are the first results from an all-sky search for unmodeled long-duration transient gravitational waves.Carnegie TrustDavid & Lucile Packard FoundationAlfred P. Sloan FoundationNational Science Foundation (U.S.

Search of the Orion spur for continuous gravitational waves using a loosely coherent algorithm on data from LIGO interferometers

We report results of a wideband search for periodic gravitational waves from isolated neutron stars within the Orion spur towards both the inner and outer regions of our Galaxy. As gravitational waves interact very weakly with matter, the search is unimpeded by dust and concentrations of stars. One search disk (A) is 6.87° in diameter and centered on 20[superscript h]10[superscript m]54.71[superscript s] + 33°33[superscript ′]25.29[superscript ′′], and the other (B) is 7.45° in diameter and centered on 8[superscript h]35[superscript m]20.61[superscript s] - 46°49[superscript ′]25.151[superscript ′′]. We explored the frequency range of 50–1500 Hz and frequency derivative from 0 to -5 × 10[superscript -9]  Hz/s. A multistage, loosely coherent search program allowed probing more deeply than before in these two regions, while increasing coherence length with every stage. Rigorous follow-up parameters have winnowed the initial coincidence set to only 70 candidates, to be examined manually. None of those 70 candidates proved to be consistent with an isolated gravitational-wave emitter, and 95% confidence level upper limits were placed on continuous-wave strain amplitudes. Near 169 Hz we achieve our lowest 95% C.L. upper limit on the worst-case linearly polarized strain amplitude h[subscript 0] of 6.3 × 10[superscript -25], while at the high end of our frequency range we achieve a worst-case upper limit of 3.4 × 10[superscript -24] for all polarizations and sky locations.National Science Foundation (U.S.)United States. National Aeronautics and Space AdministrationCarnegie TrustDavid & Lucile Packard FoundationAlfred P. Sloan Foundatio

Properties of the Binary Black Hole Merger GW150914

On September 14, 2015, the Laser Interferometer Gravitational-Wave Observatory (LIGO) detected a gravitational-wave transient (GW150914); we characterize the properties of the source and its parameters. The data around the time of the event were analyzed coherently across the LIGO network using a suite of accurate waveform models that describe gravitational waves from a compact binary system in general relativity. GW150914 was produced by a nearly equal mass binary black hole of masses 36+5−4M⊙ and 29+4−4M⊙; for each parameter we report the median value and the range of the 90% credible interval. The dimensionless spin magnitude of the more massive black hole is bound to be <0.7 (at 90% probability). The luminosity distance to the source is 410+160−180  Mpc, corresponding to a redshift 0.09+0.03−0.04 assuming standard cosmology. The source location is constrained to an annulus section of 610  deg2, primarily in the southern hemisphere. The binary merges into a black hole of mass 62+4−4M⊙ and spin 0.67+0.05−0.07. This black hole is significantly more massive than any other inferred from electromagnetic observations in the stellar-mass regime

Residual activation of the SPES Front-End system: a comparative study between the MCNPX and FLUKA codes

A study of the residual activation of the Front- End system structure of the SPES (Selective Production of Exotic Species) facility, currently under construction at the Legnaro National Laboratories of INFN, Italy, is performed. The study provides useful information for the planning of inspections, maintenance operations and decommissioning of the facility as well as for the assessment of radiological conditions and safety requirements in the design and operation of any accelerator-driven radioactive ion beam facility. To better assess the obtained results, two Monte Carlo codes were independently used: MCNPX combined with CINDER’90 and FLUKA. The results of the two calculation procedures are compared at each step: fissions, fluxes, activation, dose rate. Since the energy range considered does not represent a typical application for any of the two codes, the comparison of the collected results can provide useful inputs for the developers. In particular, the agreement of the two codes on the global quantities is good, being of the order of 20–40% on average, and never larger than a factor 2. Nevertheless, the comparative study shows that, in this energy range, FLUKA seems to underestimate the angular straggling of protons and to overestimate the proton interaction cross-sections, with respect to MCNPX