Resources Description, Selection, Reservation and Verification on a Large-scale Testbed

International audienceThe management of resources on testbeds, including their description, reservation and verification, is a challenging issue, especially on of large scale testbeds such as those used for research on High Performance Computing or Clouds. In this paper, we present the solution designed for the Grid'5000 testbed in order to: (1) provide users with an in-depth and machine-parsable description of the testbed's resources; (2) enable multi-criteria selection and reservation of resources using a HPC resource manager; (3) ensure that the description of the resources remains accurate

Leveraging Semantic Web Technologies for Managing Resources in a Multi-Domain Infrastructure-as-a-Service Environment

This paper reports on experience with using semantically-enabled network resource models to construct an operational multi-domain networked infrastructure-as-a-service (NIaaS) testbed called ExoGENI, recently funded through NSF's GENI project. A defining property of NIaaS is the deep integration of network provisioning functions alongside the more common storage and computation provisioning functions. Resource provider topologies and user requests can be described using network resource models with common base classes for fundamental cyber-resources (links, nodes, interfaces) specialized via virtualization and adaptations between networking layers to specific technologies. This problem space gives rise to a number of application areas where semantic web technologies become highly useful - common information models and resource class hierarchies simplify resource descriptions from multiple providers, pathfinding and topology embedding algorithms rely on query abstractions as building blocks. The paper describes how the semantic resource description models enable ExoGENI to autonomously instantiate on-demand virtual topologies of virtual machines provisioned from cloud providers and are linked by on-demand virtual connections acquired from multiple autonomous network providers to serve a variety of applications ranging from distributed system experiments to high-performance computing

Chameleon, CloudLab, Grid’5000: What will the ultimate testbed look like?

International audienceA comparison of the three major Cloud testbeds

Testbeds for Reproducible Research

International audienceThis talk provides an overview of the Grid'5000 testbed, and a comparison with two recently created testbeds, Chameleon and CloudLab

Grid'5000: a testbed for reproducible research on HPC, Clouds, Big Data and Networking

National audienceOverview of Grid'5000 features for reproducible researc

Towards Trustworthy Testbeds thanks to Throughout Testing

International audienceWhen using testbeds in the context of experimental computer science, theability to produce trustworthy and reproducible experiments results dependsgreatly on the trustworthiness of the infrastructure itself. Unfortunately,several factors many issues such as software misconfiguration, hardwareheterogeneity, or service failures, can remain undetected and affect thequality of experimental results. This paper presents the design andimplementation of an automated testbed testing framework. This framework wasdeployed in the context of the Grid'5000 project, and uncovered more than onehundred of issues

Testing Testbeds Towards Reproducibility

International audienceWhen using testbeds in the context of experimental computer science, the ability to produce trustworthy and reproducible experiments results depends greatly on the trustworthiness of the infrastructure itself. Unfortunately, several factors many issues such as software misconfiguration, hardware heterogeneity, or service failures, can remain undetected and affect the quality of experimental results. This paper presents the design and implementation of an automated testbed testing framework. This framework was deployed in the context of the Grid'5000 project, and uncovered more than one hundred of issues.(see also https://hal.inria.fr/hal-01538682 for an extended version of this work

Survey and Analysis of Production Distributed Computing Infrastructures

This report has two objectives. First, we describe a set of the production distributed infrastructures currently available, so that the reader has a basic understanding of them. This includes explaining why each infrastructure was created and made available and how it has succeeded and failed. The set is not complete, but we believe it is representative. Second, we describe the infrastructures in terms of their use, which is a combination of how they were designed to be used and how users have found ways to use them. Applications are often designed and created with specific infrastructures in mind, with both an appreciation of the existing capabilities provided by those infrastructures and an anticipation of their future capabilities. Here, the infrastructures we discuss were often designed and created with specific applications in mind, or at least specific types of applications. The reader should understand how the interplay between the infrastructure providers and the users leads to such usages, which we call usage modalities. These usage modalities are really abstractions that exist between the infrastructures and the applications; they influence the infrastructures by representing the applications, and they influence the ap- plications by representing the infrastructures

Grid'5000 for high-quality reproducible research

International audienceThere is currently a push towards higher-quality and more reproducible experimental research. The specific features of HPC and Clouds research make it a field where those questions are particularly important. In this talk, we will highlight some challenges faced in HPC and Clouds research, and describe how Grid'5000 already addresses many of them. We will also discuss some future plans and remaining open questions

FESTIVAL: towards an intercontinental federation approach

In the last years, in both Europe and Japan, several initiatives have been started with the aim of building and testing Internet of Things and Smart ICT architectures and platforms to address specific domain issues through designed solutions. FESTIVAL EU-Japan collaborative project aims at federating these testbeds, making them interoperable, allowing centralized data collection and analyzing societal issues in both cultures, all of it under a user privacy-preserving context. In this sense, FESTIVAL pursues a twofold approach: firstly, the intercontinental federation of testbeds in Japan and Europe using existing tools as well as developing new ones; and secondly, the creation of new services and experiments, to be performed on top of the FESTIVAL testbeds and experimentation facilities, associated to three different smart city domains: smart energy, smart building and smart shopping. Throughout this article the current status of the project (in its first year) is shown, describing the Experimentation as a Service federation approach to be implemented, with a first analysis of the platforms and testbeds that are included within the project. Furthermore, the paper also describes the services and use cases that will be conducted within FESTIVAL lifespan. Finally, next steps to be carried out in the coming years of the project are indicated.This work was funded in part by the European Union’s Horizon 2020 Programme of the FESTIVAL project (Federated Interoperable Smart ICT Services Development and Testing Platforms) under grant agreement 643275, and from the Japanese National Institute of Information and Communications Technolog