22 research outputs found

    Autonomic Management of Large Clusters and Their Integration into the Grid

    Get PDF
    We present a framework for the co-ordinated, autonomic management of multiple clusters in a compute center and their integration into a Grid environment. Site autonomy and the automation of administrative tasks are prime aspects in this framework. The system behavior is continuously monitored in a steering cycle and appropriate actions are taken to resolve any problems. All presented components have been implemented in the course of the EU project DataGrid: The Lemon monitoring components, the FT fault-tolerance mechanism, the quattor system for software installation and configuration, the RMS job and resource management system, and the Gridification scheme that integrates clusters into the Grid

    Visualization, toolkit integration and other indicator processing

    No full text
    <p>The goal of WP4 is to develop suitable means for visualizing impact indicators to enable easy comparison and ranking of those indicators to the stakeholders to establish an overall user friendly ‘lay out’ for mapping and presentation of impact indicators and indices, using generic and uniform cartographic principle</p

    CLIPC : Demonstrating the climate impact indicator toolkit and MyCLIPC processing services

    No full text
    <ul> <li>Introduction to CLIPC   </li> <li>Typical use case of CLIPC supported by online scenario viewer</li> <li>Working with the Impact Indicator Toolkit (Demo)</li> <li>MyCLIPC / Climate4Impact concept – Finding climate data and processing it yourself (Demo)</li> <li>Technical details on the interfaces and service</li> <li>Discussion</li> </ul

    Earth science test suites to evaluate grid tools and middleware-examples for grid data access tools

    No full text
    International audienceThe Earth Science (ES) community has three major IT related concerns: Modeling (computing intensive), exploitation of datasets, and production of large shared datasets. All could be accomplishable using Grid. Different Grid middleware solutions exist and are being developed. In DEGREE (Dissemination and Exploitation of Grids in Earth sciencE) the aim was to disseminate and promote uptake of Grid in ES and to create a bridge between ES and Grid communities. DEGREE identified key ES requirements and has disseminated these to Grid projects, evaluated Grid middleware tools and standards regarding ES requirements and provided feedback to Grid developers. In order to convey requirements to the Grid community, test suite specifications were developed. Test suites provide real applications for testing functional and non-functional aspects of Grid, contrary to typical whiteboard tests or use cases. In this paper the GOMEVAL test suite is explained in detail and the results obtained are discussed

    Integrating e-infrastructures for remote climate data processing

    No full text
    Presented at EGU 2020 - Accessing and processing large climate data has nowadays become a particularly challenging task for end users, due to the rapidly increasing volumes being produced and made available. Access to climate data is crucial for sustaining research and performing climate change impact assessments. These activities have strong societal impact as climate change affects and requires that almost all economic and social sectors need adapting. The whole climate data archive is expected to reach a volume of 30 PB in 2020 and up to 2000 PB in 2024 (estimated), evolving from 0.03 PB (30 TB) in 2007 and 2 PB in 2014. Data processing and analysis must now take place remotely for the users: users typically have to rely on heterogeneous infrastructures and services between the data and their physical location. Developers of Research Infrastructures have to provide services to those users, hence having to define standards and generic services to fulfil those requirements. It will be shown how the DARE eScience Platform (http://project-dare.eu) will help developers to develop needed services more quickly and transparently for a large range of scientific researchers. The platform is designed for efficient and traceable development of complex experiments and domain-specific services. Most importantly, the DARE Platform integrates the following e-infrastructure services: the climate IS-ENES (https://is.enes.org) Research Infrastructure front-end climate4impact (C4I: https://climate4impact.eu), the EUDAT CDI (https://www.eudat.eu/eudat-collaborative-data-infrastructure-cdi) B2DROP Service, as well as the ESGF (https://esgf.llnl.gov). The DARE Platform itself can be deployed by research communities on local, public or commercial clouds, thanks to its containerized architecture. More specifically, two distinct Use Cases for the climate science domain will be presented. The first will show how an open source software to compute climate indices and indicators (icclim: https://github.com/cerfacs-globc/icclim) is leveraged using the DARE Platform to enable users to build their own workflows. The second Use Case will demonstrate how more complex tools, such as an extra-tropical and tropical cyclone tracking software (https://github.com/cerfacs-globc/cyclone_tracking), can be easily made available to end users by infrastructure and front-end software developers

    Building a Climate Information Portal for Europe

    No full text
    Poster presented at Our Common Future under Climate Change, July 2015 The breadth of user communities and technical information providers poses many new challenges. Precise technical language is clearly needed to provide full and accurate documentation of the methods and technologies used to collect and process data. The challenges of conveying complex information is compounded by the complex and evolving state of our knowledge. There is a steady flow of events, technical innovations, and scientific advances which continually update our knowledge and expectations. CLIPC is developing a knowledge organisation framework, exploiting standards such as the “Simple Knowledge Organisation System (SKOS)”, to provide a seamless access to climate information

    Communicating across the disciplines to support climate services: the CLIPC portal

    No full text
    ● CLIPC is designing a platform to provide access to climate information of direct relevance to a wide variety of users, from scientists to policy makers and private sector decision makers; ● The “one-stop-shop” platform will provide data and information on climate and climate impacts, and ensure that the provenance of science and policy relevant data products is thoroughly documented; ● Engagement with user communities is informing development; ● Climate knowledge includes both data and tools, for interacting with, viewing, analysing the data

    Towards a dedicated impact portal to bridge the gap between the impact and climate communities : Lessons from use cases

    Get PDF
    International audienceFuture climate evolution is of primary importance for the societal, economical, political orientations and decision-making. It explains the increasing use of climate projections as input for quantitative impact studies, assessing vulnerability and defining adaptation strategies in different sectors. Here we analyse 17 national and representative use cases so as to identify the diversity of the demand for climate information depending on user profiles as well as the best practices, methods and tools that are needed to answer the different requests. A particular emphasis is put on the workflow that allows to translate climate data into suitable impact data, the way to deal with the different sources of uncertainty and to provide a suited product to users. We identified three complementary tools to close the gap between climate scientists and user needs: an efficient interface between users and providers; an optimized methodology to handle user requests and a portal to facilitate access to data and elaborated products. We detail in the paper how these three tools can limit the intervention of experts, educate users, and lead to the production of useful information. This work provides the basis on which the ENES (European Network for Earth System Modelling) Portal Interface for the Climate Impact Communities is built
    corecore