23 research outputs found

    Autonomic Management of Large Clusters and Their Integration into the Grid

    Get PDF
    We present a framework for the co-ordinated, autonomic management of multiple clusters in a compute center and their integration into a Grid environment. Site autonomy and the automation of administrative tasks are prime aspects in this framework. The system behavior is continuously monitored in a steering cycle and appropriate actions are taken to resolve any problems. All presented components have been implemented in the course of the EU project DataGrid: The Lemon monitoring components, the FT fault-tolerance mechanism, the quattor system for software installation and configuration, the RMS job and resource management system, and the Gridification scheme that integrates clusters into the Grid

    Visualization, toolkit integration and other indicator processing

    No full text
    <p>The goal of WP4 is to develop suitable means for visualizing impact indicators to enable easy comparison and ranking of those indicators to the stakeholders to establish an overall user friendly ‘lay out’ for mapping and presentation of impact indicators and indices, using generic and uniform cartographic principle</p

    CLIPC : Demonstrating the climate impact indicator toolkit and MyCLIPC processing services

    No full text
    <ul> <li>Introduction to CLIPC   </li> <li>Typical use case of CLIPC supported by online scenario viewer</li> <li>Working with the Impact Indicator Toolkit (Demo)</li> <li>MyCLIPC / Climate4Impact concept – Finding climate data and processing it yourself (Demo)</li> <li>Technical details on the interfaces and service</li> <li>Discussion</li> </ul

    Earth science test suites to evaluate grid tools and middleware-examples for grid data access tools

    No full text
    International audienceThe Earth Science (ES) community has three major IT related concerns: Modeling (computing intensive), exploitation of datasets, and production of large shared datasets. All could be accomplishable using Grid. Different Grid middleware solutions exist and are being developed. In DEGREE (Dissemination and Exploitation of Grids in Earth sciencE) the aim was to disseminate and promote uptake of Grid in ES and to create a bridge between ES and Grid communities. DEGREE identified key ES requirements and has disseminated these to Grid projects, evaluated Grid middleware tools and standards regarding ES requirements and provided feedback to Grid developers. In order to convey requirements to the Grid community, test suite specifications were developed. Test suites provide real applications for testing functional and non-functional aspects of Grid, contrary to typical whiteboard tests or use cases. In this paper the GOMEVAL test suite is explained in detail and the results obtained are discussed

    Integrating e-infrastructures for remote climate data processing

    No full text
    Presented at EGU 2020 - Accessing and processing large climate data has nowadays become a particularly challenging task for end users, due to the rapidly increasing volumes being produced and made available. Access to climate data is crucial for sustaining research and performing climate change impact assessments. These activities have strong societal impact as climate change affects and requires that almost all economic and social sectors need adapting. The whole climate data archive is expected to reach a volume of 30 PB in 2020 and up to 2000 PB in 2024 (estimated), evolving from 0.03 PB (30 TB) in 2007 and 2 PB in 2014. Data processing and analysis must now take place remotely for the users: users typically have to rely on heterogeneous infrastructures and services between the data and their physical location. Developers of Research Infrastructures have to provide services to those users, hence having to define standards and generic services to fulfil those requirements. It will be shown how the DARE eScience Platform (http://project-dare.eu) will help developers to develop needed services more quickly and transparently for a large range of scientific researchers. The platform is designed for efficient and traceable development of complex experiments and domain-specific services. Most importantly, the DARE Platform integrates the following e-infrastructure services: the climate IS-ENES (https://is.enes.org) Research Infrastructure front-end climate4impact (C4I: https://climate4impact.eu), the EUDAT CDI (https://www.eudat.eu/eudat-collaborative-data-infrastructure-cdi) B2DROP Service, as well as the ESGF (https://esgf.llnl.gov). The DARE Platform itself can be deployed by research communities on local, public or commercial clouds, thanks to its containerized architecture. More specifically, two distinct Use Cases for the climate science domain will be presented. The first will show how an open source software to compute climate indices and indicators (icclim: https://github.com/cerfacs-globc/icclim) is leveraged using the DARE Platform to enable users to build their own workflows. The second Use Case will demonstrate how more complex tools, such as an extra-tropical and tropical cyclone tracking software (https://github.com/cerfacs-globc/cyclone_tracking), can be easily made available to end users by infrastructure and front-end software developers

    Roadmap Thematic Digital Competence Center v1.0 - Domain Natural and Engineering Sciences

    Get PDF
    The Thematic Digital Competence Centre (TDCC) for the Natural & Engineering Sciences (NES) is a network organisation that will bring together researchers, local DCC’s, infrastructure providers, knowledge and expertise networks, as well as other strategic initiatives within the NES domain. TDCC-NES aims to facilitate researchers to manage data and software in a FAIR manner by identifying bottlenecks and initiating projects to mitigate them

    Building a Climate Information Portal for Europe

    No full text
    Poster presented at Our Common Future under Climate Change, July 2015 The breadth of user communities and technical information providers poses many new challenges. Precise technical language is clearly needed to provide full and accurate documentation of the methods and technologies used to collect and process data. The challenges of conveying complex information is compounded by the complex and evolving state of our knowledge. There is a steady flow of events, technical innovations, and scientific advances which continually update our knowledge and expectations. CLIPC is developing a knowledge organisation framework, exploiting standards such as the “Simple Knowledge Organisation System (SKOS)”, to provide a seamless access to climate information

    Communicating across the disciplines to support climate services: the CLIPC portal

    No full text
    ● CLIPC is designing a platform to provide access to climate information of direct relevance to a wide variety of users, from scientists to policy makers and private sector decision makers; ● The “one-stop-shop” platform will provide data and information on climate and climate impacts, and ensure that the provenance of science and policy relevant data products is thoroughly documented; ● Engagement with user communities is informing development; ● Climate knowledge includes both data and tools, for interacting with, viewing, analysing the data
    corecore