Portaleinsatz im C3Grid - Erfahrungen bei der Implementation

Vortrag über den Einsatz der Portalsoftware GridSphere im C3 Gri

Online sea ice data platform: www.seaiceportal.de

There is an increasing public interest in sea ice information from both Polar Regions, which requires up-to-date background information and data sets at different levels for various target groups. In order to serve this interest and need, seaiceportal.de (originally: meereisportal.de) was developed as a comprehensive German knowledge platform on sea ice and its snow cover in the Arctic and Antarctic. It was launched in April 2013. Since then, the content and selection of data sets increased and the data portal received increasing attention, also from the international science community. Meanwhile, we are providing near-real time and archive data of many key parameters of sea ice and its snow cover. The data sets result from measurements acquired by various platforms as well as numerical simulations. Satellite observations of sea ice concentration, freeboard, thickness and drift are available as gridded data sets. Sea ice and snow temperatures and thickness as well as atmospheric parameters are available from autonomous platforms (buoys). Additional ship observations, ice station measurements, and mooring time series are compiled as data collections over the last decade. In parallel, we are continuously extending our meta-data and uncertainty information for all data sets. In addition to the data portal, seaiceportal.de provides general comprehensive background information on sea ice and snow as well as expert statements on recent observations and developments. This content is mostly in German in order to complement the various existing international sites for the German speaking public. We will present the portal, its content and function, but we are also asking for direct user feedback

MOSAiC goes O2A - Arctic Expedition Data Flow from Observations to Archives

During the largest polar expedition in history starting in September 2019, the German research icebreaker Polarstern spends a whole year drifting with the ice through the Arctic Ocean. The MOSAiC expedition takes the closest look ever at the Arctic even throughout the polar winter to gain fundamental insights and most unique on-site data for a better understanding of global climate change. Hundreds of researchers from 20 countries are involved. Scientists will use the in situ gathered data instantaneously in near-real time modus as well as long afterwards all around the globe taking climate research to a completely new level. Hence, proper data management, sampling strategies beforehand, and monitoring actual data flow as well as processing, analysis and sharing of data during and long after the MOSAiC expedition are the most essential tools for scientific gain and progress. To prepare for that challenge we adapted and integrated the research data management framework O2A “Data flow from Observations to Archives” to the needs of the MOSAiC expedition on board Polarstern as well as on land for data storage and access at the Alfred Wegener Institute Computing and Data Center in Bremerhaven, Germany. Our O2A-framework assembles a modular research infrastructure comprising a collection of tools and services. These components allow researchers to register all necessary sensor metadata beforehand linked to automatized data ingestion and to ensure and monitor data flow as well as to process, analyze, and publish data to turn the most valuable and uniquely gained arctic data into scientific outcomes. The framework further allows for the integration of data obtained with discrete sampling devices into the data flow. These requirements have led us to adapt the generic and cost-effective framework O2A to enable, control, and access the flow of sensor observations to archives in a cloud-like infrastructure on board Polarstern and later on to land based repositories for international availability. Major roadblocks of the MOSAiC-O2A data flow framework are (i) the increasing number and complexity of research platforms, devices, and sensors, (ii) the heterogeneous interdisciplinary driven requirements towards, e. g., satellite data, sensor monitoring, in situ sample collection, quality assessment and control, processing, analysis and visualization, and (iii) the demand for near real time analyses on board as well as on land with limited satellite bandwidth. The key modules of O2A's digital research infrastructure established by AWI are implementing the FAIR principles: SENSORWeb, to register sensor applications and sampling devices and capture controlled meta data before and alongside any measurements in the field Data ingest, allowing researchers to feed data into storage systems and processing pipelines in a prepared and documented way, at best in controlled near real-time data streams Dashboards allowing researchers to find and access data and share and collaborate among partners Workspace enabling researchers to access and use data with research software utilizing a cloud-based virtualized infrastructure that allows researchers to analyze massive amounts of data on the spot Archiving and publishing data via repositories and Digital Object Identifiers (DOI

Data Information Service based on Open Archives Initiative Protocols and Apache Lucene

We present a generic portal system architecture suitable for geoscientific data portals. The portals harvest data providers with Open Archives Initiative (OAI) protocols using XML based metadata formats like DIF or ISO-19139 format. Current implementations of OAI only support Dublin Core metadata. The new Java based portal software will support any XML format and makes them searchable through Apache Lucene without any other database software. The open architecture makes it possible to define searchable fields in several data formats by XPath allowing full text queries on all types of fields including numerical ranges. The metadata of all providers are stored in separate indices which makes it possible to combine them in several different portals. The web service interface allows to support custom front-ends for users and additional visualization in maps. The software will be made freely available through the Open-Source concept. A use case describes how the generic software is used in the Collaborative Climate Community Data and Processing Grid (C3-Grid)

The Collaborative Climate Community Data and Processing Grid (C3Grid) - A Technical View

The Collaborative Climate Community Data and Processing Grid (C3Grid) - A Technical View. Poster from D-Grid All Hands Meetin

Konzeptionierung und Prototypenentwicklung eines auf der Web Services-Architektur basierenden Portals zur Suche von Publikationen und Daten der Meteorologie in einer wissenschaftlichen Großforschungseinrichtung

A portal named MISAWIsta (Meteorological Information System)was created which allows users to search for primary data and relatedpublications found in Pangaea and Fedora information systems respectively.The user has the possibility (in case of measurement data) toview the results and download them as CSV- or MarineXML-file.Given that Pangaea and Fedora information systems have been implementedas a Web Service, a PHP-based SOAP-Client was writtento expose these data. The SOAP-Client prepares the query results andpresents them to the user. This work describes the conception anddevelopment of the prototype

25 Years of Polarstern Meteorology

The most important tool in Germany's polar research program is the research and supply vessel Polarstern. The ship was commissioned in 1982, the maiden voyage started at the end of 1982. The owner of the ship is the Alfred Wegener Institute for Polar and Marine Research in Bremerhaven, Germany. Within the last 25 years Polarstern performed a total of 44 expeditions to the Arctic and Antarctic. The ship is well equipped for meteorological research as well as for routine meteorological services. The meteorological office is permanently manned with a weather technician/- observer from the German Weather Service (DWD) who performs the routine 3-hourly synoptic observations and the daily upper air soundings. Additionally, a weather forecaster is responsible to advice the ships captain as well as the helicopter pilots and all scientists in any weather related question. The forecaster gets assistance from the weather technician who performs the satellite picture reception and manages the near real time data flow

EGEE - Intelligent, distributed climate data management

In collaboration with the German C3Grid Project (http://www.c3grid.de) a system has been developed to ease and accelerate climate data workflows. The system is built modular and based on international standards to be expandable by further data sites, partners and disciplines