Begeman, K.

Boxhoorn, D.

Dabin, C.

Droge, B.

McFarland, J. P.

Tsyganov, A.

Valentijn, E. A.

Vriend, W. J.

Williams, O. R.

English

Euclid is an ESA M2 mission which will create a 15,000 square degrees space-based survey: the Euclid Archive System (EAS) is a core element of the Science Ground Segment (SGS) of Euclid. The EAS follows a data-centric approach to data processing, whereby the Data Processing System (DPS) is responsible for the centralized metadata storage and the Distributed Storage System (DSS) supports the distributed storage of data files. The EAS-DPS implements the Euclid Common Data model and along with the EAS-DSS provides numerous services for Euclid Consortium users and SGS subsystems. In addition, the EAS-DPS assists in the preparation of Euclid data releases which are copied to the third EAS subsystem, the ESA developed Science Archive System (SAS) where they become available to the wider astronomical community. The EAS-DPS implements the object-oriented Euclid Common Data Model using a relational DBMS for the storage. The EAS-DPS supports the tracing of the lineage of any data item in the system, provides services for the data quality assessment and the data processing orchestration. The EAS-DSS is a distributed storage system which is based on a set of storage nodes located in each of the ten Science Data Centers of the Euclid SGS. The storage nodes supports a wide range of solutions from local disk, using a unix filesystem, to iRODS nodes or Grid storage elements. In this paper the architectural design of EAS-DPS and EAS-DSS are reviewed: the interaction between them and tests of the already implemented components are described

Dissertations of the University of Groningen

   University of GroningenThe Role of the Euclid Archive System in the Processing of Euclid and External DataWilliams, O. R.; Begeman, K.; Boxhoorn, D.; Droge, B.; Tsyganov, A.; McFarland, J. P.;Valentijn, E. A.; Vriend, W. J.; Dabin, C.Published in:Astronomical Data Analysis Software and Systems XXVIIMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite fromit. Please check the document version below.Document VersionPublisher's PDF, also known as Version of recordPublication date:2019Link to publication in University of Groningen/UMCG research databaseCitation for published version (APA):Williams, O. R., Begeman, K., Boxhoorn, D., Droge, B., Tsyganov, A., McFarland, J. P., Valentijn, E. A.,Vriend, W. J., & Dabin, C. (2019). The Role of the Euclid Archive System in the Processing of Euclid andExternal Data. In M. Molinaro, K. Shortridge, & F. Pasian (Eds.), Astronomical Data Analysis Software andSystems XXVI (pp. 120-123). (ASP Conference Series; Vol. 521). Astronomical Society of the Pacific.http://adsabs.harvard.edu/abs/2019ASPC..521..120WCopyrightOther than for strictly personal use, it is not permitted to download or to forward/distribute the text or part of it without the consent of theauthor(s) and/or copyright holder(s), unless the work is under an open content license (like Creative Commons).The publication may also be distributed here under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license.More information can be found on the University of Groningen website: https://www.rug.nl/library/open-access/self-archiving-pure/taverne-amendment.Take-down policyIf you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediatelyand investigate your claim.Downloaded from the University of Groningen/UMCG research database (Pure): http://www.rug.nl/research/portal. For technical reasons thenumber of authors shown on this cover page is limited to 10 maximum.Download date: 05-06-2022

The Role of the Euclid Archive System in the Processing of Euclid and External Data

https://pure.rug.nl/ws/files/103418325/521_0120.pdf

The Role of the Euclid Archive System in the Processing of Euclid and External Data

Abstract

Similar works

Full text

Available Versions

Dissertations of the University of Groningen