Atkinson, Malcolm

Casarotti, Emanuele

Filgueira Vicente, Rosa

Frobert, Laurent

Gemünd, André

Krause, Amrey

Krischer, Lion

Magnoni, Federica

Matser, Jonas

Spinuso, Alessandro

Filgueira, Rosa

Gemund, Andre

University of St. Andrews - Pure

The VERCE platform: Enabling Computational Seismology via Streaming Workflows and Science Gateways. A Forecasting Model Testing Centre

Heriot Watt Pure

The VERCE platform:Enabling Computational Seismology via Streaming Workflows and Science Gateways. A Forecasting Model Testing Centre

Edinburgh Research Explorer

     Edinburgh Research Explorer                                      The VERCE platform: Enabling Computational Seismology viaStreaming Workflows and Science Gateways. A ForecastingModel Testing CentreCitation for published version:Spinuso, A, Filgueira Vicente, R, Krause, A, Matser, J, Casarotti, E, Magnoni, F, Gemünd, A, Frobert, L,Krischer, L & Atkinson, M 2015, The VERCE platform: Enabling Computational Seismology via StreamingWorkflows and Science Gateways. A Forecasting Model Testing Centre. in European Geosciences UnionGeneral Assembly (EGU2015).Link:Link to publication record in Edinburgh Research ExplorerDocument Version:Publisher's PDF, also known as Version of recordPublished In:European Geosciences Union General Assembly (EGU2015)General rightsCopyright for the publications made accessible via the Edinburgh Research Explorer is retained by the author(s)and / or other copyright owners and it is a condition of accessing these publications that users recognise andabide by the legal requirements associated with these rights.Take down policyThe University of Edinburgh has made every reasonable effort to ensure that Edinburgh Research Explorercontent complies with UK legislation. If you believe that the public display of this file breaches copyright pleasecontact openaccess@ed.ac.uk providing details, and we will remove access to the work immediately andinvestigate your claim.Download date: 05. Apr. 2019Geophysical Research AbstractsVol. 17, EGU2015-6129-8, 2015EGU General Assembly 2015© Author(s) 2015. CC Attribution 3.0 License.The VERCE platform: Enabling Computational Seismology viaStreaming Workflows and Science GatewaysAlessandro Spinuso (1), Rosa Filgueira (2), Amrey Krause (2), Jonas Matser (1), Emanuele Casarotti (3),Federica Magnoni (3), Andre Gemund (4), Laurent Frobert (5), Lion Krischer (6), and Malcolm Atkinson (2)(1) ORFEUS-KNMI, R&D Observation an Data Technology, Utrecht, Netherlands, (2) University of Edinburgh, UK, (3)INGV - Italian National Institute of Geophysics and Vulcanology, Italy, (4) SCAI - Fraunhofer, Germany, (5) EMSC-CSEM,Euro-Med Seismological Centre, France, (6) LMU - Ludwig Maximilians-Universiteit, GermanyThe VERCE project is creating an e-Science platform to facilitate innovative data analysis and coding methodsthat fully exploit the wealth of data in global seismology. One of the technologies developed within the projectis the Dispel4Py python library, which allows to describe abstract stream-based workflows for data-intensiveapplications and to execute them in a distributed environment. At runtime Dispel4Py is able to map workflowdescriptions dynamically onto a number of computational resources (Apache Storm clusters, MPI poweredclusters, and shared-memory multi-core machines, single-core machines), setting it apart from other workflowframeworks. Therefore, Dispel4Py enables scientists to focus on their computation instead of being distracted bydetails of the computing infrastructure they use.Among the workflows developed with Dispel4Py in VERCE, we mention here those for Seismic AmbientNoise Cross-Correlation and MISFIT calculation, which address two data-intensive problems that are common incomputational seismology. The former, also called Passive Imaging, allows the detection of relative seismic-wavevelocity variations during the time of recording, to be associated with the stress-field changes that occurred inthe test area. The MISFIT instead, takes as input the synthetic seismograms generated from HPC simulations fora certain Earth model and earthquake and, after a preprocessing stage, compares them with real observations inorder to foster subsequent model updates and improvement (Inversion).The VERCE Science Gateway exposes the MISFIT calculation workflow as a service, in combination withthe simulation phase. Both phases can be configured, controlled and monitored by the user via a rich user interfacewhich is integrated within the gUSE Science Gateway framework, hiding the complexity of accessing third partiesdata services, security mechanisms and enactment on the target resources. Thanks to a modular extension to theDispel4Py framework, the system collects provenance data adopting the W3C-PROV data model. Provenancerecordings can be explored and analysed at run time for rapid diagnostic and workflow steering, or later forfurther validation and comparisons across runs. We will illustrate the interactive services of the gateway and thecapabilities of the produced metadata, coupled with the VERCE data management layer based on iRODS.The Cross-Correlation workflow was evaluated on SuperMUC, a supercomputing cluster at the Leibniz Su-percomputing Centre in Munich, with 155,656 processor cores in 9400 compute nodes. SuperMUC is based onthe Intel Xeon architecture consisting of 18 Thin Node Islands and one Fat Node Island. This work has only hadaccess to the Thin Node Islands, which contain Sandy Bridge nodes, each having 16 cores and 32 GB of memory.In the evaluations we used 1000 stations, and we applied two types of methods (whiten and non-whiten) forpre-processing the data. The workflow was tested on a varying number of cores (16, 32, 64, 128, and 256 cores)using the MPI mapping of Dispel4Py. The results show that Dispel4Py is able to improve the performance byincreasing the number of cores without changing the description of the workflow.

https://www.pure.ed.ac.uk/ws/files/23610779/EGU2015_6129_8.pdf

The VERCE platform: Enabling Computational Seismology via Streaming Workflows and Science Gateways. A Forecasting Model Testing Centre

Abstract

Similar works

Full text

Available Versions

University of St. Andrews - Pure

Heriot Watt Pure

University of St. Andrews - Pure

Heriot Watt Pure

Edinburgh Research Explorer