Software Platform for European XFEL: Towards Online Experimental Data Analysis

Abstract

Large amount of data being generated at large scale facilities like European X-ray Free-Electron Laser (XFEL) requires new approaches for data processing and analysis. One of the mostcomputationally challenging experiments at an XFEL is single-particle structure determination.In this paper we propose a new design for an integrated software platform which combines well establishedtechniques for XFEL data analysis with High Performance Data Analysis (HPDA)methods. In our software platform we use streaming data analysis algorithms with high performancecomputing solutions. This approach should allow analysis of the experimental dataflow in quasionlineregime