Al-Turany, M.

Bertini, D.

Karabowicz, R.

Kresan, D.

Lebedev, A.

Manafov, A.

Rybalchenko, A.

Uhlig, F.

Winckler, N.

GSI Repository

FairMQ application example in CbmRootN. Winckler1, M. Al-Turany1, D. Bertini1, R. Karabowicz1, D. Kresan1, A. Lebedev1, A. Manafov1, A.Rybalchenko1, and F. Uhlig11GSI, Darmstadt, GermanyIntroductionThe FairMQ package is an asynchronous messag-ing layer in FairRoot framework aiming to support on-line/offline data analysis with high data rates[1, 2, 3]. It al-lows to distribute processes on different nodes (from a lap-top to an entire homogenous or heterogenous system withmany thousands of cores) and provides the communicationlayer between these processes.In this contribution, we present a simple FairMQapplication example in the context of the CbmRootframework[4].Device topologyThe components encapsulating the tasks are called de-vices and derive from the common base class FairMQDe-vice. The devices are arranged into topologies, which de-scribe the data flow between the different deployed pro-cesses. In this example, the used device topology is shownin figure1 and consists of the following devices:• Two data sources (called Sampler) sending mi-croslices• One Merger merging microslices into timeslices• One FileSink receiving and storing data to fileFigure 1: Simple topology involving four processes (2 sam-plers, 1 merger, 1 FileSink) with the push-pull messagingpattern.Sampler, Merger and FileSinkThe sampler device is used as data source, i.e. it readsdata from a file and send them to another device. In thisexample, the two samplers read from root file the CbmRoottimeslices, convert the data into STS or MUCH FLES mi-croslices, and then streamed them to the Merger device.The merger device collect, synchronize and merge theFLES microslices streamed by the two samplers into FLEStimeslices. Once merged, the timeslices are streamed to theFileSink device.The FileSink device collect the data send by the Merger,convert them into CbmRoot data format and store the resultinto root file.Summary and outlookA simple FairMQ application example is available in theCbmRoot simulation framework. Other process nodes (e.g.track finder or track reconstruction task) as well as othermessaging pattern (e.g. request/reply, pub/sub) can be eas-ily added to the device topology. A Dynamic DeploymentSystem (DDS) under development will ease the topologygeneration and deployments[5].References[1] D. Klein, “Flexible data transport for the online analysis in aparticle physics experiment”, Bachelor Thesis, TU darmstadt(2013)[2] A. Rybalchenko, and M. Al-Turany “Streaming data process-ing with FairMQ”, GSI Scientific Report 2013-2014[3] M. Al-Turany et al. “ALFA: A new Framework for ALICEand FAIR experiments”, GSI Scientific Report 2013-2014[4] CbmRoot collaboration[5] A. Manafov, et al. “DDS : A Dynamic Deployment Sytem”,GSI report 2014-2015INFRASTRUCTURE-IT-03 GSI SCIENTIFIC REPORT 2014370 DOI:10.15120/GR-2015-1-INFRASTRUCTURE-IT-03

FairMQ application example in CbmRoot

http://repository.gsi.de/record/184094/files/INFRASTRUCTURE-IT-03.pdf

FairMQ application example in CbmRoot

Abstract

Similar works

Full text

Available Versions

GSI Repository