Boosting Performance of Data-intensive Analysis Workflows with Distributed Coordinated Caching

Data-intensive end-user analyses in high energy physics require high data throughput to reach short turnaround cycles. This leads to enormous challenges for storage and network infrastructure, especially when facing the tremendously increasing amount of data to be processed during High-Luminosity LHC runs. Including opportunistic resources with volatile storage systems into the traditional HEP computing facilities makes this situation more complex. Bringing data close to the computing units is a promising approach to solve throughput limitations and improve the overall performance. We focus on coordinated distributed caching by coordinating workows to the most suitable hosts in terms of cached files. This allows optimizing overall processing efficiency of data-intensive workows and efficiently use limited cache volume by reducing replication of data on distributed caches. We developed a NaviX coordination service at KIT that realizes coordinated distributed caching using XRootD cache proxy server infrastructure and HTCondor batch system. In this paper, we present the experience gained in operating coordinated distributed caches on cloud and HPC resources. Furthermore, we show benchmarks of a dedicated high throughput cluster, the Throughput-Optimized Analysis-System (TOpAS), which is based on the above-mentioned concept

Federation of compute resources available to the German CMS community

The German CMS community (DCMS) as a whole can benefit from the various compute resources, available to its different institutes. While Grid-enabled and National Analysis Facility resources are usually shared within the community, local and recently enabled opportunistic resources like HPC centers and cloud resources are not. Furthermore, there is no shared submission infrastructure available. Via HTCondor\u27s [1] mechanisms to connect resource pools, several remote pools can be connected transparently to the users and therefore used more efficiently by a multitude of user groups. In addition to the statically provisioned resources, also dynamically allocated resources from external cloud providers as well as HPC centers can be integrated. However, the usage of such dynamically allocated resources gives rise to additional complexity. Constraints on access policies of the resources, as well as workflow necessities have to be taken care of. To maintain a well-defined and reliable runtime environment on each resource, virtualization and containerization technologies such as virtual machines, Docker, and Singularity, are used

HEP Analyses on Dynamically Allocated Opportunistic Computing Resources

The current experiments in high energy physics (HEP) have a huge data rate. To convert the measured data, an enormous number of computing resources is needed and will further increase with upgraded and newer experiments. To fulfill the ever-growing demand the allocation of additional, potentially only temporary available non-HEP dedicated resources is important. These so-called opportunistic resources cannot only be used for analyses in general but are also well-suited to cover the typical unpredictable peak demands for computing resources. For both use cases, the temporary availability of the opportunistic resources requires a dynamic allocation, integration, and management, while their heterogeneity requires optimization to maintain high resource utilization by allocating best matching resources. To find the best matching resources which should be allocated is challenging due to the unpredictable submission behavior as well as an ever-changing mixture of workflows with different requirements. Instead of predicting the best matching resource, we base our decisions on the utilization of resources. For this reason, we are developing the resource manager TARDIS (Transparent Adaptive Resource Dynamic Integration System) which manages and dynamically requests or releases resources. The decision of how many resources TARDIS has to request is implemented in COBalD (COBald - The Opportunistic Balancing Daemon) to ensure further allocation of well-used resources while reducing the amount of insufficiently used ones. TARDIS allocates and manages resources from various resource providers such as HPC centers or commercial and public clouds while ensuring a dynamic allocation and efficient utilization of these heterogeneous opportunistic resources. Furthermore, TARDIS integrates the allocated opportunistic resources into one overlay batch system which provides a single point of entry for all users. In order to provide the dedicated HEP software environment, we use virtualization and container technologies. In this contribution, we give an overview of the dynamic integration of opportunistic resources via TARDIS/COBalD in our HEP institute as well as how user analyses benefit from these additional resources

Equilibrium and nonequilibrium properties of systems with long-range interactions

We briefly review some equilibrium and nonequilibrium properties of systems with long-range interactions. Such systems, which are characterized by a potential that weakly decays at large distances, have striking properties at equilibrium, like negative specific heat in the microcanonical ensemble, temperature jumps at first order phase transitions, broken ergodicity. Here, we mainly restrict our analysis to mean-field models, where particles globally interact with the same strength. We show that relaxation to equilibrium proceeds through quasi-stationary states whose duration increases with system size. We propose a theoretical explanation, based on Lynden-Bell's entropy, of this intriguing relaxation process. This allows to address problems related to nonequilibrium using an extension of standard equilibrium statistical mechanics. We discuss in some detail the example of the dynamics of the free electron laser, where the existence and features of quasi-stationary states is likely to be tested experimentally in the future. We conclude with some perspectives to study open problems and to find applications of these ideas to dipolar media.Comment: 8 pages, 14 figures, Procs. of STATPHYS23, to be published on EPJ

Controlled generation of momentum states in a high-finesse ring cavity

A Bose-Einstein condensate in a high-finesse ring cavity scatters the photons of a pump beam into counterpropagating cavity modes, populating a bi-dimensional momentum lattice. A high-finesse ring cavity with a sub-recoil linewidth allows to control the quantized atomic motion, selecting particular discrete momentum states and generating atom-photon entanglement. The semiclassical and quantum model for the 2D collective atomic recoil lasing (CARL) are derived and the superradiant and good-cavity regimes discussed. For pump incidence perpendicular to the cavity axis, the momentum lattice is symmetrically populated. Conversely, for oblique pump incidence the motion along the two recoil directions is unbalanced and different momentum states can be populated on demand by tuning the pump frequency.Comment: Submitted to EPJ-ST Special Issue. 10 pages and 3 figure

The methodology of surveillance for antimicrobial resistance and healthcare-associated infections in Europe (SUSPIRE): a systematic review of publicly available information.

OBJECTIVES: Surveillance is a key component of any control strategy for healthcare-associated infections (HAIs) and antimicrobial resistance (AMR), and public availability of methodologic aspects is crucial for the interpretation of the data. We sought to systematically review publicly available information for HAIs and/or AMR surveillance systems organized by public institutions or scientific societies in European countries. METHODS: A systematic review of scientific and grey literature following the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines was performed. Information on HAIs and/or AMR surveillance systems published until 31 October 2016 were included. RESULTS: A total of 112 surveillance systems were detected; 56 from 20 countries were finally included. Most exclusions were due to lack of publicly available information. Regarding AMR, the most frequent indicator was the proportion of resistant isolates (27 of 34 providing information, 79.42%); only 18 (52.9%) included incidence rates; the data were only laboratory based in 33 (78.5%) of the 42 providing this information. Regarding HAIs in intensive care units, all 22 of the systems providing data included central line-associated bloodstream infections, and 19 (86.3%) included ventilator-associated pneumonia and catheter-associated urinary tract infections; incidence density was the most frequent indicator. Regarding surgical site infections, the most frequent procedures included were hip prosthesis, colon surgery and caesarean section (21/22, 95.5%). CONCLUSIONS: Publicly available information about the methods and indicators of the surveillance system is frequently lacking. Despite the efforts of European Centre for Disease Control and Prevention (ECDC) and other organizations, wide heterogeneity in procedures and indicators still exists

Strategies and performance of the CMS silicon tracker alignment during LHC Run 2

The strategies for and the performance of the CMS silicon tracking system alignment during the 2015–2018 data-taking period of the LHC are described. The alignment procedures during and after data taking are explained. Alignment scenarios are also derived for use in the simulation of the detector response. Systematic effects, related to intrinsic symmetries of the alignment task or to external constraints, are discussed and illustrated for different scenarios

Search for a vector-like quark T′ → tH via the diphoton decay mode of the Higgs boson in proton-proton collisions at s \sqrt{s} = 13 TeV

A search for the electroweak production of a vector-like quark T′, decaying to a top quark and a Higgs boson is presented. The search is based on a sample of proton-proton collision events recorded at the LHC at = 13 TeV, corresponding to an integrated luminosity of 138 fb−1. This is the first T′ search that exploits the Higgs boson decay to a pair of photons. For narrow isospin singlet T′ states with masses up to 1.1 TeV, the excellent diphoton invariant mass resolution of 1–2% results in an increased sensitivity compared to previous searches based on the same production mechanism. The electroweak production of a T′ quark with mass up to 960 GeV is excluded at 95% confidence level, assuming a coupling strength κT = 0.25 and a relative decay width Γ/MT′ < 5%

A search for new physics in central exclusive production using the missing mass technique with the CMS detector and the CMS-TOTEM precision proton spectrometer

A generic search is presented for the associated production of a Z boson or a photon with an additional unspecified massive particle X, pp → pp + Z/γ + X, in proton-tagged events from proton–proton collisions at √s = 13 TeV, recorded in 2017 with the CMS detector and the CMS-TOTEM precision proton spectrometer. The missing mass spectrum is analysed in the 600–1600 GeV range and a fit is performed to search for possible deviations from the background expectation. No significant excess in data with respect to the background predictions has been observed. odelindependent upper limits on the visible production cross section of pp → pp + Z/γ + X are set