CMS physics technical design report : Addendum on high density QCD with heavy ions

Peer reviewe

Puppet module for dCache

The dCache module allows you to manage your instance with Puppet

New HPC Usage Model @ Jülich, Multi PB User Data Migration

1.) HPC storage Infrastruktur basierend auf GPFS / GPFS based storage infrastructure for HPC user - neue JUST 5 HW - neuer Layer XCST mit CES Gateways Richtung OpenStack VMs (aktuell nur NFS, Ende 2019 auch Object Store?)2.) Neues HPC Usage Modell: Datenmigration von 10 PB an User Daten / New HPC Usage Model: 10 PB HPC user data migrated to new file systems - Realisation (kein rsync!) - Probleme mit independent filesets in den neuen Filesystemen (Sev. 1 Case

Jülich TSM infrastructure upgrade - a long, hard road

Since decades the Jülich Supercomputing Centre operates a TSM infrastructure.On the one hand it is used for backup and TSM/HSM for the Jülich HPC file systems and on the other hand it is used for user archive and backup of desktop and server systems of the Forschungszentrum Jülich campus.In 2017 we decided to do major design changes in our setup. Including moving disk storage pools from local RAIDs to GPFS, switch the server platform from AIX to Linux and upgrade from Power6 to Power8. In addition over time we were forced to upgrade from TSM server version 6.4 to 7.1.6 and finally to the secure version 8.1.3.In this talk we will speak about the goals we wanted to achieve, the experience and pitfalls we faced and what we have reached so far

CES based Object Store - Jülich Storage Cluster JUST

Realization of an Object Store based on the IBM Storage Scale Cluster Export Service (CES) Object solutio

Realising the LOFAR Two-Metre Sky Survey

The new generation of high-resolution broad-band radio telescopes, like the Low Frequency Array (LOFAR), produces, depending on the level of compression, between 1 to 10 TB of data per hour after correlation. Such a large amount of scientific data demand powerful computing resources and efficient data handling strategies to be mastered. The LOFAR Two-metre Sky Survey (LoTSS) is a Key Science Project (KSP) of the LOFAR telescope. It aims to map the entire northern hemisphere at unprecedented sensitivity and resolution. The survey consist of 3 168 pointings, requiring about 30 PBytes of storage space. As a member of the German Long Wavelength Consortium (GLOW) the Forschungszentrum Jülich (FZJ) stores in the Long Term Archive (LTA) about 50% of all LoTSS observations conducted to date. In collaboration with SURFsara in Amsterdam we developed service tools that enables the KSP to process LOFAR data stored in the LTA at the Jülich Supercomputing Centre (JSC) in an automated and robust fashion. Through our system more than 500 out of 800 existing LoTSS observationshave already been processed with the prefactor pipeline. This pipeline calibrates the direction-independent instrumental and ionospheric effects and furthermore reduces the data size significantly. For continuum imaging, this processing pipeline is the standard pipeline that is executed before more advanced processing and image reconstruction methods are applied