Contribution to a conference proceedings/Journal Article

PUBDB-2025-01981

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Federated Heterogeneous Compute and Storage Infrastructure for the PUNCH4NFDI Consortium

Drabent, A. ; Freyermuth, O. ; Giffels, M. (Corresponding author)Extern* ; Hoeft, M. ; Künsemöller, J. ; Roland, B. ; Schwarz, D. ; Wissing, C.DESY*

2024
EDP Sciences Les Ulis

This record in other databases:    

Please use a persistent id in citations: doi:10.1051/epjconf/202429507020  doi:10.3204/PUBDB-2025-01981

Abstract: PUNCH4NFDI, funded by the Germany Research Foundation initially for five years, is a diverse consortium of particle, astro-, astroparticle, hadron and nuclear physics embedded in the National Research Data Infrastructure initiative. In order to provide seamless and federated access to the huge variety of compute and storage systems provided by the participating communities covering their very diverse needs, the Compute4PUNCH and Storage4PUNCH concepts have been developed. Both concepts comprise state-of-the-art technologies such as a token-based AAI for standardized access to compute and storage resources. The community supplied heterogeneous HPC, HTC and Cloud compute resources are dynamically and transparently integrated into one federated HTCondorbased overlay batch system using the COBalD/TARDIS resource meta-scheduler. Traditional login nodes and a JupyterHub provide entry points into the entire landscape of available compute resources, while container technologies and the CERN Virtual Machine File System (CVMFS) ensure a scalable provisioning of community-specific software environments. In Storage4PUNCH, community supplied storage systems mainly based on dCache or XRootD technology are being federated in a common infrastructure employing methods that are well established in the wider HEP community. Furthermore existing technologies for caching as well as metadata handling are being evaluated with the aim for a deeper integration. The combined Compute4PUNCH and Storage4PUNCH environment will allow a large variety of researchers to carry out resource-demanding analysis tasks. In this contribution we will present the Compute4PUNCH and Storage4PUNCH concepts, the current status of the developments as well as first experiences with scientific applications being executed on the available prototypes.

---

Contributing Institute(s):

1. LHC/CMS Experiment (CMS)

Research Program(s):

1. 611 - Fundamental Particles and Forces (POF4-611) (POF4-611)
2. DFG project G:(GEPRIS)460248186 - PUNCH4NFDI - Teilchen, Universum, Kerne und Hadronen für die NFDI (460248186) (460248186)

Experiment(s):

1. No specific instrument

---

Database coverage:
; ; ; ; DOAJ Seal ; SCOPUS

---