Journal Article/Contribution to a conference proceedings

PUBDB-2025-04876

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png Label-based Virtual Directories In dCache

Sahakyan, M. (Corresponding author)DESY* ; Green, C. ; Litvintsev, D. ; Chitrapu, K. ; Morschel, L. ; Mkrtchyan, T. ; Meyer, S.DESY*

2025
EDP Sciences Les Ulis

This record in other databases:    

Please use a persistent id in citations: doi:10.1051/epjconf/202533701274  doi:10.3204/PUBDB-2025-04876

Abstract: Traditional filesystems organize data in directories. These directories are typically a collection of files whose grouping is based on a single criterion, e.g., the starting date of an experiment, experiment name, beamline ID, measurement device, or instrument. However, each file in a directory can belong to several logical groups, such as a special event type, experiment condition, or a part of a selected dataset. dCache is a storage system developed to store large amounts of scientific data, used by many HEP and Photon Science experiments. With recent developments in dCache, we have introduced a concept of file tagging, which dynamically groups files with the same label into virtual directories. The file labels can be added, removed, renamed, and deleted through the admin interface or via REST API. The files in virtual directories are exposed through all protocols supported by dCache. This contribution will describe the details of the implementation for file tagging in dCache and present our future development plans on automatic metadata extractions, a feature that will significantly simplify data management. Additionally, we are exploring the future use of virtual directories as a way to translate scientific data catalogs into filesystem views for direct data analysis.

---

Contributing Institute(s):

1. Informationstechnologie (IT)

Research Program(s):

1. 623 - Data Management and Analysis (POF4-623) (POF4-623)

Experiment(s):

1. No specific instrument

Appears in the scientific report 2025

---

Database coverage:
; ; ; ; DOAJ Seal ; SCOPUS

---