Cargando…

WLCG space accounting in the SRM-less world

The WLCG computing infrastructure provides distributed storage capacity hosted at the geographically dispersed computing sites. In order to effectively organize storage and processing of the LHC data, the LHC experiments require a reliable and complete overview of the storage capacity in terms of th...

Descripción completa

Detalles Bibliográficos
Autores principales: Andreeva, Julia, Christidis, Dimitrios, Di Girolamo, Alessandro, Keeble, Oliver
Lenguaje:eng
Publicado: 2019
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/201921404021
http://cds.cern.ch/record/2701402
_version_ 1780964600988041216
author Andreeva, Julia
Christidis, Dimitrios
Di Girolamo, Alessandro
Keeble, Oliver
author_facet Andreeva, Julia
Christidis, Dimitrios
Di Girolamo, Alessandro
Keeble, Oliver
author_sort Andreeva, Julia
collection CERN
description The WLCG computing infrastructure provides distributed storage capacity hosted at the geographically dispersed computing sites. In order to effectively organize storage and processing of the LHC data, the LHC experiments require a reliable and complete overview of the storage capacity in terms of the occupied and free space, the storage shares allocated to different computing activities, and the possibility to detect “dark” data that occupies space while being unknown to the experiment’s file catalogue. The task of the WLCG space accounting activity is to provide such an overview and to assist LHC experiments and WLCG operations to manage storage space and to understand future requirements. Several space accounting solutions which have been developed by the LHC experiments are currently based on Storage Resource Manager (SRM). In the coming years SRM becomes an optional service for sites which do not provide tape storage. Moreover, already now some of the storage implementations do not provide an SRM interface. Therefore, the next generation of the space accounting systems should not be based on SRM. In order to enable possibility for exposing storage topology and space accounting information the Storage Resource Reporting proposal has been agreed between LHC experiments, sites and storage providers. This contribution describes the WLCG storage resource accounting system which is being developed based on Storage Resource Reporting proposal.
id oai-inspirehep.net-1760975
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling oai-inspirehep.net-17609752022-08-10T12:22:21Zdoi:10.1051/epjconf/201921404021http://cds.cern.ch/record/2701402engAndreeva, JuliaChristidis, DimitriosDi Girolamo, AlessandroKeeble, OliverWLCG space accounting in the SRM-less worldComputing and ComputersThe WLCG computing infrastructure provides distributed storage capacity hosted at the geographically dispersed computing sites. In order to effectively organize storage and processing of the LHC data, the LHC experiments require a reliable and complete overview of the storage capacity in terms of the occupied and free space, the storage shares allocated to different computing activities, and the possibility to detect “dark” data that occupies space while being unknown to the experiment’s file catalogue. The task of the WLCG space accounting activity is to provide such an overview and to assist LHC experiments and WLCG operations to manage storage space and to understand future requirements. Several space accounting solutions which have been developed by the LHC experiments are currently based on Storage Resource Manager (SRM). In the coming years SRM becomes an optional service for sites which do not provide tape storage. Moreover, already now some of the storage implementations do not provide an SRM interface. Therefore, the next generation of the space accounting systems should not be based on SRM. In order to enable possibility for exposing storage topology and space accounting information the Storage Resource Reporting proposal has been agreed between LHC experiments, sites and storage providers. This contribution describes the WLCG storage resource accounting system which is being developed based on Storage Resource Reporting proposal.oai:inspirehep.net:17609752019
spellingShingle Computing and Computers
Andreeva, Julia
Christidis, Dimitrios
Di Girolamo, Alessandro
Keeble, Oliver
WLCG space accounting in the SRM-less world
title WLCG space accounting in the SRM-less world
title_full WLCG space accounting in the SRM-less world
title_fullStr WLCG space accounting in the SRM-less world
title_full_unstemmed WLCG space accounting in the SRM-less world
title_short WLCG space accounting in the SRM-less world
title_sort wlcg space accounting in the srm-less world
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/201921404021
http://cds.cern.ch/record/2701402
work_keys_str_mv AT andreevajulia wlcgspaceaccountinginthesrmlessworld
AT christidisdimitrios wlcgspaceaccountinginthesrmlessworld
AT digirolamoalessandro wlcgspaceaccountinginthesrmlessworld
AT keebleoliver wlcgspaceaccountinginthesrmlessworld