Cargando…
WLCG space accounting in the SRM-less world
The WLCG computing infrastructure provides distributed storage capacity hosted at the geographically dispersed computing sites. In order to effectively organize storage and processing of the LHC data, the LHC experiments require a reliable and complete overview of the storage capacity in terms of th...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2019
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/201921404021 http://cds.cern.ch/record/2701402 |
_version_ | 1780964600988041216 |
---|---|
author | Andreeva, Julia Christidis, Dimitrios Di Girolamo, Alessandro Keeble, Oliver |
author_facet | Andreeva, Julia Christidis, Dimitrios Di Girolamo, Alessandro Keeble, Oliver |
author_sort | Andreeva, Julia |
collection | CERN |
description | The WLCG computing infrastructure provides distributed storage capacity hosted at the geographically dispersed computing sites. In order to effectively organize storage and processing of the LHC data, the LHC experiments require a reliable and complete overview of the storage capacity in terms of the occupied and free space, the storage shares allocated to different computing activities, and the possibility to detect “dark” data that occupies space while being unknown to the experiment’s file catalogue. The task of the WLCG space accounting activity is to provide such an overview and to assist LHC experiments and WLCG operations to manage storage space and to understand future requirements. Several space accounting solutions which have been developed by the LHC experiments are currently based on Storage Resource Manager (SRM). In the coming years SRM becomes an optional service for sites which do not provide tape storage. Moreover, already now some of the storage implementations do not provide an SRM interface. Therefore, the next generation of the space accounting systems should not be based on SRM. In order to enable possibility for exposing storage topology and space accounting information the Storage Resource Reporting proposal has been agreed between LHC experiments, sites and storage providers. This contribution describes the WLCG storage resource accounting system which is being developed based on Storage Resource Reporting proposal. |
id | oai-inspirehep.net-1760975 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2019 |
record_format | invenio |
spelling | oai-inspirehep.net-17609752022-08-10T12:22:21Zdoi:10.1051/epjconf/201921404021http://cds.cern.ch/record/2701402engAndreeva, JuliaChristidis, DimitriosDi Girolamo, AlessandroKeeble, OliverWLCG space accounting in the SRM-less worldComputing and ComputersThe WLCG computing infrastructure provides distributed storage capacity hosted at the geographically dispersed computing sites. In order to effectively organize storage and processing of the LHC data, the LHC experiments require a reliable and complete overview of the storage capacity in terms of the occupied and free space, the storage shares allocated to different computing activities, and the possibility to detect “dark” data that occupies space while being unknown to the experiment’s file catalogue. The task of the WLCG space accounting activity is to provide such an overview and to assist LHC experiments and WLCG operations to manage storage space and to understand future requirements. Several space accounting solutions which have been developed by the LHC experiments are currently based on Storage Resource Manager (SRM). In the coming years SRM becomes an optional service for sites which do not provide tape storage. Moreover, already now some of the storage implementations do not provide an SRM interface. Therefore, the next generation of the space accounting systems should not be based on SRM. In order to enable possibility for exposing storage topology and space accounting information the Storage Resource Reporting proposal has been agreed between LHC experiments, sites and storage providers. This contribution describes the WLCG storage resource accounting system which is being developed based on Storage Resource Reporting proposal.oai:inspirehep.net:17609752019 |
spellingShingle | Computing and Computers Andreeva, Julia Christidis, Dimitrios Di Girolamo, Alessandro Keeble, Oliver WLCG space accounting in the SRM-less world |
title | WLCG space accounting in the SRM-less world |
title_full | WLCG space accounting in the SRM-less world |
title_fullStr | WLCG space accounting in the SRM-less world |
title_full_unstemmed | WLCG space accounting in the SRM-less world |
title_short | WLCG space accounting in the SRM-less world |
title_sort | wlcg space accounting in the srm-less world |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/201921404021 http://cds.cern.ch/record/2701402 |
work_keys_str_mv | AT andreevajulia wlcgspaceaccountinginthesrmlessworld AT christidisdimitrios wlcgspaceaccountinginthesrmlessworld AT digirolamoalessandro wlcgspaceaccountinginthesrmlessworld AT keebleoliver wlcgspaceaccountinginthesrmlessworld |