Cargando…
Integration of the Italian cache federation within the CMS computing model
The next decades at HL-LHC will be characterized by a huge increase of both storage and computing requirements (between one and two orders of magnitude). Moreover we foresee a shift on resources provisioning towards the exploitation of dynamic (on private or public cloud and HPC facilities) solution...
Autores principales: | , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
SISSA
2019
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.22323/1.351.0014 http://cds.cern.ch/record/2797736 |
_version_ | 1780972424878096384 |
---|---|
author | Ciangottini, Diego Bagliesi, Giuseppe Biasotto, Massimo Boccali, Tommaso Cesini, Daniele Donvito, Giacinto Falabella, Antonio Mazzoni, Enrico Spiga, Daniele Tracolli, Mirco |
author_facet | Ciangottini, Diego Bagliesi, Giuseppe Biasotto, Massimo Boccali, Tommaso Cesini, Daniele Donvito, Giacinto Falabella, Antonio Mazzoni, Enrico Spiga, Daniele Tracolli, Mirco |
author_sort | Ciangottini, Diego |
collection | CERN |
description | The next decades at HL-LHC will be characterized by a huge increase of both storage and
computing requirements (between one and two orders of magnitude). Moreover we foresee a
shift on resources provisioning towards the exploitation of dynamic (on private or public cloud
and HPC facilities) solutions. In this scenario the computing model of the CMS experiment is
pushed towards an evolution for the optimization of the amount of space that is managed
centrally and the CPU efficiency of the jobs that run on "storage-less" resources. In particular
the computing resources of the "Tier2" sites layer, for the most part, can be instrumented to
read data from a geographically distributed cache storage based on unmanaged resources,
reducing, in this way, the operational efforts by a large fraction and generating additional
flexibility.
The objective of this contribution is to present the first implementation of an INFN federation
of cache servers, developed also in collaboration with the eXtreme Data Cloud EU project. The
CNAF Tier-1 plus Bari and Legnaro Tier-2s provide unmanaged storages which have been
organized under a common namespace. This distributed cache federation has been seamlessly
integrated in the CMS computing infrastructure, while the technical implementation of this
solution is based on XRootD, largely adopted in the CMS computing model under the
"Anydata, Anytime, Anywhere project" (AAA).
The results in terms of CMS workflows performances will be shown. In addition a complete
simulation of the effects of the described model under several scenarios, including dynamic
hybrid cloud resource provisioning, will be discussed. Finally a plan for the upgrade of such a
prototype towards a stable INFN setup seamlessly integrated with production CMS computing
infrastructure will be discussed. |
id | cern-2797736 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2019 |
publisher | SISSA |
record_format | invenio |
spelling | cern-27977362022-09-15T13:58:10Zdoi:10.22323/1.351.0014http://cds.cern.ch/record/2797736engCiangottini, DiegoBagliesi, GiuseppeBiasotto, MassimoBoccali, TommasoCesini, DanieleDonvito, GiacintoFalabella, AntonioMazzoni, EnricoSpiga, DanieleTracolli, MircoIntegration of the Italian cache federation within the CMS computing modelDetectors and Experimental TechniquesComputing and ComputersThe next decades at HL-LHC will be characterized by a huge increase of both storage and computing requirements (between one and two orders of magnitude). Moreover we foresee a shift on resources provisioning towards the exploitation of dynamic (on private or public cloud and HPC facilities) solutions. In this scenario the computing model of the CMS experiment is pushed towards an evolution for the optimization of the amount of space that is managed centrally and the CPU efficiency of the jobs that run on "storage-less" resources. In particular the computing resources of the "Tier2" sites layer, for the most part, can be instrumented to read data from a geographically distributed cache storage based on unmanaged resources, reducing, in this way, the operational efforts by a large fraction and generating additional flexibility. The objective of this contribution is to present the first implementation of an INFN federation of cache servers, developed also in collaboration with the eXtreme Data Cloud EU project. The CNAF Tier-1 plus Bari and Legnaro Tier-2s provide unmanaged storages which have been organized under a common namespace. This distributed cache federation has been seamlessly integrated in the CMS computing infrastructure, while the technical implementation of this solution is based on XRootD, largely adopted in the CMS computing model under the "Anydata, Anytime, Anywhere project" (AAA). The results in terms of CMS workflows performances will be shown. In addition a complete simulation of the effects of the described model under several scenarios, including dynamic hybrid cloud resource provisioning, will be discussed. Finally a plan for the upgrade of such a prototype towards a stable INFN setup seamlessly integrated with production CMS computing infrastructure will be discussed.The next decades at HL-LHC will be characterized by a huge increase of both storage andcomputing requirements (between one and two orders of magnitude). Moreover we foresee a shift on resources provisioning towards the exploitation of dynamic (on private or public cloud and HPC facilities) solutions. In this scenario the computing model of the CMS experiment ispushed towards an evolution for the optimization of the amount of space that is managed centrally and the CPU efficiency of the jobs that run on "storage-less" resources. In particular the computing resources of the "Tier2" sites layer, for the most part, can be instrumented to read data from a geographically distributed cache storage based on unmanaged resources, reducing, in this way, the operational efforts by a large fraction and generating additionalflexibility.The objective of this contribution is to present the first implementation of an INFN federation of cache servers, developed also in collaboration with the eXtreme Data Cloud EU project. The CNAF Tier-1 plus Bari and Legnaro Tier-2s provide unmanaged storages which have been organized under a common namespace. This distributed cache federation has been seamlessly integrated in the CMS computing infrastructure, while the technical implementation of this solution is based on XRootD, largely adopted in the CMS computing model under the "Anydata, Anytime, Anywhere project" (AAA).The results in terms of CMS workflows performances will be shown. In addition a complete simulation of the effects of the described model under several scenarios, including dynamic hybrid cloud resource provisioning, will be discussed. Finally a plan for the upgrade of such a prototype towards a stable INFN setup seamlessly integrated with production CMS computing infrastructure will be discussed.SISSACMS-CR-2019-067oai:cds.cern.ch:27977362019-05-16 |
spellingShingle | Detectors and Experimental Techniques Computing and Computers Ciangottini, Diego Bagliesi, Giuseppe Biasotto, Massimo Boccali, Tommaso Cesini, Daniele Donvito, Giacinto Falabella, Antonio Mazzoni, Enrico Spiga, Daniele Tracolli, Mirco Integration of the Italian cache federation within the CMS computing model |
title | Integration of the Italian cache federation within the CMS computing model |
title_full | Integration of the Italian cache federation within the CMS computing model |
title_fullStr | Integration of the Italian cache federation within the CMS computing model |
title_full_unstemmed | Integration of the Italian cache federation within the CMS computing model |
title_short | Integration of the Italian cache federation within the CMS computing model |
title_sort | integration of the italian cache federation within the cms computing model |
topic | Detectors and Experimental Techniques Computing and Computers |
url | https://dx.doi.org/10.22323/1.351.0014 http://cds.cern.ch/record/2797736 |
work_keys_str_mv | AT ciangottinidiego integrationoftheitaliancachefederationwithinthecmscomputingmodel AT bagliesigiuseppe integrationoftheitaliancachefederationwithinthecmscomputingmodel AT biasottomassimo integrationoftheitaliancachefederationwithinthecmscomputingmodel AT boccalitommaso integrationoftheitaliancachefederationwithinthecmscomputingmodel AT cesinidaniele integrationoftheitaliancachefederationwithinthecmscomputingmodel AT donvitogiacinto integrationoftheitaliancachefederationwithinthecmscomputingmodel AT falabellaantonio integrationoftheitaliancachefederationwithinthecmscomputingmodel AT mazzonienrico integrationoftheitaliancachefederationwithinthecmscomputingmodel AT spigadaniele integrationoftheitaliancachefederationwithinthecmscomputingmodel AT tracollimirco integrationoftheitaliancachefederationwithinthecmscomputingmodel |