Cargando…

Design and Performance of the Virtualization Platform for Offline computing on the ATLAS TDAQ Farm

With the LHC collider at CERN currently going through the period of Long Shutdown 1 (LS1) there is a remarkable opportunity to use the computing resources of the large trigger farms of the experiments for other data processing activities. In the case of ATLAS experiment the TDAQ farm, consisting of...

Descripción completa

Detalles Bibliográficos
Autores principales: Ballestrero, S, Batraneanu, S M, Brasolin, F, Contescu, C, Di Girolamo, A, Lee, C J, Pozo Astigarraga, M E, Scannicchio, D A, Twomey, M S, Zaytsev, A
Lenguaje:eng
Publicado: 2013
Materias:
Acceso en línea:http://cds.cern.ch/record/1607090
_version_ 1780931708722348032
author Ballestrero, S
Batraneanu, S M
Brasolin, F
Contescu, C
Di Girolamo, A
Lee, C J
Pozo Astigarraga, M E
Scannicchio, D A
Twomey, M S
Zaytsev, A
author_facet Ballestrero, S
Batraneanu, S M
Brasolin, F
Contescu, C
Di Girolamo, A
Lee, C J
Pozo Astigarraga, M E
Scannicchio, D A
Twomey, M S
Zaytsev, A
author_sort Ballestrero, S
collection CERN
description With the LHC collider at CERN currently going through the period of Long Shutdown 1 (LS1) there is a remarkable opportunity to use the computing resources of the large trigger farms of the experiments for other data processing activities. In the case of ATLAS experiment the TDAQ farm, consisting of more than 1500 compute nodes, is particularly suitable for running Monte Carlo production jobs that are mostly CPU and not I/O bound. This contribution gives a thorough review of all the stages of Sim@P1 project dedicated to the design and deployment of a virtualized platform running on the ATLAS TDAQ computing resources and using it to run the large groups of CernVM based virtual machines operating as a single CERN-P1 WLCG site. This platform has been designed to avoid interference with TDAQ usage of the farm and to guarantee the security and the usability of the ATLAS private network; Openstack has been chosen to provide a cloud management layer. The approaches to organizing support for the sustained operation of the system on both infrastructural (hardware, virtualization platform) and logical (site support and job execution) levels are also discussed. The project is a result of combined effort of the ATLAS TDAQ SysAdmins and NetAdmins teams, CERN IT-SDC-OL Department and RHIC and ATLAS Computing Facility at BNL. The experience obtained while operating Sim@P1 infrastructure over the last 3.5 months shows that the virtualized infrastructure deployed on top of the ATLAS HLT farm is capable of contributing to the ATLAS MC production on a level of computing power of a large Tier-1 WLCG site, despite the opportunistic nature of the underlying computing resources being used.
id cern-1607090
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2013
record_format invenio
spelling cern-16070902019-09-30T06:29:59Zhttp://cds.cern.ch/record/1607090engBallestrero, SBatraneanu, S MBrasolin, FContescu, CDi Girolamo, ALee, C JPozo Astigarraga, M EScannicchio, D ATwomey, M SZaytsev, ADesign and Performance of the Virtualization Platform for Offline computing on the ATLAS TDAQ FarmDetectors and Experimental TechniquesWith the LHC collider at CERN currently going through the period of Long Shutdown 1 (LS1) there is a remarkable opportunity to use the computing resources of the large trigger farms of the experiments for other data processing activities. In the case of ATLAS experiment the TDAQ farm, consisting of more than 1500 compute nodes, is particularly suitable for running Monte Carlo production jobs that are mostly CPU and not I/O bound. This contribution gives a thorough review of all the stages of Sim@P1 project dedicated to the design and deployment of a virtualized platform running on the ATLAS TDAQ computing resources and using it to run the large groups of CernVM based virtual machines operating as a single CERN-P1 WLCG site. This platform has been designed to avoid interference with TDAQ usage of the farm and to guarantee the security and the usability of the ATLAS private network; Openstack has been chosen to provide a cloud management layer. The approaches to organizing support for the sustained operation of the system on both infrastructural (hardware, virtualization platform) and logical (site support and job execution) levels are also discussed. The project is a result of combined effort of the ATLAS TDAQ SysAdmins and NetAdmins teams, CERN IT-SDC-OL Department and RHIC and ATLAS Computing Facility at BNL. The experience obtained while operating Sim@P1 infrastructure over the last 3.5 months shows that the virtualized infrastructure deployed on top of the ATLAS HLT farm is capable of contributing to the ATLAS MC production on a level of computing power of a large Tier-1 WLCG site, despite the opportunistic nature of the underlying computing resources being used.ATL-DAQ-SLIDE-2013-814oai:cds.cern.ch:16070902013-10-09
spellingShingle Detectors and Experimental Techniques
Ballestrero, S
Batraneanu, S M
Brasolin, F
Contescu, C
Di Girolamo, A
Lee, C J
Pozo Astigarraga, M E
Scannicchio, D A
Twomey, M S
Zaytsev, A
Design and Performance of the Virtualization Platform for Offline computing on the ATLAS TDAQ Farm
title Design and Performance of the Virtualization Platform for Offline computing on the ATLAS TDAQ Farm
title_full Design and Performance of the Virtualization Platform for Offline computing on the ATLAS TDAQ Farm
title_fullStr Design and Performance of the Virtualization Platform for Offline computing on the ATLAS TDAQ Farm
title_full_unstemmed Design and Performance of the Virtualization Platform for Offline computing on the ATLAS TDAQ Farm
title_short Design and Performance of the Virtualization Platform for Offline computing on the ATLAS TDAQ Farm
title_sort design and performance of the virtualization platform for offline computing on the atlas tdaq farm
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1607090
work_keys_str_mv AT ballestreros designandperformanceofthevirtualizationplatformforofflinecomputingontheatlastdaqfarm
AT batraneanusm designandperformanceofthevirtualizationplatformforofflinecomputingontheatlastdaqfarm
AT brasolinf designandperformanceofthevirtualizationplatformforofflinecomputingontheatlastdaqfarm
AT contescuc designandperformanceofthevirtualizationplatformforofflinecomputingontheatlastdaqfarm
AT digirolamoa designandperformanceofthevirtualizationplatformforofflinecomputingontheatlastdaqfarm
AT leecj designandperformanceofthevirtualizationplatformforofflinecomputingontheatlastdaqfarm
AT pozoastigarragame designandperformanceofthevirtualizationplatformforofflinecomputingontheatlastdaqfarm
AT scannicchioda designandperformanceofthevirtualizationplatformforofflinecomputingontheatlastdaqfarm
AT twomeyms designandperformanceofthevirtualizationplatformforofflinecomputingontheatlastdaqfarm
AT zaytseva designandperformanceofthevirtualizationplatformforofflinecomputingontheatlastdaqfarm