Cargando…

Consolidation of Cloud Computing in ATLAS

Throughout the first year of LHC Run 2, ATLAS Cloud Computing has undergone a period of consolidation, characterized by building upon previously established systems, with the aim of reducing operational effort, improving robustness, and reaching higher scale. This paper describes the current state o...

Descripción completa

Detalles Bibliográficos
Autores principales: Taylor, Ryan P., Cordeiro, Cristovao, Di Girolamo, Alessandro, Hover, John, Kouba, Tomas, Love, Peter, Mcnab, Andrew, Schovancova, Jaroslava, Sobie, Randall
Lenguaje:eng
Publicado: 2016
Materias:
Acceso en línea:http://cds.cern.ch/record/2216950
_version_ 1780952067942121472
author Taylor, Ryan P.
Cordeiro, Cristovao
Di Girolamo, Alessandro
Hover, John
Kouba, Tomas
Love, Peter
Mcnab, Andrew
Schovancova, Jaroslava
Sobie, Randall
author_facet Taylor, Ryan P.
Cordeiro, Cristovao
Di Girolamo, Alessandro
Hover, John
Kouba, Tomas
Love, Peter
Mcnab, Andrew
Schovancova, Jaroslava
Sobie, Randall
author_sort Taylor, Ryan P.
collection CERN
description Throughout the first year of LHC Run 2, ATLAS Cloud Computing has undergone a period of consolidation, characterized by building upon previously established systems, with the aim of reducing operational effort, improving robustness, and reaching higher scale. This paper describes the current state of ATLAS Cloud Computing. Cloud activities are converging on a common contextualization approach for virtual machines, and cloud resources are sharing monitoring and service discovery components. We describe the integration of Vac resources, streamlined usage of the High Level Trigger cloud for simulation and reconstruction, extreme scaling on Amazon EC2, and procurement of commercial cloud capacity in Europe. Building on the previously established monitoring infrastructure, we have deployed a real-time monitoring and alerting platform which coalesces data from multiple sources, provides flexible visualization via customizable dashboards, and issues alerts and carries out corrective actions in response to problems. Finally, a versatile analytics platform for data mining of log files is being used to analyze benchmark data and diagnose and gain insight on job errors.
id cern-2216950
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2016
record_format invenio
spelling cern-22169502019-09-30T06:29:59Zhttp://cds.cern.ch/record/2216950engTaylor, Ryan P.Cordeiro, CristovaoDi Girolamo, AlessandroHover, JohnKouba, TomasLove, PeterMcnab, AndrewSchovancova, JaroslavaSobie, RandallConsolidation of Cloud Computing in ATLASParticle Physics - ExperimentThroughout the first year of LHC Run 2, ATLAS Cloud Computing has undergone a period of consolidation, characterized by building upon previously established systems, with the aim of reducing operational effort, improving robustness, and reaching higher scale. This paper describes the current state of ATLAS Cloud Computing. Cloud activities are converging on a common contextualization approach for virtual machines, and cloud resources are sharing monitoring and service discovery components. We describe the integration of Vac resources, streamlined usage of the High Level Trigger cloud for simulation and reconstruction, extreme scaling on Amazon EC2, and procurement of commercial cloud capacity in Europe. Building on the previously established monitoring infrastructure, we have deployed a real-time monitoring and alerting platform which coalesces data from multiple sources, provides flexible visualization via customizable dashboards, and issues alerts and carries out corrective actions in response to problems. Finally, a versatile analytics platform for data mining of log files is being used to analyze benchmark data and diagnose and gain insight on job errors.ATL-SOFT-SLIDE-2016-657oai:cds.cern.ch:22169502016-09-20
spellingShingle Particle Physics - Experiment
Taylor, Ryan P.
Cordeiro, Cristovao
Di Girolamo, Alessandro
Hover, John
Kouba, Tomas
Love, Peter
Mcnab, Andrew
Schovancova, Jaroslava
Sobie, Randall
Consolidation of Cloud Computing in ATLAS
title Consolidation of Cloud Computing in ATLAS
title_full Consolidation of Cloud Computing in ATLAS
title_fullStr Consolidation of Cloud Computing in ATLAS
title_full_unstemmed Consolidation of Cloud Computing in ATLAS
title_short Consolidation of Cloud Computing in ATLAS
title_sort consolidation of cloud computing in atlas
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2216950
work_keys_str_mv AT taylorryanp consolidationofcloudcomputinginatlas
AT cordeirocristovao consolidationofcloudcomputinginatlas
AT digirolamoalessandro consolidationofcloudcomputinginatlas
AT hoverjohn consolidationofcloudcomputinginatlas
AT koubatomas consolidationofcloudcomputinginatlas
AT lovepeter consolidationofcloudcomputinginatlas
AT mcnabandrew consolidationofcloudcomputinginatlas
AT schovancovajaroslava consolidationofcloudcomputinginatlas
AT sobierandall consolidationofcloudcomputinginatlas