Cargando…

The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda

The ATLAS Installation System v2 is the evolution of the original system, used since 2003. The original tool has been completely re-designed in terms of database backend and components, adding support for submission to multiple backends, including the original WMS and the new Panda modules. The data...

Descripción completa

Detalles Bibliográficos
Autores principales: De Salvo, Alessandro, Maeno Kataoka, Mayuko, Smirnov, Yuri, Sanchez, Arturo
Lenguaje:eng
Publicado: 2015
Materias:
Acceso en línea:http://cds.cern.ch/record/2000990
_version_ 1780946014533844992
author De Salvo, Alessandro
Maeno Kataoka, Mayuko
Smirnov, Yuri
Sanchez, Arturo
author_facet De Salvo, Alessandro
Maeno Kataoka, Mayuko
Smirnov, Yuri
Sanchez, Arturo
author_sort De Salvo, Alessandro
collection CERN
description The ATLAS Installation System v2 is the evolution of the original system, used since 2003. The original tool has been completely re-designed in terms of database backend and components, adding support for submission to multiple backends, including the original WMS and the new Panda modules. The database engine has been changed from plain MySQL to Galera/Percona and the table structure has been optimized to allow a full High-Availability (HA) solution over WAN. The servlets, running on each frontend, have been also decoupled from local settings, to allow an easy scalability of the system, including the possibility of an HA system with multiple sites. The clients can also be run in multiple copies and in different geographical locations, and take care of sending the installation and validation jobs to the target Grid or Cloud sites. Moreover, the Installation DB is used as source of parameters by the automatic agents running in CVMFS, in order to install the software and distribute it to the sites. The system is in production for ATLAS since 2013, having as main sites in HA the INFN Roma T2 and CERN AI. The LJSFi2 engine is directly interfacing with Panda for the Job Management, AGIS for the site parameter configurations, and CVMFS for both core components and the installation of the software itself. LJSFi2 is also able to use other plugins, and is essentially VO-agnostic, so can be directly used and extended to cope with the requirements of any Grid or Cloud enabled VO. In this work we'll present the architecture, performance, status and possible evolutions to the system for the LHC Run2 and beyond.
id cern-2000990
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2015
record_format invenio
spelling cern-20009902019-09-30T06:29:59Zhttp://cds.cern.ch/record/2000990engDe Salvo, AlessandroMaeno Kataoka, MayukoSmirnov, YuriSanchez, ArturoThe ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via PandaParticle Physics - ExperimentThe ATLAS Installation System v2 is the evolution of the original system, used since 2003. The original tool has been completely re-designed in terms of database backend and components, adding support for submission to multiple backends, including the original WMS and the new Panda modules. The database engine has been changed from plain MySQL to Galera/Percona and the table structure has been optimized to allow a full High-Availability (HA) solution over WAN. The servlets, running on each frontend, have been also decoupled from local settings, to allow an easy scalability of the system, including the possibility of an HA system with multiple sites. The clients can also be run in multiple copies and in different geographical locations, and take care of sending the installation and validation jobs to the target Grid or Cloud sites. Moreover, the Installation DB is used as source of parameters by the automatic agents running in CVMFS, in order to install the software and distribute it to the sites. The system is in production for ATLAS since 2013, having as main sites in HA the INFN Roma T2 and CERN AI. The LJSFi2 engine is directly interfacing with Panda for the Job Management, AGIS for the site parameter configurations, and CVMFS for both core components and the installation of the software itself. LJSFi2 is also able to use other plugins, and is essentially VO-agnostic, so can be directly used and extended to cope with the requirements of any Grid or Cloud enabled VO. In this work we'll present the architecture, performance, status and possible evolutions to the system for the LHC Run2 and beyond.ATL-SOFT-SLIDE-2015-057oai:cds.cern.ch:20009902015-03-11
spellingShingle Particle Physics - Experiment
De Salvo, Alessandro
Maeno Kataoka, Mayuko
Smirnov, Yuri
Sanchez, Arturo
The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda
title The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda
title_full The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda
title_fullStr The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda
title_full_unstemmed The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda
title_short The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda
title_sort atlas software installation system v2: a highly available system to install and validate grid and cloud sites via panda
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2000990
work_keys_str_mv AT desalvoalessandro theatlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda
AT maenokataokamayuko theatlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda
AT smirnovyuri theatlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda
AT sanchezarturo theatlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda
AT desalvoalessandro atlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda
AT maenokataokamayuko atlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda
AT smirnovyuri atlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda
AT sanchezarturo atlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda