Cargando…
The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda
The ATLAS Installation System v2 is the evolution of the original system, used since 2003. The original tool has been completely re-designed in terms of database backend and components, adding support for submission to multiple backends, including the original WMS and the new Panda modules. The data...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2015
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2000990 |
_version_ | 1780946014533844992 |
---|---|
author | De Salvo, Alessandro Maeno Kataoka, Mayuko Smirnov, Yuri Sanchez, Arturo |
author_facet | De Salvo, Alessandro Maeno Kataoka, Mayuko Smirnov, Yuri Sanchez, Arturo |
author_sort | De Salvo, Alessandro |
collection | CERN |
description | The ATLAS Installation System v2 is the evolution of the original system, used since 2003. The original tool has been completely re-designed in terms of database backend and components, adding support for submission to multiple backends, including the original WMS and the new Panda modules. The database engine has been changed from plain MySQL to Galera/Percona and the table structure has been optimized to allow a full High-Availability (HA) solution over WAN. The servlets, running on each frontend, have been also decoupled from local settings, to allow an easy scalability of the system, including the possibility of an HA system with multiple sites. The clients can also be run in multiple copies and in different geographical locations, and take care of sending the installation and validation jobs to the target Grid or Cloud sites. Moreover, the Installation DB is used as source of parameters by the automatic agents running in CVMFS, in order to install the software and distribute it to the sites. The system is in production for ATLAS since 2013, having as main sites in HA the INFN Roma T2 and CERN AI. The LJSFi2 engine is directly interfacing with Panda for the Job Management, AGIS for the site parameter configurations, and CVMFS for both core components and the installation of the software itself. LJSFi2 is also able to use other plugins, and is essentially VO-agnostic, so can be directly used and extended to cope with the requirements of any Grid or Cloud enabled VO. In this work we'll present the architecture, performance, status and possible evolutions to the system for the LHC Run2 and beyond. |
id | cern-2000990 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2015 |
record_format | invenio |
spelling | cern-20009902019-09-30T06:29:59Zhttp://cds.cern.ch/record/2000990engDe Salvo, AlessandroMaeno Kataoka, MayukoSmirnov, YuriSanchez, ArturoThe ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via PandaParticle Physics - ExperimentThe ATLAS Installation System v2 is the evolution of the original system, used since 2003. The original tool has been completely re-designed in terms of database backend and components, adding support for submission to multiple backends, including the original WMS and the new Panda modules. The database engine has been changed from plain MySQL to Galera/Percona and the table structure has been optimized to allow a full High-Availability (HA) solution over WAN. The servlets, running on each frontend, have been also decoupled from local settings, to allow an easy scalability of the system, including the possibility of an HA system with multiple sites. The clients can also be run in multiple copies and in different geographical locations, and take care of sending the installation and validation jobs to the target Grid or Cloud sites. Moreover, the Installation DB is used as source of parameters by the automatic agents running in CVMFS, in order to install the software and distribute it to the sites. The system is in production for ATLAS since 2013, having as main sites in HA the INFN Roma T2 and CERN AI. The LJSFi2 engine is directly interfacing with Panda for the Job Management, AGIS for the site parameter configurations, and CVMFS for both core components and the installation of the software itself. LJSFi2 is also able to use other plugins, and is essentially VO-agnostic, so can be directly used and extended to cope with the requirements of any Grid or Cloud enabled VO. In this work we'll present the architecture, performance, status and possible evolutions to the system for the LHC Run2 and beyond.ATL-SOFT-SLIDE-2015-057oai:cds.cern.ch:20009902015-03-11 |
spellingShingle | Particle Physics - Experiment De Salvo, Alessandro Maeno Kataoka, Mayuko Smirnov, Yuri Sanchez, Arturo The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda |
title | The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda |
title_full | The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda |
title_fullStr | The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda |
title_full_unstemmed | The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda |
title_short | The ATLAS Software Installation System v2: a highly available system to install and validate Grid and Cloud sites via Panda |
title_sort | atlas software installation system v2: a highly available system to install and validate grid and cloud sites via panda |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2000990 |
work_keys_str_mv | AT desalvoalessandro theatlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda AT maenokataokamayuko theatlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda AT smirnovyuri theatlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda AT sanchezarturo theatlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda AT desalvoalessandro atlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda AT maenokataokamayuko atlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda AT smirnovyuri atlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda AT sanchezarturo atlassoftwareinstallationsystemv2ahighlyavailablesystemtoinstallandvalidategridandcloudsitesviapanda |