Cargando…
WHALE, a management tool for Tier-2 LCG sites
The LCG (Worldwide LHC Computing Grid) is a grid-based hierarchical computing distributed facility, composed of more than 140 computing centers, organized in 4 tiers, by size and offer of services. Every site, although indipendent for many technical choices, has to provide services with a well-defin...
Autores principales: | , , |
---|---|
Lenguaje: | eng |
Publicado: |
2012
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/396/4/042008 http://cds.cern.ch/record/1457649 |
_version_ | 1780925131316527104 |
---|---|
author | Barone, Luciano Organtini, Giovanni Talamo , Ivano Giuseppe |
author_facet | Barone, Luciano Organtini, Giovanni Talamo , Ivano Giuseppe |
author_sort | Barone, Luciano |
collection | CERN |
description | The LCG (Worldwide LHC Computing Grid) is a grid-based hierarchical computing
distributed facility, composed of more than 140 computing centers, organized in 4
tiers, by size and offer of services.
Every site, although indipendent for many technical choices, has to provide services with a well-defined set of interfaces.
For this reason, different LCG sites need frequently to manage very similar situations, like jobs behaviour on the batch system, dataset transfers between sites, operating system and experiment software installation and configuration, monitoring of services.
In this context we created WHALE (WHALE Handles Administration in an LCG Environment), a software actually used at the T2\_IT\_Rome site, an LCG Tier-2 for the CMS experiment.
WHALE is a generic, site indipendent tool written in python: it allows administrator to interact in a uniform and coherent way with several subsystems using a high level syntax which hides specific
commands.
The architecture of WHALE is based on the plugin concept and on the possibility of connecting the output of a plugin to the input of the next one, in a pipe-like system, giving the administrator the
possibility of making complex functions by combining the simpler ones.
The core of WHALE just handles the plugin orchestrations, while even the basic functions (eg. the WHALE activity logging) are performed by plugins, giving the capability to tune and possibly
modify every component of the system.
WHALE already provides many plugins useful for a LCG site and some more for a Tier-2 of the CMS experiment, expecially in the field of job management, dataset transfer and analysis of performance results and availability tests (eg. Nagios tests, SAM tests).
Thanks to its architecture and the provided plugins WHALE makes easy to perform tasks that, even if logically simple, are technically complex or tedious, like eg. closing all the worker nodes with a
job-failure rate greater than a given threshold.
Finally, thanks to the centralization of the activities on a single point and to its logging functionalities, WHALES acts as a knowledge-base of the site and a handful tool to keep track of the activities at a given site. For this reason it also provides a tailored plugin to perform advanced searches in the activity log. |
id | cern-1457649 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2012 |
record_format | invenio |
spelling | cern-14576492019-09-30T06:29:59Zdoi:10.1088/1742-6596/396/4/042008http://cds.cern.ch/record/1457649engBarone, LucianoOrgantini, GiovanniTalamo , Ivano GiuseppeWHALE, a management tool for Tier-2 LCG sitesDetectors and Experimental TechniquesThe LCG (Worldwide LHC Computing Grid) is a grid-based hierarchical computing distributed facility, composed of more than 140 computing centers, organized in 4 tiers, by size and offer of services. Every site, although indipendent for many technical choices, has to provide services with a well-defined set of interfaces. For this reason, different LCG sites need frequently to manage very similar situations, like jobs behaviour on the batch system, dataset transfers between sites, operating system and experiment software installation and configuration, monitoring of services. In this context we created WHALE (WHALE Handles Administration in an LCG Environment), a software actually used at the T2\_IT\_Rome site, an LCG Tier-2 for the CMS experiment. WHALE is a generic, site indipendent tool written in python: it allows administrator to interact in a uniform and coherent way with several subsystems using a high level syntax which hides specific commands. The architecture of WHALE is based on the plugin concept and on the possibility of connecting the output of a plugin to the input of the next one, in a pipe-like system, giving the administrator the possibility of making complex functions by combining the simpler ones. The core of WHALE just handles the plugin orchestrations, while even the basic functions (eg. the WHALE activity logging) are performed by plugins, giving the capability to tune and possibly modify every component of the system. WHALE already provides many plugins useful for a LCG site and some more for a Tier-2 of the CMS experiment, expecially in the field of job management, dataset transfer and analysis of performance results and availability tests (eg. Nagios tests, SAM tests). Thanks to its architecture and the provided plugins WHALE makes easy to perform tasks that, even if logically simple, are technically complex or tedious, like eg. closing all the worker nodes with a job-failure rate greater than a given threshold. Finally, thanks to the centralization of the activities on a single point and to its logging functionalities, WHALES acts as a knowledge-base of the site and a handful tool to keep track of the activities at a given site. For this reason it also provides a tailored plugin to perform advanced searches in the activity log.CMS-CR-2012-075oai:cds.cern.ch:14576492012-05-11 |
spellingShingle | Detectors and Experimental Techniques Barone, Luciano Organtini, Giovanni Talamo , Ivano Giuseppe WHALE, a management tool for Tier-2 LCG sites |
title | WHALE, a management tool for Tier-2 LCG sites |
title_full | WHALE, a management tool for Tier-2 LCG sites |
title_fullStr | WHALE, a management tool for Tier-2 LCG sites |
title_full_unstemmed | WHALE, a management tool for Tier-2 LCG sites |
title_short | WHALE, a management tool for Tier-2 LCG sites |
title_sort | whale, a management tool for tier-2 lcg sites |
topic | Detectors and Experimental Techniques |
url | https://dx.doi.org/10.1088/1742-6596/396/4/042008 http://cds.cern.ch/record/1457649 |
work_keys_str_mv | AT baroneluciano whaleamanagementtoolfortier2lcgsites AT organtinigiovanni whaleamanagementtoolfortier2lcgsites AT talamoivanogiuseppe whaleamanagementtoolfortier2lcgsites |