Cargando…

Employing peer-to-peer software distribution in ALICE Grid Services to enable opportunistic use of OSG resources

<!--HTML-->The ALICE Grid infrastructure is based on AliEn, a lightweight open source framework built on Web Services and a Distributed Agent Model in which job agents are submitted onto a grid site to prepare the environment and pull work from a central task queue located at CERN. In the sta...

Descripción completa

Detalles Bibliográficos
Autores principales: Porter, Jeff, Sakrejda, Iwona
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:http://cds.cern.ch/record/1460684
_version_ 1780925254898548736
author Porter, Jeff
Sakrejda, Iwona
author_facet Porter, Jeff
Sakrejda, Iwona
author_sort Porter, Jeff
collection CERN
description <!--HTML-->The ALICE Grid infrastructure is based on AliEn, a lightweight open source framework built on Web Services and a Distributed Agent Model in which job agents are submitted onto a grid site to prepare the environment and pull work from a central task queue located at CERN. In the standard configuration, each ALICE grid site supports an ALICE-specific VO box as a single point of contact between the site and the ALICE central services. VO box processes monitor site utilization and job requests (ClusterMonitor), monitor dynamic job and site properties (MonaLisa), perform job agent submission (CE) and deploy job-specific software (PackMan). In particular, requiring a VO box at each site simplifies deployment of job software, done onto a shared file system at the site, and adds redundancy to the overall Grid system. ALICE offline computing, however, has also implemented a peer-to-peer method (based on BitTorrent) for downloading job software directly onto each worker node as needed. By utilizing both this peer-to-peer deployment model and job agent submission onto remote Open Science Grid (OSG) Compute Elements, we are able relax the site VO box requirement and run jobs opportunistically on independent OSG resources from a single VO box. In this paper, we will describe the implementation of the peer-to-peer method and the full configuration of the setup. We will cover the deployment of this configuration at NERSC utilizing a VO box at PDSF and an OSG gatekeeper on the NERSC Carver system from which we can directly compare the performance to that of a standard ALICE Grid installation. We will also describe our experience with wider deployments.
id cern-1460684
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14606842022-11-02T22:23:34Zhttp://cds.cern.ch/record/1460684engPorter, JeffSakrejda, IwonaEmploying peer-to-peer software distribution in ALICE Grid Services to enable opportunistic use of OSG resourcesComputing in High Energy and Nuclear Physics (CHEP) 2012Conferences<!--HTML-->The ALICE Grid infrastructure is based on AliEn, a lightweight open source framework built on Web Services and a Distributed Agent Model in which job agents are submitted onto a grid site to prepare the environment and pull work from a central task queue located at CERN. In the standard configuration, each ALICE grid site supports an ALICE-specific VO box as a single point of contact between the site and the ALICE central services. VO box processes monitor site utilization and job requests (ClusterMonitor), monitor dynamic job and site properties (MonaLisa), perform job agent submission (CE) and deploy job-specific software (PackMan). In particular, requiring a VO box at each site simplifies deployment of job software, done onto a shared file system at the site, and adds redundancy to the overall Grid system. ALICE offline computing, however, has also implemented a peer-to-peer method (based on BitTorrent) for downloading job software directly onto each worker node as needed. By utilizing both this peer-to-peer deployment model and job agent submission onto remote Open Science Grid (OSG) Compute Elements, we are able relax the site VO box requirement and run jobs opportunistically on independent OSG resources from a single VO box. In this paper, we will describe the implementation of the peer-to-peer method and the full configuration of the setup. We will cover the deployment of this configuration at NERSC utilizing a VO box at PDSF and an OSG gatekeeper on the NERSC Carver system from which we can directly compare the performance to that of a standard ALICE Grid installation. We will also describe our experience with wider deployments.oai:cds.cern.ch:14606842012
spellingShingle Conferences
Porter, Jeff
Sakrejda, Iwona
Employing peer-to-peer software distribution in ALICE Grid Services to enable opportunistic use of OSG resources
title Employing peer-to-peer software distribution in ALICE Grid Services to enable opportunistic use of OSG resources
title_full Employing peer-to-peer software distribution in ALICE Grid Services to enable opportunistic use of OSG resources
title_fullStr Employing peer-to-peer software distribution in ALICE Grid Services to enable opportunistic use of OSG resources
title_full_unstemmed Employing peer-to-peer software distribution in ALICE Grid Services to enable opportunistic use of OSG resources
title_short Employing peer-to-peer software distribution in ALICE Grid Services to enable opportunistic use of OSG resources
title_sort employing peer-to-peer software distribution in alice grid services to enable opportunistic use of osg resources
topic Conferences
url http://cds.cern.ch/record/1460684
work_keys_str_mv AT porterjeff employingpeertopeersoftwaredistributioninalicegridservicestoenableopportunisticuseofosgresources
AT sakrejdaiwona employingpeertopeersoftwaredistributioninalicegridservicestoenableopportunisticuseofosgresources
AT porterjeff computinginhighenergyandnuclearphysicschep2012
AT sakrejdaiwona computinginhighenergyandnuclearphysicschep2012