Cargando…

AliEn Resource Brokers

AliEn (ALICE Environment) is a lightweight GRID framework developed by the Alice Collaboration. When the experiment starts running, it will collect data at a rate of approximately 2 PB per year, producing O(109) files per year. All these files, including all simulated events generated during the pre...

Descripción completa

Detalles Bibliográficos
Autores principales: Saiz, Pablo, Buncic, Predrag, Peters, Andreas J.
Lenguaje:eng
Publicado: 2003
Materias:
Acceso en línea:http://cds.cern.ch/record/621983
_version_ 1780900416659128320
author Saiz, Pablo
Buncic, Predrag
Peters, Andreas J.
author_facet Saiz, Pablo
Buncic, Predrag
Peters, Andreas J.
author_sort Saiz, Pablo
collection CERN
description AliEn (ALICE Environment) is a lightweight GRID framework developed by the Alice Collaboration. When the experiment starts running, it will collect data at a rate of approximately 2 PB per year, producing O(109) files per year. All these files, including all simulated events generated during the preparation phase of the experiment, must be accounted and reliably tracked in the GRID environment. The backbone of AliEn is a distributed file catalogue, which associates universal logical file name to physical file names for each dataset and provides transparent access to datasets independently of physical location. The file replication and transport is carried out under the control of the File Transport Broker. In addition, the file catalogue maintains information about every job running in the system. The jobs are distributed by the Job Resource Broker that is implemented using a simplified pull (as opposed to traditional push) architecture. This paper describes the Job and File Transport Resource Brokers and shows that a similar architecture can be applied to solve both problems.
id cern-621983
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2003
record_format invenio
spelling cern-6219832023-03-15T19:11:02Zhttp://cds.cern.ch/record/621983engSaiz, PabloBuncic, PredragPeters, Andreas J.AliEn Resource BrokersComputing and ComputersAliEn (ALICE Environment) is a lightweight GRID framework developed by the Alice Collaboration. When the experiment starts running, it will collect data at a rate of approximately 2 PB per year, producing O(109) files per year. All these files, including all simulated events generated during the preparation phase of the experiment, must be accounted and reliably tracked in the GRID environment. The backbone of AliEn is a distributed file catalogue, which associates universal logical file name to physical file names for each dataset and provides transparent access to datasets independently of physical location. The file replication and transport is carried out under the control of the File Transport Broker. In addition, the file catalogue maintains information about every job running in the system. The jobs are distributed by the Job Resource Broker that is implemented using a simplified pull (as opposed to traditional push) architecture. This paper describes the Job and File Transport Resource Brokers and shows that a similar architecture can be applied to solve both problems.AliEn (ALICE Environment) is a lightweight GRID framework developed by the Alice Collaboration. When the experiment starts running, it will collect data at a rate of approximately 2 PB per year, producing O(109) files per year. All these files, including all simulated events generated during the preparation phase of the experiment, must be accounted and reliably tracked in the GRID environment. The backbone of AliEn is a distributed file catalogue, which associates universal logical file name to physical file names for each dataset and provides transparent access to datasets independently of physical location. The file replication and transport is carried out under the control of the File Transport Broker. In addition, the file catalogue maintains information about every job running in the system. The jobs are distributed by the Job Resource Broker that is implemented using a simplified pull (as opposed to traditional push) architecture. This paper describes the Job and File Transport Resource Brokers and shows that a similar architecture can be applied to solve both problems.CHEP-2003-TUAP002cs/0306068oai:cds.cern.ch:6219832003-06-13
spellingShingle Computing and Computers
Saiz, Pablo
Buncic, Predrag
Peters, Andreas J.
AliEn Resource Brokers
title AliEn Resource Brokers
title_full AliEn Resource Brokers
title_fullStr AliEn Resource Brokers
title_full_unstemmed AliEn Resource Brokers
title_short AliEn Resource Brokers
title_sort alien resource brokers
topic Computing and Computers
url http://cds.cern.ch/record/621983
work_keys_str_mv AT saizpablo alienresourcebrokers
AT buncicpredrag alienresourcebrokers
AT petersandreasj alienresourcebrokers