Cargando…

DIRAC: a community grid solution

The DIRAC system was developed in order to provide a complete solution for using the distributed computing resources of the LHCb experiment at CERN for data production and analysis. It allows a concurrent use of over 10K CPUs and 10M file replicas distributed over many tens of sites. The sites can b...

Descripción completa

Detalles Bibliográficos
Autores principales: Tsaregorodtsev, A, Bargiotti, M, Brook, N, Ramo, A C, Castellani, G, Charpentier, P, Cioffi, C, Closier, J, Díaz, R G, Kuznetsov, G, Li, Y Y, Nandakumar, R, Paterson, S, Santinelli, R, Smith, A C, Miguelez, M S, Jimenez, S G
Lenguaje:eng
Publicado: 2008
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/119/6/062048
http://cds.cern.ch/record/1176117
_version_ 1780916243774046208
author Tsaregorodtsev, A
Bargiotti, M
Brook, N
Ramo, A C
Castellani, G
Charpentier, P
Cioffi, C
Closier, J
Díaz, R G
Kuznetsov, G
Li, Y Y
Nandakumar, R
Paterson, S
Santinelli, R
Smith, A C
Miguelez, M S
Jimenez, S G
author_facet Tsaregorodtsev, A
Bargiotti, M
Brook, N
Ramo, A C
Castellani, G
Charpentier, P
Cioffi, C
Closier, J
Díaz, R G
Kuznetsov, G
Li, Y Y
Nandakumar, R
Paterson, S
Santinelli, R
Smith, A C
Miguelez, M S
Jimenez, S G
author_sort Tsaregorodtsev, A
collection CERN
description The DIRAC system was developed in order to provide a complete solution for using the distributed computing resources of the LHCb experiment at CERN for data production and analysis. It allows a concurrent use of over 10K CPUs and 10M file replicas distributed over many tens of sites. The sites can be part of a Computing Grid such as WLCG or standalone computing clusters all integrated in a single management structure. DIRAC is a generic system with the LHCb specific functionality incorporated through a number of plug-in modules. It can be easily adapted to the needs of other communities. Special attention is paid to the resilience of the DIRAC components to allow an efficient use of non-reliable resources. The DIRAC production management components provide a framework for building highly automated data production systems including data distribution and data driven workload scheduling. In this paper we give an overview of the DIRAC system architecture and design choices. We show how different components are put together to compose an integrated data processing system including all the aspects of the LHCb experiment - from the MC production and raw data reconstruction to the final user analysis.
id cern-1176117
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2008
record_format invenio
spelling cern-11761172022-08-17T13:34:52Zdoi:10.1088/1742-6596/119/6/062048http://cds.cern.ch/record/1176117engTsaregorodtsev, ABargiotti, MBrook, NRamo, A CCastellani, GCharpentier, PCioffi, CClosier, JDíaz, R GKuznetsov, GLi, Y YNandakumar, RPaterson, SSantinelli, RSmith, A CMiguelez, M SJimenez, S GDIRAC: a community grid solutionComputing and ComputersThe DIRAC system was developed in order to provide a complete solution for using the distributed computing resources of the LHCb experiment at CERN for data production and analysis. It allows a concurrent use of over 10K CPUs and 10M file replicas distributed over many tens of sites. The sites can be part of a Computing Grid such as WLCG or standalone computing clusters all integrated in a single management structure. DIRAC is a generic system with the LHCb specific functionality incorporated through a number of plug-in modules. It can be easily adapted to the needs of other communities. Special attention is paid to the resilience of the DIRAC components to allow an efficient use of non-reliable resources. The DIRAC production management components provide a framework for building highly automated data production systems including data distribution and data driven workload scheduling. In this paper we give an overview of the DIRAC system architecture and design choices. We show how different components are put together to compose an integrated data processing system including all the aspects of the LHCb experiment - from the MC production and raw data reconstruction to the final user analysis.oai:cds.cern.ch:11761172008
spellingShingle Computing and Computers
Tsaregorodtsev, A
Bargiotti, M
Brook, N
Ramo, A C
Castellani, G
Charpentier, P
Cioffi, C
Closier, J
Díaz, R G
Kuznetsov, G
Li, Y Y
Nandakumar, R
Paterson, S
Santinelli, R
Smith, A C
Miguelez, M S
Jimenez, S G
DIRAC: a community grid solution
title DIRAC: a community grid solution
title_full DIRAC: a community grid solution
title_fullStr DIRAC: a community grid solution
title_full_unstemmed DIRAC: a community grid solution
title_short DIRAC: a community grid solution
title_sort dirac: a community grid solution
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/119/6/062048
http://cds.cern.ch/record/1176117
work_keys_str_mv AT tsaregorodtseva diracacommunitygridsolution
AT bargiottim diracacommunitygridsolution
AT brookn diracacommunitygridsolution
AT ramoac diracacommunitygridsolution
AT castellanig diracacommunitygridsolution
AT charpentierp diracacommunitygridsolution
AT cioffic diracacommunitygridsolution
AT closierj diracacommunitygridsolution
AT diazrg diracacommunitygridsolution
AT kuznetsovg diracacommunitygridsolution
AT liyy diracacommunitygridsolution
AT nandakumarr diracacommunitygridsolution
AT patersons diracacommunitygridsolution
AT santinellir diracacommunitygridsolution
AT smithac diracacommunitygridsolution
AT miguelezms diracacommunitygridsolution
AT jimenezsg diracacommunitygridsolution