Cargando…

DIRAC - Distributed Infrastructure with Remote Agent Control

This paper describes DIRAC, the LHCb Monte Carlo production system. DIRAC has a client/server architecture based on: Compute elements distributed among the collaborating institutes; Databases for production management, bookkeeping (the metadata catalogue) and software configuration; Monitoring and c...

Descripción completa

Detalles Bibliográficos
Autores principales: Tsaregorodtsev, A., Garonne, V., Closier, J., Frank, M., Gaspar, C., van Herwijnen, E., Loverre, F., Ponce, S., Graciani Diaz, R., Galli, D., Marconi, U., Vagnoni, V., Brook, N., Buckley, A., Harrison, K., Schmelling, M., Egede, U., Bogdanchikov, A., Korolko, I., Washbrook, A., Palacios, J.P., Klous, S., Saborido, J.J., Khan, A., Pickford, A., Soroko, A., Romanovski, V., Patrick, G.N., Kuznetsov, G., Gandelman, M.
Lenguaje:eng
Publicado: 2003
Materias:
Acceso en línea:http://cds.cern.ch/record/621979
_version_ 1780900415983845376
author Tsaregorodtsev, A.
Garonne, V.
Closier, J.
Frank, M.
Gaspar, C.
van Herwijnen, E.
Loverre, F.
Ponce, S.
Graciani Diaz, R.
Galli, D.
Marconi, U.
Vagnoni, V.
Brook, N.
Buckley, A.
Harrison, K.
Schmelling, M.
Egede, U.
Bogdanchikov, A.
Korolko, I.
Washbrook, A.
Palacios, J.P.
Klous, S.
Saborido, J.J.
Khan, A.
Pickford, A.
Soroko, A.
Romanovski, V.
Patrick, G.N.
Kuznetsov, G.
Gandelman, M.
author_facet Tsaregorodtsev, A.
Garonne, V.
Closier, J.
Frank, M.
Gaspar, C.
van Herwijnen, E.
Loverre, F.
Ponce, S.
Graciani Diaz, R.
Galli, D.
Marconi, U.
Vagnoni, V.
Brook, N.
Buckley, A.
Harrison, K.
Schmelling, M.
Egede, U.
Bogdanchikov, A.
Korolko, I.
Washbrook, A.
Palacios, J.P.
Klous, S.
Saborido, J.J.
Khan, A.
Pickford, A.
Soroko, A.
Romanovski, V.
Patrick, G.N.
Kuznetsov, G.
Gandelman, M.
author_sort Tsaregorodtsev, A.
collection CERN
description This paper describes DIRAC, the LHCb Monte Carlo production system. DIRAC has a client/server architecture based on: Compute elements distributed among the collaborating institutes; Databases for production management, bookkeeping (the metadata catalogue) and software configuration; Monitoring and cataloguing services for updating and accessing the databases. Locally installed software agents implemented in Python monitor the local batch queue, interrogate the production database for any outstanding production requests using the XML-RPC protocol and initiate the job submission. The agent checks and, if necessary, installs any required software automatically. After the job has processed the events, the agent transfers the output data and updates the metadata catalogue. DIRAC has been successfully installed at 18 collaborating institutes, including the DataGRID, and has been used in recent Physics Data Challenges. In the near to medium term future we must use a mixed environment with different types of grid middleware or no middleware. We describe how this flexibility has been achieved and how ubiquitously available grid middleware would improve DIRAC.
id cern-621979
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2003
record_format invenio
spelling cern-6219792023-03-15T19:11:02Zhttp://cds.cern.ch/record/621979engTsaregorodtsev, A.Garonne, V.Closier, J.Frank, M.Gaspar, C.van Herwijnen, E.Loverre, F.Ponce, S.Graciani Diaz, R.Galli, D.Marconi, U.Vagnoni, V.Brook, N.Buckley, A.Harrison, K.Schmelling, M.Egede, U.Bogdanchikov, A.Korolko, I.Washbrook, A.Palacios, J.P.Klous, S.Saborido, J.J.Khan, A.Pickford, A.Soroko, A.Romanovski, V.Patrick, G.N.Kuznetsov, G.Gandelman, M.DIRAC - Distributed Infrastructure with Remote Agent ControlComputing and ComputersThis paper describes DIRAC, the LHCb Monte Carlo production system. DIRAC has a client/server architecture based on: Compute elements distributed among the collaborating institutes; Databases for production management, bookkeeping (the metadata catalogue) and software configuration; Monitoring and cataloguing services for updating and accessing the databases. Locally installed software agents implemented in Python monitor the local batch queue, interrogate the production database for any outstanding production requests using the XML-RPC protocol and initiate the job submission. The agent checks and, if necessary, installs any required software automatically. After the job has processed the events, the agent transfers the output data and updates the metadata catalogue. DIRAC has been successfully installed at 18 collaborating institutes, including the DataGRID, and has been used in recent Physics Data Challenges. In the near to medium term future we must use a mixed environment with different types of grid middleware or no middleware. We describe how this flexibility has been achieved and how ubiquitously available grid middleware would improve DIRAC.This paper describes DIRAC, the LHCb Monte Carlo production system. DIRAC has a client/server architecture based on: Compute elements distributed among the collaborating institutes: Databases for production management, bookkeeping (the metadata catalogue) and software configuration: Monitoring and cataloguing services for updating and accessing the databases. Locally installed software agents implemented in Python monitor the local batch queue, interrogate the production database for any outstanding production requests using the XML-RPC protocol and initiate the job submission. The agent checks and, if necessary, installs any required software automatically. After the job has processed the events, the agent transfers the output data and updates the metadata catalogue. DIRAC has been successfully installed at 18 collaborating institutes, including the DataGRID, and has been used in recent Physics Data Challenges. In the near to medium term future we must use a mixed environment with different types of grid middleware or no middleware. We describe how this flexibility has been achieved and how ubiquitously available grid middleware would improve DIRAC.cs/0306060CHEP-2003-TUAT006oai:cds.cern.ch:6219792003-06-12
spellingShingle Computing and Computers
Tsaregorodtsev, A.
Garonne, V.
Closier, J.
Frank, M.
Gaspar, C.
van Herwijnen, E.
Loverre, F.
Ponce, S.
Graciani Diaz, R.
Galli, D.
Marconi, U.
Vagnoni, V.
Brook, N.
Buckley, A.
Harrison, K.
Schmelling, M.
Egede, U.
Bogdanchikov, A.
Korolko, I.
Washbrook, A.
Palacios, J.P.
Klous, S.
Saborido, J.J.
Khan, A.
Pickford, A.
Soroko, A.
Romanovski, V.
Patrick, G.N.
Kuznetsov, G.
Gandelman, M.
DIRAC - Distributed Infrastructure with Remote Agent Control
title DIRAC - Distributed Infrastructure with Remote Agent Control
title_full DIRAC - Distributed Infrastructure with Remote Agent Control
title_fullStr DIRAC - Distributed Infrastructure with Remote Agent Control
title_full_unstemmed DIRAC - Distributed Infrastructure with Remote Agent Control
title_short DIRAC - Distributed Infrastructure with Remote Agent Control
title_sort dirac - distributed infrastructure with remote agent control
topic Computing and Computers
url http://cds.cern.ch/record/621979
work_keys_str_mv AT tsaregorodtseva diracdistributedinfrastructurewithremoteagentcontrol
AT garonnev diracdistributedinfrastructurewithremoteagentcontrol
AT closierj diracdistributedinfrastructurewithremoteagentcontrol
AT frankm diracdistributedinfrastructurewithremoteagentcontrol
AT gasparc diracdistributedinfrastructurewithremoteagentcontrol
AT vanherwijnene diracdistributedinfrastructurewithremoteagentcontrol
AT loverref diracdistributedinfrastructurewithremoteagentcontrol
AT ponces diracdistributedinfrastructurewithremoteagentcontrol
AT gracianidiazr diracdistributedinfrastructurewithremoteagentcontrol
AT gallid diracdistributedinfrastructurewithremoteagentcontrol
AT marconiu diracdistributedinfrastructurewithremoteagentcontrol
AT vagnoniv diracdistributedinfrastructurewithremoteagentcontrol
AT brookn diracdistributedinfrastructurewithremoteagentcontrol
AT buckleya diracdistributedinfrastructurewithremoteagentcontrol
AT harrisonk diracdistributedinfrastructurewithremoteagentcontrol
AT schmellingm diracdistributedinfrastructurewithremoteagentcontrol
AT egedeu diracdistributedinfrastructurewithremoteagentcontrol
AT bogdanchikova diracdistributedinfrastructurewithremoteagentcontrol
AT korolkoi diracdistributedinfrastructurewithremoteagentcontrol
AT washbrooka diracdistributedinfrastructurewithremoteagentcontrol
AT palaciosjp diracdistributedinfrastructurewithremoteagentcontrol
AT klouss diracdistributedinfrastructurewithremoteagentcontrol
AT saboridojj diracdistributedinfrastructurewithremoteagentcontrol
AT khana diracdistributedinfrastructurewithremoteagentcontrol
AT pickforda diracdistributedinfrastructurewithremoteagentcontrol
AT sorokoa diracdistributedinfrastructurewithremoteagentcontrol
AT romanovskiv diracdistributedinfrastructurewithremoteagentcontrol
AT patrickgn diracdistributedinfrastructurewithremoteagentcontrol
AT kuznetsovg diracdistributedinfrastructurewithremoteagentcontrol
AT gandelmanm diracdistributedinfrastructurewithremoteagentcontrol