Cargando…

Offline processing in the online computer farm

LHCb is one of the 4 experiments at the LHC accelerator at CERN. LHCb has approximately 1500 PCs for processing the High Level Trigger (HLT) during physics data acquisition. During periods when data acquisition is not required or the resources needed for data acquisition are reduced most of these PC...

Descripción completa

Detalles Bibliográficos
Autores principales: Cardoso, LG, Gaspar, C, Callot, O, Closier, J, Neufeld, N, Frank, M, Jost, B, Charpentier, P, Liu, G
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/396/3/032052
http://cds.cern.ch/record/1565922
_version_ 1780930949309005824
author Cardoso, LG
Gaspar, C
Callot, O
Closier, J
Neufeld, N
Frank, M
Jost, B
Charpentier, P
Liu, G
author_facet Cardoso, LG
Gaspar, C
Callot, O
Closier, J
Neufeld, N
Frank, M
Jost, B
Charpentier, P
Liu, G
author_sort Cardoso, LG
collection CERN
description LHCb is one of the 4 experiments at the LHC accelerator at CERN. LHCb has approximately 1500 PCs for processing the High Level Trigger (HLT) during physics data acquisition. During periods when data acquisition is not required or the resources needed for data acquisition are reduced most of these PCs are idle or very little used. In these periods it is possible to profit from the unused processing capacity to reprocess earlier datasets with the newest applications (code and calibration constants), thus reducing the CPU capacity needed on the Grid. The offline computing environment is based on LHCbDIRAC (Distributed Infrastructure with Remote Agent Control) to process physics data on the Grid. In DIRAC, agents are started on Worker Nodes, pull available jobs from the DIRAC central WMS (Workload Management System) and process them on the available resources. A Control System was developed which is able to launch, control and monitor the agents for the offline data processing on the HLT Farm. It can do so without overwhelming the offline resources (e.g. DBs) and in case of change of the accelerator planning it can easily return the used resources for online purposes. This control system is based on the existing Online System Control infrastructure, the PVSS SCADA and the FSM toolkit.
id cern-1565922
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-15659222022-08-17T13:25:22Zdoi:10.1088/1742-6596/396/3/032052http://cds.cern.ch/record/1565922engCardoso, LGGaspar, CCallot, OClosier, JNeufeld, NFrank, MJost, BCharpentier, PLiu, GOffline processing in the online computer farmComputing and ComputersLHCb is one of the 4 experiments at the LHC accelerator at CERN. LHCb has approximately 1500 PCs for processing the High Level Trigger (HLT) during physics data acquisition. During periods when data acquisition is not required or the resources needed for data acquisition are reduced most of these PCs are idle or very little used. In these periods it is possible to profit from the unused processing capacity to reprocess earlier datasets with the newest applications (code and calibration constants), thus reducing the CPU capacity needed on the Grid. The offline computing environment is based on LHCbDIRAC (Distributed Infrastructure with Remote Agent Control) to process physics data on the Grid. In DIRAC, agents are started on Worker Nodes, pull available jobs from the DIRAC central WMS (Workload Management System) and process them on the available resources. A Control System was developed which is able to launch, control and monitor the agents for the offline data processing on the HLT Farm. It can do so without overwhelming the offline resources (e.g. DBs) and in case of change of the accelerator planning it can easily return the used resources for online purposes. This control system is based on the existing Online System Control infrastructure, the PVSS SCADA and the FSM toolkit.oai:cds.cern.ch:15659222012
spellingShingle Computing and Computers
Cardoso, LG
Gaspar, C
Callot, O
Closier, J
Neufeld, N
Frank, M
Jost, B
Charpentier, P
Liu, G
Offline processing in the online computer farm
title Offline processing in the online computer farm
title_full Offline processing in the online computer farm
title_fullStr Offline processing in the online computer farm
title_full_unstemmed Offline processing in the online computer farm
title_short Offline processing in the online computer farm
title_sort offline processing in the online computer farm
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/396/3/032052
http://cds.cern.ch/record/1565922
work_keys_str_mv AT cardosolg offlineprocessingintheonlinecomputerfarm
AT gasparc offlineprocessingintheonlinecomputerfarm
AT calloto offlineprocessingintheonlinecomputerfarm
AT closierj offlineprocessingintheonlinecomputerfarm
AT neufeldn offlineprocessingintheonlinecomputerfarm
AT frankm offlineprocessingintheonlinecomputerfarm
AT jostb offlineprocessingintheonlinecomputerfarm
AT charpentierp offlineprocessingintheonlinecomputerfarm
AT liug offlineprocessingintheonlinecomputerfarm