Cargando…

DIRAC optimized workload management

The LHCb DIRAC Workload and Data Management System employs advanced optimization techniques in order to dynamically allocate resources. The paradigms realized by DIRAC, such as late binding through the Pilot Agent approach, have proven to be highly successful. For example, this has allowed the princ...

Descripción completa

Detalles Bibliográficos
Autores principales: Paterson, S K, Tsaregorodtsev, A
Lenguaje:eng
Publicado: 2008
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/119/6/062040
http://cds.cern.ch/record/1177368
_version_ 1780916270637514752
author Paterson, S K
Tsaregorodtsev, A
author_facet Paterson, S K
Tsaregorodtsev, A
author_sort Paterson, S K
collection CERN
description The LHCb DIRAC Workload and Data Management System employs advanced optimization techniques in order to dynamically allocate resources. The paradigms realized by DIRAC, such as late binding through the Pilot Agent approach, have proven to be highly successful. For example, this has allowed the principles of workload management to be applied not only at the time of user job submission to the Grid but also to optimize the use of computing resources once jobs have been acquired. Along with the central application of job priorities, DIRAC minimizes the system response time for high priority tasks. This paper will describe the recent developments to support Monte Carlo simulation, data processing and distributed user analysis in a consistent way across disparate compute resources including individual PCs, local batch systems, and the Worldwide LHC Computing Grid. The Grid environment is inherently unpredictable and whilst short-term studies have proven to deliver high job efficiencies, the system performance over an extended period of time will be considered here in order to convey the experience gained so far.
id cern-1177368
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2008
record_format invenio
spelling cern-11773682022-08-17T13:37:19Zdoi:10.1088/1742-6596/119/6/062040http://cds.cern.ch/record/1177368engPaterson, S KTsaregorodtsev, ADIRAC optimized workload managementComputing and ComputersThe LHCb DIRAC Workload and Data Management System employs advanced optimization techniques in order to dynamically allocate resources. The paradigms realized by DIRAC, such as late binding through the Pilot Agent approach, have proven to be highly successful. For example, this has allowed the principles of workload management to be applied not only at the time of user job submission to the Grid but also to optimize the use of computing resources once jobs have been acquired. Along with the central application of job priorities, DIRAC minimizes the system response time for high priority tasks. This paper will describe the recent developments to support Monte Carlo simulation, data processing and distributed user analysis in a consistent way across disparate compute resources including individual PCs, local batch systems, and the Worldwide LHC Computing Grid. The Grid environment is inherently unpredictable and whilst short-term studies have proven to deliver high job efficiencies, the system performance over an extended period of time will be considered here in order to convey the experience gained so far.oai:cds.cern.ch:11773682008
spellingShingle Computing and Computers
Paterson, S K
Tsaregorodtsev, A
DIRAC optimized workload management
title DIRAC optimized workload management
title_full DIRAC optimized workload management
title_fullStr DIRAC optimized workload management
title_full_unstemmed DIRAC optimized workload management
title_short DIRAC optimized workload management
title_sort dirac optimized workload management
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/119/6/062040
http://cds.cern.ch/record/1177368
work_keys_str_mv AT patersonsk diracoptimizedworkloadmanagement
AT tsaregorodtseva diracoptimizedworkloadmanagement