Cargando…

COMPASS Production System Overview

Migration of COMPASS data processing to Grid environment has started in 2015 from a small prototype, deployed on a single virtual machine. Since summer of 2017, the system works in production mode, distributing jobs to two traditional Grid sites: CERN and JINR. Now the infrastructure of COMPASS Grid...

Descripción completa

Detalles Bibliográficos
Autor principal: Petrosyan, Artem
Lenguaje:eng
Publicado: EDP Sciences 2019
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/201921403039
http://cds.cern.ch/record/2728529
_version_ 1780966432884916224
author Petrosyan, Artem
author_facet Petrosyan, Artem
author_sort Petrosyan, Artem
collection CERN
description Migration of COMPASS data processing to Grid environment has started in 2015 from a small prototype, deployed on a single virtual machine. Since summer of 2017, the system works in production mode, distributing jobs to two traditional Grid sites: CERN and JINR. Now the infrastructure of COMPASS Grid Production System includes 6 virtual machines, each is reserved for one production service: database, PanDA, Auto Pilot Factory, Monitoring, CRIC information system and, finally, production system (ProdSys) management instance, which provides a user interface for production manager and hosts services of automatic processing. Support of COMPASS virtual organization is provided by CERN IT. CRIC is also deployed at CERN Cloud Service. Other ProdSys services are deployed at JINR Cloud Service. There are two storage elements at CERN: EOS for short-term storage and Castor for long-term storage. During last year, along with providing a 24/7 service, the system was instrumented by many features, which allow automating data processing as much as possible. Recently, Blue Waters HPC has become a member of the computing infrastructure of the experiment. Details of implementation, workflow management, and infrastructure overview are presented in this article.
id oai-inspirehep.net-1760937
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
publisher EDP Sciences
record_format invenio
spelling oai-inspirehep.net-17609372020-08-22T20:37:55Zdoi:10.1051/epjconf/201921403039http://cds.cern.ch/record/2728529engPetrosyan, ArtemCOMPASS Production System OverviewComputing and ComputersMigration of COMPASS data processing to Grid environment has started in 2015 from a small prototype, deployed on a single virtual machine. Since summer of 2017, the system works in production mode, distributing jobs to two traditional Grid sites: CERN and JINR. Now the infrastructure of COMPASS Grid Production System includes 6 virtual machines, each is reserved for one production service: database, PanDA, Auto Pilot Factory, Monitoring, CRIC information system and, finally, production system (ProdSys) management instance, which provides a user interface for production manager and hosts services of automatic processing. Support of COMPASS virtual organization is provided by CERN IT. CRIC is also deployed at CERN Cloud Service. Other ProdSys services are deployed at JINR Cloud Service. There are two storage elements at CERN: EOS for short-term storage and Castor for long-term storage. During last year, along with providing a 24/7 service, the system was instrumented by many features, which allow automating data processing as much as possible. Recently, Blue Waters HPC has become a member of the computing infrastructure of the experiment. Details of implementation, workflow management, and infrastructure overview are presented in this article.EDP Sciencesoai:inspirehep.net:17609372019
spellingShingle Computing and Computers
Petrosyan, Artem
COMPASS Production System Overview
title COMPASS Production System Overview
title_full COMPASS Production System Overview
title_fullStr COMPASS Production System Overview
title_full_unstemmed COMPASS Production System Overview
title_short COMPASS Production System Overview
title_sort compass production system overview
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/201921403039
http://cds.cern.ch/record/2728529
work_keys_str_mv AT petrosyanartem compassproductionsystemoverview