Cargando…

Integration of XRootD into the cloud infrastructure for ALICE data analysis

Cloud technologies allow easy load balancing between different tasks and projects. From the viewpoint of the data analysis in the ALICE experiment, cloud allows to deploy software using Cern Virtual Machine (CernVM) and CernVM File System (CVMFS), to run different (including outdated) versions of so...

Descripción completa

Detalles Bibliográficos
Autores principales: Kompaniets, Mikhail, Shadura, Oksana, Svirin, Pavlo, Yurchenko, Volodymyr, Zarochentsev, Andrey
Lenguaje:eng
Publicado: 2015
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/664/2/022036
http://cds.cern.ch/record/2134539
_version_ 1780949900929794048
author Kompaniets, Mikhail
Shadura, Oksana
Svirin, Pavlo
Yurchenko, Volodymyr
Zarochentsev, Andrey
author_facet Kompaniets, Mikhail
Shadura, Oksana
Svirin, Pavlo
Yurchenko, Volodymyr
Zarochentsev, Andrey
author_sort Kompaniets, Mikhail
collection CERN
description Cloud technologies allow easy load balancing between different tasks and projects. From the viewpoint of the data analysis in the ALICE experiment, cloud allows to deploy software using Cern Virtual Machine (CernVM) and CernVM File System (CVMFS), to run different (including outdated) versions of software for long term data preservation and to dynamically allocate resources for different computing activities, e.g. grid site, ALICE Analysis Facility (AAF) and possible usage for local projects or other LHC experiments.We present a cloud solution for Tier-3 sites based on OpenStack and Ceph distributed storage with an integrated XRootD based storage element (SE). One of the key features of the solution is based on idea that Ceph has been used as a backend for Cinder Block Storage service for OpenStack, and in the same time as a storage backend for XRootD, with redundancy and availability of data preserved by Ceph settings. For faster and easier OpenStack deployment was applied the Packstack solution, which is based on the Puppet configuration management system. Ceph installation and configuration operations are structured and converted to Puppet manifests describing node configurations and integrated into Packstack. This solution can be easily deployed, maintained and used even in small groups with limited computing resources and small organizations, which usually have lack of IT support. The proposed infrastructure has been tested on two different clouds (SPbSU & BITP) and integrates successfully with the ALICE data analysis model.
id oai-inspirehep.net-1413798
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2015
record_format invenio
spelling oai-inspirehep.net-14137982022-08-10T13:00:50Zdoi:10.1088/1742-6596/664/2/022036http://cds.cern.ch/record/2134539engKompaniets, MikhailShadura, OksanaSvirin, PavloYurchenko, VolodymyrZarochentsev, AndreyIntegration of XRootD into the cloud infrastructure for ALICE data analysisComputing and ComputersCloud technologies allow easy load balancing between different tasks and projects. From the viewpoint of the data analysis in the ALICE experiment, cloud allows to deploy software using Cern Virtual Machine (CernVM) and CernVM File System (CVMFS), to run different (including outdated) versions of software for long term data preservation and to dynamically allocate resources for different computing activities, e.g. grid site, ALICE Analysis Facility (AAF) and possible usage for local projects or other LHC experiments.We present a cloud solution for Tier-3 sites based on OpenStack and Ceph distributed storage with an integrated XRootD based storage element (SE). One of the key features of the solution is based on idea that Ceph has been used as a backend for Cinder Block Storage service for OpenStack, and in the same time as a storage backend for XRootD, with redundancy and availability of data preserved by Ceph settings. For faster and easier OpenStack deployment was applied the Packstack solution, which is based on the Puppet configuration management system. Ceph installation and configuration operations are structured and converted to Puppet manifests describing node configurations and integrated into Packstack. This solution can be easily deployed, maintained and used even in small groups with limited computing resources and small organizations, which usually have lack of IT support. The proposed infrastructure has been tested on two different clouds (SPbSU & BITP) and integrates successfully with the ALICE data analysis model.oai:inspirehep.net:14137982015
spellingShingle Computing and Computers
Kompaniets, Mikhail
Shadura, Oksana
Svirin, Pavlo
Yurchenko, Volodymyr
Zarochentsev, Andrey
Integration of XRootD into the cloud infrastructure for ALICE data analysis
title Integration of XRootD into the cloud infrastructure for ALICE data analysis
title_full Integration of XRootD into the cloud infrastructure for ALICE data analysis
title_fullStr Integration of XRootD into the cloud infrastructure for ALICE data analysis
title_full_unstemmed Integration of XRootD into the cloud infrastructure for ALICE data analysis
title_short Integration of XRootD into the cloud infrastructure for ALICE data analysis
title_sort integration of xrootd into the cloud infrastructure for alice data analysis
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/664/2/022036
http://cds.cern.ch/record/2134539
work_keys_str_mv AT kompanietsmikhail integrationofxrootdintothecloudinfrastructureforalicedataanalysis
AT shaduraoksana integrationofxrootdintothecloudinfrastructureforalicedataanalysis
AT svirinpavlo integrationofxrootdintothecloudinfrastructureforalicedataanalysis
AT yurchenkovolodymyr integrationofxrootdintothecloudinfrastructureforalicedataanalysis
AT zarochentsevandrey integrationofxrootdintothecloudinfrastructureforalicedataanalysis