Cargando…
Integration of XRootD into the cloud infrastructure for ALICE data analysis
Cloud technologies allow easy load balancing between different tasks and projects. From the viewpoint of the data analysis in the ALICE experiment, cloud allows to deploy software using Cern Virtual Machine (CernVM) and CernVM File System (CVMFS), to run different (including outdated) versions of so...
Autores principales: | , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2015
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/664/2/022036 http://cds.cern.ch/record/2134539 |
_version_ | 1780949900929794048 |
---|---|
author | Kompaniets, Mikhail Shadura, Oksana Svirin, Pavlo Yurchenko, Volodymyr Zarochentsev, Andrey |
author_facet | Kompaniets, Mikhail Shadura, Oksana Svirin, Pavlo Yurchenko, Volodymyr Zarochentsev, Andrey |
author_sort | Kompaniets, Mikhail |
collection | CERN |
description | Cloud technologies allow easy load balancing between different tasks and projects. From the viewpoint of the data analysis in the ALICE experiment, cloud allows to deploy software using Cern Virtual Machine (CernVM) and CernVM File System (CVMFS), to run different (including outdated) versions of software for long term data preservation and to dynamically allocate resources for different computing activities, e.g. grid site, ALICE Analysis Facility (AAF) and possible usage for local projects or other LHC experiments.We present a cloud solution for Tier-3 sites based on OpenStack and Ceph distributed storage with an integrated XRootD based storage element (SE). One of the key features of the solution is based on idea that Ceph has been used as a backend for Cinder Block Storage service for OpenStack, and in the same time as a storage backend for XRootD, with redundancy and availability of data preserved by Ceph settings. For faster and easier OpenStack deployment was applied the Packstack solution, which is based on the Puppet configuration management system. Ceph installation and configuration operations are structured and converted to Puppet manifests describing node configurations and integrated into Packstack. This solution can be easily deployed, maintained and used even in small groups with limited computing resources and small organizations, which usually have lack of IT support. The proposed infrastructure has been tested on two different clouds (SPbSU & BITP) and integrates successfully with the ALICE data analysis model. |
id | oai-inspirehep.net-1413798 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2015 |
record_format | invenio |
spelling | oai-inspirehep.net-14137982022-08-10T13:00:50Zdoi:10.1088/1742-6596/664/2/022036http://cds.cern.ch/record/2134539engKompaniets, MikhailShadura, OksanaSvirin, PavloYurchenko, VolodymyrZarochentsev, AndreyIntegration of XRootD into the cloud infrastructure for ALICE data analysisComputing and ComputersCloud technologies allow easy load balancing between different tasks and projects. From the viewpoint of the data analysis in the ALICE experiment, cloud allows to deploy software using Cern Virtual Machine (CernVM) and CernVM File System (CVMFS), to run different (including outdated) versions of software for long term data preservation and to dynamically allocate resources for different computing activities, e.g. grid site, ALICE Analysis Facility (AAF) and possible usage for local projects or other LHC experiments.We present a cloud solution for Tier-3 sites based on OpenStack and Ceph distributed storage with an integrated XRootD based storage element (SE). One of the key features of the solution is based on idea that Ceph has been used as a backend for Cinder Block Storage service for OpenStack, and in the same time as a storage backend for XRootD, with redundancy and availability of data preserved by Ceph settings. For faster and easier OpenStack deployment was applied the Packstack solution, which is based on the Puppet configuration management system. Ceph installation and configuration operations are structured and converted to Puppet manifests describing node configurations and integrated into Packstack. This solution can be easily deployed, maintained and used even in small groups with limited computing resources and small organizations, which usually have lack of IT support. The proposed infrastructure has been tested on two different clouds (SPbSU & BITP) and integrates successfully with the ALICE data analysis model.oai:inspirehep.net:14137982015 |
spellingShingle | Computing and Computers Kompaniets, Mikhail Shadura, Oksana Svirin, Pavlo Yurchenko, Volodymyr Zarochentsev, Andrey Integration of XRootD into the cloud infrastructure for ALICE data analysis |
title | Integration of XRootD into the cloud infrastructure for ALICE data analysis |
title_full | Integration of XRootD into the cloud infrastructure for ALICE data analysis |
title_fullStr | Integration of XRootD into the cloud infrastructure for ALICE data analysis |
title_full_unstemmed | Integration of XRootD into the cloud infrastructure for ALICE data analysis |
title_short | Integration of XRootD into the cloud infrastructure for ALICE data analysis |
title_sort | integration of xrootd into the cloud infrastructure for alice data analysis |
topic | Computing and Computers |
url | https://dx.doi.org/10.1088/1742-6596/664/2/022036 http://cds.cern.ch/record/2134539 |
work_keys_str_mv | AT kompanietsmikhail integrationofxrootdintothecloudinfrastructureforalicedataanalysis AT shaduraoksana integrationofxrootdintothecloudinfrastructureforalicedataanalysis AT svirinpavlo integrationofxrootdintothecloudinfrastructureforalicedataanalysis AT yurchenkovolodymyr integrationofxrootdintothecloudinfrastructureforalicedataanalysis AT zarochentsevandrey integrationofxrootdintothecloudinfrastructureforalicedataanalysis |