Cargando…

Software installation and condition data distribution via CernVM FileSystem in ATLAS

The ATLAS Collaboration is managing one of the largest collections of software among the High Energy Physics Experiments. Traditionally this software has been distributed via rpm or pacman packages, and has been installed in every site and user's machine, using more space than needed since the...

Descripción completa

Detalles Bibliográficos
Autores principales: De Salvo, A, De Silva, A, Benjamin, D, Blomer, J, Buncic, P, Harutyunyan, H, Undrus, A, Yao, Y
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:http://cds.cern.ch/record/1448195
_version_ 1780924847218491392
author De Salvo, A
De Silva, A
Benjamin, D
Blomer, J
Buncic, P
Harutyunyan, H
Undrus, A
Yao, Y
author_facet De Salvo, A
De Silva, A
Benjamin, D
Blomer, J
Buncic, P
Harutyunyan, H
Undrus, A
Yao, Y
author_sort De Salvo, A
collection CERN
description The ATLAS Collaboration is managing one of the largest collections of software among the High Energy Physics Experiments. Traditionally this software has been distributed via rpm or pacman packages, and has been installed in every site and user's machine, using more space than needed since the releases could not always share common binaries. As soon as the software has grown in size and number of releases this approach showed its limits, in terms of manageability, used disk space and performance. The adopted solution is based on the CernVM FileSystem, a fuse-based http, read-only filesystem which guarantees file de-duplication, on-demand file transfer with caching, scalability and performance. Here we describe the ATLAS experience in setting up the CVMFS facility and putting it into production, for different type of use-cases, ranging from single users' machines up to large Data Centers, for both Software and Conditions Data. The performance of CernVM-FS, both with software and condition data access, will be shown, comparing with other filesystems currently in use by the Collaboration.
id cern-1448195
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14481952019-09-30T06:29:59Zhttp://cds.cern.ch/record/1448195engDe Salvo, ADe Silva, ABenjamin, DBlomer, JBuncic, PHarutyunyan, HUndrus, AYao, YSoftware installation and condition data distribution via CernVM FileSystem in ATLASDetectors and Experimental TechniquesThe ATLAS Collaboration is managing one of the largest collections of software among the High Energy Physics Experiments. Traditionally this software has been distributed via rpm or pacman packages, and has been installed in every site and user's machine, using more space than needed since the releases could not always share common binaries. As soon as the software has grown in size and number of releases this approach showed its limits, in terms of manageability, used disk space and performance. The adopted solution is based on the CernVM FileSystem, a fuse-based http, read-only filesystem which guarantees file de-duplication, on-demand file transfer with caching, scalability and performance. Here we describe the ATLAS experience in setting up the CVMFS facility and putting it into production, for different type of use-cases, ranging from single users' machines up to large Data Centers, for both Software and Conditions Data. The performance of CernVM-FS, both with software and condition data access, will be shown, comparing with other filesystems currently in use by the Collaboration.ATL-SOFT-SLIDE-2012-206oai:cds.cern.ch:14481952012-05-13
spellingShingle Detectors and Experimental Techniques
De Salvo, A
De Silva, A
Benjamin, D
Blomer, J
Buncic, P
Harutyunyan, H
Undrus, A
Yao, Y
Software installation and condition data distribution via CernVM FileSystem in ATLAS
title Software installation and condition data distribution via CernVM FileSystem in ATLAS
title_full Software installation and condition data distribution via CernVM FileSystem in ATLAS
title_fullStr Software installation and condition data distribution via CernVM FileSystem in ATLAS
title_full_unstemmed Software installation and condition data distribution via CernVM FileSystem in ATLAS
title_short Software installation and condition data distribution via CernVM FileSystem in ATLAS
title_sort software installation and condition data distribution via cernvm filesystem in atlas
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1448195
work_keys_str_mv AT desalvoa softwareinstallationandconditiondatadistributionviacernvmfilesysteminatlas
AT desilvaa softwareinstallationandconditiondatadistributionviacernvmfilesysteminatlas
AT benjamind softwareinstallationandconditiondatadistributionviacernvmfilesysteminatlas
AT blomerj softwareinstallationandconditiondatadistributionviacernvmfilesysteminatlas
AT buncicp softwareinstallationandconditiondatadistributionviacernvmfilesysteminatlas
AT harutyunyanh softwareinstallationandconditiondatadistributionviacernvmfilesysteminatlas
AT undrusa softwareinstallationandconditiondatadistributionviacernvmfilesysteminatlas
AT yaoy softwareinstallationandconditiondatadistributionviacernvmfilesysteminatlas