Cargando…
EOS as the present and future solution for data storage at CERN
EOS is an open source distributed disk storage system in production since 2011 at CERN. Development focus has been on low-latency analysis use cases for LHC(1) and non- LHC experiments and life-cycle management using JBOD(2) hardware for multi PB storage installations. The EOS design implies a split...
Autores principales: | , , |
---|---|
Lenguaje: | eng |
Publicado: |
2015
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/664/4/042042 http://cds.cern.ch/record/2134573 |
_version_ | 1780949907618660352 |
---|---|
author | Peters, AJ Sindrilaru, EA Adde, G |
author_facet | Peters, AJ Sindrilaru, EA Adde, G |
author_sort | Peters, AJ |
collection | CERN |
description | EOS is an open source distributed disk storage system in production since 2011 at CERN. Development focus has been on low-latency analysis use cases for LHC(1) and non- LHC experiments and life-cycle management using JBOD(2) hardware for multi PB storage installations. The EOS design implies a split of hot and cold storage and introduced a change of the traditional HSM(3) functionality based workflows at CERN.The 2015 deployment brings storage at CERN to a new scale and foresees to breach 100 PB of disk storage in a distributed environment using tens of thousands of (heterogeneous) hard drives. EOS has brought to CERN major improvements compared to past storage solutions by allowing quick changes in the quality of service of the storage pools. This allows the data centre to quickly meet the changing performance and reliability requirements of the LHC experiments with minimal data movements and dynamic reconfiguration. For example, the software stack has met the specific needs of the dual computing centre set-up required by CERN and allowed the fast design of new workflows accommodating the separation of long-term tape archive and disk storage required for the LHC Run II.This paper will give a high-level state of the art overview of EOS with respect to Run II, introduce new tools and use cases and set the roadmap for the next storage solutions to come. |
id | oai-inspirehep.net-1413872 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2015 |
record_format | invenio |
spelling | oai-inspirehep.net-14138722022-08-10T13:00:54Zdoi:10.1088/1742-6596/664/4/042042http://cds.cern.ch/record/2134573engPeters, AJSindrilaru, EAAdde, GEOS as the present and future solution for data storage at CERNComputing and ComputersEOS is an open source distributed disk storage system in production since 2011 at CERN. Development focus has been on low-latency analysis use cases for LHC(1) and non- LHC experiments and life-cycle management using JBOD(2) hardware for multi PB storage installations. The EOS design implies a split of hot and cold storage and introduced a change of the traditional HSM(3) functionality based workflows at CERN.The 2015 deployment brings storage at CERN to a new scale and foresees to breach 100 PB of disk storage in a distributed environment using tens of thousands of (heterogeneous) hard drives. EOS has brought to CERN major improvements compared to past storage solutions by allowing quick changes in the quality of service of the storage pools. This allows the data centre to quickly meet the changing performance and reliability requirements of the LHC experiments with minimal data movements and dynamic reconfiguration. For example, the software stack has met the specific needs of the dual computing centre set-up required by CERN and allowed the fast design of new workflows accommodating the separation of long-term tape archive and disk storage required for the LHC Run II.This paper will give a high-level state of the art overview of EOS with respect to Run II, introduce new tools and use cases and set the roadmap for the next storage solutions to come.oai:inspirehep.net:14138722015 |
spellingShingle | Computing and Computers Peters, AJ Sindrilaru, EA Adde, G EOS as the present and future solution for data storage at CERN |
title | EOS as the present and future solution for data storage at CERN |
title_full | EOS as the present and future solution for data storage at CERN |
title_fullStr | EOS as the present and future solution for data storage at CERN |
title_full_unstemmed | EOS as the present and future solution for data storage at CERN |
title_short | EOS as the present and future solution for data storage at CERN |
title_sort | eos as the present and future solution for data storage at cern |
topic | Computing and Computers |
url | https://dx.doi.org/10.1088/1742-6596/664/4/042042 http://cds.cern.ch/record/2134573 |
work_keys_str_mv | AT petersaj eosasthepresentandfuturesolutionfordatastorageatcern AT sindrilaruea eosasthepresentandfuturesolutionfordatastorageatcern AT addeg eosasthepresentandfuturesolutionfordatastorageatcern |