Cargando…
EOS developments
CERN has been developing and operating EOS as a disk storage solution successfully for over 6 years. The CERN deployment provides 135 PB and stores 1.2 billion replicas distributed over two computer centres. Deployment includes four LHC instances, a shared instance for smaller experiments and since...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2017
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/898/6/062032 http://cds.cern.ch/record/2297057 |
_version_ | 1780956903878164480 |
---|---|
author | Sindrilaru, Elvin A Peters, Andreas J Adde, Geoffray M Duellmann, Dirk |
author_facet | Sindrilaru, Elvin A Peters, Andreas J Adde, Geoffray M Duellmann, Dirk |
author_sort | Sindrilaru, Elvin A |
collection | CERN |
description | CERN has been developing and operating EOS as a disk storage solution successfully for over 6 years. The CERN deployment provides 135 PB and stores 1.2 billion replicas distributed over two computer centres. Deployment includes four LHC instances, a shared instance for smaller experiments and since last year an instance for individual user data as well. The user instance represents the backbone of the CERNBOX service for file sharing. New use cases like synchronisation and sharing, the planned migration to reduce AFS usage at CERN and the continuous growth has brought EOS to new challenges. Recent developments include the integration and evaluation of various technologies to do the transition from a single active in-memory namespace to a scale-out implementation distributed over many meta-data servers. The new architecture aims to separate the data from the application logic and user interface code, thus providing flexibility and scalability to the namespace component. Another important goal is to provide EOS as a CERN-wide mounted filesystem with strong authentication making it a single storage repository accessible via various services and front- ends (/eos initiative). This required new developments in the security infrastructure of the EOS FUSE implementation. Furthermore, there were a series of improvements targeting the end-user experience like tighter consistency and latency optimisations. In collaboration with Seagate as Openlab partner, EOS has a complete integration of OpenKinetic object drive cluster as a high-throughput, high-availability, low-cost storage solution. This contribution will discuss these three main development projects and present new performance metrics. |
id | oai-inspirehep.net-1638521 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2017 |
record_format | invenio |
spelling | oai-inspirehep.net-16385212021-02-09T10:05:52Zdoi:10.1088/1742-6596/898/6/062032http://cds.cern.ch/record/2297057engSindrilaru, Elvin APeters, Andreas JAdde, Geoffray MDuellmann, DirkEOS developmentsComputing and ComputersCERN has been developing and operating EOS as a disk storage solution successfully for over 6 years. The CERN deployment provides 135 PB and stores 1.2 billion replicas distributed over two computer centres. Deployment includes four LHC instances, a shared instance for smaller experiments and since last year an instance for individual user data as well. The user instance represents the backbone of the CERNBOX service for file sharing. New use cases like synchronisation and sharing, the planned migration to reduce AFS usage at CERN and the continuous growth has brought EOS to new challenges. Recent developments include the integration and evaluation of various technologies to do the transition from a single active in-memory namespace to a scale-out implementation distributed over many meta-data servers. The new architecture aims to separate the data from the application logic and user interface code, thus providing flexibility and scalability to the namespace component. Another important goal is to provide EOS as a CERN-wide mounted filesystem with strong authentication making it a single storage repository accessible via various services and front- ends (/eos initiative). This required new developments in the security infrastructure of the EOS FUSE implementation. Furthermore, there were a series of improvements targeting the end-user experience like tighter consistency and latency optimisations. In collaboration with Seagate as Openlab partner, EOS has a complete integration of OpenKinetic object drive cluster as a high-throughput, high-availability, low-cost storage solution. This contribution will discuss these three main development projects and present new performance metrics.oai:inspirehep.net:16385212017 |
spellingShingle | Computing and Computers Sindrilaru, Elvin A Peters, Andreas J Adde, Geoffray M Duellmann, Dirk EOS developments |
title | EOS developments |
title_full | EOS developments |
title_fullStr | EOS developments |
title_full_unstemmed | EOS developments |
title_short | EOS developments |
title_sort | eos developments |
topic | Computing and Computers |
url | https://dx.doi.org/10.1088/1742-6596/898/6/062032 http://cds.cern.ch/record/2297057 |
work_keys_str_mv | AT sindrilaruelvina eosdevelopments AT petersandreasj eosdevelopments AT addegeoffraym eosdevelopments AT duellmanndirk eosdevelopments |