Cargando…

EOS developments

CERN has been developing and operating EOS as a disk storage solution successfully for over 6 years. The CERN deployment provides 135 PB and stores 1.2 billion replicas distributed over two computer centres. Deployment includes four LHC instances, a shared instance for smaller experiments and since...

Descripción completa

Detalles Bibliográficos
Autores principales: Sindrilaru, Elvin A, Peters, Andreas J, Adde, Geoffray M, Duellmann, Dirk
Lenguaje:eng
Publicado: 2017
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/898/6/062032
http://cds.cern.ch/record/2297057
_version_ 1780956903878164480
author Sindrilaru, Elvin A
Peters, Andreas J
Adde, Geoffray M
Duellmann, Dirk
author_facet Sindrilaru, Elvin A
Peters, Andreas J
Adde, Geoffray M
Duellmann, Dirk
author_sort Sindrilaru, Elvin A
collection CERN
description CERN has been developing and operating EOS as a disk storage solution successfully for over 6 years. The CERN deployment provides 135 PB and stores 1.2 billion replicas distributed over two computer centres. Deployment includes four LHC instances, a shared instance for smaller experiments and since last year an instance for individual user data as well. The user instance represents the backbone of the CERNBOX service for file sharing. New use cases like synchronisation and sharing, the planned migration to reduce AFS usage at CERN and the continuous growth has brought EOS to new challenges. Recent developments include the integration and evaluation of various technologies to do the transition from a single active in-memory namespace to a scale-out implementation distributed over many meta-data servers. The new architecture aims to separate the data from the application logic and user interface code, thus providing flexibility and scalability to the namespace component. Another important goal is to provide EOS as a CERN-wide mounted filesystem with strong authentication making it a single storage repository accessible via various services and front- ends (/eos initiative). This required new developments in the security infrastructure of the EOS FUSE implementation. Furthermore, there were a series of improvements targeting the end-user experience like tighter consistency and latency optimisations. In collaboration with Seagate as Openlab partner, EOS has a complete integration of OpenKinetic object drive cluster as a high-throughput, high-availability, low-cost storage solution. This contribution will discuss these three main development projects and present new performance metrics.
id oai-inspirehep.net-1638521
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2017
record_format invenio
spelling oai-inspirehep.net-16385212021-02-09T10:05:52Zdoi:10.1088/1742-6596/898/6/062032http://cds.cern.ch/record/2297057engSindrilaru, Elvin APeters, Andreas JAdde, Geoffray MDuellmann, DirkEOS developmentsComputing and ComputersCERN has been developing and operating EOS as a disk storage solution successfully for over 6 years. The CERN deployment provides 135 PB and stores 1.2 billion replicas distributed over two computer centres. Deployment includes four LHC instances, a shared instance for smaller experiments and since last year an instance for individual user data as well. The user instance represents the backbone of the CERNBOX service for file sharing. New use cases like synchronisation and sharing, the planned migration to reduce AFS usage at CERN and the continuous growth has brought EOS to new challenges. Recent developments include the integration and evaluation of various technologies to do the transition from a single active in-memory namespace to a scale-out implementation distributed over many meta-data servers. The new architecture aims to separate the data from the application logic and user interface code, thus providing flexibility and scalability to the namespace component. Another important goal is to provide EOS as a CERN-wide mounted filesystem with strong authentication making it a single storage repository accessible via various services and front- ends (/eos initiative). This required new developments in the security infrastructure of the EOS FUSE implementation. Furthermore, there were a series of improvements targeting the end-user experience like tighter consistency and latency optimisations. In collaboration with Seagate as Openlab partner, EOS has a complete integration of OpenKinetic object drive cluster as a high-throughput, high-availability, low-cost storage solution. This contribution will discuss these three main development projects and present new performance metrics.oai:inspirehep.net:16385212017
spellingShingle Computing and Computers
Sindrilaru, Elvin A
Peters, Andreas J
Adde, Geoffray M
Duellmann, Dirk
EOS developments
title EOS developments
title_full EOS developments
title_fullStr EOS developments
title_full_unstemmed EOS developments
title_short EOS developments
title_sort eos developments
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/898/6/062032
http://cds.cern.ch/record/2297057
work_keys_str_mv AT sindrilaruelvina eosdevelopments
AT petersandreasj eosdevelopments
AT addegeoffraym eosdevelopments
AT duellmanndirk eosdevelopments