Cargando…
Overview of storage operations at CERN
<!--HTML-->Large-volume physics data storage at CERN is based on two services, CASTOR and EOS: * CASTOR - in production for many years - now handles the Tier0 activities (including WAN data distribution), as well as all tape-backed data; * EOS - in production since 2011 - supports the fast-gro...
Autores principales: | , |
---|---|
Lenguaje: | eng |
Publicado: |
2012
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/1460580 |
_version_ | 1780925240850776064 |
---|---|
author | Iven, Jan Lamanna, Massimo |
author_facet | Iven, Jan Lamanna, Massimo |
author_sort | Iven, Jan |
collection | CERN |
description | <!--HTML-->Large-volume physics data storage at CERN is based on two services, CASTOR and EOS:
* CASTOR - in production for many years - now handles the Tier0 activities (including WAN data distribution), as well as all tape-backed data;
* EOS - in production since 2011 - supports the fast-growing need for high-performance low-latency (i.e. diskonly) data access for user analysis.
In 2011, a large part of the original CASTOR storage has been migrated into EOS, which grew from the original testbed installation (1 PB usable capacity for ATLAS) to over 6 PB for ATLAS and CMS. EOS has
has been validated for several month under production conditions and has already replaced several CASTOR service classes.
CASTOR also evolved during this time with major improvements in critical areas - notably the internal scheduling of requests, the simplifications of the database structure and a complete overhaul of
the tape subsystem.
The talk will compare the two systems from an operation's perspective (setup, day-by-day user support, upgrades, resilience to common
failures) while taking into account their different scope. In the case of CASTOR we will analyse the impact of the 2011 improvements on delivering Tier0 services, while for EOS we will focus on the steps to achieve to a production-quality service.
For both systems, the upcoming changes will be discussed in relation with the evolution of the LHC programme and computing models (data volumes, access patterns, relations among computing sites). |
id | cern-1460580 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2012 |
record_format | invenio |
spelling | cern-14605802022-11-02T22:23:45Zhttp://cds.cern.ch/record/1460580engIven, JanLamanna, MassimoOverview of storage operations at CERNComputing in High Energy and Nuclear Physics (CHEP) 2012Conferences<!--HTML-->Large-volume physics data storage at CERN is based on two services, CASTOR and EOS: * CASTOR - in production for many years - now handles the Tier0 activities (including WAN data distribution), as well as all tape-backed data; * EOS - in production since 2011 - supports the fast-growing need for high-performance low-latency (i.e. diskonly) data access for user analysis. In 2011, a large part of the original CASTOR storage has been migrated into EOS, which grew from the original testbed installation (1 PB usable capacity for ATLAS) to over 6 PB for ATLAS and CMS. EOS has has been validated for several month under production conditions and has already replaced several CASTOR service classes. CASTOR also evolved during this time with major improvements in critical areas - notably the internal scheduling of requests, the simplifications of the database structure and a complete overhaul of the tape subsystem. The talk will compare the two systems from an operation's perspective (setup, day-by-day user support, upgrades, resilience to common failures) while taking into account their different scope. In the case of CASTOR we will analyse the impact of the 2011 improvements on delivering Tier0 services, while for EOS we will focus on the steps to achieve to a production-quality service. For both systems, the upcoming changes will be discussed in relation with the evolution of the LHC programme and computing models (data volumes, access patterns, relations among computing sites).oai:cds.cern.ch:14605802012 |
spellingShingle | Conferences Iven, Jan Lamanna, Massimo Overview of storage operations at CERN |
title | Overview of storage operations at CERN |
title_full | Overview of storage operations at CERN |
title_fullStr | Overview of storage operations at CERN |
title_full_unstemmed | Overview of storage operations at CERN |
title_short | Overview of storage operations at CERN |
title_sort | overview of storage operations at cern |
topic | Conferences |
url | http://cds.cern.ch/record/1460580 |
work_keys_str_mv | AT ivenjan overviewofstorageoperationsatcern AT lamannamassimo overviewofstorageoperationsatcern AT ivenjan computinginhighenergyandnuclearphysicschep2012 AT lamannamassimo computinginhighenergyandnuclearphysicschep2012 |