Cargando…

Overview of storage operations at CERN

<!--HTML-->Large-volume physics data storage at CERN is based on two services, CASTOR and EOS: * CASTOR - in production for many years - now handles the Tier0 activities (including WAN data distribution), as well as all tape-backed data; * EOS - in production since 2011 - supports the fast-gro...

Descripción completa

Detalles Bibliográficos
Autores principales: Iven, Jan, Lamanna, Massimo
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:http://cds.cern.ch/record/1460580
_version_ 1780925240850776064
author Iven, Jan
Lamanna, Massimo
author_facet Iven, Jan
Lamanna, Massimo
author_sort Iven, Jan
collection CERN
description <!--HTML-->Large-volume physics data storage at CERN is based on two services, CASTOR and EOS: * CASTOR - in production for many years - now handles the Tier0 activities (including WAN data distribution), as well as all tape-backed data; * EOS - in production since 2011 - supports the fast-growing need for high-performance low-latency (i.e. diskonly) data access for user analysis. In 2011, a large part of the original CASTOR storage has been migrated into EOS, which grew from the original testbed installation (1 PB usable capacity for ATLAS) to over 6 PB for ATLAS and CMS. EOS has has been validated for several month under production conditions and has already replaced several CASTOR service classes. CASTOR also evolved during this time with major improvements in critical areas - notably the internal scheduling of requests, the simplifications of the database structure and a complete overhaul of the tape subsystem. The talk will compare the two systems from an operation's perspective (setup, day-by-day user support, upgrades, resilience to common failures) while taking into account their different scope. In the case of CASTOR we will analyse the impact of the 2011 improvements on delivering Tier0 services, while for EOS we will focus on the steps to achieve to a production-quality service. For both systems, the upcoming changes will be discussed in relation with the evolution of the LHC programme and computing models (data volumes, access patterns, relations among computing sites).
id cern-1460580
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14605802022-11-02T22:23:45Zhttp://cds.cern.ch/record/1460580engIven, JanLamanna, MassimoOverview of storage operations at CERNComputing in High Energy and Nuclear Physics (CHEP) 2012Conferences<!--HTML-->Large-volume physics data storage at CERN is based on two services, CASTOR and EOS: * CASTOR - in production for many years - now handles the Tier0 activities (including WAN data distribution), as well as all tape-backed data; * EOS - in production since 2011 - supports the fast-growing need for high-performance low-latency (i.e. diskonly) data access for user analysis. In 2011, a large part of the original CASTOR storage has been migrated into EOS, which grew from the original testbed installation (1 PB usable capacity for ATLAS) to over 6 PB for ATLAS and CMS. EOS has has been validated for several month under production conditions and has already replaced several CASTOR service classes. CASTOR also evolved during this time with major improvements in critical areas - notably the internal scheduling of requests, the simplifications of the database structure and a complete overhaul of the tape subsystem. The talk will compare the two systems from an operation's perspective (setup, day-by-day user support, upgrades, resilience to common failures) while taking into account their different scope. In the case of CASTOR we will analyse the impact of the 2011 improvements on delivering Tier0 services, while for EOS we will focus on the steps to achieve to a production-quality service. For both systems, the upcoming changes will be discussed in relation with the evolution of the LHC programme and computing models (data volumes, access patterns, relations among computing sites).oai:cds.cern.ch:14605802012
spellingShingle Conferences
Iven, Jan
Lamanna, Massimo
Overview of storage operations at CERN
title Overview of storage operations at CERN
title_full Overview of storage operations at CERN
title_fullStr Overview of storage operations at CERN
title_full_unstemmed Overview of storage operations at CERN
title_short Overview of storage operations at CERN
title_sort overview of storage operations at cern
topic Conferences
url http://cds.cern.ch/record/1460580
work_keys_str_mv AT ivenjan overviewofstorageoperationsatcern
AT lamannamassimo overviewofstorageoperationsatcern
AT ivenjan computinginhighenergyandnuclearphysicschep2012
AT lamannamassimo computinginhighenergyandnuclearphysicschep2012