Cargando…

EOS at the Joint Research Centre

<!--HTML-->The Joint Research Centre (JRC) of the European Commission has set up the Big Data Analytics Platform to enable the JRC projects to process and analyse big data, extracting knowledge and insights in support of EU policy making. Since 2016, EOS is the main storage component of the p...

Descripción completa

Detalles Bibliográficos
Autor principal: Scavazzon, Marco
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:http://cds.cern.ch/record/2754054
_version_ 1780969382578487296
author Scavazzon, Marco
author_facet Scavazzon, Marco
author_sort Scavazzon, Marco
collection CERN
description <!--HTML-->The Joint Research Centre (JRC) of the European Commission has set up the Big Data Analytics Platform to enable the JRC projects to process and analyse big data, extracting knowledge and insights in support of EU policy making. Since 2016, EOS is the main storage component of the platform. In 2020, the total gross capacity of this instance has reached 19 PiB. The Big Data Analytics Platform is actively used by more than 40 JRC projects, covering a wide range of data analysis activities. To support the growing needs for data storage and processing capacity, the platform has been extended over the last year. Eight new FSTs have been added, for a space increase of 3.5 PiB. In addition, to increase the security of the platform, the team started to migrate the EOS nodes in a segregated VLAN. The presentation will give an overview about the Big Data Analytics Platform and its EOS storage back-end, presenting the current status, experiences made and the issues identified.
id cern-2754054
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27540542022-11-02T22:19:18Zhttp://cds.cern.ch/record/2754054engScavazzon, MarcoEOS at the Joint Research CentreEOS workshopHEP Computing<!--HTML-->The Joint Research Centre (JRC) of the European Commission has set up the Big Data Analytics Platform to enable the JRC projects to process and analyse big data, extracting knowledge and insights in support of EU policy making. Since 2016, EOS is the main storage component of the platform. In 2020, the total gross capacity of this instance has reached 19 PiB. The Big Data Analytics Platform is actively used by more than 40 JRC projects, covering a wide range of data analysis activities. To support the growing needs for data storage and processing capacity, the platform has been extended over the last year. Eight new FSTs have been added, for a space increase of 3.5 PiB. In addition, to increase the security of the platform, the team started to migrate the EOS nodes in a segregated VLAN. The presentation will give an overview about the Big Data Analytics Platform and its EOS storage back-end, presenting the current status, experiences made and the issues identified.oai:cds.cern.ch:27540542021
spellingShingle HEP Computing
Scavazzon, Marco
EOS at the Joint Research Centre
title EOS at the Joint Research Centre
title_full EOS at the Joint Research Centre
title_fullStr EOS at the Joint Research Centre
title_full_unstemmed EOS at the Joint Research Centre
title_short EOS at the Joint Research Centre
title_sort eos at the joint research centre
topic HEP Computing
url http://cds.cern.ch/record/2754054
work_keys_str_mv AT scavazzonmarco eosatthejointresearchcentre
AT scavazzonmarco eosworkshop