Cargando…

ESCAPE prototypes a data infrastructure for open science

The European-funded ESCAPE project will prototype a shared solution to computing challenges in the context of the European Open Science Cloud. It targets Astronomy and Particle Physics facilities and research infrastructures and focuses on developing solutions for handling Exabyte scale datasets. Th...

Descripción completa

Detalles Bibliográficos
Autores principales: Bolton, Rosie, Campana, Simone, Ceccanti, Andrea, Espinal, Xavier, Fkiaras, Aristeidis, Fuhrmann, Patrick, Grange, Yan
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024504019
http://cds.cern.ch/record/2758821
_version_ 1780970195325550592
author Bolton, Rosie
Campana, Simone
Ceccanti, Andrea
Espinal, Xavier
Fkiaras, Aristeidis
Fuhrmann, Patrick
Grange, Yan
author_facet Bolton, Rosie
Campana, Simone
Ceccanti, Andrea
Espinal, Xavier
Fkiaras, Aristeidis
Fuhrmann, Patrick
Grange, Yan
author_sort Bolton, Rosie
collection CERN
description The European-funded ESCAPE project will prototype a shared solution to computing challenges in the context of the European Open Science Cloud. It targets Astronomy and Particle Physics facilities and research infrastructures and focuses on developing solutions for handling Exabyte scale datasets. The DIOS work package aims at delivering a Data Infrastructure for Open Science. Such an infrastructure would be a non HEP specific implementation of the data lake concept elaborated in the HSF Community White Paper and endorsed in the WLCG Strategy Document for HL-LHC. The science projects in ESCAPE are in different phases of evolution. While HL-LHC can leverage 15 years of experience of distributed computing in WLCG, other sciences are building now their computing models. This contribution describes the architecture of a shared ecosystem of services fulfilling the needs in terms of data organisation, management and access for the ESCAPE community. The backbone of such a data lake will consist of several storage services operated by the partner institutes and connected through reliable networks. Data management and organisation will be orchestrated through Rucio. A layer of caching and latency hiding services, supporting various access protocols will serve the data to heterogeneous facilities, from conventional Grid sites to HPC centres and Cloud providers. The authentication and authorisation system will be based on tokens. For the success of the project, DIOS will integrate open source solutions which demonstrated reliability and scalability as at the multi petabyte scale. Such services will be configured, deployed and complemented to cover the use cases of the ESCAPE sciences which will be further developed during the project.
id oai-inspirehep.net-1831548
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling oai-inspirehep.net-18315482021-03-25T22:33:56Zdoi:10.1051/epjconf/202024504019http://cds.cern.ch/record/2758821engBolton, RosieCampana, SimoneCeccanti, AndreaEspinal, XavierFkiaras, AristeidisFuhrmann, PatrickGrange, YanESCAPE prototypes a data infrastructure for open scienceComputing and ComputersThe European-funded ESCAPE project will prototype a shared solution to computing challenges in the context of the European Open Science Cloud. It targets Astronomy and Particle Physics facilities and research infrastructures and focuses on developing solutions for handling Exabyte scale datasets. The DIOS work package aims at delivering a Data Infrastructure for Open Science. Such an infrastructure would be a non HEP specific implementation of the data lake concept elaborated in the HSF Community White Paper and endorsed in the WLCG Strategy Document for HL-LHC. The science projects in ESCAPE are in different phases of evolution. While HL-LHC can leverage 15 years of experience of distributed computing in WLCG, other sciences are building now their computing models. This contribution describes the architecture of a shared ecosystem of services fulfilling the needs in terms of data organisation, management and access for the ESCAPE community. The backbone of such a data lake will consist of several storage services operated by the partner institutes and connected through reliable networks. Data management and organisation will be orchestrated through Rucio. A layer of caching and latency hiding services, supporting various access protocols will serve the data to heterogeneous facilities, from conventional Grid sites to HPC centres and Cloud providers. The authentication and authorisation system will be based on tokens. For the success of the project, DIOS will integrate open source solutions which demonstrated reliability and scalability as at the multi petabyte scale. Such services will be configured, deployed and complemented to cover the use cases of the ESCAPE sciences which will be further developed during the project.oai:inspirehep.net:18315482020
spellingShingle Computing and Computers
Bolton, Rosie
Campana, Simone
Ceccanti, Andrea
Espinal, Xavier
Fkiaras, Aristeidis
Fuhrmann, Patrick
Grange, Yan
ESCAPE prototypes a data infrastructure for open science
title ESCAPE prototypes a data infrastructure for open science
title_full ESCAPE prototypes a data infrastructure for open science
title_fullStr ESCAPE prototypes a data infrastructure for open science
title_full_unstemmed ESCAPE prototypes a data infrastructure for open science
title_short ESCAPE prototypes a data infrastructure for open science
title_sort escape prototypes a data infrastructure for open science
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024504019
http://cds.cern.ch/record/2758821
work_keys_str_mv AT boltonrosie escapeprototypesadatainfrastructureforopenscience
AT campanasimone escapeprototypesadatainfrastructureforopenscience
AT ceccantiandrea escapeprototypesadatainfrastructureforopenscience
AT espinalxavier escapeprototypesadatainfrastructureforopenscience
AT fkiarasaristeidis escapeprototypesadatainfrastructureforopenscience
AT fuhrmannpatrick escapeprototypesadatainfrastructureforopenscience
AT grangeyan escapeprototypesadatainfrastructureforopenscience