Xrootd S3 Gateway for WLCG Storage

The Xrootd S3 Gateway is a universal high performance proxy service that can be used to access S3 portals using existing HEP credentials (e.g. JSON Web Tokens and x509). This eliminates one of the biggest roadblocks to using public cloud storage resources. This paper describes how the S3 Gateway lev...

Descripción completa

Detalles Bibliográficos
Autores principales: Hanushevsky, Andrew Bohdan, Yang, Wei
Lenguaje:eng
Publicado: 2023
Materias:
Particle Physics - Experiment
Acceso en línea:http://cds.cern.ch/record/2857626
_version_ 1780977571903569920
author Hanushevsky, Andrew Bohdan
Yang, Wei
author_facet Hanushevsky, Andrew Bohdan
Yang, Wei
author_sort Hanushevsky, Andrew Bohdan
collection CERN
description The Xrootd S3 Gateway is a universal high performance proxy service that can be used to access S3 portals using existing HEP credentials (e.g. JSON Web Tokens and x509). This eliminates one of the biggest roadblocks to using public cloud storage resources. This paper describes how the S3 Gateway leverages existing HEP software (e.g. Davix and XRootD) to provide a familiar scalable service that works with public (i.e. AWS, GCS, etc) and private (i.e. CEPH, MinIO, etc.) S3 portal available to the HEP community, and to seamlessly integrate them into the WLCG storage and data transfer ecosystem. The test was conducted at an ATLAS site and ATLAS installation in GCP and AWS.
id cern-2857626
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2023
record_format invenio
spelling cern-28576262023-05-04T18:19:47Zhttp://cds.cern.ch/record/2857626engHanushevsky, Andrew BohdanYang, WeiXrootd S3 Gateway for WLCG StorageParticle Physics - ExperimentThe Xrootd S3 Gateway is a universal high performance proxy service that can be used to access S3 portals using existing HEP credentials (e.g. JSON Web Tokens and x509). This eliminates one of the biggest roadblocks to using public cloud storage resources. This paper describes how the S3 Gateway leverages existing HEP software (e.g. Davix and XRootD) to provide a familiar scalable service that works with public (i.e. AWS, GCS, etc) and private (i.e. CEPH, MinIO, etc.) S3 portal available to the HEP community, and to seamlessly integrate them into the WLCG storage and data transfer ecosystem. The test was conducted at an ATLAS site and ATLAS installation in GCP and AWS.ATL-SOFT-SLIDE-2023-125oai:cds.cern.ch:28576262023-05-03
spellingShingle Particle Physics - Experiment
Hanushevsky, Andrew Bohdan
Yang, Wei
Xrootd S3 Gateway for WLCG Storage
title Xrootd S3 Gateway for WLCG Storage
title_full Xrootd S3 Gateway for WLCG Storage
title_fullStr Xrootd S3 Gateway for WLCG Storage
title_full_unstemmed Xrootd S3 Gateway for WLCG Storage
title_short Xrootd S3 Gateway for WLCG Storage
title_sort xrootd s3 gateway for wlcg storage
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2857626
work_keys_str_mv AT hanushevskyandrewbohdan xrootds3gatewayforwlcgstorage
AT yangwei xrootds3gatewayforwlcgstorage

Ejemplares similares