Cargando…

XRootD Third Party Copy for the WLCG and HLLHC

A Third Party Copy (TPC) mechanism has existed in the pure XRootD storage environment for many years. However, using the XRootD TPC in the WLCG environment presents additional challenges due to the diversity of the storage systems involved such as EOS, dCache, DPM and ECHO, requiring that we careful...

Descripción completa

Detalles Bibliográficos
Autores principales: Adye, T, Bockelman, B, Ellis, K, Freyermuth, O, Furano, F, Ganis, G, Hanushevsky, A, Ito, H, Johnson, I, Keeble, O, Litvintsev, D, Manzi, A, Millar, P, Mkrtchyan, T, Patargias, G, Rossi, A, Severini, H, Simon, M, Sindrilaru, E, Yang, W
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024504034
http://cds.cern.ch/record/2757340
_version_ 1780969975974985728
author Adye, T
Bockelman, B
Ellis, K
Freyermuth, O
Furano, F
Ganis, G
Hanushevsky, A
Ito, H
Johnson, I
Keeble, O
Litvintsev, D
Manzi, A
Millar, P
Mkrtchyan, T
Patargias, G
Rossi, A
Severini, H
Simon, M
Sindrilaru, E
Yang, W
author_facet Adye, T
Bockelman, B
Ellis, K
Freyermuth, O
Furano, F
Ganis, G
Hanushevsky, A
Ito, H
Johnson, I
Keeble, O
Litvintsev, D
Manzi, A
Millar, P
Mkrtchyan, T
Patargias, G
Rossi, A
Severini, H
Simon, M
Sindrilaru, E
Yang, W
author_sort Adye, T
collection CERN
description A Third Party Copy (TPC) mechanism has existed in the pure XRootD storage environment for many years. However, using the XRootD TPC in the WLCG environment presents additional challenges due to the diversity of the storage systems involved such as EOS, dCache, DPM and ECHO, requiring that we carefully navigate the unique constraints imposed by these storage systems and their site-specific environments through customized configuration and software development. To support multitenant setups seen at many WLCG sites, X509 based authentication and authorization in XRootD was significantly improved to meet both security and functionality requirements. This paper presents architecture of the pull based TPC with optional X509 credential delegation, and how it is implemented in native XRootD and dCache. The paper discusses technical requirements, challenges, design choices and implementation details in the WLCG storage systems, as well as in FTS/gfal2. It also outlines XRootD’s plan to support newer TPC and security models such as token based authorization.
id oai-inspirehep.net-1831562
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling oai-inspirehep.net-18315622021-03-22T22:08:56Zdoi:10.1051/epjconf/202024504034http://cds.cern.ch/record/2757340engAdye, TBockelman, BEllis, KFreyermuth, OFurano, FGanis, GHanushevsky, AIto, HJohnson, IKeeble, OLitvintsev, DManzi, AMillar, PMkrtchyan, TPatargias, GRossi, ASeverini, HSimon, MSindrilaru, EYang, WXRootD Third Party Copy for the WLCG and HLLHCComputing and ComputersA Third Party Copy (TPC) mechanism has existed in the pure XRootD storage environment for many years. However, using the XRootD TPC in the WLCG environment presents additional challenges due to the diversity of the storage systems involved such as EOS, dCache, DPM and ECHO, requiring that we carefully navigate the unique constraints imposed by these storage systems and their site-specific environments through customized configuration and software development. To support multitenant setups seen at many WLCG sites, X509 based authentication and authorization in XRootD was significantly improved to meet both security and functionality requirements. This paper presents architecture of the pull based TPC with optional X509 credential delegation, and how it is implemented in native XRootD and dCache. The paper discusses technical requirements, challenges, design choices and implementation details in the WLCG storage systems, as well as in FTS/gfal2. It also outlines XRootD’s plan to support newer TPC and security models such as token based authorization.oai:inspirehep.net:18315622020
spellingShingle Computing and Computers
Adye, T
Bockelman, B
Ellis, K
Freyermuth, O
Furano, F
Ganis, G
Hanushevsky, A
Ito, H
Johnson, I
Keeble, O
Litvintsev, D
Manzi, A
Millar, P
Mkrtchyan, T
Patargias, G
Rossi, A
Severini, H
Simon, M
Sindrilaru, E
Yang, W
XRootD Third Party Copy for the WLCG and HLLHC
title XRootD Third Party Copy for the WLCG and HLLHC
title_full XRootD Third Party Copy for the WLCG and HLLHC
title_fullStr XRootD Third Party Copy for the WLCG and HLLHC
title_full_unstemmed XRootD Third Party Copy for the WLCG and HLLHC
title_short XRootD Third Party Copy for the WLCG and HLLHC
title_sort xrootd third party copy for the wlcg and hllhc
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024504034
http://cds.cern.ch/record/2757340
work_keys_str_mv AT adyet xrootdthirdpartycopyforthewlcgandhllhc
AT bockelmanb xrootdthirdpartycopyforthewlcgandhllhc
AT ellisk xrootdthirdpartycopyforthewlcgandhllhc
AT freyermutho xrootdthirdpartycopyforthewlcgandhllhc
AT furanof xrootdthirdpartycopyforthewlcgandhllhc
AT ganisg xrootdthirdpartycopyforthewlcgandhllhc
AT hanushevskya xrootdthirdpartycopyforthewlcgandhllhc
AT itoh xrootdthirdpartycopyforthewlcgandhllhc
AT johnsoni xrootdthirdpartycopyforthewlcgandhllhc
AT keebleo xrootdthirdpartycopyforthewlcgandhllhc
AT litvintsevd xrootdthirdpartycopyforthewlcgandhllhc
AT manzia xrootdthirdpartycopyforthewlcgandhllhc
AT millarp xrootdthirdpartycopyforthewlcgandhllhc
AT mkrtchyant xrootdthirdpartycopyforthewlcgandhllhc
AT patargiasg xrootdthirdpartycopyforthewlcgandhllhc
AT rossia xrootdthirdpartycopyforthewlcgandhllhc
AT severinih xrootdthirdpartycopyforthewlcgandhllhc
AT simonm xrootdthirdpartycopyforthewlcgandhllhc
AT sindrilarue xrootdthirdpartycopyforthewlcgandhllhc
AT yangw xrootdthirdpartycopyforthewlcgandhllhc