Cargando…
XRootD Third Party Copy for the WLCG and HLLHC
A Third Party Copy (TPC) mechanism has existed in the pure XRootD storage environment for many years. However, using the XRootD TPC in the WLCG environment presents additional challenges due to the diversity of the storage systems involved such as EOS, dCache, DPM and ECHO, requiring that we careful...
Autores principales: | , , , , , , , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202024504034 http://cds.cern.ch/record/2757340 |
_version_ | 1780969975974985728 |
---|---|
author | Adye, T Bockelman, B Ellis, K Freyermuth, O Furano, F Ganis, G Hanushevsky, A Ito, H Johnson, I Keeble, O Litvintsev, D Manzi, A Millar, P Mkrtchyan, T Patargias, G Rossi, A Severini, H Simon, M Sindrilaru, E Yang, W |
author_facet | Adye, T Bockelman, B Ellis, K Freyermuth, O Furano, F Ganis, G Hanushevsky, A Ito, H Johnson, I Keeble, O Litvintsev, D Manzi, A Millar, P Mkrtchyan, T Patargias, G Rossi, A Severini, H Simon, M Sindrilaru, E Yang, W |
author_sort | Adye, T |
collection | CERN |
description | A Third Party Copy (TPC) mechanism has existed in the pure XRootD storage environment for many years. However, using the XRootD TPC in the WLCG environment presents additional challenges due to the diversity of the storage systems involved such as EOS, dCache, DPM and ECHO, requiring that we carefully navigate the unique constraints imposed by these storage systems and their site-specific environments through customized configuration and software development. To support multitenant setups seen at many WLCG sites, X509 based authentication and authorization in XRootD was significantly improved to meet both security and functionality requirements. This paper presents architecture of the pull based TPC with optional X509 credential delegation, and how it is implemented in native XRootD and dCache. The paper discusses technical requirements, challenges, design choices and implementation details in the WLCG storage systems, as well as in FTS/gfal2. It also outlines XRootD’s plan to support newer TPC and security models such as token based authorization. |
id | oai-inspirehep.net-1831562 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | oai-inspirehep.net-18315622021-03-22T22:08:56Zdoi:10.1051/epjconf/202024504034http://cds.cern.ch/record/2757340engAdye, TBockelman, BEllis, KFreyermuth, OFurano, FGanis, GHanushevsky, AIto, HJohnson, IKeeble, OLitvintsev, DManzi, AMillar, PMkrtchyan, TPatargias, GRossi, ASeverini, HSimon, MSindrilaru, EYang, WXRootD Third Party Copy for the WLCG and HLLHCComputing and ComputersA Third Party Copy (TPC) mechanism has existed in the pure XRootD storage environment for many years. However, using the XRootD TPC in the WLCG environment presents additional challenges due to the diversity of the storage systems involved such as EOS, dCache, DPM and ECHO, requiring that we carefully navigate the unique constraints imposed by these storage systems and their site-specific environments through customized configuration and software development. To support multitenant setups seen at many WLCG sites, X509 based authentication and authorization in XRootD was significantly improved to meet both security and functionality requirements. This paper presents architecture of the pull based TPC with optional X509 credential delegation, and how it is implemented in native XRootD and dCache. The paper discusses technical requirements, challenges, design choices and implementation details in the WLCG storage systems, as well as in FTS/gfal2. It also outlines XRootD’s plan to support newer TPC and security models such as token based authorization.oai:inspirehep.net:18315622020 |
spellingShingle | Computing and Computers Adye, T Bockelman, B Ellis, K Freyermuth, O Furano, F Ganis, G Hanushevsky, A Ito, H Johnson, I Keeble, O Litvintsev, D Manzi, A Millar, P Mkrtchyan, T Patargias, G Rossi, A Severini, H Simon, M Sindrilaru, E Yang, W XRootD Third Party Copy for the WLCG and HLLHC |
title | XRootD Third Party Copy for the WLCG and HLLHC |
title_full | XRootD Third Party Copy for the WLCG and HLLHC |
title_fullStr | XRootD Third Party Copy for the WLCG and HLLHC |
title_full_unstemmed | XRootD Third Party Copy for the WLCG and HLLHC |
title_short | XRootD Third Party Copy for the WLCG and HLLHC |
title_sort | xrootd third party copy for the wlcg and hllhc |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/202024504034 http://cds.cern.ch/record/2757340 |
work_keys_str_mv | AT adyet xrootdthirdpartycopyforthewlcgandhllhc AT bockelmanb xrootdthirdpartycopyforthewlcgandhllhc AT ellisk xrootdthirdpartycopyforthewlcgandhllhc AT freyermutho xrootdthirdpartycopyforthewlcgandhllhc AT furanof xrootdthirdpartycopyforthewlcgandhllhc AT ganisg xrootdthirdpartycopyforthewlcgandhllhc AT hanushevskya xrootdthirdpartycopyforthewlcgandhllhc AT itoh xrootdthirdpartycopyforthewlcgandhllhc AT johnsoni xrootdthirdpartycopyforthewlcgandhllhc AT keebleo xrootdthirdpartycopyforthewlcgandhllhc AT litvintsevd xrootdthirdpartycopyforthewlcgandhllhc AT manzia xrootdthirdpartycopyforthewlcgandhllhc AT millarp xrootdthirdpartycopyforthewlcgandhllhc AT mkrtchyant xrootdthirdpartycopyforthewlcgandhllhc AT patargiasg xrootdthirdpartycopyforthewlcgandhllhc AT rossia xrootdthirdpartycopyforthewlcgandhllhc AT severinih xrootdthirdpartycopyforthewlcgandhllhc AT simonm xrootdthirdpartycopyforthewlcgandhllhc AT sindrilarue xrootdthirdpartycopyforthewlcgandhllhc AT yangw xrootdthirdpartycopyforthewlcgandhllhc |