Cargando…
ATLAS DQ2 Deletion Service
The ATLAS Distributed Data Management project DQ2 is responsible for the replication, access and bookkeeping of ATLAS data across more than 100 distributed grid sites. It also enforces data management policies decided on by the collaboration and defined in the ATLAS computing model. The DQ2 deletion...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2012
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/1448168 |
_version_ | 1780924844767969280 |
---|---|
author | OLEYNIK, D PETROSYAN, A GARONNE, V CAMPANA, S |
author_facet | OLEYNIK, D PETROSYAN, A GARONNE, V CAMPANA, S |
author_sort | OLEYNIK, D |
collection | CERN |
description | The ATLAS Distributed Data Management project DQ2 is responsible for the replication, access and bookkeeping of ATLAS data across more than 100 distributed grid sites. It also enforces data management policies decided on by the collaboration and defined in the ATLAS computing model. The DQ2 deletion service is one of the most important DDM services. This distributed service interacts with 3rd party grid middleware and the DQ2 catalogs to serve data deletion requests on the grid. Furthermore, it also takes care of retry strategies, check-pointing transactions, load management and fault tolerance. In this paper special attention is paid to the technical details which are used to achieve the high performance of service (peaking at more than 4 millions files deleted per day), accomplished without overloading either site storage, catalogs or other DQ2 components. Special attention is also paid to the deletion monitoring service that allows operators a detailed view of the working system. |
id | cern-1448168 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2012 |
record_format | invenio |
spelling | cern-14481682019-09-30T06:29:59Zhttp://cds.cern.ch/record/1448168engOLEYNIK, DPETROSYAN, AGARONNE, VCAMPANA, SATLAS DQ2 Deletion ServiceDetectors and Experimental TechniquesThe ATLAS Distributed Data Management project DQ2 is responsible for the replication, access and bookkeeping of ATLAS data across more than 100 distributed grid sites. It also enforces data management policies decided on by the collaboration and defined in the ATLAS computing model. The DQ2 deletion service is one of the most important DDM services. This distributed service interacts with 3rd party grid middleware and the DQ2 catalogs to serve data deletion requests on the grid. Furthermore, it also takes care of retry strategies, check-pointing transactions, load management and fault tolerance. In this paper special attention is paid to the technical details which are used to achieve the high performance of service (peaking at more than 4 millions files deleted per day), accomplished without overloading either site storage, catalogs or other DQ2 components. Special attention is also paid to the deletion monitoring service that allows operators a detailed view of the working system.ATL-SOFT-SLIDE-2012-197oai:cds.cern.ch:14481682012-05-12 |
spellingShingle | Detectors and Experimental Techniques OLEYNIK, D PETROSYAN, A GARONNE, V CAMPANA, S ATLAS DQ2 Deletion Service |
title | ATLAS DQ2 Deletion Service |
title_full | ATLAS DQ2 Deletion Service |
title_fullStr | ATLAS DQ2 Deletion Service |
title_full_unstemmed | ATLAS DQ2 Deletion Service |
title_short | ATLAS DQ2 Deletion Service |
title_sort | atlas dq2 deletion service |
topic | Detectors and Experimental Techniques |
url | http://cds.cern.ch/record/1448168 |
work_keys_str_mv | AT oleynikd atlasdq2deletionservice AT petrosyana atlasdq2deletionservice AT garonnev atlasdq2deletionservice AT campanas atlasdq2deletionservice |