Cargando…

ATLAS DQ2 Deletion Service

The ATLAS Distributed Data Management project DQ2 is responsible for the replication, access and bookkeeping of ATLAS data across more than 100 distributed grid sites. It also enforces data management policies decided on by the collaboration and defined in the ATLAS computing model. The DQ2 deletion...

Descripción completa

Detalles Bibliográficos
Autores principales: OLEYNIK, D, PETROSYAN, A, GARONNE, V, CAMPANA, S
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:http://cds.cern.ch/record/1448168
_version_ 1780924844767969280
author OLEYNIK, D
PETROSYAN, A
GARONNE, V
CAMPANA, S
author_facet OLEYNIK, D
PETROSYAN, A
GARONNE, V
CAMPANA, S
author_sort OLEYNIK, D
collection CERN
description The ATLAS Distributed Data Management project DQ2 is responsible for the replication, access and bookkeeping of ATLAS data across more than 100 distributed grid sites. It also enforces data management policies decided on by the collaboration and defined in the ATLAS computing model. The DQ2 deletion service is one of the most important DDM services. This distributed service interacts with 3rd party grid middleware and the DQ2 catalogs to serve data deletion requests on the grid. Furthermore, it also takes care of retry strategies, check-pointing transactions, load management and fault tolerance. In this paper special attention is paid to the technical details which are used to achieve the high performance of service (peaking at more than 4 millions files deleted per day), accomplished without overloading either site storage, catalogs or other DQ2 components. Special attention is also paid to the deletion monitoring service that allows operators a detailed view of the working system.
id cern-1448168
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14481682019-09-30T06:29:59Zhttp://cds.cern.ch/record/1448168engOLEYNIK, DPETROSYAN, AGARONNE, VCAMPANA, SATLAS DQ2 Deletion ServiceDetectors and Experimental TechniquesThe ATLAS Distributed Data Management project DQ2 is responsible for the replication, access and bookkeeping of ATLAS data across more than 100 distributed grid sites. It also enforces data management policies decided on by the collaboration and defined in the ATLAS computing model. The DQ2 deletion service is one of the most important DDM services. This distributed service interacts with 3rd party grid middleware and the DQ2 catalogs to serve data deletion requests on the grid. Furthermore, it also takes care of retry strategies, check-pointing transactions, load management and fault tolerance. In this paper special attention is paid to the technical details which are used to achieve the high performance of service (peaking at more than 4 millions files deleted per day), accomplished without overloading either site storage, catalogs or other DQ2 components. Special attention is also paid to the deletion monitoring service that allows operators a detailed view of the working system.ATL-SOFT-SLIDE-2012-197oai:cds.cern.ch:14481682012-05-12
spellingShingle Detectors and Experimental Techniques
OLEYNIK, D
PETROSYAN, A
GARONNE, V
CAMPANA, S
ATLAS DQ2 Deletion Service
title ATLAS DQ2 Deletion Service
title_full ATLAS DQ2 Deletion Service
title_fullStr ATLAS DQ2 Deletion Service
title_full_unstemmed ATLAS DQ2 Deletion Service
title_short ATLAS DQ2 Deletion Service
title_sort atlas dq2 deletion service
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1448168
work_keys_str_mv AT oleynikd atlasdq2deletionservice
AT petrosyana atlasdq2deletionservice
AT garonnev atlasdq2deletionservice
AT campanas atlasdq2deletionservice