Cargando…

Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS

Increases in data volumes are forcing high-energy and nuclear physics experiments to store more frequently accessed data on tape. Extracting the maximum performance from tape drives is critical to make this viable from a data availability and system cost standpoint. The nature of data ingest and ret...

Descripción completa

Detalles Bibliográficos
Autor principal: Misawa, Shigeki
Lenguaje:eng
Publicado: 2023
Materias:
Acceso en línea:http://cds.cern.ch/record/2857488
_version_ 1780977565616308224
author Misawa, Shigeki
author_facet Misawa, Shigeki
author_sort Misawa, Shigeki
collection CERN
description Increases in data volumes are forcing high-energy and nuclear physics experiments to store more frequently accessed data on tape. Extracting the maximum performance from tape drives is critical to make this viable from a data availability and system cost standpoint. The nature of data ingest and retrieval in an experimental physics environment make achieving high access performance difficult given the inherent limitations of magnetic tape. Tailoring the layout of data on tape is one key to improving read performance. This paper highlights the work in progress to characterize ATLAS data ingested in the tape system, understand how data layout, i.e. file co-location on tape and file distribution over tapes, affect read performance and how optimal data layout might be achieved in a production environment.
id cern-2857488
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2023
record_format invenio
spelling cern-28574882023-05-03T00:32:56Zhttp://cds.cern.ch/record/2857488engMisawa, ShigekiExamining the Impact of Data Layout on Tape on Data Recall Performance for ATLASParticle Physics - ExperimentIncreases in data volumes are forcing high-energy and nuclear physics experiments to store more frequently accessed data on tape. Extracting the maximum performance from tape drives is critical to make this viable from a data availability and system cost standpoint. The nature of data ingest and retrieval in an experimental physics environment make achieving high access performance difficult given the inherent limitations of magnetic tape. Tailoring the layout of data on tape is one key to improving read performance. This paper highlights the work in progress to characterize ATLAS data ingested in the tape system, understand how data layout, i.e. file co-location on tape and file distribution over tapes, affect read performance and how optimal data layout might be achieved in a production environment.ATL-SOFT-SLIDE-2023-119oai:cds.cern.ch:28574882023-05-02
spellingShingle Particle Physics - Experiment
Misawa, Shigeki
Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS
title Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS
title_full Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS
title_fullStr Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS
title_full_unstemmed Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS
title_short Examining the Impact of Data Layout on Tape on Data Recall Performance for ATLAS
title_sort examining the impact of data layout on tape on data recall performance for atlas
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2857488
work_keys_str_mv AT misawashigeki examiningtheimpactofdatalayoutontapeondatarecallperformanceforatlas